[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:24:36.456527  8637 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.111.126:39745
I20260709 12:24:36.458017  8637 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:24:36.459076  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:36.475627  8644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:36.475699  8643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:36.475631  8646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:36.476805  8637 server_base.cc:1061] running on GCE node
I20260709 12:24:37.679893  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:37.680150  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:37.680357  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783599877680336 us; error 0 us; skew 500 ppm
I20260709 12:24:37.681183  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:37.687595  8637 webserver.cc:533] Webserver started at http://127.8.111.126:39147/ using document root <none> and password file <none>
I20260709 12:24:37.688443  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:37.688674  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:37.689118  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:37.694782  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599876290468-8637-0/minicluster-data/master-0-root/instance:
uuid: "8ee1c32d8fa54b14a95c6ba3056db3a5"
format_stamp: "Formatted at 2026-07-09 12:24:37 on dist-test-slave-044g"
I20260709 12:24:37.702206  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:24:37.707265  8652 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:37.708292  8637 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 12:24:37.708691  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599876290468-8637-0/minicluster-data/master-0-root
uuid: "8ee1c32d8fa54b14a95c6ba3056db3a5"
format_stamp: "Formatted at 2026-07-09 12:24:37 on dist-test-slave-044g"
I20260709 12:24:37.709021  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599876290468-8637-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599876290468-8637-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599876290468-8637-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:37.763545  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:37.765046  8637 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:24:37.765507  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:37.837971  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.126:39745
I20260709 12:24:37.837978  8703 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.126:39745 every 8 connection(s)
I20260709 12:24:37.846181  8704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:37.867837  8704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5: Bootstrap starting.
I20260709 12:24:37.873652  8704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:37.875479  8704 log.cc:826] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5: Log is configured to *not* fsync() on all Append() calls
I20260709 12:24:37.880098  8704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5: No bootstrap required, opened a new log
I20260709 12:24:37.900713  8704 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ee1c32d8fa54b14a95c6ba3056db3a5" member_type: VOTER }
I20260709 12:24:37.901330  8704 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:37.901590  8704 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ee1c32d8fa54b14a95c6ba3056db3a5, State: Initialized, Role: FOLLOWER
I20260709 12:24:37.902459  8704 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ee1c32d8fa54b14a95c6ba3056db3a5" member_type: VOTER }
I20260709 12:24:37.902953  8704 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:24:37.903251  8704 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:24:37.903581  8704 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:37.907724  8704 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ee1c32d8fa54b14a95c6ba3056db3a5" member_type: VOTER }
I20260709 12:24:37.908455  8704 leader_election.cc:304] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ee1c32d8fa54b14a95c6ba3056db3a5; no voters: 
I20260709 12:24:37.910250  8704 leader_election.cc:290] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:24:37.910665  8707 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:37.913309  8707 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5 [term 1 LEADER]: Becoming Leader. State: Replica: 8ee1c32d8fa54b14a95c6ba3056db3a5, State: Running, Role: LEADER
I20260709 12:24:37.914256  8707 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ee1c32d8fa54b14a95c6ba3056db3a5" member_type: VOTER }
I20260709 12:24:37.915411  8704 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:24:37.925889  8708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ee1c32d8fa54b14a95c6ba3056db3a5. Latest consensus state: current_term: 1 leader_uuid: "8ee1c32d8fa54b14a95c6ba3056db3a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ee1c32d8fa54b14a95c6ba3056db3a5" member_type: VOTER } }
I20260709 12:24:37.926240  8709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ee1c32d8fa54b14a95c6ba3056db3a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ee1c32d8fa54b14a95c6ba3056db3a5" member_type: VOTER } }
I20260709 12:24:37.926766  8708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5 [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:37.926849  8709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5 [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:37.929410  8717 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:24:37.941058  8717 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:24:37.943747  8637 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:24:37.958352  8717 catalog_manager.cc:1383] Generated new cluster ID: e79ec2af9d044e2d93c5eb9f6be0e6fe
I20260709 12:24:37.958616  8717 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:24:37.977905  8717 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:24:37.979620  8717 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:24:37.993556  8717 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5: Generated new TSK 0
I20260709 12:24:37.994524  8717 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:24:38.011016  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:38.019631  8726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:38.022063  8727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:38.024798  8637 server_base.cc:1061] running on GCE node
W20260709 12:24:38.025566  8729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:38.026832  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:38.027077  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:38.027287  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783599878027247 us; error 0 us; skew 500 ppm
I20260709 12:24:38.027870  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:38.032681  8637 webserver.cc:533] Webserver started at http://127.8.111.65:43703/ using document root <none> and password file <none>
I20260709 12:24:38.033277  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:38.033496  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:38.033793  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:38.034952  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599876290468-8637-0/minicluster-data/ts-0-root/instance:
uuid: "89820c3229e24de18a4254f70b183a6c"
format_stamp: "Formatted at 2026-07-09 12:24:38 on dist-test-slave-044g"
I20260709 12:24:38.040758  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:24:38.045614  8734 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:38.046630  8637 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:24:38.046927  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599876290468-8637-0/minicluster-data/ts-0-root
uuid: "89820c3229e24de18a4254f70b183a6c"
format_stamp: "Formatted at 2026-07-09 12:24:38 on dist-test-slave-044g"
I20260709 12:24:38.047266  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599876290468-8637-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599876290468-8637-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599876290468-8637-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:38.079599  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:38.080964  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:38.083755  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:38.087934  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:38.088219  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:38.088485  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:38.088671  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:38.194228  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.65:45607
I20260709 12:24:38.194326  8796 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.65:45607 every 8 connection(s)
I20260709 12:24:38.202134  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:38.213948  8802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:38.216609  8803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:38.230698  8805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:38.231717  8637 server_base.cc:1061] running on GCE node
I20260709 12:24:38.232589  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:38.232833  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:38.233038  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783599878233019 us; error 0 us; skew 500 ppm
I20260709 12:24:38.233659  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:38.236061  8797 heartbeater.cc:344] Connected to a master server at 127.8.111.126:39745
I20260709 12:24:38.236524  8797 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:38.237674  8797 heartbeater.cc:507] Master 127.8.111.126:39745 requested a full tablet report, sending...
I20260709 12:24:38.238903  8637 webserver.cc:533] Webserver started at http://127.8.111.66:44365/ using document root <none> and password file <none>
I20260709 12:24:38.239449  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:38.239684  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:38.239974  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:38.241119  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599876290468-8637-0/minicluster-data/ts-1-root/instance:
uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
format_stamp: "Formatted at 2026-07-09 12:24:38 on dist-test-slave-044g"
I20260709 12:24:38.241192  8669 ts_manager.cc:194] Registered new tserver with Master: 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607)
I20260709 12:24:38.244365  8669 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42600
I20260709 12:24:38.247179  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:24:38.251575  8810 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:38.252389  8637 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:24:38.252666  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599876290468-8637-0/minicluster-data/ts-1-root
uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
format_stamp: "Formatted at 2026-07-09 12:24:38 on dist-test-slave-044g"
I20260709 12:24:38.252957  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599876290468-8637-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599876290468-8637-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599876290468-8637-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:38.288302  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:38.289573  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:38.291719  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:38.294523  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:38.294742  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:38.294987  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:38.295171  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:38.387691  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.66:44115
I20260709 12:24:38.387881  8872 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.66:44115 every 8 connection(s)
I20260709 12:24:38.394907  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:38.404770  8876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:38.408489  8877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:38.409946  8873 heartbeater.cc:344] Connected to a master server at 127.8.111.126:39745
I20260709 12:24:38.410315  8873 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:38.411212  8873 heartbeater.cc:507] Master 127.8.111.126:39745 requested a full tablet report, sending...
I20260709 12:24:38.413544  8669 ts_manager.cc:194] Registered new tserver with Master: 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115)
I20260709 12:24:38.415328  8669 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42616
W20260709 12:24:38.416774  8879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:38.419315  8637 server_base.cc:1061] running on GCE node
I20260709 12:24:38.420153  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:38.420419  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:38.420599  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783599878420584 us; error 0 us; skew 500 ppm
I20260709 12:24:38.421149  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:38.423820  8637 webserver.cc:533] Webserver started at http://127.8.111.67:46001/ using document root <none> and password file <none>
I20260709 12:24:38.424396  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:38.424693  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:38.424974  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:38.426069  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599876290468-8637-0/minicluster-data/ts-2-root/instance:
uuid: "a26c2b0b5b2f447097c60da4958d6d09"
format_stamp: "Formatted at 2026-07-09 12:24:38 on dist-test-slave-044g"
I20260709 12:24:38.430940  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:24:38.434103  8884 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:38.434900  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:24:38.435220  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599876290468-8637-0/minicluster-data/ts-2-root
uuid: "a26c2b0b5b2f447097c60da4958d6d09"
format_stamp: "Formatted at 2026-07-09 12:24:38 on dist-test-slave-044g"
I20260709 12:24:38.435519  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599876290468-8637-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599876290468-8637-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599876290468-8637-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:38.450589  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:38.451825  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:38.453305  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:38.456235  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:38.456475  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:38.456718  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:38.456898  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:38.550359  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.67:35919
I20260709 12:24:38.550858  8946 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.67:35919 every 8 connection(s)
I20260709 12:24:38.568322  8947 heartbeater.cc:344] Connected to a master server at 127.8.111.126:39745
I20260709 12:24:38.568850  8947 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:38.569901  8947 heartbeater.cc:507] Master 127.8.111.126:39745 requested a full tablet report, sending...
I20260709 12:24:38.572036  8669 ts_manager.cc:194] Registered new tserver with Master: a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:38.572983  8637 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017105706s
I20260709 12:24:38.573727  8669 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42620
I20260709 12:24:38.631326  8669 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42636:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:24:38.636133  8669 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:24:38.746097  8838 tablet_service.cc:1511] Processing CreateTablet for tablet 842cb132550246f7b891dd071fa42042 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:38.749015  8837 tablet_service.cc:1511] Processing CreateTablet for tablet 2c02d26dcde247119ad22f7fb9ad6e42 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:38.759037  8838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 842cb132550246f7b891dd071fa42042. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.753326  8834 tablet_service.cc:1511] Processing CreateTablet for tablet ad68501f591d446f953f4f1f07b6ba45 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:38.752239  8835 tablet_service.cc:1511] Processing CreateTablet for tablet d67731beaedd47a89b0ee7737f9083e6 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:38.756918  8762 tablet_service.cc:1511] Processing CreateTablet for tablet 842cb132550246f7b891dd071fa42042 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:38.760711  8760 tablet_service.cc:1511] Processing CreateTablet for tablet f7223e8d80a649bea80c3b438c3af4a1 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:38.758451  8836 tablet_service.cc:1511] Processing CreateTablet for tablet f7223e8d80a649bea80c3b438c3af4a1 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:38.770010  8757 tablet_service.cc:1511] Processing CreateTablet for tablet cf2ea80ddaf24514a3ea597b2661ec91 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:38.772261  8762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 842cb132550246f7b891dd071fa42042. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.764662  8761 tablet_service.cc:1511] Processing CreateTablet for tablet 2c02d26dcde247119ad22f7fb9ad6e42 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:38.774747  8835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d67731beaedd47a89b0ee7737f9083e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.769462  8759 tablet_service.cc:1511] Processing CreateTablet for tablet d67731beaedd47a89b0ee7737f9083e6 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:38.778144  8834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad68501f591d446f953f4f1f07b6ba45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.780019  8833 tablet_service.cc:1511] Processing CreateTablet for tablet cf2ea80ddaf24514a3ea597b2661ec91 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:38.781268  8760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7223e8d80a649bea80c3b438c3af4a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.772315  8758 tablet_service.cc:1511] Processing CreateTablet for tablet ad68501f591d446f953f4f1f07b6ba45 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:38.783536  8756 tablet_service.cc:1511] Processing CreateTablet for tablet e4a57ce90459497cb623214481efe782 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:38.788311  8836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7223e8d80a649bea80c3b438c3af4a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.795266  8912 tablet_service.cc:1511] Processing CreateTablet for tablet 842cb132550246f7b891dd071fa42042 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:38.798662  8911 tablet_service.cc:1511] Processing CreateTablet for tablet 2c02d26dcde247119ad22f7fb9ad6e42 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:38.798688  8910 tablet_service.cc:1511] Processing CreateTablet for tablet f7223e8d80a649bea80c3b438c3af4a1 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:38.797940  8837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c02d26dcde247119ad22f7fb9ad6e42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.798785  8832 tablet_service.cc:1511] Processing CreateTablet for tablet e4a57ce90459497cb623214481efe782 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:38.804993  8912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 842cb132550246f7b891dd071fa42042. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.805128  8909 tablet_service.cc:1511] Processing CreateTablet for tablet d67731beaedd47a89b0ee7737f9083e6 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:38.807005  8910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7223e8d80a649bea80c3b438c3af4a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.805928  8833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2ea80ddaf24514a3ea597b2661ec91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.813534  8755 tablet_service.cc:1511] Processing CreateTablet for tablet 911b2f05169e49379263206730564c6e (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:38.817036  8909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d67731beaedd47a89b0ee7737f9083e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.819636  8832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4a57ce90459497cb623214481efe782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.821058  8908 tablet_service.cc:1511] Processing CreateTablet for tablet ad68501f591d446f953f4f1f07b6ba45 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:38.821437  8906 tablet_service.cc:1511] Processing CreateTablet for tablet e4a57ce90459497cb623214481efe782 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:38.820194  8907 tablet_service.cc:1511] Processing CreateTablet for tablet cf2ea80ddaf24514a3ea597b2661ec91 (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:38.825759  8908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad68501f591d446f953f4f1f07b6ba45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.830518  8757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2ea80ddaf24514a3ea597b2661ec91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.836341  8907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2ea80ddaf24514a3ea597b2661ec91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.823658  8831 tablet_service.cc:1511] Processing CreateTablet for tablet 911b2f05169e49379263206730564c6e (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:38.840833  8759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d67731beaedd47a89b0ee7737f9083e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.846889  8758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad68501f591d446f953f4f1f07b6ba45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.848310  8906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4a57ce90459497cb623214481efe782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.847869  8905 tablet_service.cc:1511] Processing CreateTablet for tablet 911b2f05169e49379263206730564c6e (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:38.852737  8905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911b2f05169e49379263206730564c6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.855057  8756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4a57ce90459497cb623214481efe782. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.864472  8911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c02d26dcde247119ad22f7fb9ad6e42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.864473  8831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911b2f05169e49379263206730564c6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.899616  8761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c02d26dcde247119ad22f7fb9ad6e42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:38.930444  8755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 911b2f05169e49379263206730564c6e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:38.938946  8716 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:38.961696  8754 tablet_service.cc:1511] Processing CreateTablet for tablet c788b9b2b3234316b1652b80ccc1277d (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:38.967105  8754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c788b9b2b3234316b1652b80ccc1277d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:39.029043  8965 tablet_bootstrap.cc:492] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c: Bootstrap starting.
I20260709 12:24:39.046150  8830 tablet_service.cc:1511] Processing CreateTablet for tablet c788b9b2b3234316b1652b80ccc1277d (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:39.048138  8830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c788b9b2b3234316b1652b80ccc1277d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:39.071722  8904 tablet_service.cc:1511] Processing CreateTablet for tablet c788b9b2b3234316b1652b80ccc1277d (DEFAULT_TABLE table=test-workload [id=cc82f1cb852d42609d44be1445f91a5c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:39.073086  8904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c788b9b2b3234316b1652b80ccc1277d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:39.079339  8965 tablet_bootstrap.cc:654] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.118203  8966 tablet_bootstrap.cc:492] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09: Bootstrap starting.
I20260709 12:24:39.156293  8968 tablet_bootstrap.cc:492] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9: Bootstrap starting.
I20260709 12:24:39.165961  8968 tablet_bootstrap.cc:654] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.169181  8965 tablet_bootstrap.cc:492] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c: No bootstrap required, opened a new log
I20260709 12:24:39.172366  8965 ts_tablet_manager.cc:1403] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c: Time spent bootstrapping tablet: real 0.144s	user 0.012s	sys 0.009s
I20260709 12:24:39.177754  8966 tablet_bootstrap.cc:654] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.198179  8965 raft_consensus.cc:359] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } }
I20260709 12:24:39.201108  8968 tablet_bootstrap.cc:492] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9: No bootstrap required, opened a new log
I20260709 12:24:39.208464  8968 ts_tablet_manager.cc:1403] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.008s
I20260709 12:24:39.204619  8966 tablet_bootstrap.cc:492] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09: No bootstrap required, opened a new log
I20260709 12:24:39.210479  8965 raft_consensus.cc:385] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.210618  8966 ts_tablet_manager.cc:1403] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.004s
I20260709 12:24:39.210947  8965 raft_consensus.cc:740] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.210918  8968 raft_consensus.cc:359] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } }
I20260709 12:24:39.211683  8968 raft_consensus.cc:385] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.211989  8968 raft_consensus.cc:740] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.212102  8965 consensus_queue.cc:260] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } }
I20260709 12:24:39.212828  8968 consensus_queue.cc:260] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } }
I20260709 12:24:39.213649  8966 raft_consensus.cc:359] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.214427  8966 raft_consensus.cc:385] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.214720  8966 raft_consensus.cc:740] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26c2b0b5b2f447097c60da4958d6d09, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.215420  8966 consensus_queue.cc:260] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.222050  8797 heartbeater.cc:499] Master 127.8.111.126:39745 was elected leader, sending a full tablet report...
I20260709 12:24:39.223203  8965 ts_tablet_manager.cc:1434] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.007s
I20260709 12:24:39.224241  8965 tablet_bootstrap.cc:492] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c: Bootstrap starting.
I20260709 12:24:39.229120  8873 heartbeater.cc:499] Master 127.8.111.126:39745 was elected leader, sending a full tablet report...
I20260709 12:24:39.229714  8968 ts_tablet_manager.cc:1434] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.005s
I20260709 12:24:39.230708  8968 tablet_bootstrap.cc:492] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9: Bootstrap starting.
I20260709 12:24:39.232592  8947 heartbeater.cc:499] Master 127.8.111.126:39745 was elected leader, sending a full tablet report...
I20260709 12:24:39.238646  8966 ts_tablet_manager.cc:1434] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.008s
I20260709 12:24:39.239387  8966 tablet_bootstrap.cc:492] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09: Bootstrap starting.
I20260709 12:24:39.242817  8965 tablet_bootstrap.cc:654] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.243108  8972 raft_consensus.cc:493] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.242936  8968 tablet_bootstrap.cc:654] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.243621  8972 raft_consensus.cc:515] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } }
I20260709 12:24:39.247020  8972 leader_election.cc:290] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919), 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607)
I20260709 12:24:39.274856  8965 tablet_bootstrap.cc:492] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c: No bootstrap required, opened a new log
I20260709 12:24:39.275364  8965 ts_tablet_manager.cc:1403] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.003s
I20260709 12:24:39.278016  8965 raft_consensus.cc:359] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.278735  8965 raft_consensus.cc:385] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.279038  8965 raft_consensus.cc:740] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.279479  8966 tablet_bootstrap.cc:654] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.279747  8965 consensus_queue.cc:260] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.281940  8965 ts_tablet_manager.cc:1434] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:24:39.282574  8971 raft_consensus.cc:493] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.282882  8965 tablet_bootstrap.cc:492] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c: Bootstrap starting.
I20260709 12:24:39.283042  8971 raft_consensus.cc:515] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } }
I20260709 12:24:39.286552  8971 leader_election.cc:290] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919), 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115)
I20260709 12:24:39.290015  8965 tablet_bootstrap.cc:654] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:39.309329  8948 tablet.cc:2406] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:24:39.308892  8965 tablet_bootstrap.cc:492] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c: No bootstrap required, opened a new log
I20260709 12:24:39.310655  8965 ts_tablet_manager.cc:1403] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.017s
I20260709 12:24:39.313469  8965 raft_consensus.cc:359] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.314160  8965 raft_consensus.cc:385] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.314469  8965 raft_consensus.cc:740] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.315165  8965 consensus_queue.cc:260] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.317641  8965 ts_tablet_manager.cc:1434] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:24:39.318581  8965 tablet_bootstrap.cc:492] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c: Bootstrap starting.
I20260709 12:24:39.324931  8965 tablet_bootstrap.cc:654] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.337145  8965 tablet_bootstrap.cc:492] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c: No bootstrap required, opened a new log
I20260709 12:24:39.337705  8965 ts_tablet_manager.cc:1403] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.005s
I20260709 12:24:39.346549  8966 tablet_bootstrap.cc:492] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09: No bootstrap required, opened a new log
I20260709 12:24:39.346938  8965 raft_consensus.cc:359] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.348155  8965 raft_consensus.cc:385] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.348699  8966 ts_tablet_manager.cc:1403] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09: Time spent bootstrapping tablet: real 0.109s	user 0.010s	sys 0.003s
I20260709 12:24:39.349326  8965 raft_consensus.cc:740] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.351454  8965 consensus_queue.cc:260] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.353688  8965 ts_tablet_manager.cc:1434] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:24:39.350364  8772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842cb132550246f7b891dd071fa42042" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89820c3229e24de18a4254f70b183a6c" is_pre_election: true
I20260709 12:24:39.356009  8772 raft_consensus.cc:2468] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 0.
I20260709 12:24:39.357364  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842cb132550246f7b891dd071fa42042" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09" is_pre_election: true
I20260709 12:24:39.359041  8965 tablet_bootstrap.cc:492] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c: Bootstrap starting.
I20260709 12:24:39.359493  8968 tablet_bootstrap.cc:492] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9: No bootstrap required, opened a new log
I20260709 12:24:39.359988  8968 ts_tablet_manager.cc:1403] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9: Time spent bootstrapping tablet: real 0.129s	user 0.040s	sys 0.025s
I20260709 12:24:39.360963  8812 leader_election.cc:304] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, 89820c3229e24de18a4254f70b183a6c; no voters: 
W20260709 12:24:39.364928  8814 leader_election.cc:343] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.366093  8972 raft_consensus.cc:2804] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:39.366508  8972 raft_consensus.cc:493] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.366993  8972 raft_consensus.cc:3060] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.370333  8968 raft_consensus.cc:359] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.371119  8968 raft_consensus.cc:385] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.371667  8968 raft_consensus.cc:740] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.372371  8968 consensus_queue.cc:260] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.374185  8966 raft_consensus.cc:359] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.376009  8966 raft_consensus.cc:385] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.376320  8966 raft_consensus.cc:740] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26c2b0b5b2f447097c60da4958d6d09, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.377115  8972 raft_consensus.cc:515] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } }
I20260709 12:24:39.377038  8966 consensus_queue.cc:260] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.383777  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842cb132550246f7b891dd071fa42042" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09" is_pre_election: true
I20260709 12:24:39.385208  8972 leader_election.cc:290] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 1 election: Requested vote from peers a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919), 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607)
W20260709 12:24:39.385691  8738 leader_election.cc:343] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.386201  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842cb132550246f7b891dd071fa42042" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:39.387348  8772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842cb132550246f7b891dd071fa42042" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89820c3229e24de18a4254f70b183a6c"
I20260709 12:24:39.387871  8772 raft_consensus.cc:3060] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.389628  8966 ts_tablet_manager.cc:1434] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 12:24:39.390637  8966 tablet_bootstrap.cc:492] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09: Bootstrap starting.
W20260709 12:24:39.392498  8814 leader_election.cc:343] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.397327  8772 raft_consensus.cc:2468] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 1.
I20260709 12:24:39.398537  8812 leader_election.cc:304] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, 89820c3229e24de18a4254f70b183a6c; no voters: a26c2b0b5b2f447097c60da4958d6d09
I20260709 12:24:39.401584  8972 raft_consensus.cc:2804] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:39.405179  8965 tablet_bootstrap.cc:654] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.402086  8972 raft_consensus.cc:697] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Running, Role: LEADER
I20260709 12:24:39.406548  8848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842cb132550246f7b891dd071fa42042" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" is_pre_election: true
I20260709 12:24:39.408136  8972 consensus_queue.cc:237] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } }
I20260709 12:24:39.414129  8968 ts_tablet_manager.cc:1434] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.008s
I20260709 12:24:39.420383  8966 tablet_bootstrap.cc:654] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.422055  8968 tablet_bootstrap.cc:492] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9: Bootstrap starting.
I20260709 12:24:39.425171  8965 tablet_bootstrap.cc:492] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c: No bootstrap required, opened a new log
I20260709 12:24:39.425957  8965 ts_tablet_manager.cc:1403] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.012s
I20260709 12:24:39.430015  8968 tablet_bootstrap.cc:654] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.430236  8965 raft_consensus.cc:359] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.435353  8965 raft_consensus.cc:385] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.435739  8965 raft_consensus.cc:740] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.436546  8965 consensus_queue.cc:260] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.438705  8971 raft_consensus.cc:493] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.439303  8971 raft_consensus.cc:515] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.441823  8971 leader_election.cc:290] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:39.443406  8738 leader_election.cc:304] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89820c3229e24de18a4254f70b183a6c; no voters: 0ed8a3294f314f9689ea0d295bd9dfb9, a26c2b0b5b2f447097c60da4958d6d09
I20260709 12:24:39.445109  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a57ce90459497cb623214481efe782" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09" is_pre_election: true
I20260709 12:24:39.445751  8921 raft_consensus.cc:2468] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 0.
I20260709 12:24:39.446559  8966 tablet_bootstrap.cc:492] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09: No bootstrap required, opened a new log
I20260709 12:24:39.447104  8966 ts_tablet_manager.cc:1403] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09: Time spent bootstrapping tablet: real 0.057s	user 0.016s	sys 0.001s
I20260709 12:24:39.447490  8847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a57ce90459497cb623214481efe782" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" is_pre_election: true
I20260709 12:24:39.450078  8973 raft_consensus.cc:493] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.450481  8966 raft_consensus.cc:359] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.450637  8973 raft_consensus.cc:515] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.451258  8966 raft_consensus.cc:385] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.451586  8966 raft_consensus.cc:740] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26c2b0b5b2f447097c60da4958d6d09, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.452423  8966 consensus_queue.cc:260] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.456727  8968 tablet_bootstrap.cc:492] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9: No bootstrap required, opened a new log
I20260709 12:24:39.458007  8738 leader_election.cc:304] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89820c3229e24de18a4254f70b183a6c, a26c2b0b5b2f447097c60da4958d6d09; no voters: 
I20260709 12:24:39.459123  8968 ts_tablet_manager.cc:1403] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.005s
I20260709 12:24:39.459617  8973 leader_election.cc:290] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115)
I20260709 12:24:39.460211  8971 raft_consensus.cc:2749] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:24:39.459026  8738 leader_election.cc:343] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.462931  8968 raft_consensus.cc:359] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.473541  8968 raft_consensus.cc:385] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.473897  8968 raft_consensus.cc:740] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.465245  8666 catalog_manager.cc:5697] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:39.471206  8965 ts_tablet_manager.cc:1434] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c: Time spent starting tablet: real 0.045s	user 0.014s	sys 0.013s
I20260709 12:24:39.474745  8968 consensus_queue.cc:260] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.470566  8991 raft_consensus.cc:2804] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:39.475272  8971 raft_consensus.cc:493] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.477576  8991 raft_consensus.cc:493] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.478029  8991 raft_consensus.cc:3060] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.477727  8971 raft_consensus.cc:515] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.478751  8968 ts_tablet_manager.cc:1434] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 12:24:39.479624  8968 tablet_bootstrap.cc:492] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9: Bootstrap starting.
I20260709 12:24:39.483772  8971 leader_election.cc:290] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:39.487030  8965 tablet_bootstrap.cc:492] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c: Bootstrap starting.
I20260709 12:24:39.496344  8968 tablet_bootstrap.cc:654] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.496240  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ea80ddaf24514a3ea597b2661ec91" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09" is_pre_election: true
I20260709 12:24:39.494488  8848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ea80ddaf24514a3ea597b2661ec91" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" is_pre_election: true
I20260709 12:24:39.488782  8991 raft_consensus.cc:515] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.499571  8848 raft_consensus.cc:2468] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 0.
W20260709 12:24:39.504199  8738 leader_election.cc:343] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.509740  8738 leader_election.cc:304] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, 89820c3229e24de18a4254f70b183a6c; no voters: a26c2b0b5b2f447097c60da4958d6d09
I20260709 12:24:39.506474  8965 tablet_bootstrap.cc:654] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.512040  8991 leader_election.cc:290] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 election: Requested vote from peers 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:39.513690  8991 raft_consensus.cc:2804] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:39.514946  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a57ce90459497cb623214481efe782" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:39.515787  8991 raft_consensus.cc:493] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.516285  8921 raft_consensus.cc:3060] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.516292  8991 raft_consensus.cc:3060] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.513000  8848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a57ce90459497cb623214481efe782" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
I20260709 12:24:39.526906  8991 raft_consensus.cc:515] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
W20260709 12:24:39.527259  8738 leader_election.cc:343] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.533506  8772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67731beaedd47a89b0ee7737f9083e6" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89820c3229e24de18a4254f70b183a6c" is_pre_election: true
W20260709 12:24:39.535234  8886 leader_election.cc:343] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.546254  8848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ea80ddaf24514a3ea597b2661ec91" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
I20260709 12:24:39.547047  8848 raft_consensus.cc:3060] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.547621  8966 ts_tablet_manager.cc:1434] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09: Time spent starting tablet: real 0.100s	user 0.027s	sys 0.044s
I20260709 12:24:39.548574  8966 tablet_bootstrap.cc:492] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09: Bootstrap starting.
I20260709 12:24:39.549340  8921 raft_consensus.cc:2468] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 1.
I20260709 12:24:39.550908  8738 leader_election.cc:304] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89820c3229e24de18a4254f70b183a6c, a26c2b0b5b2f447097c60da4958d6d09; no voters: 0ed8a3294f314f9689ea0d295bd9dfb9
I20260709 12:24:39.552054  8971 raft_consensus.cc:2804] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:39.560906  8848 raft_consensus.cc:2468] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 1.
I20260709 12:24:39.555696  8991 leader_election.cc:290] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 election: Requested vote from peers 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:39.573573  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ea80ddaf24514a3ea597b2661ec91" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:39.574469  8965 tablet_bootstrap.cc:492] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c: No bootstrap required, opened a new log
I20260709 12:24:39.574517  8968 tablet_bootstrap.cc:492] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9: No bootstrap required, opened a new log
I20260709 12:24:39.575065  8965 ts_tablet_manager.cc:1403] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.018s
I20260709 12:24:39.575287  8966 tablet_bootstrap.cc:654] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.576048  8848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67731beaedd47a89b0ee7737f9083e6" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" is_pre_election: true
I20260709 12:24:39.575085  8968 ts_tablet_manager.cc:1403] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9: Time spent bootstrapping tablet: real 0.096s	user 0.021s	sys 0.025s
I20260709 12:24:39.577257  8738 leader_election.cc:304] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, 89820c3229e24de18a4254f70b183a6c; no voters: 
I20260709 12:24:39.576794  8848 raft_consensus.cc:2468] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a26c2b0b5b2f447097c60da4958d6d09 in term 0.
I20260709 12:24:39.579071  8971 raft_consensus.cc:697] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 1 LEADER]: Becoming Leader. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Running, Role: LEADER
I20260709 12:24:39.579430  8888 leader_election.cc:304] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, a26c2b0b5b2f447097c60da4958d6d09; no voters: 89820c3229e24de18a4254f70b183a6c
I20260709 12:24:39.579834  8968 raft_consensus.cc:359] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.580453  8992 raft_consensus.cc:2804] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:39.580655  8968 raft_consensus.cc:385] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.580893  8992 raft_consensus.cc:493] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.581028  8968 raft_consensus.cc:740] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.581277  8992 raft_consensus.cc:3060] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:24:39.581776  8738 leader_election.cc:343] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.581795  8968 consensus_queue.cc:260] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.584609  8968 ts_tablet_manager.cc:1434] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:24:39.584594  8991 raft_consensus.cc:2804] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:39.586081  8968 tablet_bootstrap.cc:492] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9: Bootstrap starting.
I20260709 12:24:39.579921  8971 consensus_queue.cc:237] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.590829  9000 raft_consensus.cc:493] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.591315  9000 raft_consensus.cc:515] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.593562  9000 leader_election.cc:290] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:39.594484  8991 raft_consensus.cc:697] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 1 LEADER]: Becoming Leader. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Running, Role: LEADER
I20260709 12:24:39.594393  8848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788b9b2b3234316b1652b80ccc1277d" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" is_pre_election: true
I20260709 12:24:39.595296  8973 raft_consensus.cc:493] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.595456  8991 consensus_queue.cc:237] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.595775  8973 raft_consensus.cc:515] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.597656  8968 tablet_bootstrap.cc:654] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.597589  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788b9b2b3234316b1652b80ccc1277d" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09" is_pre_election: true
I20260709 12:24:39.597965  8973 leader_election.cc:290] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115)
I20260709 12:24:39.598409  8921 raft_consensus.cc:2468] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 0.
I20260709 12:24:39.598564  8998 raft_consensus.cc:493] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.598505  8965 raft_consensus.cc:359] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.599414  8965 raft_consensus.cc:385] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.599201  8998 raft_consensus.cc:515] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.599841  8965 raft_consensus.cc:740] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.601114  8772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788b9b2b3234316b1652b80ccc1277d" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89820c3229e24de18a4254f70b183a6c" is_pre_election: true
I20260709 12:24:39.600749  8965 consensus_queue.cc:260] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.601765  8772 raft_consensus.cc:2468] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a26c2b0b5b2f447097c60da4958d6d09 in term 0.
I20260709 12:24:39.602452  8992 raft_consensus.cc:515] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.603322  8965 ts_tablet_manager.cc:1434] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.003s
I20260709 12:24:39.603467  8848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788b9b2b3234316b1652b80ccc1277d" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" is_pre_election: true
I20260709 12:24:39.604379  8965 tablet_bootstrap.cc:492] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c: Bootstrap starting.
I20260709 12:24:39.604736  8992 leader_election.cc:290] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 1 election: Requested vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115)
I20260709 12:24:39.606228  8771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67731beaedd47a89b0ee7737f9083e6" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89820c3229e24de18a4254f70b183a6c"
I20260709 12:24:39.607846  8968 tablet_bootstrap.cc:492] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9: No bootstrap required, opened a new log
W20260709 12:24:39.607936  8886 leader_election.cc:343] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.608314  8968 ts_tablet_manager.cc:1403] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.002s
I20260709 12:24:39.609455  8847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67731beaedd47a89b0ee7737f9083e6" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
I20260709 12:24:39.610103  8847 raft_consensus.cc:3060] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.611156  8998 leader_election.cc:290] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:39.612044  8965 tablet_bootstrap.cc:654] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.611461  8968 raft_consensus.cc:359] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.612493  8968 raft_consensus.cc:385] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.612870  8968 raft_consensus.cc:740] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Initialized, Role: FOLLOWER
W20260709 12:24:39.619097  8738 leader_election.cc:343] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.624155  8846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7223e8d80a649bea80c3b438c3af4a1" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" is_pre_election: true
I20260709 12:24:39.620568  8738 leader_election.cc:304] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89820c3229e24de18a4254f70b183a6c, a26c2b0b5b2f447097c60da4958d6d09; no voters: 0ed8a3294f314f9689ea0d295bd9dfb9
I20260709 12:24:39.625772  8998 raft_consensus.cc:2804] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:39.626933  8998 raft_consensus.cc:493] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.627691  8998 raft_consensus.cc:3060] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.627231  8968 consensus_queue.cc:260] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.635172  8968 ts_tablet_manager.cc:1434] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.001s
I20260709 12:24:39.636185  8968 tablet_bootstrap.cc:492] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9: Bootstrap starting.
I20260709 12:24:39.636049  8847 raft_consensus.cc:2468] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26c2b0b5b2f447097c60da4958d6d09 in term 1.
W20260709 12:24:39.638859  8738 leader_election.cc:343] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:24:39.638935  8888 leader_election.cc:343] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.639840  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7223e8d80a649bea80c3b438c3af4a1" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09" is_pre_election: true
W20260709 12:24:39.641494  8738 leader_election.cc:343] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.641927  8738 leader_election.cc:304] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89820c3229e24de18a4254f70b183a6c; no voters: 0ed8a3294f314f9689ea0d295bd9dfb9, a26c2b0b5b2f447097c60da4958d6d09
I20260709 12:24:39.643447  8991 raft_consensus.cc:2749] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:39.643543  8886 leader_election.cc:304] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 89820c3229e24de18a4254f70b183a6c, a26c2b0b5b2f447097c60da4958d6d09; no voters: 0ed8a3294f314f9689ea0d295bd9dfb9
I20260709 12:24:39.644331  8992 raft_consensus.cc:2804] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:39.644680  8992 raft_consensus.cc:493] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.644644  8888 leader_election.cc:304] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, a26c2b0b5b2f447097c60da4958d6d09; no voters: 89820c3229e24de18a4254f70b183a6c
I20260709 12:24:39.645159  8992 raft_consensus.cc:3060] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.645485  8973 raft_consensus.cc:2804] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:39.646091  8998 raft_consensus.cc:515] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.662760  8966 tablet_bootstrap.cc:492] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09: No bootstrap required, opened a new log
I20260709 12:24:39.662250  8973 raft_consensus.cc:697] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 LEADER]: Becoming Leader. State: Replica: a26c2b0b5b2f447097c60da4958d6d09, State: Running, Role: LEADER
I20260709 12:24:39.663852  8966 ts_tablet_manager.cc:1403] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09: Time spent bootstrapping tablet: real 0.115s	user 0.018s	sys 0.009s
I20260709 12:24:39.660524  8668 catalog_manager.cc:5697] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 89820c3229e24de18a4254f70b183a6c (127.8.111.65). New cstate: current_term: 1 leader_uuid: "89820c3229e24de18a4254f70b183a6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:39.664188  8973 consensus_queue.cc:237] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.671677  8992 raft_consensus.cc:515] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.679554  8847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788b9b2b3234316b1652b80ccc1277d" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
I20260709 12:24:39.679900  8968 tablet_bootstrap.cc:654] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.681422  8772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788b9b2b3234316b1652b80ccc1277d" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89820c3229e24de18a4254f70b183a6c"
W20260709 12:24:39.684007  8738 leader_election.cc:343] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.681918  8992 leader_election.cc:290] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 1 election: Requested vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115)
I20260709 12:24:39.684844  8991 raft_consensus.cc:493] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.685336  8772 raft_consensus.cc:2393] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a26c2b0b5b2f447097c60da4958d6d09 in current term 1: Already voted for candidate 89820c3229e24de18a4254f70b183a6c in this term.
I20260709 12:24:39.685494  8847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788b9b2b3234316b1652b80ccc1277d" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
I20260709 12:24:39.685636  8991 raft_consensus.cc:515] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.687897  8972 raft_consensus.cc:493] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:39.688220  8888 leader_election.cc:343] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:39.688621  8972 raft_consensus.cc:515] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.688753  8888 leader_election.cc:304] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a26c2b0b5b2f447097c60da4958d6d09; no voters: 0ed8a3294f314f9689ea0d295bd9dfb9, 89820c3229e24de18a4254f70b183a6c
I20260709 12:24:39.688946  8991 leader_election.cc:290] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:39.689268  8998 leader_election.cc:290] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 election: Requested vote from peers 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:39.690317  8992 raft_consensus.cc:2749] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:39.692233  8972 leader_election.cc:290] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:39.692674  8966 raft_consensus.cc:359] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.693393  8966 raft_consensus.cc:385] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.693233  8847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c02d26dcde247119ad22f7fb9ad6e42" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" is_pre_election: true
I20260709 12:24:39.693686  8966 raft_consensus.cc:740] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26c2b0b5b2f447097c60da4958d6d09, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.693899  8847 raft_consensus.cc:2468] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 0.
I20260709 12:24:39.693238  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788b9b2b3234316b1652b80ccc1277d" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:39.694455  8966 consensus_queue.cc:260] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.694309  8965 tablet_bootstrap.cc:492] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c: No bootstrap required, opened a new log
I20260709 12:24:39.698726  8772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c02d26dcde247119ad22f7fb9ad6e42" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89820c3229e24de18a4254f70b183a6c" is_pre_election: true
I20260709 12:24:39.694103  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c02d26dcde247119ad22f7fb9ad6e42" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09" is_pre_election: true
I20260709 12:24:39.700363  8965 ts_tablet_manager.cc:1403] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c: Time spent bootstrapping tablet: real 0.096s	user 0.016s	sys 0.000s
I20260709 12:24:39.701308  8921 raft_consensus.cc:2393] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 89820c3229e24de18a4254f70b183a6c in current term 1: Already voted for candidate a26c2b0b5b2f447097c60da4958d6d09 in this term.
I20260709 12:24:39.700557  8772 raft_consensus.cc:2468] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 0.
I20260709 12:24:39.699489  8738 leader_election.cc:304] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, 89820c3229e24de18a4254f70b183a6c; no voters: 
I20260709 12:24:39.698585  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c02d26dcde247119ad22f7fb9ad6e42" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09" is_pre_election: true
I20260709 12:24:39.701483  8922 raft_consensus.cc:2468] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 0.
I20260709 12:24:39.703449  8998 raft_consensus.cc:2804] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:39.704490  8812 leader_election.cc:304] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, 89820c3229e24de18a4254f70b183a6c; no voters: 
I20260709 12:24:39.707253  8972 raft_consensus.cc:2804] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:39.707604  8966 ts_tablet_manager.cc:1434] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.004s
I20260709 12:24:39.707919  8738 leader_election.cc:304] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89820c3229e24de18a4254f70b183a6c; no voters: 0ed8a3294f314f9689ea0d295bd9dfb9, a26c2b0b5b2f447097c60da4958d6d09
I20260709 12:24:39.708842  8966 tablet_bootstrap.cc:492] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09: Bootstrap starting.
I20260709 12:24:39.708882  8991 raft_consensus.cc:2749] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:39.706516  8998 raft_consensus.cc:493] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.709666  8998 raft_consensus.cc:3060] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.707604  8972 raft_consensus.cc:493] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.712186  8972 raft_consensus.cc:3060] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.721805  8968 tablet_bootstrap.cc:492] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9: No bootstrap required, opened a new log
I20260709 12:24:39.722910  8968 ts_tablet_manager.cc:1403] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.010s
I20260709 12:24:39.723948  8965 raft_consensus.cc:359] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.725467  8965 raft_consensus.cc:385] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.726392  8965 raft_consensus.cc:740] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.725912  8998 raft_consensus.cc:515] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.728943  8965 consensus_queue.cc:260] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.731208  8998 leader_election.cc:290] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 election: Requested vote from peers 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:39.731717  8847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c02d26dcde247119ad22f7fb9ad6e42" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
I20260709 12:24:39.732474  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c02d26dcde247119ad22f7fb9ad6e42" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:39.733366  8920 raft_consensus.cc:3060] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.733539  8966 tablet_bootstrap.cc:654] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.730229  8972 raft_consensus.cc:515] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.734889  8965 ts_tablet_manager.cc:1434] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 12:24:39.735107  8847 raft_consensus.cc:2393] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 89820c3229e24de18a4254f70b183a6c in current term 1: Already voted for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in this term.
I20260709 12:24:39.736162  8968 raft_consensus.cc:359] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.736869  8968 raft_consensus.cc:385] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.737509  8968 raft_consensus.cc:740] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.738587  8965 tablet_bootstrap.cc:492] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c: Bootstrap starting.
I20260709 12:24:39.738799  8968 consensus_queue.cc:260] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.739610  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c02d26dcde247119ad22f7fb9ad6e42" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:39.741211  8772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c02d26dcde247119ad22f7fb9ad6e42" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89820c3229e24de18a4254f70b183a6c"
I20260709 12:24:39.742141  8772 raft_consensus.cc:2393] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in current term 1: Already voted for candidate 89820c3229e24de18a4254f70b183a6c in this term.
I20260709 12:24:39.740654  8972 leader_election.cc:290] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 1 election: Requested vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:39.743952  8920 raft_consensus.cc:2468] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 1.
I20260709 12:24:39.745281  8812 leader_election.cc:304] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9; no voters: 89820c3229e24de18a4254f70b183a6c, a26c2b0b5b2f447097c60da4958d6d09
I20260709 12:24:39.745379  8738 leader_election.cc:304] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89820c3229e24de18a4254f70b183a6c, a26c2b0b5b2f447097c60da4958d6d09; no voters: 
I20260709 12:24:39.745839  8968 ts_tablet_manager.cc:1434] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.001s
I20260709 12:24:39.746146  8998 raft_consensus.cc:2804] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:39.746594  8998 raft_consensus.cc:697] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 1 LEADER]: Becoming Leader. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Running, Role: LEADER
I20260709 12:24:39.747015  8968 tablet_bootstrap.cc:492] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9: Bootstrap starting.
I20260709 12:24:39.746902  8972 raft_consensus.cc:2749] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:24:39.748399  8998 consensus_queue.cc:237] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.750007  8966 tablet_bootstrap.cc:492] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09: No bootstrap required, opened a new log
I20260709 12:24:39.750504  8965 tablet_bootstrap.cc:654] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.750536  8966 ts_tablet_manager.cc:1403] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.008s
I20260709 12:24:39.755318  8968 tablet_bootstrap.cc:654] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.759121  8966 raft_consensus.cc:359] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.760149  8966 raft_consensus.cc:385] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.760923  8966 raft_consensus.cc:740] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26c2b0b5b2f447097c60da4958d6d09, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.762683  8966 consensus_queue.cc:260] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.766778  8966 ts_tablet_manager.cc:1434] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:24:39.767715  8966 tablet_bootstrap.cc:492] T 842cb132550246f7b891dd071fa42042 P a26c2b0b5b2f447097c60da4958d6d09: Bootstrap starting.
I20260709 12:24:39.771137  8968 tablet_bootstrap.cc:492] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9: No bootstrap required, opened a new log
I20260709 12:24:39.771687  8968 ts_tablet_manager.cc:1403] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.003s
I20260709 12:24:39.774160  8966 tablet_bootstrap.cc:654] T 842cb132550246f7b891dd071fa42042 P a26c2b0b5b2f447097c60da4958d6d09: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.780793  8668 catalog_manager.cc:5697] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 reported cstate change: term changed from 0 to 1, leader changed from <none> to a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "a26c2b0b5b2f447097c60da4958d6d09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:39.782204  8968 raft_consensus.cc:359] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.783066  8968 raft_consensus.cc:385] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.783504  8968 raft_consensus.cc:740] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.784364  8968 consensus_queue.cc:260] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.787329  8968 ts_tablet_manager.cc:1434] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:24:39.788408  8968 tablet_bootstrap.cc:492] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9: Bootstrap starting.
I20260709 12:24:39.795576  8968 tablet_bootstrap.cc:654] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.800756  8965 tablet_bootstrap.cc:492] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c: No bootstrap required, opened a new log
I20260709 12:24:39.801407  8965 ts_tablet_manager.cc:1403] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.011s
I20260709 12:24:39.804315  8966 tablet_bootstrap.cc:492] T 842cb132550246f7b891dd071fa42042 P a26c2b0b5b2f447097c60da4958d6d09: No bootstrap required, opened a new log
I20260709 12:24:39.804781  8966 ts_tablet_manager.cc:1403] T 842cb132550246f7b891dd071fa42042 P a26c2b0b5b2f447097c60da4958d6d09: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.015s
I20260709 12:24:39.803584  8669 catalog_manager.cc:5697] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 89820c3229e24de18a4254f70b183a6c (127.8.111.65). New cstate: current_term: 1 leader_uuid: "89820c3229e24de18a4254f70b183a6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:39.806048  8669 catalog_manager.cc:5697] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c reported cstate change: term changed from 0 to 1, leader changed from <none> to 89820c3229e24de18a4254f70b183a6c (127.8.111.65). New cstate: current_term: 1 leader_uuid: "89820c3229e24de18a4254f70b183a6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:39.808200  8968 tablet_bootstrap.cc:492] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9: No bootstrap required, opened a new log
I20260709 12:24:39.808056  8966 raft_consensus.cc:359] T 842cb132550246f7b891dd071fa42042 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } }
I20260709 12:24:39.808692  8968 ts_tablet_manager.cc:1403] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 12:24:39.808799  8966 raft_consensus.cc:385] T 842cb132550246f7b891dd071fa42042 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.809173  8966 raft_consensus.cc:740] T 842cb132550246f7b891dd071fa42042 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26c2b0b5b2f447097c60da4958d6d09, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.809978  8966 consensus_queue.cc:260] T 842cb132550246f7b891dd071fa42042 P a26c2b0b5b2f447097c60da4958d6d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } }
I20260709 12:24:39.811489  8968 raft_consensus.cc:359] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.812179  8968 raft_consensus.cc:385] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.812374  8966 ts_tablet_manager.cc:1434] T 842cb132550246f7b891dd071fa42042 P a26c2b0b5b2f447097c60da4958d6d09: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:39.812494  8968 raft_consensus.cc:740] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.813380  8966 tablet_bootstrap.cc:492] T 911b2f05169e49379263206730564c6e P a26c2b0b5b2f447097c60da4958d6d09: Bootstrap starting.
I20260709 12:24:39.813483  8968 consensus_queue.cc:260] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.815894  8968 ts_tablet_manager.cc:1434] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:24:39.817075  8968 tablet_bootstrap.cc:492] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9: Bootstrap starting.
I20260709 12:24:39.819919  8966 tablet_bootstrap.cc:654] T 911b2f05169e49379263206730564c6e P a26c2b0b5b2f447097c60da4958d6d09: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.824056  8968 tablet_bootstrap.cc:654] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.831070  8966 tablet_bootstrap.cc:492] T 911b2f05169e49379263206730564c6e P a26c2b0b5b2f447097c60da4958d6d09: No bootstrap required, opened a new log
I20260709 12:24:39.831524  8966 ts_tablet_manager.cc:1403] T 911b2f05169e49379263206730564c6e P a26c2b0b5b2f447097c60da4958d6d09: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:24:39.835834  8968 tablet_bootstrap.cc:492] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9: No bootstrap required, opened a new log
I20260709 12:24:39.836294  8968 ts_tablet_manager.cc:1403] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.002s
I20260709 12:24:39.839011  8968 raft_consensus.cc:359] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.839709  8968 raft_consensus.cc:385] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.834183  8966 raft_consensus.cc:359] T 911b2f05169e49379263206730564c6e P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.839989  8968 raft_consensus.cc:740] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.840127  8966 raft_consensus.cc:385] T 911b2f05169e49379263206730564c6e P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.840476  8966 raft_consensus.cc:740] T 911b2f05169e49379263206730564c6e P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26c2b0b5b2f447097c60da4958d6d09, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.840746  8968 consensus_queue.cc:260] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.841209  8966 consensus_queue.cc:260] T 911b2f05169e49379263206730564c6e P a26c2b0b5b2f447097c60da4958d6d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.843241  8968 ts_tablet_manager.cc:1434] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:24:39.843781  8966 ts_tablet_manager.cc:1434] T 911b2f05169e49379263206730564c6e P a26c2b0b5b2f447097c60da4958d6d09: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:24:39.844735  8966 tablet_bootstrap.cc:492] T ad68501f591d446f953f4f1f07b6ba45 P a26c2b0b5b2f447097c60da4958d6d09: Bootstrap starting.
I20260709 12:24:39.851023  8966 tablet_bootstrap.cc:654] T ad68501f591d446f953f4f1f07b6ba45 P a26c2b0b5b2f447097c60da4958d6d09: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.851902  8965 raft_consensus.cc:359] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.852384  8965 raft_consensus.cc:385] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.852568  8965 raft_consensus.cc:740] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.853143  8965 consensus_queue.cc:260] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.858410  8965 ts_tablet_manager.cc:1434] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.002s
I20260709 12:24:39.859346  8965 tablet_bootstrap.cc:492] T 911b2f05169e49379263206730564c6e P 89820c3229e24de18a4254f70b183a6c: Bootstrap starting.
I20260709 12:24:39.865927  8965 tablet_bootstrap.cc:654] T 911b2f05169e49379263206730564c6e P 89820c3229e24de18a4254f70b183a6c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.868593  8966 tablet_bootstrap.cc:492] T ad68501f591d446f953f4f1f07b6ba45 P a26c2b0b5b2f447097c60da4958d6d09: No bootstrap required, opened a new log
I20260709 12:24:39.869035  8966 ts_tablet_manager.cc:1403] T ad68501f591d446f953f4f1f07b6ba45 P a26c2b0b5b2f447097c60da4958d6d09: Time spent bootstrapping tablet: real 0.024s	user 0.002s	sys 0.020s
I20260709 12:24:39.874365  8966 raft_consensus.cc:359] T ad68501f591d446f953f4f1f07b6ba45 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.875005  8966 raft_consensus.cc:385] T ad68501f591d446f953f4f1f07b6ba45 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.875274  8966 raft_consensus.cc:740] T ad68501f591d446f953f4f1f07b6ba45 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26c2b0b5b2f447097c60da4958d6d09, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.875903  8966 consensus_queue.cc:260] T ad68501f591d446f953f4f1f07b6ba45 P a26c2b0b5b2f447097c60da4958d6d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.878546  8965 tablet_bootstrap.cc:492] T 911b2f05169e49379263206730564c6e P 89820c3229e24de18a4254f70b183a6c: No bootstrap required, opened a new log
I20260709 12:24:39.879031  8965 ts_tablet_manager.cc:1403] T 911b2f05169e49379263206730564c6e P 89820c3229e24de18a4254f70b183a6c: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 12:24:39.881058  8966 ts_tablet_manager.cc:1434] T ad68501f591d446f953f4f1f07b6ba45 P a26c2b0b5b2f447097c60da4958d6d09: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:24:39.881930  8966 tablet_bootstrap.cc:492] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09: Bootstrap starting.
I20260709 12:24:39.881811  8965 raft_consensus.cc:359] T 911b2f05169e49379263206730564c6e P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.882602  8965 raft_consensus.cc:385] T 911b2f05169e49379263206730564c6e P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.882921  8965 raft_consensus.cc:740] T 911b2f05169e49379263206730564c6e P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.883796  8965 consensus_queue.cc:260] T 911b2f05169e49379263206730564c6e P 89820c3229e24de18a4254f70b183a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.885882  8965 ts_tablet_manager.cc:1434] T 911b2f05169e49379263206730564c6e P 89820c3229e24de18a4254f70b183a6c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:24:39.887642  8966 tablet_bootstrap.cc:654] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:39.895610  8966 tablet_bootstrap.cc:492] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09: No bootstrap required, opened a new log
I20260709 12:24:39.895996  8966 ts_tablet_manager.cc:1403] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:24:39.898396  8966 raft_consensus.cc:359] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.899008  8966 raft_consensus.cc:385] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:39.899266  8966 raft_consensus.cc:740] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26c2b0b5b2f447097c60da4958d6d09, State: Initialized, Role: FOLLOWER
I20260709 12:24:39.899840  8966 consensus_queue.cc:260] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.901708  8966 ts_tablet_manager.cc:1434] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:24:39.920791  8972 raft_consensus.cc:493] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.921293  8972 raft_consensus.cc:515] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.923038  8972 leader_election.cc:290] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:39.923808  8772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad68501f591d446f953f4f1f07b6ba45" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89820c3229e24de18a4254f70b183a6c" is_pre_election: true
I20260709 12:24:39.924113  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad68501f591d446f953f4f1f07b6ba45" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09" is_pre_election: true
I20260709 12:24:39.924805  8920 raft_consensus.cc:2468] T ad68501f591d446f953f4f1f07b6ba45 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 0.
I20260709 12:24:39.924609  8772 raft_consensus.cc:2468] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 0.
I20260709 12:24:39.925911  8814 leader_election.cc:304] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, a26c2b0b5b2f447097c60da4958d6d09; no voters: 
I20260709 12:24:39.926599  8972 raft_consensus.cc:2804] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:39.926891  8972 raft_consensus.cc:493] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.927174  8972 raft_consensus.cc:3060] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.931809  8972 raft_consensus.cc:515] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.933255  8972 leader_election.cc:290] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 1 election: Requested vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:39.934118  8772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad68501f591d446f953f4f1f07b6ba45" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89820c3229e24de18a4254f70b183a6c"
I20260709 12:24:39.934324  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad68501f591d446f953f4f1f07b6ba45" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:39.934660  8772 raft_consensus.cc:3060] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.934891  8920 raft_consensus.cc:3060] T ad68501f591d446f953f4f1f07b6ba45 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.939128  8772 raft_consensus.cc:2468] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 1.
I20260709 12:24:39.940101  8812 leader_election.cc:304] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, 89820c3229e24de18a4254f70b183a6c; no voters: 
I20260709 12:24:39.940946  8972 raft_consensus.cc:2804] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:39.941493  8920 raft_consensus.cc:2468] T ad68501f591d446f953f4f1f07b6ba45 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 1.
I20260709 12:24:39.942091  8972 raft_consensus.cc:697] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Running, Role: LEADER
W20260709 12:24:39.943228  8716 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:39.942935  8972 consensus_queue.cc:237] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.950519  8669 catalog_manager.cc:5697] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:39.967530  8972 consensus_queue.cc:1048] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:39.984297  8920 raft_consensus.cc:3060] T 842cb132550246f7b891dd071fa42042 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.989319  8973 raft_consensus.cc:493] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.989862  8973 raft_consensus.cc:515] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:39.991858  8973 leader_election.cc:290] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115)
I20260709 12:24:39.992522  8772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7223e8d80a649bea80c3b438c3af4a1" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89820c3229e24de18a4254f70b183a6c" is_pre_election: true
I20260709 12:24:39.993178  8772 raft_consensus.cc:2468] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a26c2b0b5b2f447097c60da4958d6d09 in term 0.
I20260709 12:24:39.994323  8886 leader_election.cc:304] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89820c3229e24de18a4254f70b183a6c, a26c2b0b5b2f447097c60da4958d6d09; no voters: 
I20260709 12:24:39.995095  8973 raft_consensus.cc:2804] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:39.995445  8973 raft_consensus.cc:493] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.995832  8973 raft_consensus.cc:3060] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:39.998672  9025 consensus_queue.cc:1048] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:39.999481  8972 raft_consensus.cc:493] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.999963  8972 raft_consensus.cc:515] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:40.002023  8972 leader_election.cc:290] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:40.003424  8973 raft_consensus.cc:515] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:40.004596  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788b9b2b3234316b1652b80ccc1277d" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09" is_pre_election: true
I20260709 12:24:40.005352  8922 raft_consensus.cc:2393] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in current term 1: Already voted for candidate a26c2b0b5b2f447097c60da4958d6d09 in this term.
I20260709 12:24:40.005442  8973 leader_election.cc:290] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 1 election: Requested vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115)
I20260709 12:24:40.006253  8772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7223e8d80a649bea80c3b438c3af4a1" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89820c3229e24de18a4254f70b183a6c"
I20260709 12:24:40.006562  8847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7223e8d80a649bea80c3b438c3af4a1" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" is_pre_election: true
I20260709 12:24:40.006845  8772 raft_consensus.cc:3060] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.007193  8847 raft_consensus.cc:2468] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a26c2b0b5b2f447097c60da4958d6d09 in term 0.
I20260709 12:24:40.008832  8771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788b9b2b3234316b1652b80ccc1277d" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89820c3229e24de18a4254f70b183a6c" is_pre_election: true
I20260709 12:24:40.009531  8771 raft_consensus.cc:2393] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in current term 1: Already voted for candidate 89820c3229e24de18a4254f70b183a6c in this term.
I20260709 12:24:40.011144  8998 consensus_queue.cc:1048] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:40.014262  8847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7223e8d80a649bea80c3b438c3af4a1" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
I20260709 12:24:40.014837  8847 raft_consensus.cc:3060] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.016916  8812 leader_election.cc:304] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9; no voters: 89820c3229e24de18a4254f70b183a6c, a26c2b0b5b2f447097c60da4958d6d09
I20260709 12:24:40.016103  8772 raft_consensus.cc:2468] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26c2b0b5b2f447097c60da4958d6d09 in term 1.
I20260709 12:24:40.018034  9025 raft_consensus.cc:3060] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.019881  8886 leader_election.cc:304] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89820c3229e24de18a4254f70b183a6c, a26c2b0b5b2f447097c60da4958d6d09; no voters: 
I20260709 12:24:40.020977  8973 raft_consensus.cc:2804] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:40.021488  8973 raft_consensus.cc:697] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 LEADER]: Becoming Leader. State: Replica: a26c2b0b5b2f447097c60da4958d6d09, State: Running, Role: LEADER
I20260709 12:24:40.022342  8973 consensus_queue.cc:237] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:40.024235  8998 consensus_queue.cc:1048] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:40.027642  9025 raft_consensus.cc:2749] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:40.034925  8847 raft_consensus.cc:2468] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26c2b0b5b2f447097c60da4958d6d09 in term 1.
I20260709 12:24:40.050395  8920 raft_consensus.cc:3060] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.052886  8972 raft_consensus.cc:493] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.053341  8972 raft_consensus.cc:515] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:40.056391  8772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b2f05169e49379263206730564c6e" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89820c3229e24de18a4254f70b183a6c" is_pre_election: true
I20260709 12:24:40.056452  8921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b2f05169e49379263206730564c6e" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09" is_pre_election: true
I20260709 12:24:40.057065  8772 raft_consensus.cc:2468] T 911b2f05169e49379263206730564c6e P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 0.
I20260709 12:24:40.057148  8921 raft_consensus.cc:2468] T 911b2f05169e49379263206730564c6e P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 0.
I20260709 12:24:40.057976  8972 leader_election.cc:290] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:40.058642  8814 leader_election.cc:304] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, a26c2b0b5b2f447097c60da4958d6d09; no voters: 
I20260709 12:24:40.059545  8972 raft_consensus.cc:2804] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:40.059969  8972 raft_consensus.cc:493] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.060305  8972 raft_consensus.cc:3060] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.068958  8669 catalog_manager.cc:5697] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 reported cstate change: term changed from 0 to 1, leader changed from <none> to a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "a26c2b0b5b2f447097c60da4958d6d09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:40.071879  8971 consensus_queue.cc:1048] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:40.074723  8846 raft_consensus.cc:3060] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.081851  8972 raft_consensus.cc:515] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:40.084671  8772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b2f05169e49379263206730564c6e" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89820c3229e24de18a4254f70b183a6c"
I20260709 12:24:40.084972  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "911b2f05169e49379263206730564c6e" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:40.085268  8772 raft_consensus.cc:3060] T 911b2f05169e49379263206730564c6e P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.085541  8922 raft_consensus.cc:3060] T 911b2f05169e49379263206730564c6e P a26c2b0b5b2f447097c60da4958d6d09 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.085384  8971 consensus_queue.cc:1048] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:40.092820  8922 raft_consensus.cc:2468] T 911b2f05169e49379263206730564c6e P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 1.
I20260709 12:24:40.094022  8814 leader_election.cc:304] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, a26c2b0b5b2f447097c60da4958d6d09; no voters: 
I20260709 12:24:40.094787  9025 raft_consensus.cc:2804] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:40.095273  9025 raft_consensus.cc:697] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 LEADER]: Becoming Leader. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Running, Role: LEADER
I20260709 12:24:40.096098  9025 consensus_queue.cc:237] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:40.098479  8972 leader_election.cc:290] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 1 election: Requested vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:40.092823  8772 raft_consensus.cc:2468] T 911b2f05169e49379263206730564c6e P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 1.
I20260709 12:24:40.119364  8665 catalog_manager.cc:5697] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:40.124292  8992 consensus_queue.cc:1048] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:40.134138  8772 raft_consensus.cc:3060] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:40.142139  9006 consensus_queue.cc:1048] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:40.275547  8971 consensus_queue.cc:1048] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:40.286451  8998 consensus_queue.cc:1048] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:40.483971  9025 consensus_queue.cc:1048] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:40.496933  9025 consensus_queue.cc:1048] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:40.560376  9006 consensus_queue.cc:1048] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:40.575217  8973 consensus_queue.cc:1048] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:40.631603  9025 consensus_queue.cc:1048] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:40.643334  9025 consensus_queue.cc:1048] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:24:40.949746  8716 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:41.573452  9045 raft_consensus.cc:493] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.573868  9045 raft_consensus.cc:515] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:41.576066  9045 leader_election.cc:290] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:41.576926  8847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788b9b2b3234316b1652b80ccc1277d" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" is_pre_election: true
I20260709 12:24:41.577515  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788b9b2b3234316b1652b80ccc1277d" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09" is_pre_election: true
I20260709 12:24:41.577870  8847 raft_consensus.cc:2468] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 1.
I20260709 12:24:41.578190  8922 raft_consensus.cc:2468] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 1.
I20260709 12:24:41.579252  8738 leader_election.cc:304] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, 89820c3229e24de18a4254f70b183a6c; no voters: 
I20260709 12:24:41.580087  9045 raft_consensus.cc:2804] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:41.580440  9045 raft_consensus.cc:493] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.580722  9045 raft_consensus.cc:3060] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:41.586735  9045 raft_consensus.cc:515] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:41.588340  9045 leader_election.cc:290] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 2 election: Requested vote from peers 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:41.589226  8847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788b9b2b3234316b1652b80ccc1277d" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
I20260709 12:24:41.589721  8847 raft_consensus.cc:3060] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:41.589663  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788b9b2b3234316b1652b80ccc1277d" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:41.590548  8922 raft_consensus.cc:3060] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:41.594259  8847 raft_consensus.cc:2468] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 2.
I20260709 12:24:41.594741  8922 raft_consensus.cc:2468] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 2.
I20260709 12:24:41.595284  8738 leader_election.cc:304] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, 89820c3229e24de18a4254f70b183a6c; no voters: 
I20260709 12:24:41.596068  9045 raft_consensus.cc:2804] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:41.596534  9045 raft_consensus.cc:697] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Becoming Leader. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Running, Role: LEADER
I20260709 12:24:41.597275  9045 consensus_queue.cc:237] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:41.603470  8669 catalog_manager.cc:5697] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c reported cstate change: term changed from 0 to 2, leader changed from <none> to 89820c3229e24de18a4254f70b183a6c (127.8.111.65). New cstate: current_term: 2 leader_uuid: "89820c3229e24de18a4254f70b183a6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:41.987879  8922 raft_consensus.cc:1275] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Refusing update from remote peer 89820c3229e24de18a4254f70b183a6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:24:41.988957  9045 consensus_queue.cc:1048] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:41.999056  8847 raft_consensus.cc:1275] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Refusing update from remote peer 89820c3229e24de18a4254f70b183a6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:24:42.000515  8998 consensus_queue.cc:1048] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:42.075033  8847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "842cb132550246f7b891dd071fa42042"
dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
mode: GRACEFUL
new_leader_uuid: "89820c3229e24de18a4254f70b183a6c"
 from {username='slave'} at 127.0.0.1:39270
I20260709 12:24:42.075621  8847 raft_consensus.cc:606] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 LEADER]: Received request to transfer leadership to TS 89820c3229e24de18a4254f70b183a6c
I20260709 12:24:42.090857  8922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7223e8d80a649bea80c3b438c3af4a1"
dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
mode: GRACEFUL
new_leader_uuid: "89820c3229e24de18a4254f70b183a6c"
 from {username='slave'} at 127.0.0.1:46222
I20260709 12:24:42.091362  8922 raft_consensus.cc:606] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 LEADER]: Received request to transfer leadership to TS 89820c3229e24de18a4254f70b183a6c
I20260709 12:24:42.096076  8922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d67731beaedd47a89b0ee7737f9083e6"
dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
mode: GRACEFUL
new_leader_uuid: "89820c3229e24de18a4254f70b183a6c"
 from {username='slave'} at 127.0.0.1:46222
I20260709 12:24:42.096524  8922 raft_consensus.cc:606] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 LEADER]: Received request to transfer leadership to TS 89820c3229e24de18a4254f70b183a6c
I20260709 12:24:42.111323  8772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf2ea80ddaf24514a3ea597b2661ec91"
dest_uuid: "89820c3229e24de18a4254f70b183a6c"
mode: GRACEFUL
new_leader_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
 from {username='slave'} at 127.0.0.1:40308
I20260709 12:24:42.111837  8772 raft_consensus.cc:606] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 1 LEADER]: Received request to transfer leadership to TS 0ed8a3294f314f9689ea0d295bd9dfb9
I20260709 12:24:42.116657  8772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4a57ce90459497cb623214481efe782"
dest_uuid: "89820c3229e24de18a4254f70b183a6c"
mode: GRACEFUL
new_leader_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
 from {username='slave'} at 127.0.0.1:40308
I20260709 12:24:42.117213  8772 raft_consensus.cc:606] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 1 LEADER]: Received request to transfer leadership to TS 0ed8a3294f314f9689ea0d295bd9dfb9
I20260709 12:24:42.123624  8772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c788b9b2b3234316b1652b80ccc1277d"
dest_uuid: "89820c3229e24de18a4254f70b183a6c"
mode: GRACEFUL
new_leader_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
 from {username='slave'} at 127.0.0.1:40308
I20260709 12:24:42.124109  8772 raft_consensus.cc:606] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Received request to transfer leadership to TS a26c2b0b5b2f447097c60da4958d6d09
I20260709 12:24:42.167896  8973 raft_consensus.cc:993] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09: : Instructing follower 89820c3229e24de18a4254f70b183a6c to start an election
I20260709 12:24:42.168363  9060 raft_consensus.cc:1081] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 LEADER]: Signalling peer 89820c3229e24de18a4254f70b183a6c to start an election
I20260709 12:24:42.169919  8772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d67731beaedd47a89b0ee7737f9083e6"
dest_uuid: "89820c3229e24de18a4254f70b183a6c"
 from {username='slave'} at 127.0.0.1:40296
I20260709 12:24:42.170414  8772 raft_consensus.cc:493] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:42.170850  8772 raft_consensus.cc:3060] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.175697  8772 raft_consensus.cc:515] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:42.177357  8772 leader_election.cc:290] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 2 election: Requested vote from peers 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:42.178195  8847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67731beaedd47a89b0ee7737f9083e6" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
I20260709 12:24:42.178512  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67731beaedd47a89b0ee7737f9083e6" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:42.178742  8847 raft_consensus.cc:3060] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.179126  8922 raft_consensus.cc:3055] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:42.179415  8922 raft_consensus.cc:740] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a26c2b0b5b2f447097c60da4958d6d09, State: Running, Role: LEADER
I20260709 12:24:42.180114  8922 consensus_queue.cc:260] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:42.181177  8922 raft_consensus.cc:3060] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.183205  8847 raft_consensus.cc:2468] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 2.
I20260709 12:24:42.184128  8738 leader_election.cc:304] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, 89820c3229e24de18a4254f70b183a6c; no voters: 
I20260709 12:24:42.184787  8998 raft_consensus.cc:2804] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:42.185303  8998 raft_consensus.cc:697] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Becoming Leader. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Running, Role: LEADER
I20260709 12:24:42.186442  8922 raft_consensus.cc:2468] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 2.
I20260709 12:24:42.186209  8998 consensus_queue.cc:237] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:42.193858  8669 catalog_manager.cc:5697] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c reported cstate change: term changed from 1 to 2, leader changed from a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67) to 89820c3229e24de18a4254f70b183a6c (127.8.111.65). New cstate: current_term: 2 leader_uuid: "89820c3229e24de18a4254f70b183a6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.339368  8972 raft_consensus.cc:993] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9: : Instructing follower 89820c3229e24de18a4254f70b183a6c to start an election
I20260709 12:24:42.339802  9065 raft_consensus.cc:1081] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 LEADER]: Signalling peer 89820c3229e24de18a4254f70b183a6c to start an election
I20260709 12:24:42.341128  8772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "842cb132550246f7b891dd071fa42042"
dest_uuid: "89820c3229e24de18a4254f70b183a6c"
 from {username='slave'} at 127.0.0.1:40294
I20260709 12:24:42.341578  8772 raft_consensus.cc:493] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:42.341876  8772 raft_consensus.cc:3060] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.346112  8772 raft_consensus.cc:515] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } }
I20260709 12:24:42.347569  8772 leader_election.cc:290] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 2 election: Requested vote from peers a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919), 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115)
I20260709 12:24:42.348450  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842cb132550246f7b891dd071fa42042" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:42.348694  8847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842cb132550246f7b891dd071fa42042" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
I20260709 12:24:42.349009  8922 raft_consensus.cc:3060] T 842cb132550246f7b891dd071fa42042 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.349242  8847 raft_consensus.cc:3055] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:42.349619  8847 raft_consensus.cc:740] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Running, Role: LEADER
I20260709 12:24:42.350414  8847 consensus_queue.cc:260] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } }
I20260709 12:24:42.351401  8847 raft_consensus.cc:3060] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.353782  8922 raft_consensus.cc:2468] T 842cb132550246f7b891dd071fa42042 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 2.
I20260709 12:24:42.354765  8738 leader_election.cc:304] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89820c3229e24de18a4254f70b183a6c, a26c2b0b5b2f447097c60da4958d6d09; no voters: 
I20260709 12:24:42.355439  8998 raft_consensus.cc:2804] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:42.355863  8998 raft_consensus.cc:697] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Becoming Leader. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Running, Role: LEADER
I20260709 12:24:42.355979  8847 raft_consensus.cc:2468] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 2.
I20260709 12:24:42.356630  8998 consensus_queue.cc:237] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } }
I20260709 12:24:42.363003  8669 catalog_manager.cc:5697] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c reported cstate change: term changed from 1 to 2, leader changed from 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66) to 89820c3229e24de18a4254f70b183a6c (127.8.111.65). New cstate: current_term: 2 leader_uuid: "89820c3229e24de18a4254f70b183a6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:42.369136  9045 raft_consensus.cc:993] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c: : Instructing follower 0ed8a3294f314f9689ea0d295bd9dfb9 to start an election
I20260709 12:24:42.369575  9045 raft_consensus.cc:1081] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 1 LEADER]: Signalling peer 0ed8a3294f314f9689ea0d295bd9dfb9 to start an election
I20260709 12:24:42.371106  8847 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4a57ce90459497cb623214481efe782"
dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
 from {username='slave'} at 127.0.0.1:39254
I20260709 12:24:42.371650  8847 raft_consensus.cc:493] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:42.371961  8847 raft_consensus.cc:3060] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.376515  8847 raft_consensus.cc:515] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:42.378180  8847 leader_election.cc:290] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 2 election: Requested vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:42.378814  8772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a57ce90459497cb623214481efe782" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89820c3229e24de18a4254f70b183a6c"
I20260709 12:24:42.379127  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a57ce90459497cb623214481efe782" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:42.379393  8772 raft_consensus.cc:3055] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:42.379648  8922 raft_consensus.cc:3060] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.379724  8772 raft_consensus.cc:740] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Running, Role: LEADER
I20260709 12:24:42.380483  8772 consensus_queue.cc:260] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:42.381346  8772 raft_consensus.cc:3060] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.384565  8922 raft_consensus.cc:2468] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 2.
I20260709 12:24:42.385555  8814 leader_election.cc:304] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, a26c2b0b5b2f447097c60da4958d6d09; no voters: 
I20260709 12:24:42.385752  8772 raft_consensus.cc:2468] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 2.
I20260709 12:24:42.386408  9065 raft_consensus.cc:2804] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:42.386852  9065 raft_consensus.cc:697] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 LEADER]: Becoming Leader. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Running, Role: LEADER
I20260709 12:24:42.387604  9065 consensus_queue.cc:237] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:42.396900  8668 catalog_manager.cc:5697] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 reported cstate change: term changed from 1 to 2, leader changed from 89820c3229e24de18a4254f70b183a6c (127.8.111.65) to 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.413337  8973 raft_consensus.cc:993] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09: : Instructing follower 89820c3229e24de18a4254f70b183a6c to start an election
I20260709 12:24:42.413719  9060 raft_consensus.cc:1081] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 LEADER]: Signalling peer 89820c3229e24de18a4254f70b183a6c to start an election
I20260709 12:24:42.415024  8772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7223e8d80a649bea80c3b438c3af4a1"
dest_uuid: "89820c3229e24de18a4254f70b183a6c"
 from {username='slave'} at 127.0.0.1:40296
I20260709 12:24:42.415417  8772 raft_consensus.cc:493] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:42.415665  8772 raft_consensus.cc:3060] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.420085  8772 raft_consensus.cc:515] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:42.421636  8772 leader_election.cc:290] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 2 election: Requested vote from peers 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:42.422297  8847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7223e8d80a649bea80c3b438c3af4a1" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
I20260709 12:24:42.422641  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7223e8d80a649bea80c3b438c3af4a1" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:42.422865  8847 raft_consensus.cc:3060] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.423219  8922 raft_consensus.cc:3055] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:42.423537  8922 raft_consensus.cc:740] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a26c2b0b5b2f447097c60da4958d6d09, State: Running, Role: LEADER
I20260709 12:24:42.424319  8922 consensus_queue.cc:260] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:42.425508  8922 raft_consensus.cc:3060] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.429728  8847 raft_consensus.cc:2468] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 2.
I20260709 12:24:42.431196  8738 leader_election.cc:304] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, 89820c3229e24de18a4254f70b183a6c; no voters: 
I20260709 12:24:42.432046  8998 raft_consensus.cc:2804] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:42.432004  8922 raft_consensus.cc:2468] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 2.
I20260709 12:24:42.432624  8998 raft_consensus.cc:697] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Becoming Leader. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Running, Role: LEADER
I20260709 12:24:42.433457  8998 consensus_queue.cc:237] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:42.441123  8668 catalog_manager.cc:5697] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c reported cstate change: term changed from 1 to 2, leader changed from a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67) to 89820c3229e24de18a4254f70b183a6c (127.8.111.65). New cstate: current_term: 2 leader_uuid: "89820c3229e24de18a4254f70b183a6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.462136  9067 raft_consensus.cc:993] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c: : Instructing follower 0ed8a3294f314f9689ea0d295bd9dfb9 to start an election
I20260709 12:24:42.462597  8998 raft_consensus.cc:1081] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 1 LEADER]: Signalling peer 0ed8a3294f314f9689ea0d295bd9dfb9 to start an election
I20260709 12:24:42.464109  8847 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf2ea80ddaf24514a3ea597b2661ec91"
dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
 from {username='slave'} at 127.0.0.1:39254
I20260709 12:24:42.464813  8847 raft_consensus.cc:493] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:42.465179  8847 raft_consensus.cc:3060] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.470031  8847 raft_consensus.cc:515] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:42.471814  8847 leader_election.cc:290] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 2 election: Requested vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:42.472746  8772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ea80ddaf24514a3ea597b2661ec91" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89820c3229e24de18a4254f70b183a6c"
I20260709 12:24:42.472921  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ea80ddaf24514a3ea597b2661ec91" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:42.473259  8772 raft_consensus.cc:3055] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:42.473505  8922 raft_consensus.cc:3060] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.473621  8772 raft_consensus.cc:740] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Running, Role: LEADER
I20260709 12:24:42.474483  8772 consensus_queue.cc:260] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:42.475385  8772 raft_consensus.cc:3060] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.478932  8922 raft_consensus.cc:2468] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 2.
I20260709 12:24:42.479940  8814 leader_election.cc:304] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, a26c2b0b5b2f447097c60da4958d6d09; no voters: 
I20260709 12:24:42.480289  8772 raft_consensus.cc:2468] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 2.
I20260709 12:24:42.480671  9065 raft_consensus.cc:2804] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:42.481182  9065 raft_consensus.cc:697] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 LEADER]: Becoming Leader. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Running, Role: LEADER
I20260709 12:24:42.482038  9065 consensus_queue.cc:237] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:42.489753  8668 catalog_manager.cc:5697] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 reported cstate change: term changed from 1 to 2, leader changed from 89820c3229e24de18a4254f70b183a6c (127.8.111.65) to 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.558171  9067 raft_consensus.cc:993] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c: : Instructing follower a26c2b0b5b2f447097c60da4958d6d09 to start an election
I20260709 12:24:42.558681  8998 raft_consensus.cc:1081] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Signalling peer a26c2b0b5b2f447097c60da4958d6d09 to start an election
I20260709 12:24:42.560111  8922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c788b9b2b3234316b1652b80ccc1277d"
dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
 from {username='slave'} at 127.0.0.1:46210
I20260709 12:24:42.560628  8922 raft_consensus.cc:493] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:42.560961  8922 raft_consensus.cc:3060] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.565618  8922 raft_consensus.cc:515] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:42.567124  8922 leader_election.cc:290] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 3 election: Requested vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115)
I20260709 12:24:42.568032  8772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788b9b2b3234316b1652b80ccc1277d" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "89820c3229e24de18a4254f70b183a6c"
I20260709 12:24:42.568228  8847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c788b9b2b3234316b1652b80ccc1277d" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
I20260709 12:24:42.568652  8772 raft_consensus.cc:3055] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:42.568703  8847 raft_consensus.cc:3060] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.569087  8772 raft_consensus.cc:740] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Running, Role: LEADER
I20260709 12:24:42.569845  8772 consensus_queue.cc:260] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:42.570922  8772 raft_consensus.cc:3060] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.575289  8847 raft_consensus.cc:2468] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26c2b0b5b2f447097c60da4958d6d09 in term 3.
I20260709 12:24:42.576339  8888 leader_election.cc:304] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, a26c2b0b5b2f447097c60da4958d6d09; no voters: 
I20260709 12:24:42.576718  8772 raft_consensus.cc:2468] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26c2b0b5b2f447097c60da4958d6d09 in term 3.
I20260709 12:24:42.577019  9060 raft_consensus.cc:2804] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:42.577505  9060 raft_consensus.cc:697] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 3 LEADER]: Becoming Leader. State: Replica: a26c2b0b5b2f447097c60da4958d6d09, State: Running, Role: LEADER
I20260709 12:24:42.578362  9060 consensus_queue.cc:237] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:42.584424  8668 catalog_manager.cc:5697] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 reported cstate change: term changed from 2 to 3, leader changed from 89820c3229e24de18a4254f70b183a6c (127.8.111.65) to a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67). New cstate: current_term: 3 leader_uuid: "a26c2b0b5b2f447097c60da4958d6d09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:42.611653  8847 raft_consensus.cc:1275] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Refusing update from remote peer 89820c3229e24de18a4254f70b183a6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:42.612957  8998 consensus_queue.cc:1048] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:42.622689  8922 raft_consensus.cc:1275] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Refusing update from remote peer 89820c3229e24de18a4254f70b183a6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:42.624192  9045 consensus_queue.cc:1048] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:42.737392  8847 raft_consensus.cc:1275] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Refusing update from remote peer 89820c3229e24de18a4254f70b183a6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:42.738731  9045 consensus_queue.cc:1048] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:42.747247  8922 raft_consensus.cc:1275] T 842cb132550246f7b891dd071fa42042 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Refusing update from remote peer 89820c3229e24de18a4254f70b183a6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:42.749011  8998 consensus_queue.cc:1048] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:42.852444  8922 raft_consensus.cc:1275] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Refusing update from remote peer 0ed8a3294f314f9689ea0d295bd9dfb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:42.853574  9065 consensus_queue.cc:1048] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:42.862118  8772 raft_consensus.cc:1275] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Refusing update from remote peer 0ed8a3294f314f9689ea0d295bd9dfb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:42.863716  9079 consensus_queue.cc:1048] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:42.998214  8772 raft_consensus.cc:1275] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Refusing update from remote peer 0ed8a3294f314f9689ea0d295bd9dfb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:42.999434  9079 consensus_queue.cc:1048] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:43.004652  8922 raft_consensus.cc:1275] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Refusing update from remote peer 89820c3229e24de18a4254f70b183a6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:43.006000  9067 consensus_queue.cc:1048] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:43.007764  8922 raft_consensus.cc:1275] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Refusing update from remote peer 0ed8a3294f314f9689ea0d295bd9dfb9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:43.009188  9065 consensus_queue.cc:1048] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:43.019479  8847 raft_consensus.cc:1275] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Refusing update from remote peer a26c2b0b5b2f447097c60da4958d6d09: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:43.021405  9060 consensus_queue.cc:1048] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:43.023428  8847 raft_consensus.cc:1275] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Refusing update from remote peer 89820c3229e24de18a4254f70b183a6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:43.025458  9067 consensus_queue.cc:1048] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:43.034591  8772 raft_consensus.cc:1275] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Refusing update from remote peer a26c2b0b5b2f447097c60da4958d6d09: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:43.036896  9060 consensus_queue.cc:1048] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:45.153338  8637 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:24:45.154035  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:45.169057  8771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c02d26dcde247119ad22f7fb9ad6e42"
dest_uuid: "89820c3229e24de18a4254f70b183a6c"
mode: GRACEFUL
new_leader_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
 from {username='slave'} at 127.0.0.1:40322
I20260709 12:24:45.169570  8771 raft_consensus.cc:606] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 1 LEADER]: Received request to transfer leadership to TS a26c2b0b5b2f447097c60da4958d6d09
I20260709 12:24:45.179797  8847 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf2ea80ddaf24514a3ea597b2661ec91"
dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
mode: GRACEFUL
new_leader_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
 from {username='slave'} at 127.0.0.1:39284
I20260709 12:24:45.180411  8847 raft_consensus.cc:606] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 LEADER]: Received request to transfer leadership to TS a26c2b0b5b2f447097c60da4958d6d09
I20260709 12:24:45.181557  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:45.182029  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:45.486721  8972 raft_consensus.cc:993] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9: : Instructing follower a26c2b0b5b2f447097c60da4958d6d09 to start an election
I20260709 12:24:45.487151  9095 raft_consensus.cc:1081] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 LEADER]: Signalling peer a26c2b0b5b2f447097c60da4958d6d09 to start an election
I20260709 12:24:45.488641  8922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf2ea80ddaf24514a3ea597b2661ec91"
dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
 from {username='slave'} at 127.0.0.1:46196
I20260709 12:24:45.489154  8922 raft_consensus.cc:493] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:45.489490  8922 raft_consensus.cc:3060] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:45.494458  8922 raft_consensus.cc:515] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:45.495731  8922 leader_election.cc:290] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 3 election: Requested vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115)
I20260709 12:24:45.496459  8771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ea80ddaf24514a3ea597b2661ec91" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89820c3229e24de18a4254f70b183a6c"
I20260709 12:24:45.496632  8847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ea80ddaf24514a3ea597b2661ec91" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
I20260709 12:24:45.497084  8771 raft_consensus.cc:3060] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:45.497126  8847 raft_consensus.cc:3055] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:45.497529  8847 raft_consensus.cc:740] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Running, Role: LEADER
I20260709 12:24:45.498131  8847 consensus_queue.cc:260] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:45.498943  8847 raft_consensus.cc:3060] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:45.501945  8771 raft_consensus.cc:2468] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26c2b0b5b2f447097c60da4958d6d09 in term 3.
I20260709 12:24:45.503207  8886 leader_election.cc:304] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89820c3229e24de18a4254f70b183a6c, a26c2b0b5b2f447097c60da4958d6d09; no voters: 
I20260709 12:24:45.504007  8847 raft_consensus.cc:2468] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26c2b0b5b2f447097c60da4958d6d09 in term 3.
I20260709 12:24:45.504240  9091 raft_consensus.cc:2804] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:45.505615  9091 raft_consensus.cc:697] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 LEADER]: Becoming Leader. State: Replica: a26c2b0b5b2f447097c60da4958d6d09, State: Running, Role: LEADER
I20260709 12:24:45.506551  9091 consensus_queue.cc:237] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:45.513202  8668 catalog_manager.cc:5697] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 reported cstate change: term changed from 2 to 3, leader changed from 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66) to a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67). New cstate: current_term: 3 leader_uuid: "a26c2b0b5b2f447097c60da4958d6d09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.532485  9102 raft_consensus.cc:993] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c: : Instructing follower a26c2b0b5b2f447097c60da4958d6d09 to start an election
I20260709 12:24:45.532931  9102 raft_consensus.cc:1081] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 1 LEADER]: Signalling peer a26c2b0b5b2f447097c60da4958d6d09 to start an election
I20260709 12:24:45.534436  8922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c02d26dcde247119ad22f7fb9ad6e42"
dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
 from {username='slave'} at 127.0.0.1:46210
I20260709 12:24:45.534893  8922 raft_consensus.cc:493] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:45.535195  8922 raft_consensus.cc:3060] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:45.539104  8922 raft_consensus.cc:515] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:45.540442  8922 leader_election.cc:290] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 2 election: Requested vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115)
I20260709 12:24:45.541296  8771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c02d26dcde247119ad22f7fb9ad6e42" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89820c3229e24de18a4254f70b183a6c"
I20260709 12:24:45.541446  8847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c02d26dcde247119ad22f7fb9ad6e42" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
I20260709 12:24:45.541795  8771 raft_consensus.cc:3055] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:45.541941  8847 raft_consensus.cc:3060] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:45.542136  8771 raft_consensus.cc:740] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Running, Role: LEADER
I20260709 12:24:45.542847  8771 consensus_queue.cc:260] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:45.543795  8771 raft_consensus.cc:3060] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:45.546087  8847 raft_consensus.cc:2468] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26c2b0b5b2f447097c60da4958d6d09 in term 2.
I20260709 12:24:45.546976  8888 leader_election.cc:304] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, a26c2b0b5b2f447097c60da4958d6d09; no voters: 
I20260709 12:24:45.547621  9091 raft_consensus.cc:2804] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:45.548084  9091 raft_consensus.cc:697] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 LEADER]: Becoming Leader. State: Replica: a26c2b0b5b2f447097c60da4958d6d09, State: Running, Role: LEADER
I20260709 12:24:45.548842  8771 raft_consensus.cc:2468] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26c2b0b5b2f447097c60da4958d6d09 in term 2.
I20260709 12:24:45.548884  9091 consensus_queue.cc:237] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:45.556069  8668 catalog_manager.cc:5697] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 reported cstate change: term changed from 1 to 2, leader changed from 89820c3229e24de18a4254f70b183a6c (127.8.111.65) to a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67). New cstate: current_term: 2 leader_uuid: "a26c2b0b5b2f447097c60da4958d6d09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.981185  8771 raft_consensus.cc:1275] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Refusing update from remote peer a26c2b0b5b2f447097c60da4958d6d09: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:45.982323  9091 consensus_queue.cc:1048] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:45.993378  8847 raft_consensus.cc:1275] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Refusing update from remote peer a26c2b0b5b2f447097c60da4958d6d09: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:45.994637  9106 consensus_queue.cc:1048] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:46.073557  8771 raft_consensus.cc:1275] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Refusing update from remote peer a26c2b0b5b2f447097c60da4958d6d09: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:46.074816  9106 consensus_queue.cc:1048] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:46.084896  8847 raft_consensus.cc:1275] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Refusing update from remote peer a26c2b0b5b2f447097c60da4958d6d09: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:46.086575  9096 consensus_queue.cc:1048] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:46.183030  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:46.187805  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:46.188190  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:47.189312  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:47.194562  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:47.194984  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:48.195930  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:48.200623  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:48.201052  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:49.201992  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:49.206913  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:49.207338  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:50.208443  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:50.216723  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:50.217293  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:51.218253  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:51.222864  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:51.223225  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:52.224232  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:52.229568  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:52.229951  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:53.230821  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:53.235556  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:53.235984  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:54.237016  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:54.242656  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:54.243129  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:55.270089  8637 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:24:55.275558  8771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "842cb132550246f7b891dd071fa42042"
dest_uuid: "89820c3229e24de18a4254f70b183a6c"
mode: GRACEFUL
new_leader_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
 from {username='slave'} at 127.0.0.1:40308
I20260709 12:24:55.276247  8771 raft_consensus.cc:606] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Received request to transfer leadership to TS 0ed8a3294f314f9689ea0d295bd9dfb9
I20260709 12:24:55.281209  8922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c02d26dcde247119ad22f7fb9ad6e42"
dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
mode: GRACEFUL
new_leader_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
 from {username='slave'} at 127.0.0.1:46222
I20260709 12:24:55.281589  8922 raft_consensus.cc:606] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 LEADER]: Received request to transfer leadership to TS 0ed8a3294f314f9689ea0d295bd9dfb9
I20260709 12:24:55.286110  8771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7223e8d80a649bea80c3b438c3af4a1"
dest_uuid: "89820c3229e24de18a4254f70b183a6c"
mode: GRACEFUL
new_leader_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
 from {username='slave'} at 127.0.0.1:40308
I20260709 12:24:55.286556  8771 raft_consensus.cc:606] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Received request to transfer leadership to TS 0ed8a3294f314f9689ea0d295bd9dfb9
I20260709 12:24:55.291016  8771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d67731beaedd47a89b0ee7737f9083e6"
dest_uuid: "89820c3229e24de18a4254f70b183a6c"
mode: GRACEFUL
new_leader_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
 from {username='slave'} at 127.0.0.1:40308
I20260709 12:24:55.291536  8771 raft_consensus.cc:606] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Received request to transfer leadership to TS 0ed8a3294f314f9689ea0d295bd9dfb9
I20260709 12:24:55.299389  8922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf2ea80ddaf24514a3ea597b2661ec91"
dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
mode: GRACEFUL
new_leader_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
 from {username='slave'} at 127.0.0.1:46222
I20260709 12:24:55.300027  8922 raft_consensus.cc:606] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 LEADER]: Received request to transfer leadership to TS 0ed8a3294f314f9689ea0d295bd9dfb9
I20260709 12:24:55.386526  9091 raft_consensus.cc:993] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09: : Instructing follower 0ed8a3294f314f9689ea0d295bd9dfb9 to start an election
I20260709 12:24:55.386952  9091 raft_consensus.cc:1081] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 LEADER]: Signalling peer 0ed8a3294f314f9689ea0d295bd9dfb9 to start an election
I20260709 12:24:55.388351  8846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf2ea80ddaf24514a3ea597b2661ec91"
dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
 from {username='slave'} at 127.0.0.1:39258
I20260709 12:24:55.388854  8846 raft_consensus.cc:493] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:55.389214  8846 raft_consensus.cc:3060] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:55.394167  8846 raft_consensus.cc:515] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:55.396595  8846 leader_election.cc:290] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 4 election: Requested vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:55.397562  8771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ea80ddaf24514a3ea597b2661ec91" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "89820c3229e24de18a4254f70b183a6c"
I20260709 12:24:55.397737  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ea80ddaf24514a3ea597b2661ec91" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:55.398331  8771 raft_consensus.cc:3060] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:55.398376  8922 raft_consensus.cc:3055] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:55.398758  8922 raft_consensus.cc:740] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a26c2b0b5b2f447097c60da4958d6d09, State: Running, Role: LEADER
I20260709 12:24:55.399453  8922 consensus_queue.cc:260] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:55.400386  8922 raft_consensus.cc:3060] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:55.403193  8771 raft_consensus.cc:2468] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 4.
I20260709 12:24:55.404359  8812 leader_election.cc:304] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, 89820c3229e24de18a4254f70b183a6c; no voters: 
I20260709 12:24:55.404763  8922 raft_consensus.cc:2468] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 4.
I20260709 12:24:55.405279  9115 raft_consensus.cc:2804] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:55.406342  9115 raft_consensus.cc:697] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 4 LEADER]: Becoming Leader. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Running, Role: LEADER
I20260709 12:24:55.407173  9115 consensus_queue.cc:237] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:55.414149  8668 catalog_manager.cc:5697] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 reported cstate change: term changed from 3 to 4, leader changed from a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67) to 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66). New cstate: current_term: 4 leader_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.498121  9116 raft_consensus.cc:993] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09: : Instructing follower 0ed8a3294f314f9689ea0d295bd9dfb9 to start an election
I20260709 12:24:55.498574  9091 raft_consensus.cc:1081] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 LEADER]: Signalling peer 0ed8a3294f314f9689ea0d295bd9dfb9 to start an election
I20260709 12:24:55.499781  8846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c02d26dcde247119ad22f7fb9ad6e42"
dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
 from {username='slave'} at 127.0.0.1:39258
I20260709 12:24:55.500253  8846 raft_consensus.cc:493] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:55.500546  8846 raft_consensus.cc:3060] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:55.505012  8846 raft_consensus.cc:515] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:55.506471  8846 leader_election.cc:290] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 3 election: Requested vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:55.507263  8771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c02d26dcde247119ad22f7fb9ad6e42" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89820c3229e24de18a4254f70b183a6c"
I20260709 12:24:55.507412  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c02d26dcde247119ad22f7fb9ad6e42" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:55.507839  8771 raft_consensus.cc:3060] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:55.507879  8922 raft_consensus.cc:3055] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:55.508249  8922 raft_consensus.cc:740] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a26c2b0b5b2f447097c60da4958d6d09, State: Running, Role: LEADER
I20260709 12:24:55.508765  8922 consensus_queue.cc:260] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:55.509573  8922 raft_consensus.cc:3060] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:55.512969  8771 raft_consensus.cc:2468] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 3.
I20260709 12:24:55.514132  8812 leader_election.cc:304] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, 89820c3229e24de18a4254f70b183a6c; no voters: 
I20260709 12:24:55.514324  8922 raft_consensus.cc:2468] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 3.
I20260709 12:24:55.515173  9117 raft_consensus.cc:2804] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:55.515640  9117 raft_consensus.cc:697] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 LEADER]: Becoming Leader. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Running, Role: LEADER
I20260709 12:24:55.516426  9117 consensus_queue.cc:237] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:55.522854  8668 catalog_manager.cc:5697] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 reported cstate change: term changed from 2 to 3, leader changed from a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67) to 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66). New cstate: current_term: 3 leader_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.563534  8998 raft_consensus.cc:993] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c: : Instructing follower 0ed8a3294f314f9689ea0d295bd9dfb9 to start an election
I20260709 12:24:55.563917  8998 raft_consensus.cc:1081] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Signalling peer 0ed8a3294f314f9689ea0d295bd9dfb9 to start an election
I20260709 12:24:55.565567  8846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7223e8d80a649bea80c3b438c3af4a1"
dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
 from {username='slave'} at 127.0.0.1:39254
I20260709 12:24:55.566046  8846 raft_consensus.cc:493] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:55.566387  8846 raft_consensus.cc:3060] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:55.570178  8846 raft_consensus.cc:515] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:55.571659  8846 leader_election.cc:290] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 3 election: Requested vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:55.572429  8771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7223e8d80a649bea80c3b438c3af4a1" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89820c3229e24de18a4254f70b183a6c"
I20260709 12:24:55.572645  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7223e8d80a649bea80c3b438c3af4a1" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:55.573115  8771 raft_consensus.cc:3055] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:55.573206  8922 raft_consensus.cc:3060] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:55.573494  8771 raft_consensus.cc:740] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Running, Role: LEADER
I20260709 12:24:55.574432  8771 consensus_queue.cc:260] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:55.575742  8771 raft_consensus.cc:3060] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:55.577527  8922 raft_consensus.cc:2468] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 3.
I20260709 12:24:55.578665  8814 leader_election.cc:304] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, a26c2b0b5b2f447097c60da4958d6d09; no voters: 
I20260709 12:24:55.579396  9117 raft_consensus.cc:2804] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:55.579902  9117 raft_consensus.cc:697] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 LEADER]: Becoming Leader. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Running, Role: LEADER
I20260709 12:24:55.580950  9117 consensus_queue.cc:237] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:55.582726  8771 raft_consensus.cc:2468] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 3.
I20260709 12:24:55.583973  9124 raft_consensus.cc:993] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c: : Instructing follower 0ed8a3294f314f9689ea0d295bd9dfb9 to start an election
I20260709 12:24:55.584452  8998 raft_consensus.cc:1081] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Signalling peer 0ed8a3294f314f9689ea0d295bd9dfb9 to start an election
I20260709 12:24:55.585861  8846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d67731beaedd47a89b0ee7737f9083e6"
dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
 from {username='slave'} at 127.0.0.1:39254
I20260709 12:24:55.586352  8846 raft_consensus.cc:493] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:55.586679  8846 raft_consensus.cc:3060] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:55.591558  8668 catalog_manager.cc:5697] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 reported cstate change: term changed from 2 to 3, leader changed from 89820c3229e24de18a4254f70b183a6c (127.8.111.65) to 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66). New cstate: current_term: 3 leader_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.591900  8846 raft_consensus.cc:515] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:55.593710  8846 leader_election.cc:290] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 3 election: Requested vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:55.594730  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67731beaedd47a89b0ee7737f9083e6" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:55.594718  8771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67731beaedd47a89b0ee7737f9083e6" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89820c3229e24de18a4254f70b183a6c"
I20260709 12:24:55.595361  8922 raft_consensus.cc:3060] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:55.595677  8771 raft_consensus.cc:3055] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:55.596006  8771 raft_consensus.cc:740] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Running, Role: LEADER
I20260709 12:24:55.596755  8771 consensus_queue.cc:260] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:55.597693  8771 raft_consensus.cc:3060] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:55.601166  8922 raft_consensus.cc:2468] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 3.
I20260709 12:24:55.602180  8814 leader_election.cc:304] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, a26c2b0b5b2f447097c60da4958d6d09; no voters: 
I20260709 12:24:55.603015  9117 raft_consensus.cc:2804] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:55.603080  8771 raft_consensus.cc:2468] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 3.
I20260709 12:24:55.603582  9117 raft_consensus.cc:697] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 LEADER]: Becoming Leader. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Running, Role: LEADER
I20260709 12:24:55.604744  9117 consensus_queue.cc:237] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:55.610932  8668 catalog_manager.cc:5697] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 reported cstate change: term changed from 2 to 3, leader changed from 89820c3229e24de18a4254f70b183a6c (127.8.111.65) to 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66). New cstate: current_term: 3 leader_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.639364  9124 raft_consensus.cc:993] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c: : Instructing follower 0ed8a3294f314f9689ea0d295bd9dfb9 to start an election
I20260709 12:24:55.639817  8998 raft_consensus.cc:1081] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Signalling peer 0ed8a3294f314f9689ea0d295bd9dfb9 to start an election
I20260709 12:24:55.641187  8846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "842cb132550246f7b891dd071fa42042"
dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
 from {username='slave'} at 127.0.0.1:39254
I20260709 12:24:55.641630  8846 raft_consensus.cc:493] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:55.641892  8846 raft_consensus.cc:3060] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:55.646351  8846 raft_consensus.cc:515] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } }
I20260709 12:24:55.647770  8846 leader_election.cc:290] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 3 election: Requested vote from peers a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919), 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607)
I20260709 12:24:55.648645  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842cb132550246f7b891dd071fa42042" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:55.648741  8771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "842cb132550246f7b891dd071fa42042" candidate_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89820c3229e24de18a4254f70b183a6c"
I20260709 12:24:55.649120  8922 raft_consensus.cc:3060] T 842cb132550246f7b891dd071fa42042 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:55.649299  8771 raft_consensus.cc:3055] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:55.649688  8771 raft_consensus.cc:740] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Running, Role: LEADER
I20260709 12:24:55.650399  8771 consensus_queue.cc:260] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } }
I20260709 12:24:55.651262  8771 raft_consensus.cc:3060] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:55.653283  8922 raft_consensus.cc:2468] T 842cb132550246f7b891dd071fa42042 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 3.
I20260709 12:24:55.654160  8814 leader_election.cc:304] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, a26c2b0b5b2f447097c60da4958d6d09; no voters: 
I20260709 12:24:55.655033  9117 raft_consensus.cc:2804] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:55.655469  9117 raft_consensus.cc:697] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 LEADER]: Becoming Leader. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Running, Role: LEADER
I20260709 12:24:55.656272  8771 raft_consensus.cc:2468] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ed8a3294f314f9689ea0d295bd9dfb9 in term 3.
I20260709 12:24:55.656299  9117 consensus_queue.cc:237] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } }
I20260709 12:24:55.662549  8668 catalog_manager.cc:5697] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 reported cstate change: term changed from 2 to 3, leader changed from 89820c3229e24de18a4254f70b183a6c (127.8.111.65) to 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66). New cstate: current_term: 3 leader_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.906901  8922 raft_consensus.cc:1275] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 4 FOLLOWER]: Refusing update from remote peer 0ed8a3294f314f9689ea0d295bd9dfb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:55.908007  9117 consensus_queue.cc:1048] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:55.914562  8771 raft_consensus.cc:1275] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 4 FOLLOWER]: Refusing update from remote peer 0ed8a3294f314f9689ea0d295bd9dfb9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:55.918176  8920 raft_consensus.cc:1275] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Refusing update from remote peer 0ed8a3294f314f9689ea0d295bd9dfb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:55.918637  9130 consensus_queue.cc:1048] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:55.920981  9130 consensus_queue.cc:1048] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:55.941833  8772 raft_consensus.cc:1275] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Refusing update from remote peer 0ed8a3294f314f9689ea0d295bd9dfb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:55.943337  9117 consensus_queue.cc:1048] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:24:55.989367  8771 raft_consensus.cc:1275] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Refusing update from remote peer 0ed8a3294f314f9689ea0d295bd9dfb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:55.990499  9117 consensus_queue.cc:1048] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:55.998947  8920 raft_consensus.cc:1275] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Refusing update from remote peer 0ed8a3294f314f9689ea0d295bd9dfb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:56.000401  9115 consensus_queue.cc:1048] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:56.058818  8771 raft_consensus.cc:1275] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Refusing update from remote peer 0ed8a3294f314f9689ea0d295bd9dfb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:56.059960  9115 consensus_queue.cc:1048] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:56.064383  8920 raft_consensus.cc:1275] T 842cb132550246f7b891dd071fa42042 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Refusing update from remote peer 0ed8a3294f314f9689ea0d295bd9dfb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:56.065677  9131 consensus_queue.cc:1048] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:56.070034  8922 raft_consensus.cc:1275] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Refusing update from remote peer 0ed8a3294f314f9689ea0d295bd9dfb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:56.071388  9117 consensus_queue.cc:1048] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:56.079274  8771 raft_consensus.cc:1275] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Refusing update from remote peer 0ed8a3294f314f9689ea0d295bd9dfb9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:56.080792  9130 consensus_queue.cc:1048] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:58.338114  8637 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:24:58.338925  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:58.345649  8846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c02d26dcde247119ad22f7fb9ad6e42"
dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
mode: GRACEFUL
new_leader_uuid: "89820c3229e24de18a4254f70b183a6c"
 from {username='slave'} at 127.0.0.1:39284
I20260709 12:24:58.346235  8846 raft_consensus.cc:606] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 LEADER]: Received request to transfer leadership to TS 89820c3229e24de18a4254f70b183a6c
I20260709 12:24:58.348614  8846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad68501f591d446f953f4f1f07b6ba45"
dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
mode: GRACEFUL
new_leader_uuid: "89820c3229e24de18a4254f70b183a6c"
 from {username='slave'} at 127.0.0.1:39284
I20260709 12:24:58.349045  8846 raft_consensus.cc:606] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 LEADER]: Received request to transfer leadership to TS 89820c3229e24de18a4254f70b183a6c
I20260709 12:24:58.351378  8846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf2ea80ddaf24514a3ea597b2661ec91"
dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
mode: GRACEFUL
new_leader_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
 from {username='slave'} at 127.0.0.1:39284
I20260709 12:24:58.351800  8846 raft_consensus.cc:606] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 4 LEADER]: Received request to transfer leadership to TS a26c2b0b5b2f447097c60da4958d6d09
I20260709 12:24:58.353905  8846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d67731beaedd47a89b0ee7737f9083e6"
dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
mode: GRACEFUL
new_leader_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
 from {username='slave'} at 127.0.0.1:39284
I20260709 12:24:58.354341  8846 raft_consensus.cc:606] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 LEADER]: Received request to transfer leadership to TS a26c2b0b5b2f447097c60da4958d6d09
I20260709 12:24:58.356382  8846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e4a57ce90459497cb623214481efe782"
dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
mode: GRACEFUL
new_leader_uuid: "89820c3229e24de18a4254f70b183a6c"
 from {username='slave'} at 127.0.0.1:39284
I20260709 12:24:58.356773  8846 raft_consensus.cc:606] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 LEADER]: Received request to transfer leadership to TS 89820c3229e24de18a4254f70b183a6c
I20260709 12:24:58.357744  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:58.358193  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:58.367478  9115 raft_consensus.cc:993] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9: : Instructing follower 89820c3229e24de18a4254f70b183a6c to start an election
I20260709 12:24:58.368002  9130 raft_consensus.cc:1081] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 LEADER]: Signalling peer 89820c3229e24de18a4254f70b183a6c to start an election
I20260709 12:24:58.369374  8771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad68501f591d446f953f4f1f07b6ba45"
dest_uuid: "89820c3229e24de18a4254f70b183a6c"
 from {username='slave'} at 127.0.0.1:40294
I20260709 12:24:58.369812  8771 raft_consensus.cc:493] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:58.370118  8771 raft_consensus.cc:3060] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:58.374737  8771 raft_consensus.cc:515] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:58.377553  8771 leader_election.cc:290] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 2 election: Requested vote from peers 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:58.378368  8846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad68501f591d446f953f4f1f07b6ba45" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
I20260709 12:24:58.378806  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad68501f591d446f953f4f1f07b6ba45" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:58.379091  8846 raft_consensus.cc:3055] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:58.379309  8922 raft_consensus.cc:3060] T ad68501f591d446f953f4f1f07b6ba45 P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:58.379433  8846 raft_consensus.cc:740] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Running, Role: LEADER
I20260709 12:24:58.380299  8846 consensus_queue.cc:260] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:58.381512  8846 raft_consensus.cc:3060] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:58.385337  8922 raft_consensus.cc:2468] T ad68501f591d446f953f4f1f07b6ba45 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 2.
I20260709 12:24:58.386443  8738 leader_election.cc:304] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89820c3229e24de18a4254f70b183a6c, a26c2b0b5b2f447097c60da4958d6d09; no voters: 
I20260709 12:24:58.387143  8846 raft_consensus.cc:2468] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 2.
I20260709 12:24:58.388036  9144 raft_consensus.cc:2804] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:58.388844  9144 raft_consensus.cc:697] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Becoming Leader. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Running, Role: LEADER
I20260709 12:24:58.389581  9144 consensus_queue.cc:237] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:58.395486  8665 catalog_manager.cc:5697] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c reported cstate change: term changed from 1 to 2, leader changed from 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66) to 89820c3229e24de18a4254f70b183a6c (127.8.111.65). New cstate: current_term: 2 leader_uuid: "89820c3229e24de18a4254f70b183a6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:58.443562  9130 raft_consensus.cc:993] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9: : Instructing follower 89820c3229e24de18a4254f70b183a6c to start an election
I20260709 12:24:58.444097  9115 raft_consensus.cc:1081] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 LEADER]: Signalling peer 89820c3229e24de18a4254f70b183a6c to start an election
I20260709 12:24:58.445490  8771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c02d26dcde247119ad22f7fb9ad6e42"
dest_uuid: "89820c3229e24de18a4254f70b183a6c"
 from {username='slave'} at 127.0.0.1:40294
I20260709 12:24:58.446036  8771 raft_consensus.cc:493] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:58.446342  8771 raft_consensus.cc:3060] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.450479  8771 raft_consensus.cc:515] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:58.452051  8771 leader_election.cc:290] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 4 election: Requested vote from peers 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:58.452663  8846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c02d26dcde247119ad22f7fb9ad6e42" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
I20260709 12:24:58.452994  8922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c02d26dcde247119ad22f7fb9ad6e42" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:58.453204  8846 raft_consensus.cc:3055] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:58.453486  9130 raft_consensus.cc:993] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9: : Instructing follower a26c2b0b5b2f447097c60da4958d6d09 to start an election
I20260709 12:24:58.453534  8846 raft_consensus.cc:740] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Running, Role: LEADER
I20260709 12:24:58.453509  8922 raft_consensus.cc:3060] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.454094  9130 raft_consensus.cc:1081] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 LEADER]: Signalling peer a26c2b0b5b2f447097c60da4958d6d09 to start an election
I20260709 12:24:58.454510  8846 consensus_queue.cc:260] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:58.455646  8846 raft_consensus.cc:3060] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.455749  8920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d67731beaedd47a89b0ee7737f9083e6"
dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
 from {username='slave'} at 127.0.0.1:46196
I20260709 12:24:58.456277  8920 raft_consensus.cc:493] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:58.456606  8920 raft_consensus.cc:3060] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.459714  8846 raft_consensus.cc:2468] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 4.
I20260709 12:24:58.459949  8922 raft_consensus.cc:2468] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 4.
I20260709 12:24:58.460628  8738 leader_election.cc:304] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ed8a3294f314f9689ea0d295bd9dfb9, 89820c3229e24de18a4254f70b183a6c; no voters: 
I20260709 12:24:58.461403  9144 raft_consensus.cc:2804] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:58.461903  9144 raft_consensus.cc:697] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 4 LEADER]: Becoming Leader. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Running, Role: LEADER
I20260709 12:24:58.462724  9144 consensus_queue.cc:237] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:58.463107  8920 raft_consensus.cc:515] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:58.465332  8920 leader_election.cc:290] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 4 election: Requested vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115)
I20260709 12:24:58.466480  8771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67731beaedd47a89b0ee7737f9083e6" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "89820c3229e24de18a4254f70b183a6c"
I20260709 12:24:58.467132  8771 raft_consensus.cc:3060] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.470685  8846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d67731beaedd47a89b0ee7737f9083e6" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
I20260709 12:24:58.471146  8846 raft_consensus.cc:3055] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:58.471509  8846 raft_consensus.cc:740] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Running, Role: LEADER
I20260709 12:24:58.471100  8665 catalog_manager.cc:5697] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c reported cstate change: term changed from 3 to 4, leader changed from 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66) to 89820c3229e24de18a4254f70b183a6c (127.8.111.65). New cstate: current_term: 4 leader_uuid: "89820c3229e24de18a4254f70b183a6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:58.472267  8846 consensus_queue.cc:260] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:58.472744  8771 raft_consensus.cc:2468] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26c2b0b5b2f447097c60da4958d6d09 in term 4.
I20260709 12:24:58.473129  8846 raft_consensus.cc:3060] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.473949  8886 leader_election.cc:304] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89820c3229e24de18a4254f70b183a6c, a26c2b0b5b2f447097c60da4958d6d09; no voters: 
I20260709 12:24:58.474805  9091 raft_consensus.cc:2804] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:58.478870  8846 raft_consensus.cc:2468] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26c2b0b5b2f447097c60da4958d6d09 in term 4.
I20260709 12:24:58.479636  9091 raft_consensus.cc:697] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 4 LEADER]: Becoming Leader. State: Replica: a26c2b0b5b2f447097c60da4958d6d09, State: Running, Role: LEADER
I20260709 12:24:58.480497  9091 consensus_queue.cc:237] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:58.487241  8665 catalog_manager.cc:5697] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 reported cstate change: term changed from 3 to 4, leader changed from 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66) to a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67). New cstate: current_term: 4 leader_uuid: "a26c2b0b5b2f447097c60da4958d6d09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:58.859123  9130 raft_consensus.cc:993] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9: : Instructing follower a26c2b0b5b2f447097c60da4958d6d09 to start an election
I20260709 12:24:58.859637  9115 raft_consensus.cc:1081] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 4 LEADER]: Signalling peer a26c2b0b5b2f447097c60da4958d6d09 to start an election
I20260709 12:24:58.860553  8920 raft_consensus.cc:1275] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 4 FOLLOWER]: Refusing update from remote peer 89820c3229e24de18a4254f70b183a6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:58.860970  8922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf2ea80ddaf24514a3ea597b2661ec91"
dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
 from {username='slave'} at 127.0.0.1:46196
I20260709 12:24:58.861449  8922 raft_consensus.cc:493] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:58.861732  8922 raft_consensus.cc:3060] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:58.861711  9144 consensus_queue.cc:1048] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:58.867314  8922 raft_consensus.cc:515] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:58.869925  8771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ea80ddaf24514a3ea597b2661ec91" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "89820c3229e24de18a4254f70b183a6c"
I20260709 12:24:58.870965  8771 raft_consensus.cc:3060] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:58.875695  8846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ea80ddaf24514a3ea597b2661ec91" candidate_uuid: "a26c2b0b5b2f447097c60da4958d6d09" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
I20260709 12:24:58.876446  8846 raft_consensus.cc:3055] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:58.876896  8846 raft_consensus.cc:740] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Running, Role: LEADER
I20260709 12:24:58.877808  8846 consensus_queue.cc:260] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:58.879848  8771 raft_consensus.cc:2468] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26c2b0b5b2f447097c60da4958d6d09 in term 5.
I20260709 12:24:58.881145  8772 raft_consensus.cc:1275] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 4 FOLLOWER]: Refusing update from remote peer a26c2b0b5b2f447097c60da4958d6d09: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:58.882480  8886 leader_election.cc:304] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89820c3229e24de18a4254f70b183a6c, a26c2b0b5b2f447097c60da4958d6d09; no voters: 
I20260709 12:24:58.883002  8846 raft_consensus.cc:3060] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:58.883189  9091 raft_consensus.cc:2804] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:58.884279  9152 consensus_queue.cc:1048] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:58.884882  8922 leader_election.cc:290] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [CANDIDATE]: Term 5 election: Requested vote from peers 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607), 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115)
I20260709 12:24:58.886752  8847 raft_consensus.cc:1275] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 4 FOLLOWER]: Refusing update from remote peer 89820c3229e24de18a4254f70b183a6c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:58.886826  9091 raft_consensus.cc:697] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 5 LEADER]: Becoming Leader. State: Replica: a26c2b0b5b2f447097c60da4958d6d09, State: Running, Role: LEADER
I20260709 12:24:58.887693  9091 consensus_queue.cc:237] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:58.891371  9145 consensus_queue.cc:1048] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:58.898319  8669 catalog_manager.cc:5697] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 reported cstate change: term changed from 4 to 5, leader changed from 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66) to a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67). New cstate: current_term: 5 leader_uuid: "a26c2b0b5b2f447097c60da4958d6d09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:58.905612  8846 raft_consensus.cc:2468] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a26c2b0b5b2f447097c60da4958d6d09 in term 5.
I20260709 12:24:58.909209  8847 raft_consensus.cc:1275] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 4 FOLLOWER]: Refusing update from remote peer a26c2b0b5b2f447097c60da4958d6d09: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:58.910944  9091 consensus_queue.cc:1048] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:58.937811  9130 raft_consensus.cc:993] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9: : Instructing follower 89820c3229e24de18a4254f70b183a6c to start an election
I20260709 12:24:58.938241  9115 raft_consensus.cc:1081] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 LEADER]: Signalling peer 89820c3229e24de18a4254f70b183a6c to start an election
I20260709 12:24:58.939502  8772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e4a57ce90459497cb623214481efe782"
dest_uuid: "89820c3229e24de18a4254f70b183a6c"
 from {username='slave'} at 127.0.0.1:40294
I20260709 12:24:58.940001  8772 raft_consensus.cc:493] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:58.940305  8772 raft_consensus.cc:3060] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:58.944635  8772 raft_consensus.cc:515] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:58.946090  8772 leader_election.cc:290] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 3 election: Requested vote from peers 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66:44115), a26c2b0b5b2f447097c60da4958d6d09 (127.8.111.67:35919)
I20260709 12:24:58.946767  8847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a57ce90459497cb623214481efe782" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9"
I20260709 12:24:58.947077  8920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4a57ce90459497cb623214481efe782" candidate_uuid: "89820c3229e24de18a4254f70b183a6c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a26c2b0b5b2f447097c60da4958d6d09"
I20260709 12:24:58.947319  8847 raft_consensus.cc:3055] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:58.947633  8847 raft_consensus.cc:740] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ed8a3294f314f9689ea0d295bd9dfb9, State: Running, Role: LEADER
I20260709 12:24:58.947641  8920 raft_consensus.cc:3060] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:58.948285  8847 consensus_queue.cc:260] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:58.949142  8847 raft_consensus.cc:3060] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:58.952311  8920 raft_consensus.cc:2468] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 3.
I20260709 12:24:58.953155  8738 leader_election.cc:304] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89820c3229e24de18a4254f70b183a6c, a26c2b0b5b2f447097c60da4958d6d09; no voters: 
I20260709 12:24:58.953261  8847 raft_consensus.cc:2468] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89820c3229e24de18a4254f70b183a6c in term 3.
I20260709 12:24:58.953840  9145 raft_consensus.cc:2804] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:58.954322  9145 raft_consensus.cc:697] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 3 LEADER]: Becoming Leader. State: Replica: 89820c3229e24de18a4254f70b183a6c, State: Running, Role: LEADER
I20260709 12:24:58.955204  9145 consensus_queue.cc:237] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } }
I20260709 12:24:58.961764  8668 catalog_manager.cc:5697] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c reported cstate change: term changed from 2 to 3, leader changed from 0ed8a3294f314f9689ea0d295bd9dfb9 (127.8.111.66) to 89820c3229e24de18a4254f70b183a6c (127.8.111.65). New cstate: current_term: 3 leader_uuid: "89820c3229e24de18a4254f70b183a6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:58.977403  8920 raft_consensus.cc:1275] T ad68501f591d446f953f4f1f07b6ba45 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Refusing update from remote peer 89820c3229e24de18a4254f70b183a6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.978690  9145 consensus_queue.cc:1048] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.981863  8847 raft_consensus.cc:1275] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Refusing update from remote peer 89820c3229e24de18a4254f70b183a6c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.983115  9145 consensus_queue.cc:1048] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:59.288967  8847 raft_consensus.cc:1275] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 5 FOLLOWER]: Refusing update from remote peer a26c2b0b5b2f447097c60da4958d6d09: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:59.290035  9152 consensus_queue.cc:1048] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:59.298614  8772 raft_consensus.cc:1275] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 5 FOLLOWER]: Refusing update from remote peer a26c2b0b5b2f447097c60da4958d6d09: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:59.300326  9091 consensus_queue.cc:1048] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89820c3229e24de18a4254f70b183a6c" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 45607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:59.359354  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:59.364415  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:24:59.364842  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:59.386927  8847 raft_consensus.cc:1275] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Refusing update from remote peer 89820c3229e24de18a4254f70b183a6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:59.388206  9166 consensus_queue.cc:1048] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ed8a3294f314f9689ea0d295bd9dfb9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 44115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:59.396605  8920 raft_consensus.cc:1275] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Refusing update from remote peer 89820c3229e24de18a4254f70b183a6c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:59.398389  9145 consensus_queue.cc:1048] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26c2b0b5b2f447097c60da4958d6d09" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 35919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:00.365828  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:00.370491  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:00.370838  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:01.371766  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:01.377254  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:01.377602  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:02.378641  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:02.383643  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:02.384037  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:03.385092  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:03.390830  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:03.391466  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:04.392449  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:04.397213  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:04.397588  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:05.398568  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:05.403321  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:05.403725  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:06.404738  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:06.409489  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:06.409897  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:07.411242  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:07.417009  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:07.417557  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:08.448604  8637 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:25:08.449203  8637 tablet_server.cc:179] TabletServer@127.8.111.65:0 shutting down...
W20260709 12:25:08.469830  8886 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:25:08.475572  8886 consensus_peers.cc:597] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 -> Peer 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607): Couldn't send request to peer 89820c3229e24de18a4254f70b183a6c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:08.481568  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:08.482267  8637 tablet_replica.cc:333] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c: stopping tablet replica
I20260709 12:25:08.483029  8637 raft_consensus.cc:2243] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.483628  8637 raft_consensus.cc:2272] T d67731beaedd47a89b0ee7737f9083e6 P 89820c3229e24de18a4254f70b183a6c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.485808  8637 tablet_replica.cc:333] T 911b2f05169e49379263206730564c6e P 89820c3229e24de18a4254f70b183a6c: stopping tablet replica
I20260709 12:25:08.486394  8637 raft_consensus.cc:2243] T 911b2f05169e49379263206730564c6e P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.486783  8637 raft_consensus.cc:2272] T 911b2f05169e49379263206730564c6e P 89820c3229e24de18a4254f70b183a6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.488487  8637 tablet_replica.cc:333] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c: stopping tablet replica
I20260709 12:25:08.489013  8637 raft_consensus.cc:2243] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:08.489715  8637 raft_consensus.cc:2272] T ad68501f591d446f953f4f1f07b6ba45 P 89820c3229e24de18a4254f70b183a6c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.491230  8637 tablet_replica.cc:333] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c: stopping tablet replica
I20260709 12:25:08.491716  8637 raft_consensus.cc:2243] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.492148  8637 raft_consensus.cc:2272] T cf2ea80ddaf24514a3ea597b2661ec91 P 89820c3229e24de18a4254f70b183a6c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.493628  8637 tablet_replica.cc:333] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c: stopping tablet replica
I20260709 12:25:08.494098  8637 raft_consensus.cc:2243] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:08.494848  8637 raft_consensus.cc:2272] T 2c02d26dcde247119ad22f7fb9ad6e42 P 89820c3229e24de18a4254f70b183a6c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.496433  8637 tablet_replica.cc:333] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c: stopping tablet replica
I20260709 12:25:08.496883  8637 raft_consensus.cc:2243] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.497295  8637 raft_consensus.cc:2272] T c788b9b2b3234316b1652b80ccc1277d P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.498847  8637 tablet_replica.cc:333] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c: stopping tablet replica
I20260709 12:25:08.499310  8637 raft_consensus.cc:2243] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.499701  8637 raft_consensus.cc:2272] T f7223e8d80a649bea80c3b438c3af4a1 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.501245  8637 tablet_replica.cc:333] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c: stopping tablet replica
I20260709 12:25:08.501678  8637 raft_consensus.cc:2243] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:08.502435  8637 raft_consensus.cc:2272] T e4a57ce90459497cb623214481efe782 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.503964  8637 tablet_replica.cc:333] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c: stopping tablet replica
I20260709 12:25:08.504391  8637 raft_consensus.cc:2243] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.504797  8637 raft_consensus.cc:2272] T 842cb132550246f7b891dd071fa42042 P 89820c3229e24de18a4254f70b183a6c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.591508  8637 tablet_server.cc:196] TabletServer@127.8.111.65:0 shutdown complete.
I20260709 12:25:08.608879  8637 tablet_server.cc:179] TabletServer@127.8.111.66:0 shutting down...
I20260709 12:25:08.633932  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:08.634573  8637 tablet_replica.cc:333] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9: stopping tablet replica
I20260709 12:25:08.635185  8637 raft_consensus.cc:2243] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:08.636049  8637 raft_consensus.cc:2272] T f7223e8d80a649bea80c3b438c3af4a1 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.637877  8637 tablet_replica.cc:333] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9: stopping tablet replica
I20260709 12:25:08.638422  8637 raft_consensus.cc:2243] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.638870  8637 raft_consensus.cc:2272] T e4a57ce90459497cb623214481efe782 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.640377  8637 tablet_replica.cc:333] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9: stopping tablet replica
I20260709 12:25:08.640877  8637 raft_consensus.cc:2243] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.641260  8637 raft_consensus.cc:2272] T c788b9b2b3234316b1652b80ccc1277d P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.642791  8637 tablet_replica.cc:333] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9: stopping tablet replica
I20260709 12:25:08.643257  8637 raft_consensus.cc:2243] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.643646  8637 raft_consensus.cc:2272] T 2c02d26dcde247119ad22f7fb9ad6e42 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.645341  8637 tablet_replica.cc:333] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9: stopping tablet replica
I20260709 12:25:08.645802  8637 raft_consensus.cc:2243] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.646176  8637 raft_consensus.cc:2272] T d67731beaedd47a89b0ee7737f9083e6 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.647708  8637 tablet_replica.cc:333] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9: stopping tablet replica
I20260709 12:25:08.648173  8637 raft_consensus.cc:2243] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:08.648892  8637 raft_consensus.cc:2272] T 911b2f05169e49379263206730564c6e P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.650638  8637 tablet_replica.cc:333] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9: stopping tablet replica
I20260709 12:25:08.651095  8637 raft_consensus.cc:2243] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.651491  8637 raft_consensus.cc:2272] T ad68501f591d446f953f4f1f07b6ba45 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.652979  8637 tablet_replica.cc:333] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9: stopping tablet replica
I20260709 12:25:08.653599  8637 raft_consensus.cc:2243] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.654006  8637 raft_consensus.cc:2272] T cf2ea80ddaf24514a3ea597b2661ec91 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.655691  8637 tablet_replica.cc:333] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9: stopping tablet replica
I20260709 12:25:08.656119  8637 raft_consensus.cc:2243] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:08.656829  8637 raft_consensus.cc:2272] T 842cb132550246f7b891dd071fa42042 P 0ed8a3294f314f9689ea0d295bd9dfb9 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:08.674723  8886 consensus_peers.cc:597] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 -> Peer 89820c3229e24de18a4254f70b183a6c (127.8.111.65:45607): Couldn't send request to peer 89820c3229e24de18a4254f70b183a6c. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:45607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:08.684214  8637 tablet_server.cc:196] TabletServer@127.8.111.66:0 shutdown complete.
I20260709 12:25:08.701481  8637 tablet_server.cc:179] TabletServer@127.8.111.67:0 shutting down...
I20260709 12:25:08.726351  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:08.726929  8637 tablet_replica.cc:333] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09: stopping tablet replica
I20260709 12:25:08.727510  8637 raft_consensus.cc:2243] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.727990  8637 raft_consensus.cc:2272] T f7223e8d80a649bea80c3b438c3af4a1 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.729804  8637 tablet_replica.cc:333] T 842cb132550246f7b891dd071fa42042 P a26c2b0b5b2f447097c60da4958d6d09: stopping tablet replica
I20260709 12:25:08.730378  8637 raft_consensus.cc:2243] T 842cb132550246f7b891dd071fa42042 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.730772  8637 raft_consensus.cc:2272] T 842cb132550246f7b891dd071fa42042 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.732338  8637 tablet_replica.cc:333] T ad68501f591d446f953f4f1f07b6ba45 P a26c2b0b5b2f447097c60da4958d6d09: stopping tablet replica
I20260709 12:25:08.732822  8637 raft_consensus.cc:2243] T ad68501f591d446f953f4f1f07b6ba45 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.733215  8637 raft_consensus.cc:2272] T ad68501f591d446f953f4f1f07b6ba45 P a26c2b0b5b2f447097c60da4958d6d09 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.734753  8637 tablet_replica.cc:333] T 911b2f05169e49379263206730564c6e P a26c2b0b5b2f447097c60da4958d6d09: stopping tablet replica
I20260709 12:25:08.735229  8637 raft_consensus.cc:2243] T 911b2f05169e49379263206730564c6e P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.735596  8637 raft_consensus.cc:2272] T 911b2f05169e49379263206730564c6e P a26c2b0b5b2f447097c60da4958d6d09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.737452  8637 tablet_replica.cc:333] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09: stopping tablet replica
I20260709 12:25:08.738013  8637 raft_consensus.cc:2243] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:25:08.738795  8637 raft_consensus.cc:2272] T cf2ea80ddaf24514a3ea597b2661ec91 P a26c2b0b5b2f447097c60da4958d6d09 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.740330  8637 tablet_replica.cc:333] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09: stopping tablet replica
I20260709 12:25:08.740828  8637 raft_consensus.cc:2243] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.741593  8637 raft_consensus.cc:2272] T 2c02d26dcde247119ad22f7fb9ad6e42 P a26c2b0b5b2f447097c60da4958d6d09 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.743945  8637 tablet_replica.cc:333] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09: stopping tablet replica
I20260709 12:25:08.744463  8637 raft_consensus.cc:2243] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:08.745237  8637 raft_consensus.cc:2272] T c788b9b2b3234316b1652b80ccc1277d P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.746891  8637 tablet_replica.cc:333] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09: stopping tablet replica
I20260709 12:25:08.747339  8637 raft_consensus.cc:2243] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:08.747761  8637 raft_consensus.cc:2272] T e4a57ce90459497cb623214481efe782 P a26c2b0b5b2f447097c60da4958d6d09 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.749243  8637 tablet_replica.cc:333] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09: stopping tablet replica
I20260709 12:25:08.749676  8637 raft_consensus.cc:2243] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:08.750710  8637 raft_consensus.cc:2272] T d67731beaedd47a89b0ee7737f9083e6 P a26c2b0b5b2f447097c60da4958d6d09 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.776780  8637 tablet_server.cc:196] TabletServer@127.8.111.67:0 shutdown complete.
I20260709 12:25:08.794673  8637 master.cc:562] Master@127.8.111.126:39745 shutting down...
I20260709 12:25:08.992309  8637 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:08.993003  8637 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:08.993350  8637 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8ee1c32d8fa54b14a95c6ba3056db3a5: stopping tablet replica
I20260709 12:25:09.011579  8637 master.cc:584] Master@127.8.111.126:39745 shutdown complete.
0ed8a3294f314f9689ea0d295bd9dfb9  4
89820c3229e24de18a4254f70b183a6c  4
a26c2b0b5b2f447097c60da4958d6d09  1
0ed8a3294f314f9689ea0d295bd9dfb9  3
89820c3229e24de18a4254f70b183a6c  3
a26c2b0b5b2f447097c60da4958d6d09  3
0ed8a3294f314f9689ea0d295bd9dfb9  8
89820c3229e24de18a4254f70b183a6c  0
a26c2b0b5b2f447097c60da4958d6d09  1
0ed8a3294f314f9689ea0d295bd9dfb9  3
89820c3229e24de18a4254f70b183a6c  3
a26c2b0b5b2f447097c60da4958d6d09  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (32599 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:25:09.053292  8637 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.111.126:42453
I20260709 12:25:09.054442  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:09.059800  9183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:09.060652  9184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:09.061100  9186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:09.061337  8637 server_base.cc:1061] running on GCE node
I20260709 12:25:09.062355  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:09.062536  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:09.062726  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783599909062698 us; error 0 us; skew 500 ppm
I20260709 12:25:09.063264  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:09.065506  8637 webserver.cc:533] Webserver started at http://127.8.111.126:35623/ using document root <none> and password file <none>
I20260709 12:25:09.065969  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:09.066150  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:09.066455  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:09.067564  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599876290468-8637-0/minicluster-data/master-0-root/instance:
uuid: "890b899a7d8b4b1ba019190bd9acd55a"
format_stamp: "Formatted at 2026-07-09 12:25:09 on dist-test-slave-044g"
I20260709 12:25:09.072088  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:25:09.075434  9191 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:09.076277  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:25:09.076558  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599876290468-8637-0/minicluster-data/master-0-root
uuid: "890b899a7d8b4b1ba019190bd9acd55a"
format_stamp: "Formatted at 2026-07-09 12:25:09 on dist-test-slave-044g"
I20260709 12:25:09.076815  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599876290468-8637-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599876290468-8637-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599876290468-8637-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:09.093456  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:09.094743  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:09.131089  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.126:42453
I20260709 12:25:09.131186  9242 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.126:42453 every 8 connection(s)
I20260709 12:25:09.134963  9243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.144145  9243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a: Bootstrap starting.
I20260709 12:25:09.148662  9243 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.152757  9243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a: No bootstrap required, opened a new log
I20260709 12:25:09.154884  9243 raft_consensus.cc:359] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "890b899a7d8b4b1ba019190bd9acd55a" member_type: VOTER }
I20260709 12:25:09.155292  9243 raft_consensus.cc:385] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.155537  9243 raft_consensus.cc:740] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 890b899a7d8b4b1ba019190bd9acd55a, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.156116  9243 consensus_queue.cc:260] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "890b899a7d8b4b1ba019190bd9acd55a" member_type: VOTER }
I20260709 12:25:09.156571  9243 raft_consensus.cc:399] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:09.156776  9243 raft_consensus.cc:493] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:09.157047  9243 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:09.161409  9243 raft_consensus.cc:515] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "890b899a7d8b4b1ba019190bd9acd55a" member_type: VOTER }
I20260709 12:25:09.161998  9243 leader_election.cc:304] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 890b899a7d8b4b1ba019190bd9acd55a; no voters: 
I20260709 12:25:09.163172  9243 leader_election.cc:290] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:09.163573  9246 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:09.164816  9246 raft_consensus.cc:697] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a [term 1 LEADER]: Becoming Leader. State: Replica: 890b899a7d8b4b1ba019190bd9acd55a, State: Running, Role: LEADER
I20260709 12:25:09.165505  9246 consensus_queue.cc:237] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "890b899a7d8b4b1ba019190bd9acd55a" member_type: VOTER }
I20260709 12:25:09.166383  9243 sys_catalog.cc:565] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:09.170863  9248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 890b899a7d8b4b1ba019190bd9acd55a. Latest consensus state: current_term: 1 leader_uuid: "890b899a7d8b4b1ba019190bd9acd55a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "890b899a7d8b4b1ba019190bd9acd55a" member_type: VOTER } }
I20260709 12:25:09.171300  9247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "890b899a7d8b4b1ba019190bd9acd55a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "890b899a7d8b4b1ba019190bd9acd55a" member_type: VOTER } }
I20260709 12:25:09.171728  9247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:09.171698  9248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:09.173851  9253 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:09.178790  9253 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:09.183794  8637 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:09.187542  9253 catalog_manager.cc:1383] Generated new cluster ID: d9e181a93fae4a6485f0df28cd77b594
I20260709 12:25:09.187835  9253 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:09.201650  9253 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:09.203011  9253 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:09.216256  9253 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a: Generated new TSK 0
I20260709 12:25:09.216909  9253 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:09.250751  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:09.256736  9264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:09.257730  9265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:09.260391  8637 server_base.cc:1061] running on GCE node
W20260709 12:25:09.260355  9267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:09.261415  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:09.261593  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:09.261803  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783599909261774 us; error 0 us; skew 500 ppm
I20260709 12:25:09.262360  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:09.264619  8637 webserver.cc:533] Webserver started at http://127.8.111.65:38741/ using document root <none> and password file <none>
I20260709 12:25:09.265084  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:09.265262  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:09.265540  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:09.266677  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599876290468-8637-0/minicluster-data/ts-0-root/instance:
uuid: "b196ee6e89b2464695c8220d77dcdb30"
format_stamp: "Formatted at 2026-07-09 12:25:09 on dist-test-slave-044g"
I20260709 12:25:09.271210  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:25:09.274495  9272 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:09.275192  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:25:09.275473  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599876290468-8637-0/minicluster-data/ts-0-root
uuid: "b196ee6e89b2464695c8220d77dcdb30"
format_stamp: "Formatted at 2026-07-09 12:25:09 on dist-test-slave-044g"
I20260709 12:25:09.275751  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599876290468-8637-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599876290468-8637-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599876290468-8637-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:09.288085  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:09.289290  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:09.290763  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:09.293008  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:09.293219  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:09.293470  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:09.293650  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:09.332122  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.65:38665
I20260709 12:25:09.332217  9334 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.65:38665 every 8 connection(s)
I20260709 12:25:09.336884  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:09.343950  9339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:09.345517  9340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:09.348381  9342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:09.349645  8637 server_base.cc:1061] running on GCE node
I20260709 12:25:09.351176  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:25:09.351253  9335 heartbeater.cc:344] Connected to a master server at 127.8.111.126:42453
W20260709 12:25:09.351410  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:09.351632  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783599909351617 us; error 0 us; skew 500 ppm
I20260709 12:25:09.351706  9335 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:09.352208  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:09.352528  9335 heartbeater.cc:507] Master 127.8.111.126:42453 requested a full tablet report, sending...
I20260709 12:25:09.354809  8637 webserver.cc:533] Webserver started at http://127.8.111.66:37841/ using document root <none> and password file <none>
I20260709 12:25:09.354934  9208 ts_manager.cc:194] Registered new tserver with Master: b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665)
I20260709 12:25:09.355345  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:09.355573  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:09.355834  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:09.356897  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599876290468-8637-0/minicluster-data/ts-1-root/instance:
uuid: "c74618ad69cd41f89213bdf7943bc66e"
format_stamp: "Formatted at 2026-07-09 12:25:09 on dist-test-slave-044g"
I20260709 12:25:09.356946  9208 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59076
I20260709 12:25:09.361325  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:25:09.364737  9347 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:09.365476  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:25:09.365769  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599876290468-8637-0/minicluster-data/ts-1-root
uuid: "c74618ad69cd41f89213bdf7943bc66e"
format_stamp: "Formatted at 2026-07-09 12:25:09 on dist-test-slave-044g"
I20260709 12:25:09.366062  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599876290468-8637-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599876290468-8637-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599876290468-8637-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:09.391961  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:09.393164  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:09.394654  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:09.396719  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:09.396924  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:09.397177  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:09.397331  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:09.435091  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.66:38911
I20260709 12:25:09.435185  9409 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.66:38911 every 8 connection(s)
I20260709 12:25:09.439567  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:09.446707  9413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:09.448992  9414 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:09.450513  9416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:09.452072  9410 heartbeater.cc:344] Connected to a master server at 127.8.111.126:42453
I20260709 12:25:09.452314  8637 server_base.cc:1061] running on GCE node
I20260709 12:25:09.452488  9410 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:09.453250  9410 heartbeater.cc:507] Master 127.8.111.126:42453 requested a full tablet report, sending...
I20260709 12:25:09.453328  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:09.453656  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:09.453858  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783599909453838 us; error 0 us; skew 500 ppm
I20260709 12:25:09.454716  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:09.455435  9208 ts_manager.cc:194] Registered new tserver with Master: c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911)
I20260709 12:25:09.456807  9208 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59084
I20260709 12:25:09.457309  8637 webserver.cc:533] Webserver started at http://127.8.111.67:35135/ using document root <none> and password file <none>
I20260709 12:25:09.457966  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:09.458223  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:09.458590  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:09.459792  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599876290468-8637-0/minicluster-data/ts-2-root/instance:
uuid: "d956b41d76f241dea0c0bf203220c9e9"
format_stamp: "Formatted at 2026-07-09 12:25:09 on dist-test-slave-044g"
I20260709 12:25:09.464418  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:25:09.467491  9421 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:09.468297  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:25:09.468570  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599876290468-8637-0/minicluster-data/ts-2-root
uuid: "d956b41d76f241dea0c0bf203220c9e9"
format_stamp: "Formatted at 2026-07-09 12:25:09 on dist-test-slave-044g"
I20260709 12:25:09.468842  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599876290468-8637-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599876290468-8637-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599876290468-8637-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:09.480765  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:09.481892  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:09.483357  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:09.485488  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:09.485705  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:09.485940  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:09.486109  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:09.524286  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.67:45549
I20260709 12:25:09.524394  9483 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.67:45549 every 8 connection(s)
I20260709 12:25:09.537555  9484 heartbeater.cc:344] Connected to a master server at 127.8.111.126:42453
I20260709 12:25:09.537961  9484 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:09.538653  9484 heartbeater.cc:507] Master 127.8.111.126:42453 requested a full tablet report, sending...
I20260709 12:25:09.540645  9208 ts_manager.cc:194] Registered new tserver with Master: d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:09.541481  8637 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01414963s
I20260709 12:25:09.541968  9208 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59086
I20260709 12:25:09.567461  9208 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59090:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:09.571035  9208 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:09.657874  9374 tablet_service.cc:1511] Processing CreateTablet for tablet 17da24262ab34c6c847a08b645b7ef8c (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:09.659431  9374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17da24262ab34c6c847a08b645b7ef8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.659224  9375 tablet_service.cc:1511] Processing CreateTablet for tablet 78d391d80524431c90ec3ec0348a848d (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:09.660480  9375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d391d80524431c90ec3ec0348a848d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.661075  9369 tablet_service.cc:1511] Processing CreateTablet for tablet fa27643756124363a439a22cf9d38101 (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:09.663452  9298 tablet_service.cc:1511] Processing CreateTablet for tablet d70263eac7b74896af9db829c2518019 (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:09.664794  9298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70263eac7b74896af9db829c2518019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.664520  9295 tablet_service.cc:1511] Processing CreateTablet for tablet 11128abd1e764a12b8d231570608b56d (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:09.664675  9371 tablet_service.cc:1511] Processing CreateTablet for tablet 8099fdb4a59c47a89b57f9137a8932d3 (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:09.665755  9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11128abd1e764a12b8d231570608b56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.666982  9372 tablet_service.cc:1511] Processing CreateTablet for tablet 760a965208844aeba856202c350ec597 (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:09.667446  9296 tablet_service.cc:1511] Processing CreateTablet for tablet 8099fdb4a59c47a89b57f9137a8932d3 (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:09.668784  9296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8099fdb4a59c47a89b57f9137a8932d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.669153  9294 tablet_service.cc:1511] Processing CreateTablet for tablet fa27643756124363a439a22cf9d38101 (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:09.669216  9373 tablet_service.cc:1511] Processing CreateTablet for tablet d70263eac7b74896af9db829c2518019 (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:09.670526  9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa27643756124363a439a22cf9d38101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.671489  9299 tablet_service.cc:1511] Processing CreateTablet for tablet 17da24262ab34c6c847a08b645b7ef8c (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:09.672372  9369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa27643756124363a439a22cf9d38101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.672863  9299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17da24262ab34c6c847a08b645b7ef8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.673933  9368 tablet_service.cc:1511] Processing CreateTablet for tablet ab9cc9b294414da9994f61f618ff3e7d (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:09.675685  9368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9cc9b294414da9994f61f618ff3e7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.675336  9297 tablet_service.cc:1511] Processing CreateTablet for tablet 760a965208844aeba856202c350ec597 (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:09.676963  9297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 760a965208844aeba856202c350ec597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.677990  9367 tablet_service.cc:1511] Processing CreateTablet for tablet 899bcc97677f4b169b627076ec798cdc (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:09.678601  9372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 760a965208844aeba856202c350ec597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.678486  9300 tablet_service.cc:1511] Processing CreateTablet for tablet 78d391d80524431c90ec3ec0348a848d (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:09.679394  9367 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 899bcc97677f4b169b627076ec798cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.679766  9300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d391d80524431c90ec3ec0348a848d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.680020  9371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8099fdb4a59c47a89b57f9137a8932d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.681083  9373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70263eac7b74896af9db829c2518019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.681685  9366 tablet_service.cc:1511] Processing CreateTablet for tablet 9f40906f3d564ec8acba63581f7d8df6 (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:09.681960  9293 tablet_service.cc:1511] Processing CreateTablet for tablet ab9cc9b294414da9994f61f618ff3e7d (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:09.682978  9366 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f40906f3d564ec8acba63581f7d8df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.683168  9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9cc9b294414da9994f61f618ff3e7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.663479  9370 tablet_service.cc:1511] Processing CreateTablet for tablet 11128abd1e764a12b8d231570608b56d (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:09.691430  9292 tablet_service.cc:1511] Processing CreateTablet for tablet 899bcc97677f4b169b627076ec798cdc (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:09.692798  9292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 899bcc97677f4b169b627076ec798cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.698648  9291 tablet_service.cc:1511] Processing CreateTablet for tablet 9f40906f3d564ec8acba63581f7d8df6 (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:09.700017  9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f40906f3d564ec8acba63581f7d8df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.718652  9370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11128abd1e764a12b8d231570608b56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.740268  9442 tablet_service.cc:1511] Processing CreateTablet for tablet ab9cc9b294414da9994f61f618ff3e7d (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:09.740667  9449 tablet_service.cc:1511] Processing CreateTablet for tablet 78d391d80524431c90ec3ec0348a848d (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:09.741660  9442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab9cc9b294414da9994f61f618ff3e7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.742890  9448 tablet_service.cc:1511] Processing CreateTablet for tablet 17da24262ab34c6c847a08b645b7ef8c (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:09.744212  9448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17da24262ab34c6c847a08b645b7ef8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.747291  9447 tablet_service.cc:1511] Processing CreateTablet for tablet d70263eac7b74896af9db829c2518019 (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:09.748617  9447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d70263eac7b74896af9db829c2518019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.752846  9445 tablet_service.cc:1511] Processing CreateTablet for tablet 8099fdb4a59c47a89b57f9137a8932d3 (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:09.753186  9444 tablet_service.cc:1511] Processing CreateTablet for tablet 11128abd1e764a12b8d231570608b56d (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:09.752844  9446 tablet_service.cc:1511] Processing CreateTablet for tablet 760a965208844aeba856202c350ec597 (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:09.755487  9449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78d391d80524431c90ec3ec0348a848d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.755409  9441 tablet_service.cc:1511] Processing CreateTablet for tablet 899bcc97677f4b169b627076ec798cdc (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:09.757498  9443 tablet_service.cc:1511] Processing CreateTablet for tablet fa27643756124363a439a22cf9d38101 (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:09.758675  9445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8099fdb4a59c47a89b57f9137a8932d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.762599  9443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa27643756124363a439a22cf9d38101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.765377  9446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 760a965208844aeba856202c350ec597. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.765684  9440 tablet_service.cc:1511] Processing CreateTablet for tablet 9f40906f3d564ec8acba63581f7d8df6 (DEFAULT_TABLE table=test-workload [id=c69b146959ce4f5aba8148847f7104f3]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:09.767014  9440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f40906f3d564ec8acba63581f7d8df6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.776296  9444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11128abd1e764a12b8d231570608b56d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.777129  9441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 899bcc97677f4b169b627076ec798cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:09.804260  9499 tablet_bootstrap.cc:492] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e: Bootstrap starting.
I20260709 12:25:09.807950  9500 tablet_bootstrap.cc:492] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30: Bootstrap starting.
I20260709 12:25:09.840758  9500 tablet_bootstrap.cc:654] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.849970  9501 tablet_bootstrap.cc:492] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9: Bootstrap starting.
I20260709 12:25:09.854341  9499 tablet_bootstrap.cc:654] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.857199  9500 tablet_bootstrap.cc:492] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30: No bootstrap required, opened a new log
I20260709 12:25:09.857648  9500 ts_tablet_manager.cc:1403] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.005s
I20260709 12:25:09.860392  9500 raft_consensus.cc:359] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.861135  9500 raft_consensus.cc:385] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.861438  9500 raft_consensus.cc:740] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.862360  9501 tablet_bootstrap.cc:654] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.862305  9500 consensus_queue.cc:260] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.865875  9335 heartbeater.cc:499] Master 127.8.111.126:42453 was elected leader, sending a full tablet report...
I20260709 12:25:09.866479  9499 tablet_bootstrap.cc:492] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e: No bootstrap required, opened a new log
I20260709 12:25:09.866590  9500 ts_tablet_manager.cc:1434] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:25:09.867050  9499 ts_tablet_manager.cc:1403] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e: Time spent bootstrapping tablet: real 0.063s	user 0.004s	sys 0.016s
I20260709 12:25:09.867945  9500 tablet_bootstrap.cc:492] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30: Bootstrap starting.
I20260709 12:25:09.870133  9499 raft_consensus.cc:359] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.870872  9499 raft_consensus.cc:385] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.871264  9499 raft_consensus.cc:740] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.872041  9499 consensus_queue.cc:260] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.875085  9501 tablet_bootstrap.cc:492] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9: No bootstrap required, opened a new log
I20260709 12:25:09.875396  9500 tablet_bootstrap.cc:654] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.875584  9501 ts_tablet_manager.cc:1403] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.010s
I20260709 12:25:09.881450  9499 ts_tablet_manager.cc:1434] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.007s
I20260709 12:25:09.882236  9410 heartbeater.cc:499] Master 127.8.111.126:42453 was elected leader, sending a full tablet report...
I20260709 12:25:09.885340  9501 raft_consensus.cc:359] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.886343  9501 raft_consensus.cc:385] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.886716  9501 raft_consensus.cc:740] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.890163  9501 consensus_queue.cc:260] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.894873  9499 tablet_bootstrap.cc:492] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e: Bootstrap starting.
I20260709 12:25:09.898587  9506 raft_consensus.cc:493] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.899042  9506 raft_consensus.cc:515] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.901765  9506 leader_election.cc:290] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:09.905550  9499 tablet_bootstrap.cc:654] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.910697  9484 heartbeater.cc:499] Master 127.8.111.126:42453 was elected leader, sending a full tablet report...
I20260709 12:25:09.914530  9501 ts_tablet_manager.cc:1434] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9: Time spent starting tablet: real 0.039s	user 0.013s	sys 0.000s
I20260709 12:25:09.915397  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f40906f3d564ec8acba63581f7d8df6" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30" is_pre_election: true
I20260709 12:25:09.917871  9501 tablet_bootstrap.cc:492] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9: Bootstrap starting.
I20260709 12:25:09.918648  9500 tablet_bootstrap.cc:492] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30: No bootstrap required, opened a new log
W20260709 12:25:09.918813  9351 leader_election.cc:343] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:09.919435  9500 ts_tablet_manager.cc:1403] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30: Time spent bootstrapping tablet: real 0.052s	user 0.033s	sys 0.009s
I20260709 12:25:09.923273  9500 raft_consensus.cc:359] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.924834  9500 raft_consensus.cc:385] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.925560  9500 raft_consensus.cc:740] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.925096  9501 tablet_bootstrap.cc:654] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.926846  9500 consensus_queue.cc:260] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.930325  9500 ts_tablet_manager.cc:1434] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:25:09.931187  9499 tablet_bootstrap.cc:492] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e: No bootstrap required, opened a new log
I20260709 12:25:09.931656  9499 ts_tablet_manager.cc:1403] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.010s
I20260709 12:25:09.931198  9500 tablet_bootstrap.cc:492] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30: Bootstrap starting.
I20260709 12:25:09.934218  9499 raft_consensus.cc:359] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.934991  9499 raft_consensus.cc:385] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.935281  9499 raft_consensus.cc:740] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.935978  9499 consensus_queue.cc:260] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.936955  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f40906f3d564ec8acba63581f7d8df6" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9" is_pre_election: true
I20260709 12:25:09.938326  9499 ts_tablet_manager.cc:1434] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
W20260709 12:25:09.938560  9348 leader_election.cc:343] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:09.939067  9411 tablet.cc:2406] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:09.939010  9348 leader_election.cc:304] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c74618ad69cd41f89213bdf7943bc66e; no voters: b196ee6e89b2464695c8220d77dcdb30, d956b41d76f241dea0c0bf203220c9e9
I20260709 12:25:09.940258  9508 raft_consensus.cc:2749] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:09.940733  9499 tablet_bootstrap.cc:492] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e: Bootstrap starting.
I20260709 12:25:09.941636  9500 tablet_bootstrap.cc:654] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.948208  9499 tablet_bootstrap.cc:654] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.950835  9500 tablet_bootstrap.cc:492] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30: No bootstrap required, opened a new log
I20260709 12:25:09.951414  9500 ts_tablet_manager.cc:1403] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30: Time spent bootstrapping tablet: real 0.020s	user 0.003s	sys 0.012s
I20260709 12:25:09.952194  9501 tablet_bootstrap.cc:492] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9: No bootstrap required, opened a new log
I20260709 12:25:09.952641  9501 ts_tablet_manager.cc:1403] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.000s
I20260709 12:25:09.954902  9500 raft_consensus.cc:359] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.955317  9501 raft_consensus.cc:359] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.955850  9500 raft_consensus.cc:385] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.956055  9501 raft_consensus.cc:385] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.956285  9500 raft_consensus.cc:740] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.956418  9501 raft_consensus.cc:740] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.957357  9501 consensus_queue.cc:260] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.958443  9500 consensus_queue.cc:260] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.960662  9500 ts_tablet_manager.cc:1434] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:25:09.960662  9501 ts_tablet_manager.cc:1434] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:09.961730  9500 tablet_bootstrap.cc:492] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30: Bootstrap starting.
I20260709 12:25:09.962787  9499 tablet_bootstrap.cc:492] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e: No bootstrap required, opened a new log
I20260709 12:25:09.963282  9499 ts_tablet_manager.cc:1403] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.006s
I20260709 12:25:09.966049  9499 raft_consensus.cc:359] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.967195  9499 raft_consensus.cc:385] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.967553  9499 raft_consensus.cc:740] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.961697  9501 tablet_bootstrap.cc:492] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9: Bootstrap starting.
I20260709 12:25:09.968597  9500 tablet_bootstrap.cc:654] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.968488  9499 consensus_queue.cc:260] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.972895  9499 ts_tablet_manager.cc:1434] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:25:09.973901  9499 tablet_bootstrap.cc:492] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e: Bootstrap starting.
I20260709 12:25:09.975107  9501 tablet_bootstrap.cc:654] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.980279  9499 tablet_bootstrap.cc:654] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:09.988102  9501 tablet_bootstrap.cc:492] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9: No bootstrap required, opened a new log
I20260709 12:25:09.988436  9501 ts_tablet_manager.cc:1403] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.009s
I20260709 12:25:09.989357  9499 tablet_bootstrap.cc:492] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e: No bootstrap required, opened a new log
I20260709 12:25:09.989751  9499 ts_tablet_manager.cc:1403] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 12:25:09.989950  9500 tablet_bootstrap.cc:492] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30: No bootstrap required, opened a new log
I20260709 12:25:09.990427  9500 ts_tablet_manager.cc:1403] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.020s
I20260709 12:25:09.991271  9501 raft_consensus.cc:359] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.992003  9501 raft_consensus.cc:385] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.991842  9499 raft_consensus.cc:359] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.992347  9501 raft_consensus.cc:740] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.992508  9499 raft_consensus.cc:385] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.992805  9499 raft_consensus.cc:740] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.993045  9500 raft_consensus.cc:359] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.993112  9501 consensus_queue.cc:260] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.993822  9500 raft_consensus.cc:385] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:09.993500  9499 consensus_queue.cc:260] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.994130  9500 raft_consensus.cc:740] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Initialized, Role: FOLLOWER
I20260709 12:25:09.994668  9508 raft_consensus.cc:493] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.994838  9500 consensus_queue.cc:260] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.995092  9508 raft_consensus.cc:515] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:09.997066  9500 ts_tablet_manager.cc:1434] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:09.997648  9508 leader_election.cc:290] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:09.998004  9500 tablet_bootstrap.cc:492] T 899bcc97677f4b169b627076ec798cdc P b196ee6e89b2464695c8220d77dcdb30: Bootstrap starting.
I20260709 12:25:09.999529  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17da24262ab34c6c847a08b645b7ef8c" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9" is_pre_election: true
I20260709 12:25:10.001138  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17da24262ab34c6c847a08b645b7ef8c" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30" is_pre_election: true
I20260709 12:25:10.001611  9501 ts_tablet_manager.cc:1434] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:25:10.001725  9310 raft_consensus.cc:2468] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 0.
W20260709 12:25:10.003011  9348 leader_election.cc:343] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.004743  9500 tablet_bootstrap.cc:654] T 899bcc97677f4b169b627076ec798cdc P b196ee6e89b2464695c8220d77dcdb30: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.005090  9501 tablet_bootstrap.cc:492] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9: Bootstrap starting.
I20260709 12:25:10.004809  9351 leader_election.cc:304] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, c74618ad69cd41f89213bdf7943bc66e; no voters: d956b41d76f241dea0c0bf203220c9e9
I20260709 12:25:10.012725  9499 ts_tablet_manager.cc:1434] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 12:25:10.013170  9508 raft_consensus.cc:2804] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.013520  9508 raft_consensus.cc:493] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.013860  9508 raft_consensus.cc:3060] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.014307  9499 tablet_bootstrap.cc:492] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e: Bootstrap starting.
I20260709 12:25:10.014317  9501 tablet_bootstrap.cc:654] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.021070  9499 tablet_bootstrap.cc:654] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.021095  9500 tablet_bootstrap.cc:492] T 899bcc97677f4b169b627076ec798cdc P b196ee6e89b2464695c8220d77dcdb30: No bootstrap required, opened a new log
I20260709 12:25:10.021889  9500 ts_tablet_manager.cc:1403] T 899bcc97677f4b169b627076ec798cdc P b196ee6e89b2464695c8220d77dcdb30: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.008s
I20260709 12:25:10.021605  9508 raft_consensus.cc:515] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.024335  9501 tablet_bootstrap.cc:492] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9: No bootstrap required, opened a new log
I20260709 12:25:10.024662  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17da24262ab34c6c847a08b645b7ef8c" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
I20260709 12:25:10.024784  9501 ts_tablet_manager.cc:1403] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.001s
I20260709 12:25:10.025214  9310 raft_consensus.cc:3060] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.024814  9500 raft_consensus.cc:359] T 899bcc97677f4b169b627076ec798cdc P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.025664  9500 raft_consensus.cc:385] T 899bcc97677f4b169b627076ec798cdc P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.025950  9500 raft_consensus.cc:740] T 899bcc97677f4b169b627076ec798cdc P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.026688  9500 consensus_queue.cc:260] T 899bcc97677f4b169b627076ec798cdc P b196ee6e89b2464695c8220d77dcdb30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.027704  9501 raft_consensus.cc:359] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.028477  9501 raft_consensus.cc:385] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.028771  9501 raft_consensus.cc:740] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.028955  9500 ts_tablet_manager.cc:1434] T 899bcc97677f4b169b627076ec798cdc P b196ee6e89b2464695c8220d77dcdb30: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:10.029867  9500 tablet_bootstrap.cc:492] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30: Bootstrap starting.
I20260709 12:25:10.029682  9501 consensus_queue.cc:260] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.035761  9501 ts_tablet_manager.cc:1434] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:25:10.036064  9500 tablet_bootstrap.cc:654] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.036804  9501 tablet_bootstrap.cc:492] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9: Bootstrap starting.
I20260709 12:25:10.040730  9506 raft_consensus.cc:493] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.041193  9506 raft_consensus.cc:515] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.043318  9506 leader_election.cc:290] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.044809  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d391d80524431c90ec3ec0348a848d" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9" is_pre_election: true
I20260709 12:25:10.045435  9459 raft_consensus.cc:2468] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 0.
I20260709 12:25:10.047235  9348 leader_election.cc:304] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c74618ad69cd41f89213bdf7943bc66e, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:10.048825  9506 raft_consensus.cc:2804] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.049168  9309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d391d80524431c90ec3ec0348a848d" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30" is_pre_election: true
W20260709 12:25:10.050613  9351 leader_election.cc:343] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.049160  9506 raft_consensus.cc:493] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.051815  9506 raft_consensus.cc:3060] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.054939  9310 raft_consensus.cc:2468] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 1.
I20260709 12:25:10.056039  9351 leader_election.cc:304] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, c74618ad69cd41f89213bdf7943bc66e; no voters: 
I20260709 12:25:10.056279  9501 tablet_bootstrap.cc:654] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.058553  9508 leader_election.cc:290] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 election: Requested vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.059666  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17da24262ab34c6c847a08b645b7ef8c" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:10.059142  9508 raft_consensus.cc:2804] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.060878  9509 raft_consensus.cc:493] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:10.061069  9348 leader_election.cc:343] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.062222  9508 raft_consensus.cc:697] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Becoming Leader. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Running, Role: LEADER
I20260709 12:25:10.062188  9509 raft_consensus.cc:515] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.063409  9508 consensus_queue.cc:237] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.064718  9506 raft_consensus.cc:515] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.065680  9501 tablet_bootstrap.cc:492] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9: No bootstrap required, opened a new log
I20260709 12:25:10.066187  9501 ts_tablet_manager.cc:1403] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.000s
I20260709 12:25:10.069425  9509 leader_election.cc:290] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911)
I20260709 12:25:10.069389  9501 raft_consensus.cc:359] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.070207  9501 raft_consensus.cc:385] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.070600  9501 raft_consensus.cc:740] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.071163  9499 tablet_bootstrap.cc:492] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e: No bootstrap required, opened a new log
I20260709 12:25:10.071753  9499 ts_tablet_manager.cc:1403] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.013s
I20260709 12:25:10.071472  9501 consensus_queue.cc:260] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.073935  9501 ts_tablet_manager.cc:1434] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:25:10.074837  9501 tablet_bootstrap.cc:492] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9: Bootstrap starting.
I20260709 12:25:10.082002  9501 tablet_bootstrap.cc:654] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.082593  9506 leader_election.cc:290] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 election: Requested vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.089321  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d391d80524431c90ec3ec0348a848d" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:10.090138  9459 raft_consensus.cc:3060] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.090477  9504 raft_consensus.cc:493] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.090991  9504 raft_consensus.cc:515] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.095096  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d391d80524431c90ec3ec0348a848d" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
I20260709 12:25:10.097414  9504 leader_election.cc:290] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.101380  9500 tablet_bootstrap.cc:492] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30: No bootstrap required, opened a new log
I20260709 12:25:10.102018  9500 ts_tablet_manager.cc:1403] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30: Time spent bootstrapping tablet: real 0.072s	user 0.015s	sys 0.016s
W20260709 12:25:10.102826  9351 leader_election.cc:343] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.104072  9499 raft_consensus.cc:359] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.105093  9499 raft_consensus.cc:385] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.105444  9499 raft_consensus.cc:740] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.105800  9500 raft_consensus.cc:359] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.106803  9500 raft_consensus.cc:385] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.107198  9500 raft_consensus.cc:740] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.108439  9500 consensus_queue.cc:260] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.111310  9500 ts_tablet_manager.cc:1434] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:25:10.112344  9500 tablet_bootstrap.cc:492] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30: Bootstrap starting.
I20260709 12:25:10.113626  9205 catalog_manager.cc:5697] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e reported cstate change: term changed from 0 to 1, leader changed from <none> to c74618ad69cd41f89213bdf7943bc66e (127.8.111.66). New cstate: current_term: 1 leader_uuid: "c74618ad69cd41f89213bdf7943bc66e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.117007  9459 raft_consensus.cc:2468] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 1.
I20260709 12:25:10.120510  9499 consensus_queue.cc:260] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.124399  9348 leader_election.cc:304] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c74618ad69cd41f89213bdf7943bc66e, d956b41d76f241dea0c0bf203220c9e9; no voters: b196ee6e89b2464695c8220d77dcdb30
I20260709 12:25:10.126114  9522 raft_consensus.cc:2804] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.126397  9499 ts_tablet_manager.cc:1434] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.004s
I20260709 12:25:10.126600  9522 raft_consensus.cc:697] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Becoming Leader. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Running, Role: LEADER
I20260709 12:25:10.127372  9499 tablet_bootstrap.cc:492] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e: Bootstrap starting.
I20260709 12:25:10.127682  9501 tablet_bootstrap.cc:492] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9: No bootstrap required, opened a new log
I20260709 12:25:10.128141  9501 ts_tablet_manager.cc:1403] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9: Time spent bootstrapping tablet: real 0.054s	user 0.024s	sys 0.020s
I20260709 12:25:10.127486  9522 consensus_queue.cc:237] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.130450  9500 tablet_bootstrap.cc:654] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.130409  9506 raft_consensus.cc:493] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.131006  9506 raft_consensus.cc:515] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.137773  9501 raft_consensus.cc:359] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.138576  9499 tablet_bootstrap.cc:654] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.138556  9501 raft_consensus.cc:385] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.142170  9501 raft_consensus.cc:740] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.144471  9501 consensus_queue.cc:260] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.145601  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9cc9b294414da9994f61f618ff3e7d" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9" is_pre_election: true
I20260709 12:25:10.141438  9506 leader_election.cc:290] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.156977  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9cc9b294414da9994f61f618ff3e7d" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30" is_pre_election: true
I20260709 12:25:10.157603  9310 raft_consensus.cc:2468] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 0.
I20260709 12:25:10.161067  9501 ts_tablet_manager.cc:1434] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.003s
I20260709 12:25:10.162019  9501 tablet_bootstrap.cc:492] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9: Bootstrap starting.
W20260709 12:25:10.159227  9348 leader_election.cc:343] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.168468  9501 tablet_bootstrap.cc:654] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.175663  9351 leader_election.cc:304] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, c74618ad69cd41f89213bdf7943bc66e; no voters: d956b41d76f241dea0c0bf203220c9e9
I20260709 12:25:10.175922  9385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760a965208844aeba856202c350ec597" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74618ad69cd41f89213bdf7943bc66e" is_pre_election: true
I20260709 12:25:10.177618  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760a965208844aeba856202c350ec597" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30" is_pre_election: true
W20260709 12:25:10.178328  9256 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:10.179095  9522 raft_consensus.cc:493] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:10.179221  9425 leader_election.cc:343] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.179627  9522 raft_consensus.cc:515] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.184971  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9cc9b294414da9994f61f618ff3e7d" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9" is_pre_election: true
I20260709 12:25:10.185338  9522 leader_election.cc:290] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
W20260709 12:25:10.186462  9273 leader_election.cc:343] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.186503  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11128abd1e764a12b8d231570608b56d" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9" is_pre_election: true
I20260709 12:25:10.187301  9501 tablet_bootstrap.cc:492] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9: No bootstrap required, opened a new log
W20260709 12:25:10.187288  9422 leader_election.cc:343] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.187906  9501 ts_tablet_manager.cc:1403] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9: Time spent bootstrapping tablet: real 0.026s	user 0.003s	sys 0.015s
I20260709 12:25:10.187860  9422 leader_election.cc:304] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d956b41d76f241dea0c0bf203220c9e9; no voters: b196ee6e89b2464695c8220d77dcdb30, c74618ad69cd41f89213bdf7943bc66e
W20260709 12:25:10.188112  9348 leader_election.cc:343] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.189000  9509 raft_consensus.cc:2749] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:10.190368  9500 tablet_bootstrap.cc:492] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30: No bootstrap required, opened a new log
I20260709 12:25:10.190873  9500 ts_tablet_manager.cc:1403] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.014s
I20260709 12:25:10.190968  9501 raft_consensus.cc:359] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.191699  9501 raft_consensus.cc:385] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.192013  9501 raft_consensus.cc:740] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.192732  9501 consensus_queue.cc:260] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.194216  9385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9cc9b294414da9994f61f618ff3e7d" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74618ad69cd41f89213bdf7943bc66e" is_pre_election: true
I20260709 12:25:10.194919  9385 raft_consensus.cc:2468] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 0.
I20260709 12:25:10.195007  9499 tablet_bootstrap.cc:492] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e: No bootstrap required, opened a new log
I20260709 12:25:10.195007  9501 ts_tablet_manager.cc:1434] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:10.194212  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11128abd1e764a12b8d231570608b56d" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30" is_pre_election: true
I20260709 12:25:10.195627  9499 ts_tablet_manager.cc:1403] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e: Time spent bootstrapping tablet: real 0.068s	user 0.021s	sys 0.012s
I20260709 12:25:10.196350  9501 tablet_bootstrap.cc:492] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9: Bootstrap starting.
I20260709 12:25:10.196698  9273 leader_election.cc:304] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, c74618ad69cd41f89213bdf7943bc66e; no voters: d956b41d76f241dea0c0bf203220c9e9
I20260709 12:25:10.197842  9504 raft_consensus.cc:2804] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.198185  9504 raft_consensus.cc:493] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.198555  9504 raft_consensus.cc:3060] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:10.198518  9351 leader_election.cc:343] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.198730  9499 raft_consensus.cc:359] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.199468  9522 raft_consensus.cc:2804] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.199700  9499 raft_consensus.cc:385] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.199875  9522 raft_consensus.cc:493] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.199065  9351 leader_election.cc:304] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c74618ad69cd41f89213bdf7943bc66e; no voters: b196ee6e89b2464695c8220d77dcdb30, d956b41d76f241dea0c0bf203220c9e9
I20260709 12:25:10.201449  9499 raft_consensus.cc:740] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.202168  9531 raft_consensus.cc:2749] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:10.201001  9522 raft_consensus.cc:3060] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.202371  9499 consensus_queue.cc:260] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.203181  9501 tablet_bootstrap.cc:654] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.204970  9499 ts_tablet_manager.cc:1434] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:25:10.206233  9504 raft_consensus.cc:515] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.207512  9499 tablet_bootstrap.cc:492] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e: Bootstrap starting.
I20260709 12:25:10.209446  9385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9cc9b294414da9994f61f618ff3e7d" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
I20260709 12:25:10.211891  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9cc9b294414da9994f61f618ff3e7d" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:10.208370  9500 raft_consensus.cc:359] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.212479  9459 raft_consensus.cc:3060] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.212591  9500 raft_consensus.cc:385] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.213194  9500 raft_consensus.cc:740] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.214437  9500 consensus_queue.cc:260] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.219336  9522 raft_consensus.cc:515] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.221593  9504 leader_election.cc:290] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 1 election: Requested vote from peers c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.221287  9459 raft_consensus.cc:2468] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 1.
I20260709 12:25:10.222359  9385 raft_consensus.cc:2393] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b196ee6e89b2464695c8220d77dcdb30 in current term 1: Already voted for candidate c74618ad69cd41f89213bdf7943bc66e in this term.
I20260709 12:25:10.222949  9273 leader_election.cc:304] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:10.223604  9501 tablet_bootstrap.cc:492] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9: No bootstrap required, opened a new log
I20260709 12:25:10.221418  9499 tablet_bootstrap.cc:654] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.224145  9501 ts_tablet_manager.cc:1403] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.016s
I20260709 12:25:10.227155  9501 raft_consensus.cc:359] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.227865  9501 raft_consensus.cc:385] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.228137  9501 raft_consensus.cc:740] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.228965  9501 consensus_queue.cc:260] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.231411  9501 ts_tablet_manager.cc:1434] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:10.232391  9501 tablet_bootstrap.cc:492] T 8099fdb4a59c47a89b57f9137a8932d3 P d956b41d76f241dea0c0bf203220c9e9: Bootstrap starting.
I20260709 12:25:10.238458  9501 tablet_bootstrap.cc:654] T 8099fdb4a59c47a89b57f9137a8932d3 P d956b41d76f241dea0c0bf203220c9e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.239363  9207 catalog_manager.cc:5697] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e reported cstate change: term changed from 0 to 1, leader changed from <none> to c74618ad69cd41f89213bdf7943bc66e (127.8.111.66). New cstate: current_term: 1 leader_uuid: "c74618ad69cd41f89213bdf7943bc66e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.242666  9504 raft_consensus.cc:2804] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.243225  9504 raft_consensus.cc:697] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 1 LEADER]: Becoming Leader. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Running, Role: LEADER
I20260709 12:25:10.244143  9504 consensus_queue.cc:237] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.245833  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9cc9b294414da9994f61f618ff3e7d" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
I20260709 12:25:10.250532  9522 leader_election.cc:290] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 election: Requested vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.256397  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9cc9b294414da9994f61f618ff3e7d" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:10.257645  9459 raft_consensus.cc:2393] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c74618ad69cd41f89213bdf7943bc66e in current term 1: Already voted for candidate b196ee6e89b2464695c8220d77dcdb30 in this term.
I20260709 12:25:10.256457  9500 ts_tablet_manager.cc:1434] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30: Time spent starting tablet: real 0.065s	user 0.010s	sys 0.000s
I20260709 12:25:10.258656  9348 leader_election.cc:304] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c74618ad69cd41f89213bdf7943bc66e; no voters: b196ee6e89b2464695c8220d77dcdb30, d956b41d76f241dea0c0bf203220c9e9
I20260709 12:25:10.259791  9500 tablet_bootstrap.cc:492] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30: Bootstrap starting.
I20260709 12:25:10.260295  9499 tablet_bootstrap.cc:492] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e: No bootstrap required, opened a new log
I20260709 12:25:10.260831  9499 ts_tablet_manager.cc:1403] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.020s
I20260709 12:25:10.261303  9501 tablet_bootstrap.cc:492] T 8099fdb4a59c47a89b57f9137a8932d3 P d956b41d76f241dea0c0bf203220c9e9: No bootstrap required, opened a new log
I20260709 12:25:10.261765  9501 ts_tablet_manager.cc:1403] T 8099fdb4a59c47a89b57f9137a8932d3 P d956b41d76f241dea0c0bf203220c9e9: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.012s
I20260709 12:25:10.263989  9499 raft_consensus.cc:359] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.264434  9531 raft_consensus.cc:2749] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:10.264498  9501 raft_consensus.cc:359] T 8099fdb4a59c47a89b57f9137a8932d3 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.265352  9501 raft_consensus.cc:385] T 8099fdb4a59c47a89b57f9137a8932d3 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.265445  9499 raft_consensus.cc:385] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.265785  9501 raft_consensus.cc:740] T 8099fdb4a59c47a89b57f9137a8932d3 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.265939  9499 raft_consensus.cc:740] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.265229  9531 raft_consensus.cc:493] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.266607  9501 consensus_queue.cc:260] T 8099fdb4a59c47a89b57f9137a8932d3 P d956b41d76f241dea0c0bf203220c9e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.266995  9499 consensus_queue.cc:260] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.267297  9531 raft_consensus.cc:515] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.269677  9499 ts_tablet_manager.cc:1434] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:25:10.270900  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70263eac7b74896af9db829c2518019" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30" is_pre_election: true
I20260709 12:25:10.271440  9501 ts_tablet_manager.cc:1434] T 8099fdb4a59c47a89b57f9137a8932d3 P d956b41d76f241dea0c0bf203220c9e9: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:25:10.271484  9500 tablet_bootstrap.cc:654] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.271572  9310 raft_consensus.cc:2468] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 0.
I20260709 12:25:10.272574  9501 tablet_bootstrap.cc:492] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9: Bootstrap starting.
I20260709 12:25:10.272614  9499 tablet_bootstrap.cc:492] T 8099fdb4a59c47a89b57f9137a8932d3 P c74618ad69cd41f89213bdf7943bc66e: Bootstrap starting.
I20260709 12:25:10.277618  9351 leader_election.cc:304] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, c74618ad69cd41f89213bdf7943bc66e; no voters: 
I20260709 12:25:10.278625  9522 raft_consensus.cc:2804] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.279024  9522 raft_consensus.cc:493] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.279419  9522 raft_consensus.cc:3060] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.280181  9499 tablet_bootstrap.cc:654] T 8099fdb4a59c47a89b57f9137a8932d3 P c74618ad69cd41f89213bdf7943bc66e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.280457  9501 tablet_bootstrap.cc:654] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.288396  9206 catalog_manager.cc:5697] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 reported cstate change: term changed from 0 to 1, leader changed from <none> to b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "b196ee6e89b2464695c8220d77dcdb30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.290093  9522 raft_consensus.cc:515] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.290604  9504 raft_consensus.cc:493] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.291128  9504 raft_consensus.cc:515] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.292343  9522 leader_election.cc:290] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 election: Requested vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.293354  9504 leader_election.cc:290] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.293675  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70263eac7b74896af9db829c2518019" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:10.294044  9385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d391d80524431c90ec3ec0348a848d" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74618ad69cd41f89213bdf7943bc66e" is_pre_election: true
I20260709 12:25:10.294242  9531 leader_election.cc:290] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.296393  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d391d80524431c90ec3ec0348a848d" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9" is_pre_election: true
I20260709 12:25:10.294314  9459 raft_consensus.cc:3060] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.297469  9458 raft_consensus.cc:2393] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b196ee6e89b2464695c8220d77dcdb30 in current term 1: Already voted for candidate c74618ad69cd41f89213bdf7943bc66e in this term.
I20260709 12:25:10.298408  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70263eac7b74896af9db829c2518019" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
I20260709 12:25:10.299007  9310 raft_consensus.cc:3060] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.301712  9273 leader_election.cc:304] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30; no voters: c74618ad69cd41f89213bdf7943bc66e, d956b41d76f241dea0c0bf203220c9e9
I20260709 12:25:10.301713  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70263eac7b74896af9db829c2518019" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9" is_pre_election: true
I20260709 12:25:10.302964  9504 raft_consensus.cc:3060] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.304351  9509 raft_consensus.cc:493] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.304978  9509 raft_consensus.cc:515] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.307734  9509 leader_election.cc:290] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911)
I20260709 12:25:10.308473  9309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11128abd1e764a12b8d231570608b56d" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30" is_pre_election: true
I20260709 12:25:10.310240  9504 raft_consensus.cc:2749] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:10.310931  9385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11128abd1e764a12b8d231570608b56d" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74618ad69cd41f89213bdf7943bc66e" is_pre_election: true
I20260709 12:25:10.311601  9385 raft_consensus.cc:2468] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d956b41d76f241dea0c0bf203220c9e9 in term 0.
I20260709 12:25:10.312949  9422 leader_election.cc:304] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c74618ad69cd41f89213bdf7943bc66e, d956b41d76f241dea0c0bf203220c9e9; no voters: 
W20260709 12:25:10.313993  9425 leader_election.cc:343] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.315006  9509 raft_consensus.cc:2804] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.315421  9509 raft_consensus.cc:493] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.315814  9509 raft_consensus.cc:3060] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.317572  9310 raft_consensus.cc:2468] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 1.
I20260709 12:25:10.319150  9351 leader_election.cc:304] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, c74618ad69cd41f89213bdf7943bc66e; no voters: 
I20260709 12:25:10.320335  9531 raft_consensus.cc:2804] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.321060  9531 raft_consensus.cc:697] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Becoming Leader. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Running, Role: LEADER
I20260709 12:25:10.322100  9531 consensus_queue.cc:237] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.316615  9459 raft_consensus.cc:2468] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 1.
I20260709 12:25:10.335054  9509 raft_consensus.cc:515] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.337656  9509 leader_election.cc:290] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 election: Requested vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911)
I20260709 12:25:10.339473  9385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11128abd1e764a12b8d231570608b56d" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
I20260709 12:25:10.340099  9385 raft_consensus.cc:3060] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.340209  9499 tablet_bootstrap.cc:492] T 8099fdb4a59c47a89b57f9137a8932d3 P c74618ad69cd41f89213bdf7943bc66e: No bootstrap required, opened a new log
I20260709 12:25:10.340967  9499 ts_tablet_manager.cc:1403] T 8099fdb4a59c47a89b57f9137a8932d3 P c74618ad69cd41f89213bdf7943bc66e: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.005s
I20260709 12:25:10.342670  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11128abd1e764a12b8d231570608b56d" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
W20260709 12:25:10.343912  9425 leader_election.cc:343] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.345716  9499 raft_consensus.cc:359] T 8099fdb4a59c47a89b57f9137a8932d3 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.346549  9500 tablet_bootstrap.cc:492] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30: No bootstrap required, opened a new log
I20260709 12:25:10.348057  9385 raft_consensus.cc:2468] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d956b41d76f241dea0c0bf203220c9e9 in term 1.
I20260709 12:25:10.348399  9500 ts_tablet_manager.cc:1403] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30: Time spent bootstrapping tablet: real 0.089s	user 0.027s	sys 0.016s
I20260709 12:25:10.349174  9501 tablet_bootstrap.cc:492] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9: No bootstrap required, opened a new log
I20260709 12:25:10.349568  9501 ts_tablet_manager.cc:1403] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9: Time spent bootstrapping tablet: real 0.077s	user 0.011s	sys 0.011s
I20260709 12:25:10.349332  9422 leader_election.cc:304] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c74618ad69cd41f89213bdf7943bc66e, d956b41d76f241dea0c0bf203220c9e9; no voters: b196ee6e89b2464695c8220d77dcdb30
I20260709 12:25:10.348680  9206 catalog_manager.cc:5697] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e reported cstate change: term changed from 0 to 1, leader changed from <none> to c74618ad69cd41f89213bdf7943bc66e (127.8.111.66). New cstate: current_term: 1 leader_uuid: "c74618ad69cd41f89213bdf7943bc66e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.348054  9499 raft_consensus.cc:385] T 8099fdb4a59c47a89b57f9137a8932d3 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.350240  9499 raft_consensus.cc:740] T 8099fdb4a59c47a89b57f9137a8932d3 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.350493  9509 raft_consensus.cc:2804] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.351085  9499 consensus_queue.cc:260] T 8099fdb4a59c47a89b57f9137a8932d3 P c74618ad69cd41f89213bdf7943bc66e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.351387  9500 raft_consensus.cc:359] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.352227  9500 raft_consensus.cc:385] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.352582  9500 raft_consensus.cc:740] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.353230  9499 ts_tablet_manager.cc:1434] T 8099fdb4a59c47a89b57f9137a8932d3 P c74618ad69cd41f89213bdf7943bc66e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:25:10.353356  9500 consensus_queue.cc:260] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.354192  9499 tablet_bootstrap.cc:492] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e: Bootstrap starting.
I20260709 12:25:10.354362  9501 raft_consensus.cc:359] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.354987  9501 raft_consensus.cc:385] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.355230  9501 raft_consensus.cc:740] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.360298  9499 tablet_bootstrap.cc:654] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.360626  9501 consensus_queue.cc:260] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.361788  9504 raft_consensus.cc:493] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.362839  9504 raft_consensus.cc:515] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.364990  9504 leader_election.cc:290] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.365890  9501 ts_tablet_manager.cc:1434] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:25:10.367661  9385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8099fdb4a59c47a89b57f9137a8932d3" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74618ad69cd41f89213bdf7943bc66e" is_pre_election: true
I20260709 12:25:10.367870  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8099fdb4a59c47a89b57f9137a8932d3" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9" is_pre_election: true
I20260709 12:25:10.368382  9385 raft_consensus.cc:2468] T 8099fdb4a59c47a89b57f9137a8932d3 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 0.
I20260709 12:25:10.368494  9459 raft_consensus.cc:2468] T 8099fdb4a59c47a89b57f9137a8932d3 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 0.
I20260709 12:25:10.368847  9500 ts_tablet_manager.cc:1434] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:25:10.369877  9504 raft_consensus.cc:493] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.369843  9273 leader_election.cc:304] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, c74618ad69cd41f89213bdf7943bc66e; no voters: 
I20260709 12:25:10.370424  9504 raft_consensus.cc:515] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.370870  9540 raft_consensus.cc:2804] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.371280  9540 raft_consensus.cc:493] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.371661  9540 raft_consensus.cc:3060] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.371953  9548 raft_consensus.cc:493] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.372535  9500 tablet_bootstrap.cc:492] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30: Bootstrap starting.
I20260709 12:25:10.372395  9548 raft_consensus.cc:515] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.375276  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f40906f3d564ec8acba63581f7d8df6" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30" is_pre_election: true
I20260709 12:25:10.375515  9548 leader_election.cc:290] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911)
I20260709 12:25:10.375887  9310 raft_consensus.cc:2468] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d956b41d76f241dea0c0bf203220c9e9 in term 0.
I20260709 12:25:10.376250  9385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f40906f3d564ec8acba63581f7d8df6" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74618ad69cd41f89213bdf7943bc66e" is_pre_election: true
I20260709 12:25:10.376965  9385 raft_consensus.cc:2468] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d956b41d76f241dea0c0bf203220c9e9 in term 0.
I20260709 12:25:10.377118  9425 leader_election.cc:304] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:10.377975  9504 leader_election.cc:290] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.379431  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f40906f3d564ec8acba63581f7d8df6" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9" is_pre_election: true
I20260709 12:25:10.379581  9385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f40906f3d564ec8acba63581f7d8df6" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74618ad69cd41f89213bdf7943bc66e" is_pre_election: true
I20260709 12:25:10.380064  9459 raft_consensus.cc:2468] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 0.
I20260709 12:25:10.380503  9500 tablet_bootstrap.cc:654] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.380164  9385 raft_consensus.cc:2468] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 0.
I20260709 12:25:10.381102  9509 raft_consensus.cc:697] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 1 LEADER]: Becoming Leader. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Running, Role: LEADER
I20260709 12:25:10.382303  9273 leader_election.cc:304] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, c74618ad69cd41f89213bdf7943bc66e; no voters: 
I20260709 12:25:10.382606  9549 raft_consensus.cc:2804] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.383117  9504 raft_consensus.cc:2804] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.383507  9504 raft_consensus.cc:493] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.383870  9504 raft_consensus.cc:3060] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.382294  9509 consensus_queue.cc:237] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.386861  9540 raft_consensus.cc:515] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.390790  9385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8099fdb4a59c47a89b57f9137a8932d3" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
I20260709 12:25:10.391458  9549 raft_consensus.cc:493] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.391567  9385 raft_consensus.cc:3060] T 8099fdb4a59c47a89b57f9137a8932d3 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.392060  9549 raft_consensus.cc:3060] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.391114  9504 raft_consensus.cc:515] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.397251  9384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f40906f3d564ec8acba63581f7d8df6" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
I20260709 12:25:10.397848  9384 raft_consensus.cc:3060] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.403347  9207 catalog_manager.cc:5697] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "d956b41d76f241dea0c0bf203220c9e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:10.404733  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8099fdb4a59c47a89b57f9137a8932d3" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:10.405524  9459 raft_consensus.cc:3060] T 8099fdb4a59c47a89b57f9137a8932d3 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.405592  9384 raft_consensus.cc:2468] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 1.
I20260709 12:25:10.411202  9273 leader_election.cc:304] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, c74618ad69cd41f89213bdf7943bc66e; no voters: 
I20260709 12:25:10.412761  9548 raft_consensus.cc:493] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.413383  9548 raft_consensus.cc:515] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.416591  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "899bcc97677f4b169b627076ec798cdc" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30" is_pre_election: true
I20260709 12:25:10.416754  9459 raft_consensus.cc:2468] T 8099fdb4a59c47a89b57f9137a8932d3 P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 1.
I20260709 12:25:10.417174  9548 leader_election.cc:290] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911)
I20260709 12:25:10.417205  9310 raft_consensus.cc:2468] T 899bcc97677f4b169b627076ec798cdc P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d956b41d76f241dea0c0bf203220c9e9 in term 0.
I20260709 12:25:10.418576  9425 leader_election.cc:304] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:10.418619  9540 leader_election.cc:290] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 1 election: Requested vote from peers c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.419530  9548 raft_consensus.cc:2804] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.419943  9548 raft_consensus.cc:493] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.419983  9540 raft_consensus.cc:2804] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.420373  9548 raft_consensus.cc:3060] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.420683  9540 raft_consensus.cc:697] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 1 LEADER]: Becoming Leader. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Running, Role: LEADER
I20260709 12:25:10.424918  9385 raft_consensus.cc:2468] T 8099fdb4a59c47a89b57f9137a8932d3 P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 1.
I20260709 12:25:10.421818  9540 consensus_queue.cc:237] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.427546  9504 leader_election.cc:290] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 1 election: Requested vote from peers c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.426607  9384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "899bcc97677f4b169b627076ec798cdc" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74618ad69cd41f89213bdf7943bc66e" is_pre_election: true
W20260709 12:25:10.431354  9422 leader_election.cc:343] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:10.432631  9499 tablet_bootstrap.cc:492] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e: No bootstrap required, opened a new log
I20260709 12:25:10.433094  9499 ts_tablet_manager.cc:1403] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e: Time spent bootstrapping tablet: real 0.079s	user 0.016s	sys 0.001s
I20260709 12:25:10.435772  9499 raft_consensus.cc:359] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.436931  9499 raft_consensus.cc:385] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.437168  9500 tablet_bootstrap.cc:492] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30: No bootstrap required, opened a new log
I20260709 12:25:10.437270  9499 raft_consensus.cc:740] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.437661  9500 ts_tablet_manager.cc:1403] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30: Time spent bootstrapping tablet: real 0.065s	user 0.029s	sys 0.029s
I20260709 12:25:10.438032  9499 consensus_queue.cc:260] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.438674  9207 catalog_manager.cc:5697] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 reported cstate change: term changed from 0 to 1, leader changed from <none> to b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "b196ee6e89b2464695c8220d77dcdb30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.439903  9499 ts_tablet_manager.cc:1434] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:10.440754  9499 tablet_bootstrap.cc:492] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e: Bootstrap starting.
I20260709 12:25:10.440495  9500 raft_consensus.cc:359] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.441124  9500 raft_consensus.cc:385] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.441388  9500 raft_consensus.cc:740] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.442138  9500 consensus_queue.cc:260] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.443114  9273 leader_election.cc:304] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:10.444051  9500 ts_tablet_manager.cc:1434] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:10.444885  9500 tablet_bootstrap.cc:492] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30: Bootstrap starting.
I20260709 12:25:10.444855  9553 raft_consensus.cc:2804] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.445400  9509 raft_consensus.cc:493] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.445840  9509 raft_consensus.cc:515] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.447018  9548 raft_consensus.cc:515] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.447891  9509 leader_election.cc:290] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911)
I20260709 12:25:10.448971  9548 leader_election.cc:290] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 election: Requested vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911)
I20260709 12:25:10.451205  9309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "899bcc97677f4b169b627076ec798cdc" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
I20260709 12:25:10.451959  9309 raft_consensus.cc:3060] T 899bcc97677f4b169b627076ec798cdc P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.455492  9384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "899bcc97677f4b169b627076ec798cdc" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
I20260709 12:25:10.455914  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f40906f3d564ec8acba63581f7d8df6" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:10.456558  9549 raft_consensus.cc:515] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.461570  9384 raft_consensus.cc:3060] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.462071  9459 raft_consensus.cc:2393] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b196ee6e89b2464695c8220d77dcdb30 in current term 1: Already voted for candidate d956b41d76f241dea0c0bf203220c9e9 in this term.
I20260709 12:25:10.458583  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17da24262ab34c6c847a08b645b7ef8c" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30" is_pre_election: true
I20260709 12:25:10.463165  9310 raft_consensus.cc:2393] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d956b41d76f241dea0c0bf203220c9e9 in current term 1: Already voted for candidate c74618ad69cd41f89213bdf7943bc66e in this term.
I20260709 12:25:10.463373  9385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17da24262ab34c6c847a08b645b7ef8c" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74618ad69cd41f89213bdf7943bc66e" is_pre_election: true
I20260709 12:25:10.459713  9500 tablet_bootstrap.cc:654] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.464969  9549 leader_election.cc:290] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 election: Requested vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911)
I20260709 12:25:10.465924  9531 raft_consensus.cc:493] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.466372  9531 raft_consensus.cc:515] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.461001  9309 raft_consensus.cc:2468] T 899bcc97677f4b169b627076ec798cdc P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d956b41d76f241dea0c0bf203220c9e9 in term 1.
I20260709 12:25:10.466943  9499 tablet_bootstrap.cc:654] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:10.468526  9531 leader_election.cc:290] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.470944  9384 raft_consensus.cc:2468] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d956b41d76f241dea0c0bf203220c9e9 in term 1.
I20260709 12:25:10.471798  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f40906f3d564ec8acba63581f7d8df6" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
I20260709 12:25:10.472785  9425 leader_election.cc:304] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:10.471909  9309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa27643756124363a439a22cf9d38101" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30" is_pre_election: true
I20260709 12:25:10.473769  9549 raft_consensus.cc:2804] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.474264  9549 raft_consensus.cc:697] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [term 1 LEADER]: Becoming Leader. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Running, Role: LEADER
I20260709 12:25:10.474203  9309 raft_consensus.cc:2468] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 0.
I20260709 12:25:10.475101  9422 leader_election.cc:304] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d956b41d76f241dea0c0bf203220c9e9; no voters: b196ee6e89b2464695c8220d77dcdb30, c74618ad69cd41f89213bdf7943bc66e
I20260709 12:25:10.475255  9549 consensus_queue.cc:237] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.476696  9351 leader_election.cc:304] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, c74618ad69cd41f89213bdf7943bc66e; no voters: 
I20260709 12:25:10.477523  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa27643756124363a439a22cf9d38101" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9" is_pre_election: true
I20260709 12:25:10.477730  9509 raft_consensus.cc:3060] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.478127  9459 raft_consensus.cc:2468] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 0.
I20260709 12:25:10.478781  9384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f40906f3d564ec8acba63581f7d8df6" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
I20260709 12:25:10.479306  9500 tablet_bootstrap.cc:492] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30: No bootstrap required, opened a new log
I20260709 12:25:10.479527  9384 raft_consensus.cc:2393] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d956b41d76f241dea0c0bf203220c9e9 in current term 1: Already voted for candidate b196ee6e89b2464695c8220d77dcdb30 in this term.
I20260709 12:25:10.479832  9500 ts_tablet_manager.cc:1403] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.008s
I20260709 12:25:10.480377  9531 raft_consensus.cc:2804] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.480754  9531 raft_consensus.cc:493] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.481184  9531 raft_consensus.cc:3060] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.482708  9500 raft_consensus.cc:359] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.483405  9500 raft_consensus.cc:385] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.483723  9500 raft_consensus.cc:740] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.484550  9509 raft_consensus.cc:2749] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:10.484436  9500 consensus_queue.cc:260] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.485736  9422 leader_election.cc:304] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d956b41d76f241dea0c0bf203220c9e9; no voters: b196ee6e89b2464695c8220d77dcdb30, c74618ad69cd41f89213bdf7943bc66e
I20260709 12:25:10.486544  9548 raft_consensus.cc:2749] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:10.486898  9500 ts_tablet_manager.cc:1434] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:25:10.445415  9553 raft_consensus.cc:697] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [term 1 LEADER]: Becoming Leader. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Running, Role: LEADER
I20260709 12:25:10.488050  9553 consensus_queue.cc:237] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.491741  9531 raft_consensus.cc:515] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.494822  9309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa27643756124363a439a22cf9d38101" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
I20260709 12:25:10.495369  9499 tablet_bootstrap.cc:492] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e: No bootstrap required, opened a new log
I20260709 12:25:10.495416  9309 raft_consensus.cc:3060] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.495886  9499 ts_tablet_manager.cc:1403] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.000s
I20260709 12:25:10.497678  9531 leader_election.cc:290] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 election: Requested vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.497922  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa27643756124363a439a22cf9d38101" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:10.498497  9459 raft_consensus.cc:3060] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.498454  9499 raft_consensus.cc:359] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.498900  9499 raft_consensus.cc:385] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:10.499063  9499 raft_consensus.cc:740] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Initialized, Role: FOLLOWER
I20260709 12:25:10.499568  9499 consensus_queue.cc:260] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.500098  9531 raft_consensus.cc:493] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.501283  9499 ts_tablet_manager.cc:1434] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:10.501060  9531 raft_consensus.cc:515] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.504143  9309 raft_consensus.cc:2468] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 1.
I20260709 12:25:10.505266  9459 raft_consensus.cc:2468] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 1.
I20260709 12:25:10.506253  9348 leader_election.cc:304] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c74618ad69cd41f89213bdf7943bc66e, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:10.507282  9522 raft_consensus.cc:2804] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.507705  9522 raft_consensus.cc:697] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Becoming Leader. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Running, Role: LEADER
I20260709 12:25:10.507089  9206 catalog_manager.cc:5697] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "d956b41d76f241dea0c0bf203220c9e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:10.507846  9207 catalog_manager.cc:5697] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 reported cstate change: term changed from 0 to 1, leader changed from <none> to b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "b196ee6e89b2464695c8220d77dcdb30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.508455  9522 consensus_queue.cc:237] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.512065  9309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760a965208844aeba856202c350ec597" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30" is_pre_election: true
I20260709 12:25:10.512358  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760a965208844aeba856202c350ec597" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9" is_pre_election: true
I20260709 12:25:10.512668  9309 raft_consensus.cc:2468] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 0.
I20260709 12:25:10.512921  9459 raft_consensus.cc:2468] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 0.
I20260709 12:25:10.513721  9351 leader_election.cc:304] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, c74618ad69cd41f89213bdf7943bc66e; no voters: 
I20260709 12:25:10.514005  9531 leader_election.cc:290] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.514629  9531 raft_consensus.cc:2804] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:10.514959  9531 raft_consensus.cc:493] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.515172  9531 raft_consensus.cc:3060] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.518872  9506 consensus_queue.cc:1048] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:10.524391  9531 raft_consensus.cc:515] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.528481  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760a965208844aeba856202c350ec597" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
I20260709 12:25:10.529038  9310 raft_consensus.cc:3060] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.531984  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760a965208844aeba856202c350ec597" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:10.532590  9459 raft_consensus.cc:3060] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.536063  9310 raft_consensus.cc:2468] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 1.
I20260709 12:25:10.537185  9351 leader_election.cc:304] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, c74618ad69cd41f89213bdf7943bc66e; no voters: 
I20260709 12:25:10.538034  9522 raft_consensus.cc:2804] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:10.538512  9522 raft_consensus.cc:697] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Becoming Leader. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Running, Role: LEADER
I20260709 12:25:10.539317  9522 consensus_queue.cc:237] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.541350  9205 catalog_manager.cc:5697] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e reported cstate change: term changed from 0 to 1, leader changed from <none> to c74618ad69cd41f89213bdf7943bc66e (127.8.111.66). New cstate: current_term: 1 leader_uuid: "c74618ad69cd41f89213bdf7943bc66e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.543139  9531 leader_election.cc:290] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 1 election: Requested vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.543692  9459 raft_consensus.cc:2468] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 1.
I20260709 12:25:10.549649  9531 consensus_queue.cc:1048] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:10.556901  9531 consensus_queue.cc:1048] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:10.562252  9206 catalog_manager.cc:5697] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e reported cstate change: term changed from 0 to 1, leader changed from <none> to c74618ad69cd41f89213bdf7943bc66e (127.8.111.66). New cstate: current_term: 1 leader_uuid: "c74618ad69cd41f89213bdf7943bc66e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.572304  9508 consensus_queue.cc:1048] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:10.636488  9553 consensus_queue.cc:1048] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:10.646155  9553 consensus_queue.cc:1048] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:10.666143  9553 raft_consensus.cc:493] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.666774  9553 raft_consensus.cc:515] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.668874  9553 leader_election.cc:290] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.669597  9384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11128abd1e764a12b8d231570608b56d" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c74618ad69cd41f89213bdf7943bc66e" is_pre_election: true
I20260709 12:25:10.670017  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11128abd1e764a12b8d231570608b56d" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d956b41d76f241dea0c0bf203220c9e9" is_pre_election: true
I20260709 12:25:10.670331  9384 raft_consensus.cc:2393] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b196ee6e89b2464695c8220d77dcdb30 in current term 1: Already voted for candidate d956b41d76f241dea0c0bf203220c9e9 in this term.
I20260709 12:25:10.671409  9273 leader_election.cc:304] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30; no voters: c74618ad69cd41f89213bdf7943bc66e, d956b41d76f241dea0c0bf203220c9e9
I20260709 12:25:10.672049  9553 raft_consensus.cc:3060] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:10.676730  9553 raft_consensus.cc:2749] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:10.727309  9508 consensus_queue.cc:1048] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:10.737942  9531 consensus_queue.cc:1048] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:10.785423  9384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78d391d80524431c90ec3ec0348a848d"
dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
mode: GRACEFUL
new_leader_uuid: "b196ee6e89b2464695c8220d77dcdb30"
 from {username='slave'} at 127.0.0.1:43772
I20260709 12:25:10.785981  9384 raft_consensus.cc:606] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Received request to transfer leadership to TS b196ee6e89b2464695c8220d77dcdb30
I20260709 12:25:10.790452  9384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17da24262ab34c6c847a08b645b7ef8c"
dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
mode: GRACEFUL
new_leader_uuid: "b196ee6e89b2464695c8220d77dcdb30"
 from {username='slave'} at 127.0.0.1:43772
I20260709 12:25:10.790887  9384 raft_consensus.cc:606] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Received request to transfer leadership to TS b196ee6e89b2464695c8220d77dcdb30
I20260709 12:25:10.795233  9384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d70263eac7b74896af9db829c2518019"
dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
mode: GRACEFUL
new_leader_uuid: "b196ee6e89b2464695c8220d77dcdb30"
 from {username='slave'} at 127.0.0.1:43772
I20260709 12:25:10.795691  9384 raft_consensus.cc:606] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Received request to transfer leadership to TS b196ee6e89b2464695c8220d77dcdb30
I20260709 12:25:10.800078  9384 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "760a965208844aeba856202c350ec597"
dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
mode: GRACEFUL
new_leader_uuid: "b196ee6e89b2464695c8220d77dcdb30"
 from {username='slave'} at 127.0.0.1:43772
I20260709 12:25:10.800534  9384 raft_consensus.cc:606] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Received request to transfer leadership to TS b196ee6e89b2464695c8220d77dcdb30
I20260709 12:25:10.814764  9458 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11128abd1e764a12b8d231570608b56d"
dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
mode: GRACEFUL
new_leader_uuid: "c74618ad69cd41f89213bdf7943bc66e"
 from {username='slave'} at 127.0.0.1:48880
I20260709 12:25:10.815281  9458 raft_consensus.cc:606] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 1 LEADER]: Received request to transfer leadership to TS c74618ad69cd41f89213bdf7943bc66e
I20260709 12:25:10.830586  9309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab9cc9b294414da9994f61f618ff3e7d"
dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
mode: GRACEFUL
new_leader_uuid: "c74618ad69cd41f89213bdf7943bc66e"
 from {username='slave'} at 127.0.0.1:45644
I20260709 12:25:10.831101  9309 raft_consensus.cc:606] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 1 LEADER]: Received request to transfer leadership to TS c74618ad69cd41f89213bdf7943bc66e
I20260709 12:25:10.835937  9458 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "899bcc97677f4b169b627076ec798cdc"
dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
mode: GRACEFUL
new_leader_uuid: "c74618ad69cd41f89213bdf7943bc66e"
 from {username='slave'} at 127.0.0.1:48880
I20260709 12:25:10.836443  9458 raft_consensus.cc:606] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [term 1 LEADER]: Received request to transfer leadership to TS c74618ad69cd41f89213bdf7943bc66e
I20260709 12:25:10.841235  9309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f40906f3d564ec8acba63581f7d8df6"
dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
mode: GRACEFUL
new_leader_uuid: "d956b41d76f241dea0c0bf203220c9e9"
 from {username='slave'} at 127.0.0.1:45644
I20260709 12:25:10.841697  9309 raft_consensus.cc:606] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 1 LEADER]: Received request to transfer leadership to TS d956b41d76f241dea0c0bf203220c9e9
I20260709 12:25:10.887524  9549 consensus_queue.cc:1048] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:10.893431  9509 raft_consensus.cc:993] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9: : Instructing follower c74618ad69cd41f89213bdf7943bc66e to start an election
I20260709 12:25:10.893908  9548 raft_consensus.cc:1081] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 1 LEADER]: Signalling peer c74618ad69cd41f89213bdf7943bc66e to start an election
I20260709 12:25:10.895550  9385 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11128abd1e764a12b8d231570608b56d"
dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
 from {username='slave'} at 127.0.0.1:43752
I20260709 12:25:10.896351  9385 raft_consensus.cc:493] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:10.896767  9385 raft_consensus.cc:3060] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:10.900274  9509 consensus_queue.cc:1048] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:10.903743  9385 raft_consensus.cc:515] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.906652  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11128abd1e764a12b8d231570608b56d" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
I20260709 12:25:10.907778  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11128abd1e764a12b8d231570608b56d" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:10.908354  9458 raft_consensus.cc:3055] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:10.908675  9458 raft_consensus.cc:740] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Running, Role: LEADER
I20260709 12:25:10.909735  9385 leader_election.cc:290] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 2 election: Requested vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.909499  9458 consensus_queue.cc:260] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.910806  9458 raft_consensus.cc:3060] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:10.916318  9458 raft_consensus.cc:2468] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 2.
I20260709 12:25:10.917250  9348 leader_election.cc:304] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c74618ad69cd41f89213bdf7943bc66e, d956b41d76f241dea0c0bf203220c9e9; no voters: b196ee6e89b2464695c8220d77dcdb30
I20260709 12:25:10.917843  9531 raft_consensus.cc:2804] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:10.918324  9531 raft_consensus.cc:697] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 2 LEADER]: Becoming Leader. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Running, Role: LEADER
I20260709 12:25:10.918992  9531 consensus_queue.cc:237] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.925542  9205 catalog_manager.cc:5697] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e reported cstate change: term changed from 1 to 2, leader changed from d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67) to c74618ad69cd41f89213bdf7943bc66e (127.8.111.66). New cstate: current_term: 2 leader_uuid: "c74618ad69cd41f89213bdf7943bc66e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.950133  9553 consensus_queue.cc:1048] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:10.961026  9504 consensus_queue.cc:1048] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:10.966717  9531 raft_consensus.cc:993] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e: : Instructing follower b196ee6e89b2464695c8220d77dcdb30 to start an election
I20260709 12:25:10.967247  9531 raft_consensus.cc:1081] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Signalling peer b196ee6e89b2464695c8220d77dcdb30 to start an election
I20260709 12:25:10.968917  9309 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17da24262ab34c6c847a08b645b7ef8c"
dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
 from {username='slave'} at 127.0.0.1:45624
I20260709 12:25:10.969508  9309 raft_consensus.cc:493] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:10.969883  9309 raft_consensus.cc:3060] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:10.976833  9309 raft_consensus.cc:515] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.976898  9509 consensus_queue.cc:1048] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:10.980064  9385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17da24262ab34c6c847a08b645b7ef8c" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
I20260709 12:25:10.980209  9459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17da24262ab34c6c847a08b645b7ef8c" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:10.980790  9459 raft_consensus.cc:3060] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:10.984910  9506 consensus_queue.cc:1048] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:10.980795  9385 raft_consensus.cc:3055] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:10.988237  9309 leader_election.cc:290] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 2 election: Requested vote from peers c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:10.991716  9509 consensus_queue.cc:1048] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:10.988083  9385 raft_consensus.cc:740] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Running, Role: LEADER
I20260709 12:25:10.992184  9459 raft_consensus.cc:2468] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 2.
I20260709 12:25:10.993111  9385 consensus_queue.cc:260] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:10.993541  9540 consensus_queue.cc:1048] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:10.995596  9273 leader_election.cc:304] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:10.996878  9540 raft_consensus.cc:2804] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:10.997578  9540 raft_consensus.cc:697] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Becoming Leader. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Running, Role: LEADER
I20260709 12:25:10.994422  9385 raft_consensus.cc:3060] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:10.998396  9540 consensus_queue.cc:237] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:11.000217  9548 raft_consensus.cc:993] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9: : Instructing follower c74618ad69cd41f89213bdf7943bc66e to start an election
I20260709 12:25:11.000953  9509 raft_consensus.cc:1081] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [term 1 LEADER]: Signalling peer c74618ad69cd41f89213bdf7943bc66e to start an election
I20260709 12:25:11.003983  9383 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "899bcc97677f4b169b627076ec798cdc"
dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
 from {username='slave'} at 127.0.0.1:43752
I20260709 12:25:11.004590  9383 raft_consensus.cc:493] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:11.004968  9383 raft_consensus.cc:3060] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.014309  9504 consensus_queue.cc:1048] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:11.016637  9383 raft_consensus.cc:515] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:11.017753  9384 raft_consensus.cc:1240] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Rejecting Update request from peer d956b41d76f241dea0c0bf203220c9e9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:11.017141  9385 raft_consensus.cc:2468] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 2.
I20260709 12:25:11.022239  9549 consensus_queue.cc:1059] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:11.027112  9383 leader_election.cc:290] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 2 election: Requested vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:11.028204  9458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "899bcc97677f4b169b627076ec798cdc" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:11.030539  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "899bcc97677f4b169b627076ec798cdc" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
I20260709 12:25:11.031147  9310 raft_consensus.cc:3060] T 899bcc97677f4b169b627076ec798cdc P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.031734  9531 consensus_queue.cc:1048] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:11.035277  9540 raft_consensus.cc:993] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30: : Instructing follower d956b41d76f241dea0c0bf203220c9e9 to start an election
I20260709 12:25:11.035699  9540 raft_consensus.cc:1081] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 1 LEADER]: Signalling peer d956b41d76f241dea0c0bf203220c9e9 to start an election
I20260709 12:25:11.040373  9458 raft_consensus.cc:3055] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:11.040809  9458 raft_consensus.cc:740] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Running, Role: LEADER
I20260709 12:25:11.041667  9458 consensus_queue.cc:260] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:11.042920  9458 raft_consensus.cc:3060] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.043573  9457 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f40906f3d564ec8acba63581f7d8df6"
dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
 from {username='slave'} at 127.0.0.1:48864
I20260709 12:25:11.044098  9457 raft_consensus.cc:493] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:11.044438  9457 raft_consensus.cc:3060] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.049943  9458 raft_consensus.cc:2468] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 2.
W20260709 12:25:11.050827  9584 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:25:11.054309  9348 leader_election.cc:304] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c74618ad69cd41f89213bdf7943bc66e, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:11.055199  9531 raft_consensus.cc:2804] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:11.055840  9531 raft_consensus.cc:697] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e [term 2 LEADER]: Becoming Leader. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Running, Role: LEADER
I20260709 12:25:11.056638  9531 consensus_queue.cc:237] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:11.059222  9310 raft_consensus.cc:2468] T 899bcc97677f4b169b627076ec798cdc P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 2.
I20260709 12:25:11.062959  9457 raft_consensus.cc:515] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:11.066767  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f40906f3d564ec8acba63581f7d8df6" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
I20260709 12:25:11.072273  9310 raft_consensus.cc:3055] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:11.072600  9310 raft_consensus.cc:740] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Running, Role: LEADER
I20260709 12:25:11.073330  9310 consensus_queue.cc:260] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:11.073747  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f40906f3d564ec8acba63581f7d8df6" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
I20260709 12:25:11.067979  9205 catalog_manager.cc:5697] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 reported cstate change: term changed from 1 to 2, leader changed from c74618ad69cd41f89213bdf7943bc66e (127.8.111.66) to b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "b196ee6e89b2464695c8220d77dcdb30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.074270  9310 raft_consensus.cc:3060] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.074414  9382 raft_consensus.cc:3060] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.071343  9457 leader_election.cc:290] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 2 election: Requested vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911)
I20260709 12:25:11.081348  9310 raft_consensus.cc:2468] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d956b41d76f241dea0c0bf203220c9e9 in term 2.
I20260709 12:25:11.082115  9382 raft_consensus.cc:2468] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d956b41d76f241dea0c0bf203220c9e9 in term 2.
I20260709 12:25:11.082587  9425 leader_election.cc:304] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:11.083564  9584 raft_consensus.cc:2804] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:11.084105  9584 raft_consensus.cc:697] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [term 2 LEADER]: Becoming Leader. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Running, Role: LEADER
I20260709 12:25:11.084937  9584 consensus_queue.cc:237] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:11.088032  9506 raft_consensus.cc:993] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e: : Instructing follower b196ee6e89b2464695c8220d77dcdb30 to start an election
I20260709 12:25:11.088502  9508 raft_consensus.cc:1081] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Signalling peer b196ee6e89b2464695c8220d77dcdb30 to start an election
I20260709 12:25:11.088963  9207 catalog_manager.cc:5697] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e reported cstate change: term changed from 1 to 2, leader changed from d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67) to c74618ad69cd41f89213bdf7943bc66e (127.8.111.66). New cstate: current_term: 2 leader_uuid: "c74618ad69cd41f89213bdf7943bc66e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.090408  9310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78d391d80524431c90ec3ec0348a848d"
dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
 from {username='slave'} at 127.0.0.1:45624
I20260709 12:25:11.090947  9310 raft_consensus.cc:493] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:11.091308  9310 raft_consensus.cc:3060] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.097892  9310 raft_consensus.cc:515] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:11.100270  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d391d80524431c90ec3ec0348a848d" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
I20260709 12:25:11.101157  9310 leader_election.cc:290] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 2 election: Requested vote from peers c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:11.101550  9382 raft_consensus.cc:3055] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:11.101682  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d391d80524431c90ec3ec0348a848d" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:11.101922  9382 raft_consensus.cc:740] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Running, Role: LEADER
I20260709 12:25:11.100212  9205 catalog_manager.cc:5697] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 reported cstate change: term changed from 1 to 2, leader changed from b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65) to d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67). New cstate: current_term: 2 leader_uuid: "d956b41d76f241dea0c0bf203220c9e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:11.102262  9457 raft_consensus.cc:3060] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.102761  9382 consensus_queue.cc:260] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:11.103773  9382 raft_consensus.cc:3060] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.107460  9457 raft_consensus.cc:2468] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 2.
I20260709 12:25:11.108541  9273 leader_election.cc:304] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:11.109205  9504 raft_consensus.cc:2804] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:11.109305  9382 raft_consensus.cc:2468] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 2.
I20260709 12:25:11.109648  9504 raft_consensus.cc:697] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Becoming Leader. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Running, Role: LEADER
I20260709 12:25:11.110503  9504 consensus_queue.cc:237] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:11.118582  9206 catalog_manager.cc:5697] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 reported cstate change: term changed from 1 to 2, leader changed from c74618ad69cd41f89213bdf7943bc66e (127.8.111.66) to b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "b196ee6e89b2464695c8220d77dcdb30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.137823  9508 consensus_queue.cc:1048] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:11.144405  9531 raft_consensus.cc:993] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e: : Instructing follower b196ee6e89b2464695c8220d77dcdb30 to start an election
I20260709 12:25:11.144924  9506 raft_consensus.cc:1081] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Signalling peer b196ee6e89b2464695c8220d77dcdb30 to start an election
I20260709 12:25:11.147506  9308 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "760a965208844aeba856202c350ec597"
dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
 from {username='slave'} at 127.0.0.1:45624
I20260709 12:25:11.148142  9308 raft_consensus.cc:493] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:11.148584  9308 raft_consensus.cc:3060] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.149832  9506 consensus_queue.cc:1048] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:11.158857  9308 raft_consensus.cc:515] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:11.160562  9308 leader_election.cc:290] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 2 election: Requested vote from peers c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:11.161530  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760a965208844aeba856202c350ec597" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
I20260709 12:25:11.161949  9382 raft_consensus.cc:3055] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:11.162257  9382 raft_consensus.cc:740] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Running, Role: LEADER
I20260709 12:25:11.163065  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760a965208844aeba856202c350ec597" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:11.163074  9382 consensus_queue.cc:260] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:11.163769  9457 raft_consensus.cc:3060] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.164693  9382 raft_consensus.cc:3060] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.170672  9531 raft_consensus.cc:993] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e: : Instructing follower b196ee6e89b2464695c8220d77dcdb30 to start an election
I20260709 12:25:11.171126  9506 raft_consensus.cc:1081] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Signalling peer b196ee6e89b2464695c8220d77dcdb30 to start an election
I20260709 12:25:11.172065  9457 raft_consensus.cc:2468] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 2.
I20260709 12:25:11.172435  9308 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d70263eac7b74896af9db829c2518019"
dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
 from {username='slave'} at 127.0.0.1:45624
I20260709 12:25:11.172813  9382 raft_consensus.cc:2468] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 2.
I20260709 12:25:11.173044  9308 raft_consensus.cc:493] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:11.173437  9308 raft_consensus.cc:3060] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.173609  9273 leader_election.cc:304] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:11.174602  9504 raft_consensus.cc:2804] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:11.175143  9504 raft_consensus.cc:697] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Becoming Leader. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Running, Role: LEADER
I20260709 12:25:11.176076  9504 consensus_queue.cc:237] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:11.183630  9308 raft_consensus.cc:515] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:11.184077  9206 catalog_manager.cc:5697] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 reported cstate change: term changed from 1 to 2, leader changed from c74618ad69cd41f89213bdf7943bc66e (127.8.111.66) to b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "b196ee6e89b2464695c8220d77dcdb30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.185348  9308 leader_election.cc:290] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 2 election: Requested vote from peers c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:11.186357  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70263eac7b74896af9db829c2518019" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
I20260709 12:25:11.186911  9382 raft_consensus.cc:3055] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:11.187240  9382 raft_consensus.cc:740] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Running, Role: LEADER
I20260709 12:25:11.187274  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70263eac7b74896af9db829c2518019" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:11.187978  9457 raft_consensus.cc:3060] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.188153  9382 consensus_queue.cc:260] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:11.189431  9382 raft_consensus.cc:3060] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.196111  9457 raft_consensus.cc:2468] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 2.
I20260709 12:25:11.196111  9382 raft_consensus.cc:2468] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 2.
I20260709 12:25:11.197227  9273 leader_election.cc:304] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, c74618ad69cd41f89213bdf7943bc66e; no voters: 
I20260709 12:25:11.197832  9504 raft_consensus.cc:2804] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:11.198298  9504 raft_consensus.cc:697] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Becoming Leader. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Running, Role: LEADER
I20260709 12:25:11.199048  9504 consensus_queue.cc:237] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:11.203938  9540 raft_consensus.cc:993] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30: : Instructing follower c74618ad69cd41f89213bdf7943bc66e to start an election
I20260709 12:25:11.204351  9504 raft_consensus.cc:1081] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 1 LEADER]: Signalling peer c74618ad69cd41f89213bdf7943bc66e to start an election
I20260709 12:25:11.205677  9382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab9cc9b294414da9994f61f618ff3e7d"
dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
 from {username='slave'} at 127.0.0.1:43760
I20260709 12:25:11.206121  9382 raft_consensus.cc:493] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:11.206650  9382 raft_consensus.cc:3060] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.206115  9206 catalog_manager.cc:5697] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 reported cstate change: term changed from 1 to 2, leader changed from c74618ad69cd41f89213bdf7943bc66e (127.8.111.66) to b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "b196ee6e89b2464695c8220d77dcdb30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.212098  9382 raft_consensus.cc:515] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:11.214051  9382 leader_election.cc:290] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 2 election: Requested vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:11.215073  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9cc9b294414da9994f61f618ff3e7d" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:11.215227  9308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9cc9b294414da9994f61f618ff3e7d" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
I20260709 12:25:11.215659  9457 raft_consensus.cc:3060] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.216200  9308 raft_consensus.cc:3055] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:11.216625  9308 raft_consensus.cc:740] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Running, Role: LEADER
I20260709 12:25:11.217559  9308 consensus_queue.cc:260] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:11.218508  9308 raft_consensus.cc:3060] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.220342  9457 raft_consensus.cc:2468] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 2.
I20260709 12:25:11.221316  9348 leader_election.cc:304] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c74618ad69cd41f89213bdf7943bc66e, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:11.222003  9506 raft_consensus.cc:2804] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:11.222400  9506 raft_consensus.cc:697] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 2 LEADER]: Becoming Leader. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Running, Role: LEADER
I20260709 12:25:11.223191  9308 raft_consensus.cc:2468] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 2.
I20260709 12:25:11.223124  9506 consensus_queue.cc:237] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:11.229341  9206 catalog_manager.cc:5697] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e reported cstate change: term changed from 1 to 2, leader changed from b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65) to c74618ad69cd41f89213bdf7943bc66e (127.8.111.66). New cstate: current_term: 2 leader_uuid: "c74618ad69cd41f89213bdf7943bc66e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.475739  9457 raft_consensus.cc:1275] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Refusing update from remote peer b196ee6e89b2464695c8220d77dcdb30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.477084  9553 consensus_queue.cc:1048] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:11.484970  9382 raft_consensus.cc:1275] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Refusing update from remote peer b196ee6e89b2464695c8220d77dcdb30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.486552  9540 consensus_queue.cc:1048] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:11.494421  9308 raft_consensus.cc:3060] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.500572  9308 raft_consensus.cc:1275] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Refusing update from remote peer c74618ad69cd41f89213bdf7943bc66e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.501636  9508 consensus_queue.cc:1048] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:11.509081  9457 raft_consensus.cc:1275] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Refusing update from remote peer c74618ad69cd41f89213bdf7943bc66e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.510679  9531 consensus_queue.cc:1048] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:11.511785  9382 raft_consensus.cc:1275] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Refusing update from remote peer d956b41d76f241dea0c0bf203220c9e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.513476  9548 consensus_queue.cc:1048] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:11.522418  9308 raft_consensus.cc:1275] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Refusing update from remote peer d956b41d76f241dea0c0bf203220c9e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.524034  9548 consensus_queue.cc:1048] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:11.542929  9310 raft_consensus.cc:1275] T 899bcc97677f4b169b627076ec798cdc P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Refusing update from remote peer c74618ad69cd41f89213bdf7943bc66e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.544147  9506 consensus_queue.cc:1048] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:11.551162  9457 raft_consensus.cc:1275] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Refusing update from remote peer c74618ad69cd41f89213bdf7943bc66e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.552724  9508 consensus_queue.cc:1048] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:11.634050  9457 raft_consensus.cc:1275] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Refusing update from remote peer b196ee6e89b2464695c8220d77dcdb30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.635267  9540 consensus_queue.cc:1048] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:11.643966  9382 raft_consensus.cc:1275] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Refusing update from remote peer b196ee6e89b2464695c8220d77dcdb30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.645479  9553 consensus_queue.cc:1048] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:11.649616  9310 raft_consensus.cc:1275] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Refusing update from remote peer c74618ad69cd41f89213bdf7943bc66e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.651204  9506 consensus_queue.cc:1048] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:11.662297  9457 raft_consensus.cc:1275] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Refusing update from remote peer c74618ad69cd41f89213bdf7943bc66e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.664108  9531 consensus_queue.cc:1048] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:11.672808  9459 raft_consensus.cc:1275] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Refusing update from remote peer b196ee6e89b2464695c8220d77dcdb30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.674413  9504 consensus_queue.cc:1048] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:11.682543  9382 raft_consensus.cc:1275] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Refusing update from remote peer b196ee6e89b2464695c8220d77dcdb30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.684247  9591 consensus_queue.cc:1048] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:11.693639  9457 raft_consensus.cc:1275] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Refusing update from remote peer b196ee6e89b2464695c8220d77dcdb30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.694780  9591 consensus_queue.cc:1048] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:11.701752  9382 raft_consensus.cc:1275] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Refusing update from remote peer b196ee6e89b2464695c8220d77dcdb30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.703963  9504 consensus_queue.cc:1048] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:13.873302  8637 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:25:13.873957  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:13.897770  9310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "760a965208844aeba856202c350ec597"
dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
mode: GRACEFUL
new_leader_uuid: "d956b41d76f241dea0c0bf203220c9e9"
 from {username='slave'} at 127.0.0.1:45660
I20260709 12:25:13.898409  9310 raft_consensus.cc:606] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Received request to transfer leadership to TS d956b41d76f241dea0c0bf203220c9e9
I20260709 12:25:13.900846  9310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d70263eac7b74896af9db829c2518019"
dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
mode: GRACEFUL
new_leader_uuid: "d956b41d76f241dea0c0bf203220c9e9"
 from {username='slave'} at 127.0.0.1:45660
I20260709 12:25:13.901244  9310 raft_consensus.cc:606] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Received request to transfer leadership to TS d956b41d76f241dea0c0bf203220c9e9
I20260709 12:25:13.902315  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:13.902724  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:14.088479  9591 raft_consensus.cc:993] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30: : Instructing follower d956b41d76f241dea0c0bf203220c9e9 to start an election
I20260709 12:25:14.089003  9591 raft_consensus.cc:1081] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Signalling peer d956b41d76f241dea0c0bf203220c9e9 to start an election
I20260709 12:25:14.090780  9457 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d70263eac7b74896af9db829c2518019"
dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
 from {username='slave'} at 127.0.0.1:48864
I20260709 12:25:14.091256  9457 raft_consensus.cc:493] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:14.091555  9457 raft_consensus.cc:3060] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:14.096007  9457 raft_consensus.cc:515] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:14.097698  9457 leader_election.cc:290] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 3 election: Requested vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911)
I20260709 12:25:14.098515  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70263eac7b74896af9db829c2518019" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
I20260709 12:25:14.098742  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70263eac7b74896af9db829c2518019" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
I20260709 12:25:14.099014  9310 raft_consensus.cc:3055] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:14.099287  9382 raft_consensus.cc:3060] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:14.099382  9310 raft_consensus.cc:740] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Running, Role: LEADER
I20260709 12:25:14.100131  9310 consensus_queue.cc:260] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:14.101037  9310 raft_consensus.cc:3060] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:14.104094  9382 raft_consensus.cc:2468] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d956b41d76f241dea0c0bf203220c9e9 in term 3.
I20260709 12:25:14.105250  9422 leader_election.cc:304] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c74618ad69cd41f89213bdf7943bc66e, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:14.105587  9310 raft_consensus.cc:2468] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d956b41d76f241dea0c0bf203220c9e9 in term 3.
I20260709 12:25:14.106832  9598 raft_consensus.cc:2804] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:14.107645  9598 raft_consensus.cc:697] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 3 LEADER]: Becoming Leader. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Running, Role: LEADER
I20260709 12:25:14.108263  9598 consensus_queue.cc:237] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:14.114540  9205 catalog_manager.cc:5697] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 reported cstate change: term changed from 2 to 3, leader changed from b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65) to d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67). New cstate: current_term: 3 leader_uuid: "d956b41d76f241dea0c0bf203220c9e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:14.359601  9595 raft_consensus.cc:993] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30: : Instructing follower d956b41d76f241dea0c0bf203220c9e9 to start an election
I20260709 12:25:14.360031  9591 raft_consensus.cc:1081] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Signalling peer d956b41d76f241dea0c0bf203220c9e9 to start an election
I20260709 12:25:14.361328  9459 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "760a965208844aeba856202c350ec597"
dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
 from {username='slave'} at 127.0.0.1:48864
I20260709 12:25:14.361732  9459 raft_consensus.cc:493] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:14.361979  9459 raft_consensus.cc:3060] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:14.368373  9459 raft_consensus.cc:515] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:14.369994  9459 leader_election.cc:290] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 3 election: Requested vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911)
I20260709 12:25:14.370898  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760a965208844aeba856202c350ec597" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
I20260709 12:25:14.371018  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760a965208844aeba856202c350ec597" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
I20260709 12:25:14.371600  9382 raft_consensus.cc:3060] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:14.371585  9310 raft_consensus.cc:3055] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:14.372192  9310 raft_consensus.cc:740] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Running, Role: LEADER
I20260709 12:25:14.373050  9310 consensus_queue.cc:260] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:14.374349  9310 raft_consensus.cc:3060] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:14.379165  9382 raft_consensus.cc:2468] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d956b41d76f241dea0c0bf203220c9e9 in term 3.
I20260709 12:25:14.380301  9422 leader_election.cc:304] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c74618ad69cd41f89213bdf7943bc66e, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:14.380991  9598 raft_consensus.cc:2804] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:14.381203  9310 raft_consensus.cc:2468] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d956b41d76f241dea0c0bf203220c9e9 in term 3.
I20260709 12:25:14.381398  9598 raft_consensus.cc:697] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 3 LEADER]: Becoming Leader. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Running, Role: LEADER
I20260709 12:25:14.382248  9598 consensus_queue.cc:237] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:14.389683  9205 catalog_manager.cc:5697] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 reported cstate change: term changed from 2 to 3, leader changed from b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65) to d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67). New cstate: current_term: 3 leader_uuid: "d956b41d76f241dea0c0bf203220c9e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:14.656014  9382 raft_consensus.cc:1275] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 3 FOLLOWER]: Refusing update from remote peer d956b41d76f241dea0c0bf203220c9e9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:14.657086  9598 consensus_queue.cc:1048] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:14.666253  9310 raft_consensus.cc:1275] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Refusing update from remote peer d956b41d76f241dea0c0bf203220c9e9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:14.669258  9609 consensus_queue.cc:1048] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:14.840564  9382 raft_consensus.cc:1275] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 3 FOLLOWER]: Refusing update from remote peer d956b41d76f241dea0c0bf203220c9e9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:14.841724  9598 consensus_queue.cc:1048] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:14.850572  9310 raft_consensus.cc:1275] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Refusing update from remote peer d956b41d76f241dea0c0bf203220c9e9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:14.852288  9598 consensus_queue.cc:1048] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:14.903527  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:14.908820  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:14.909207  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:15.910087  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:15.915424  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:15.915839  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:16.917263  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:16.924278  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:16.924628  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:17.925583  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:17.930974  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:17.931391  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:18.932319  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:18.937732  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:18.938185  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:19.939050  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:19.945026  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:19.945452  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:20.946622  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:20.954412  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:20.954854  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:21.955758  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:21.960831  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:21.961246  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:22.962266  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:22.967494  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:22.967957  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:23.999363  8637 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:25:24.008569  9459 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d70263eac7b74896af9db829c2518019"
dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
mode: GRACEFUL
new_leader_uuid: "b196ee6e89b2464695c8220d77dcdb30"
 from {username='slave'} at 127.0.0.1:48880
I20260709 12:25:24.009250  9459 raft_consensus.cc:606] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 3 LEADER]: Received request to transfer leadership to TS b196ee6e89b2464695c8220d77dcdb30
I20260709 12:25:24.014353  9457 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "760a965208844aeba856202c350ec597"
dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
mode: GRACEFUL
new_leader_uuid: "b196ee6e89b2464695c8220d77dcdb30"
 from {username='slave'} at 127.0.0.1:48880
I20260709 12:25:24.015054  9457 raft_consensus.cc:606] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 3 LEADER]: Received request to transfer leadership to TS b196ee6e89b2464695c8220d77dcdb30
I20260709 12:25:24.023135  9382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11128abd1e764a12b8d231570608b56d"
dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
mode: GRACEFUL
new_leader_uuid: "b196ee6e89b2464695c8220d77dcdb30"
 from {username='slave'} at 127.0.0.1:43772
I20260709 12:25:24.023597  9382 raft_consensus.cc:606] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 2 LEADER]: Received request to transfer leadership to TS b196ee6e89b2464695c8220d77dcdb30
I20260709 12:25:24.025290  9620 raft_consensus.cc:993] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e: : Instructing follower b196ee6e89b2464695c8220d77dcdb30 to start an election
I20260709 12:25:24.025720  9620 raft_consensus.cc:1081] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 2 LEADER]: Signalling peer b196ee6e89b2464695c8220d77dcdb30 to start an election
I20260709 12:25:24.027333  9310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11128abd1e764a12b8d231570608b56d"
dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
 from {username='slave'} at 127.0.0.1:45624
I20260709 12:25:24.027748  9310 raft_consensus.cc:493] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:24.028060  9310 raft_consensus.cc:3060] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:24.031952  9382 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa27643756124363a439a22cf9d38101"
dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
mode: GRACEFUL
new_leader_uuid: "b196ee6e89b2464695c8220d77dcdb30"
 from {username='slave'} at 127.0.0.1:43772
I20260709 12:25:24.032471  9382 raft_consensus.cc:606] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Received request to transfer leadership to TS b196ee6e89b2464695c8220d77dcdb30
I20260709 12:25:24.034407  9310 raft_consensus.cc:515] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:24.036412  9310 leader_election.cc:290] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 3 election: Requested vote from peers c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:24.037024  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11128abd1e764a12b8d231570608b56d" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
I20260709 12:25:24.037343  9385 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab9cc9b294414da9994f61f618ff3e7d"
dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
mode: GRACEFUL
new_leader_uuid: "b196ee6e89b2464695c8220d77dcdb30"
 from {username='slave'} at 127.0.0.1:43772
I20260709 12:25:24.037415  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11128abd1e764a12b8d231570608b56d" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:24.037747  9382 raft_consensus.cc:3055] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:24.037932  9385 raft_consensus.cc:606] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 2 LEADER]: Received request to transfer leadership to TS b196ee6e89b2464695c8220d77dcdb30
I20260709 12:25:24.037977  9457 raft_consensus.cc:3060] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:24.038100  9382 raft_consensus.cc:740] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Running, Role: LEADER
I20260709 12:25:24.039094  9382 consensus_queue.cc:260] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:24.040302  9382 raft_consensus.cc:3060] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:24.045599  9457 raft_consensus.cc:2468] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 3.
I20260709 12:25:24.046934  9382 raft_consensus.cc:2468] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 3.
I20260709 12:25:24.046963  9273 leader_election.cc:304] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:24.047943  9618 raft_consensus.cc:2804] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:24.048688  9618 raft_consensus.cc:697] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [term 3 LEADER]: Becoming Leader. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Running, Role: LEADER
I20260709 12:25:24.049378  9618 consensus_queue.cc:237] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:24.056272  9206 catalog_manager.cc:5697] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 reported cstate change: term changed from 2 to 3, leader changed from c74618ad69cd41f89213bdf7943bc66e (127.8.111.66) to b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65). New cstate: current_term: 3 leader_uuid: "b196ee6e89b2464695c8220d77dcdb30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:24.131588  9609 raft_consensus.cc:993] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9: : Instructing follower b196ee6e89b2464695c8220d77dcdb30 to start an election
I20260709 12:25:24.132108  9630 raft_consensus.cc:1081] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 3 LEADER]: Signalling peer b196ee6e89b2464695c8220d77dcdb30 to start an election
I20260709 12:25:24.133399  9310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "760a965208844aeba856202c350ec597"
dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
 from {username='slave'} at 127.0.0.1:45640
I20260709 12:25:24.133770  9310 raft_consensus.cc:493] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:24.134038  9310 raft_consensus.cc:3060] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:24.138028  9310 raft_consensus.cc:515] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:24.139338  9310 leader_election.cc:290] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 4 election: Requested vote from peers c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:24.140103  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760a965208844aeba856202c350ec597" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
I20260709 12:25:24.140635  9382 raft_consensus.cc:3060] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:24.140784  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "760a965208844aeba856202c350ec597" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:24.141364  9457 raft_consensus.cc:3055] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:24.141646  9457 raft_consensus.cc:740] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Running, Role: LEADER
I20260709 12:25:24.142511  9457 consensus_queue.cc:260] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:24.143481  9623 raft_consensus.cc:993] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e: : Instructing follower b196ee6e89b2464695c8220d77dcdb30 to start an election
I20260709 12:25:24.143764  9457 raft_consensus.cc:3060] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:24.143945  9620 raft_consensus.cc:1081] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Signalling peer b196ee6e89b2464695c8220d77dcdb30 to start an election
I20260709 12:25:24.145478  9310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa27643756124363a439a22cf9d38101"
dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
 from {username='slave'} at 127.0.0.1:45624
I20260709 12:25:24.146052  9310 raft_consensus.cc:493] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:24.146238  9382 raft_consensus.cc:2468] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 4.
I20260709 12:25:24.146423  9310 raft_consensus.cc:3060] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.147338  9273 leader_election.cc:304] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, c74618ad69cd41f89213bdf7943bc66e; no voters: 
I20260709 12:25:24.148177  9624 raft_consensus.cc:2804] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:24.150305  9457 raft_consensus.cc:2468] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 4.
I20260709 12:25:24.150831  9624 raft_consensus.cc:697] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 4 LEADER]: Becoming Leader. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Running, Role: LEADER
I20260709 12:25:24.151790  9624 consensus_queue.cc:237] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:24.152451  9310 raft_consensus.cc:515] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:24.153937  9310 leader_election.cc:290] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 2 election: Requested vote from peers c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:24.154855  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa27643756124363a439a22cf9d38101" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:24.154767  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa27643756124363a439a22cf9d38101" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
I20260709 12:25:24.155494  9457 raft_consensus.cc:3060] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.155867  9382 raft_consensus.cc:3055] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:24.156262  9382 raft_consensus.cc:740] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Running, Role: LEADER
I20260709 12:25:24.157025  9382 consensus_queue.cc:260] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:24.159456  9206 catalog_manager.cc:5697] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 reported cstate change: term changed from 3 to 4, leader changed from d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67) to b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65). New cstate: current_term: 4 leader_uuid: "b196ee6e89b2464695c8220d77dcdb30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:24.160337  9457 raft_consensus.cc:2468] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 2.
I20260709 12:25:24.157992  9382 raft_consensus.cc:3060] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:24.161653  9273 leader_election.cc:304] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:24.162454  9624 raft_consensus.cc:2804] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:24.162925  9624 raft_consensus.cc:697] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Becoming Leader. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Running, Role: LEADER
I20260709 12:25:24.163743  9624 consensus_queue.cc:237] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:24.168143  9382 raft_consensus.cc:2468] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 2.
I20260709 12:25:24.172704  9206 catalog_manager.cc:5697] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 reported cstate change: term changed from 1 to 2, leader changed from c74618ad69cd41f89213bdf7943bc66e (127.8.111.66) to b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "b196ee6e89b2464695c8220d77dcdb30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:24.324625  9609 raft_consensus.cc:993] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9: : Instructing follower b196ee6e89b2464695c8220d77dcdb30 to start an election
I20260709 12:25:24.325037  9630 raft_consensus.cc:1081] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 3 LEADER]: Signalling peer b196ee6e89b2464695c8220d77dcdb30 to start an election
I20260709 12:25:24.326360  9310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d70263eac7b74896af9db829c2518019"
dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
 from {username='slave'} at 127.0.0.1:45640
I20260709 12:25:24.326786  9310 raft_consensus.cc:493] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:24.327077  9310 raft_consensus.cc:3060] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:24.331056  9310 raft_consensus.cc:515] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:24.332432  9310 leader_election.cc:290] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 4 election: Requested vote from peers c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:24.333074  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70263eac7b74896af9db829c2518019" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
I20260709 12:25:24.333457  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70263eac7b74896af9db829c2518019" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:24.333591  9382 raft_consensus.cc:3060] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:24.333925  9457 raft_consensus.cc:3055] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:24.334179  9457 raft_consensus.cc:740] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Running, Role: LEADER
I20260709 12:25:24.334859  9457 consensus_queue.cc:260] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:24.335711  9457 raft_consensus.cc:3060] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:24.338403  9382 raft_consensus.cc:2468] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 4.
I20260709 12:25:24.339600  9273 leader_election.cc:304] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, c74618ad69cd41f89213bdf7943bc66e; no voters: 
I20260709 12:25:24.340404  9624 raft_consensus.cc:2804] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:24.340855  9624 raft_consensus.cc:697] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 4 LEADER]: Becoming Leader. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Running, Role: LEADER
I20260709 12:25:24.341511  9457 raft_consensus.cc:2468] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 4.
I20260709 12:25:24.341657  9624 consensus_queue.cc:237] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:24.349179  9206 catalog_manager.cc:5697] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 reported cstate change: term changed from 3 to 4, leader changed from d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67) to b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65). New cstate: current_term: 4 leader_uuid: "b196ee6e89b2464695c8220d77dcdb30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:24.461799  9382 raft_consensus.cc:1275] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 3 FOLLOWER]: Refusing update from remote peer b196ee6e89b2464695c8220d77dcdb30: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:24.463086  9624 consensus_queue.cc:1048] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:24.472611  9457 raft_consensus.cc:1275] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Refusing update from remote peer b196ee6e89b2464695c8220d77dcdb30: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:24.473716  9624 consensus_queue.cc:1048] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:24.522562  9623 raft_consensus.cc:993] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e: : Instructing follower b196ee6e89b2464695c8220d77dcdb30 to start an election
I20260709 12:25:24.523010  9623 raft_consensus.cc:1081] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 2 LEADER]: Signalling peer b196ee6e89b2464695c8220d77dcdb30 to start an election
I20260709 12:25:24.524477  9310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab9cc9b294414da9994f61f618ff3e7d"
dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
 from {username='slave'} at 127.0.0.1:45624
I20260709 12:25:24.524883  9310 raft_consensus.cc:493] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:24.525151  9310 raft_consensus.cc:3060] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:24.529385  9310 raft_consensus.cc:515] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:24.530834  9310 leader_election.cc:290] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 3 election: Requested vote from peers c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:24.531584  9382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9cc9b294414da9994f61f618ff3e7d" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
I20260709 12:25:24.531867  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9cc9b294414da9994f61f618ff3e7d" candidate_uuid: "b196ee6e89b2464695c8220d77dcdb30" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:24.532069  9382 raft_consensus.cc:3055] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:24.532326  9382 raft_consensus.cc:740] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Running, Role: LEADER
I20260709 12:25:24.532385  9457 raft_consensus.cc:3060] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:24.532972  9382 consensus_queue.cc:260] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:24.533859  9382 raft_consensus.cc:3060] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:24.537946  9457 raft_consensus.cc:2468] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 3.
I20260709 12:25:24.538777  9273 leader_election.cc:304] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:24.539093  9382 raft_consensus.cc:2468] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b196ee6e89b2464695c8220d77dcdb30 in term 3.
I20260709 12:25:24.539422  9624 raft_consensus.cc:2804] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:24.539932  9624 raft_consensus.cc:697] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 3 LEADER]: Becoming Leader. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Running, Role: LEADER
I20260709 12:25:24.540767  9624 consensus_queue.cc:237] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:24.547049  9206 catalog_manager.cc:5697] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 reported cstate change: term changed from 2 to 3, leader changed from c74618ad69cd41f89213bdf7943bc66e (127.8.111.66) to b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65). New cstate: current_term: 3 leader_uuid: "b196ee6e89b2464695c8220d77dcdb30" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:24.694079  9457 raft_consensus.cc:1275] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Refusing update from remote peer b196ee6e89b2464695c8220d77dcdb30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:24.695220  9624 consensus_queue.cc:1048] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:24.703398  9382 raft_consensus.cc:1275] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Refusing update from remote peer b196ee6e89b2464695c8220d77dcdb30: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:24.704995  9631 consensus_queue.cc:1048] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:24.751777  9457 raft_consensus.cc:1275] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 4 FOLLOWER]: Refusing update from remote peer b196ee6e89b2464695c8220d77dcdb30: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:24.752815  9631 consensus_queue.cc:1048] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:24.761440  9382 raft_consensus.cc:1275] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 4 FOLLOWER]: Refusing update from remote peer b196ee6e89b2464695c8220d77dcdb30: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:24.763077  9618 consensus_queue.cc:1048] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:24.924423  9382 raft_consensus.cc:1275] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 4 FOLLOWER]: Refusing update from remote peer b196ee6e89b2464695c8220d77dcdb30: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:24.925403  9618 consensus_queue.cc:1048] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:24.933585  9457 raft_consensus.cc:1275] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 4 FOLLOWER]: Refusing update from remote peer b196ee6e89b2464695c8220d77dcdb30: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:24.934996  9624 consensus_queue.cc:1048] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:24.988066  9382 raft_consensus.cc:1275] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 3 FOLLOWER]: Refusing update from remote peer b196ee6e89b2464695c8220d77dcdb30: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:24.989030  9624 consensus_queue.cc:1048] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:24.998528  9457 raft_consensus.cc:1275] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Refusing update from remote peer b196ee6e89b2464695c8220d77dcdb30: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:24.999576  9624 consensus_queue.cc:1048] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:27.078256  8637 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:25:27.079167  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:27.086719  9310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78d391d80524431c90ec3ec0348a848d"
dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
mode: GRACEFUL
new_leader_uuid: "c74618ad69cd41f89213bdf7943bc66e"
 from {username='slave'} at 127.0.0.1:45660
I20260709 12:25:27.087430  9310 raft_consensus.cc:606] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Received request to transfer leadership to TS c74618ad69cd41f89213bdf7943bc66e
I20260709 12:25:27.090132  9310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab9cc9b294414da9994f61f618ff3e7d"
dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
mode: GRACEFUL
new_leader_uuid: "d956b41d76f241dea0c0bf203220c9e9"
 from {username='slave'} at 127.0.0.1:45660
I20260709 12:25:27.090651  9310 raft_consensus.cc:606] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 3 LEADER]: Received request to transfer leadership to TS d956b41d76f241dea0c0bf203220c9e9
I20260709 12:25:27.093019  9310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d70263eac7b74896af9db829c2518019"
dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
mode: GRACEFUL
new_leader_uuid: "c74618ad69cd41f89213bdf7943bc66e"
 from {username='slave'} at 127.0.0.1:45660
I20260709 12:25:27.093430  9310 raft_consensus.cc:606] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 4 LEADER]: Received request to transfer leadership to TS c74618ad69cd41f89213bdf7943bc66e
I20260709 12:25:27.095691  9310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa27643756124363a439a22cf9d38101"
dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
mode: GRACEFUL
new_leader_uuid: "d956b41d76f241dea0c0bf203220c9e9"
 from {username='slave'} at 127.0.0.1:45660
I20260709 12:25:27.096153  9310 raft_consensus.cc:606] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Received request to transfer leadership to TS d956b41d76f241dea0c0bf203220c9e9
I20260709 12:25:27.097216  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:25:27.097678  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:27.229549  9624 raft_consensus.cc:993] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30: : Instructing follower d956b41d76f241dea0c0bf203220c9e9 to start an election
I20260709 12:25:27.230125  9650 raft_consensus.cc:1081] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Signalling peer d956b41d76f241dea0c0bf203220c9e9 to start an election
I20260709 12:25:27.231607  9457 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa27643756124363a439a22cf9d38101"
dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
 from {username='slave'} at 127.0.0.1:48864
I20260709 12:25:27.232088  9457 raft_consensus.cc:493] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.232390  9457 raft_consensus.cc:3060] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:27.237962  9457 raft_consensus.cc:515] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:27.240087  9457 leader_election.cc:290] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 3 election: Requested vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911)
I20260709 12:25:27.240885  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa27643756124363a439a22cf9d38101" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
I20260709 12:25:27.241395  9385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa27643756124363a439a22cf9d38101" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
I20260709 12:25:27.241683  9310 raft_consensus.cc:3055] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:27.241935  9385 raft_consensus.cc:3060] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:27.241982  9310 raft_consensus.cc:740] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Running, Role: LEADER
I20260709 12:25:27.242965  9310 consensus_queue.cc:260] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:27.244446  9310 raft_consensus.cc:3060] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:27.250252  9385 raft_consensus.cc:2468] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d956b41d76f241dea0c0bf203220c9e9 in term 3.
I20260709 12:25:27.251662  9310 raft_consensus.cc:2468] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d956b41d76f241dea0c0bf203220c9e9 in term 3.
I20260709 12:25:27.251609  9422 leader_election.cc:304] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c74618ad69cd41f89213bdf7943bc66e, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:27.252624  9630 raft_consensus.cc:2804] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:27.253700  9630 raft_consensus.cc:697] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [term 3 LEADER]: Becoming Leader. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Running, Role: LEADER
I20260709 12:25:27.254558  9630 consensus_queue.cc:237] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:27.261176  9205 catalog_manager.cc:5697] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 reported cstate change: term changed from 2 to 3, leader changed from b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65) to d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67). New cstate: current_term: 3 leader_uuid: "d956b41d76f241dea0c0bf203220c9e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.392344  9650 raft_consensus.cc:993] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30: : Instructing follower d956b41d76f241dea0c0bf203220c9e9 to start an election
I20260709 12:25:27.392768  9624 raft_consensus.cc:1081] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 3 LEADER]: Signalling peer d956b41d76f241dea0c0bf203220c9e9 to start an election
I20260709 12:25:27.394112  9457 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab9cc9b294414da9994f61f618ff3e7d"
dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
 from {username='slave'} at 127.0.0.1:48864
I20260709 12:25:27.394621  9457 raft_consensus.cc:493] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.394903  9457 raft_consensus.cc:3060] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:27.399504  9457 raft_consensus.cc:515] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:27.401008  9457 leader_election.cc:290] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 4 election: Requested vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911)
I20260709 12:25:27.401736  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9cc9b294414da9994f61f618ff3e7d" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
I20260709 12:25:27.402319  9310 raft_consensus.cc:3055] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:27.402098  9385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab9cc9b294414da9994f61f618ff3e7d" candidate_uuid: "d956b41d76f241dea0c0bf203220c9e9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
I20260709 12:25:27.402791  9310 raft_consensus.cc:740] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Running, Role: LEADER
I20260709 12:25:27.403018  9385 raft_consensus.cc:3060] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:27.403581  9310 consensus_queue.cc:260] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:27.404405  9310 raft_consensus.cc:3060] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:27.407655  9385 raft_consensus.cc:2468] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d956b41d76f241dea0c0bf203220c9e9 in term 4.
I20260709 12:25:27.408757  9310 raft_consensus.cc:2468] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d956b41d76f241dea0c0bf203220c9e9 in term 4.
I20260709 12:25:27.408900  9422 leader_election.cc:304] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c74618ad69cd41f89213bdf7943bc66e, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:27.410040  9630 raft_consensus.cc:2804] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:27.410508  9630 raft_consensus.cc:697] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [term 4 LEADER]: Becoming Leader. State: Replica: d956b41d76f241dea0c0bf203220c9e9, State: Running, Role: LEADER
I20260709 12:25:27.411355  9630 consensus_queue.cc:237] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:27.412331  9624 raft_consensus.cc:993] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30: : Instructing follower c74618ad69cd41f89213bdf7943bc66e to start an election
I20260709 12:25:27.412729  9624 raft_consensus.cc:1081] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 4 LEADER]: Signalling peer c74618ad69cd41f89213bdf7943bc66e to start an election
I20260709 12:25:27.414906  9385 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d70263eac7b74896af9db829c2518019"
dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
 from {username='slave'} at 127.0.0.1:43760
I20260709 12:25:27.415375  9385 raft_consensus.cc:493] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.415705  9385 raft_consensus.cc:3060] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:27.419178  9205 catalog_manager.cc:5697] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 reported cstate change: term changed from 3 to 4, leader changed from b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65) to d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67). New cstate: current_term: 4 leader_uuid: "d956b41d76f241dea0c0bf203220c9e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.421211  9385 raft_consensus.cc:515] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:27.424049  9385 leader_election.cc:290] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 5 election: Requested vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:27.425123  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70263eac7b74896af9db829c2518019" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
I20260709 12:25:27.425361  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d70263eac7b74896af9db829c2518019" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:27.425680  9310 raft_consensus.cc:3055] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:27.425856  9457 raft_consensus.cc:3060] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:27.426040  9310 raft_consensus.cc:740] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Running, Role: LEADER
I20260709 12:25:27.427050  9310 consensus_queue.cc:260] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:27.428179  9310 raft_consensus.cc:3060] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:27.432649  9457 raft_consensus.cc:2468] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 5.
I20260709 12:25:27.432742  9310 raft_consensus.cc:2468] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 5.
I20260709 12:25:27.433849  9351 leader_election.cc:304] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b196ee6e89b2464695c8220d77dcdb30, c74618ad69cd41f89213bdf7943bc66e; no voters: 
I20260709 12:25:27.434717  9623 raft_consensus.cc:2804] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:27.435678  9623 raft_consensus.cc:697] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 5 LEADER]: Becoming Leader. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Running, Role: LEADER
I20260709 12:25:27.436455  9623 consensus_queue.cc:237] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:27.443717  9205 catalog_manager.cc:5697] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e reported cstate change: term changed from 4 to 5, leader changed from b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65) to c74618ad69cd41f89213bdf7943bc66e (127.8.111.66). New cstate: current_term: 5 leader_uuid: "c74618ad69cd41f89213bdf7943bc66e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.482262  9624 raft_consensus.cc:993] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30: : Instructing follower c74618ad69cd41f89213bdf7943bc66e to start an election
I20260709 12:25:27.482736  9650 raft_consensus.cc:1081] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Signalling peer c74618ad69cd41f89213bdf7943bc66e to start an election
I20260709 12:25:27.484115  9385 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78d391d80524431c90ec3ec0348a848d"
dest_uuid: "c74618ad69cd41f89213bdf7943bc66e"
 from {username='slave'} at 127.0.0.1:43760
I20260709 12:25:27.484551  9385 raft_consensus.cc:493] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.484814  9385 raft_consensus.cc:3060] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:27.489708  9385 raft_consensus.cc:515] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:27.491422  9385 leader_election.cc:290] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 3 election: Requested vote from peers b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665), d956b41d76f241dea0c0bf203220c9e9 (127.8.111.67:45549)
I20260709 12:25:27.492027  9310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d391d80524431c90ec3ec0348a848d" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b196ee6e89b2464695c8220d77dcdb30"
I20260709 12:25:27.492440  9457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78d391d80524431c90ec3ec0348a848d" candidate_uuid: "c74618ad69cd41f89213bdf7943bc66e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d956b41d76f241dea0c0bf203220c9e9"
I20260709 12:25:27.492641  9310 raft_consensus.cc:3055] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:27.492916  9457 raft_consensus.cc:3060] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:27.492933  9310 raft_consensus.cc:740] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b196ee6e89b2464695c8220d77dcdb30, State: Running, Role: LEADER
I20260709 12:25:27.493824  9310 consensus_queue.cc:260] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:27.494922  9310 raft_consensus.cc:3060] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:27.499117  9457 raft_consensus.cc:2468] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 3.
I20260709 12:25:27.500273  9348 leader_election.cc:304] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c74618ad69cd41f89213bdf7943bc66e, d956b41d76f241dea0c0bf203220c9e9; no voters: 
I20260709 12:25:27.500664  9310 raft_consensus.cc:2468] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c74618ad69cd41f89213bdf7943bc66e in term 3.
I20260709 12:25:27.500965  9623 raft_consensus.cc:2804] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:27.501473  9623 raft_consensus.cc:697] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 3 LEADER]: Becoming Leader. State: Replica: c74618ad69cd41f89213bdf7943bc66e, State: Running, Role: LEADER
I20260709 12:25:27.502233  9623 consensus_queue.cc:237] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } } peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } }
I20260709 12:25:27.509032  9205 catalog_manager.cc:5697] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e reported cstate change: term changed from 2 to 3, leader changed from b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65) to c74618ad69cd41f89213bdf7943bc66e (127.8.111.66). New cstate: current_term: 3 leader_uuid: "c74618ad69cd41f89213bdf7943bc66e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.750207  9385 raft_consensus.cc:1275] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 3 FOLLOWER]: Refusing update from remote peer d956b41d76f241dea0c0bf203220c9e9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:27.751318  9630 consensus_queue.cc:1048] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:27.760507  9310 raft_consensus.cc:1275] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Refusing update from remote peer d956b41d76f241dea0c0bf203220c9e9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:27.762692  9663 consensus_queue.cc:1048] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:27.896440  9457 raft_consensus.cc:1275] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Refusing update from remote peer c74618ad69cd41f89213bdf7943bc66e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:27.897545  9623 consensus_queue.cc:1048] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:27.906016  9310 raft_consensus.cc:1275] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 5 FOLLOWER]: Refusing update from remote peer c74618ad69cd41f89213bdf7943bc66e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:27.908094  9623 consensus_queue.cc:1048] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:27.908727  9310 raft_consensus.cc:1275] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Refusing update from remote peer c74618ad69cd41f89213bdf7943bc66e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:27.910301  9658 consensus_queue.cc:1048] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:27.919946  9457 raft_consensus.cc:1275] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 5 FOLLOWER]: Refusing update from remote peer c74618ad69cd41f89213bdf7943bc66e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:27.921160  9623 consensus_queue.cc:1048] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d956b41d76f241dea0c0bf203220c9e9" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 45549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:27.924404  9310 raft_consensus.cc:1275] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 4 FOLLOWER]: Refusing update from remote peer d956b41d76f241dea0c0bf203220c9e9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:27.925963  9630 consensus_queue.cc:1048] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b196ee6e89b2464695c8220d77dcdb30" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:27.937996  9385 raft_consensus.cc:1275] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 4 FOLLOWER]: Refusing update from remote peer d956b41d76f241dea0c0bf203220c9e9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:27.939975  9651 consensus_queue.cc:1048] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c74618ad69cd41f89213bdf7943bc66e" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 38911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:28.098737  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:28.104004  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:28.104471  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:29.105597  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:29.111017  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:29.111450  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:30.112568  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:30.117887  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:30.118353  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:31.119287  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:31.124532  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:31.124966  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:32.125757  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:32.131244  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:32.131831  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:33.133051  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:33.138865  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:33.139315  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:34.140202  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:34.145787  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:34.146241  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:35.147166  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:35.152314  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:35.152738  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:36.153627  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:36.158836  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:36.159299  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:37.190156  8637 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:25:37.190785  8637 tablet_server.cc:179] TabletServer@127.8.111.65:0 shutting down...
W20260709 12:25:37.216306  9351 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 12:25:37.221493  9351 consensus_peers.cc:597] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e -> Peer b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665): Couldn't send request to peer b196ee6e89b2464695c8220d77dcdb30. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:37.224778  9425 consensus_peers.cc:597] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 -> Peer b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665): Couldn't send request to peer b196ee6e89b2464695c8220d77dcdb30. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.232435  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:37.233434  8637 tablet_replica.cc:333] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30: stopping tablet replica
W20260709 12:25:37.233343  9351 consensus_peers.cc:597] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e -> Peer b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665): Couldn't send request to peer b196ee6e89b2464695c8220d77dcdb30. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.234629  8637 raft_consensus.cc:2243] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.235749  8637 raft_consensus.cc:2272] T 11128abd1e764a12b8d231570608b56d P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.237869  8637 tablet_replica.cc:333] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30: stopping tablet replica
I20260709 12:25:37.238492  8637 raft_consensus.cc:2243] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.239269  8637 raft_consensus.cc:2272] T 760a965208844aeba856202c350ec597 P b196ee6e89b2464695c8220d77dcdb30 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.241029  8637 tablet_replica.cc:333] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30: stopping tablet replica
I20260709 12:25:37.241580  8637 raft_consensus.cc:2243] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.242024  8637 raft_consensus.cc:2272] T fa27643756124363a439a22cf9d38101 P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.243734  8637 tablet_replica.cc:333] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30: stopping tablet replica
I20260709 12:25:37.244230  8637 raft_consensus.cc:2243] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.245013  8637 raft_consensus.cc:2272] T 17da24262ab34c6c847a08b645b7ef8c P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.247542  8637 tablet_replica.cc:333] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30: stopping tablet replica
I20260709 12:25:37.248013  8637 raft_consensus.cc:2243] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.248860  8637 raft_consensus.cc:2272] T 8099fdb4a59c47a89b57f9137a8932d3 P b196ee6e89b2464695c8220d77dcdb30 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.250784  8637 tablet_replica.cc:333] T 899bcc97677f4b169b627076ec798cdc P b196ee6e89b2464695c8220d77dcdb30: stopping tablet replica
I20260709 12:25:37.251401  8637 raft_consensus.cc:2243] T 899bcc97677f4b169b627076ec798cdc P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.251873  8637 raft_consensus.cc:2272] T 899bcc97677f4b169b627076ec798cdc P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.253494  8637 tablet_replica.cc:333] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30: stopping tablet replica
I20260709 12:25:37.253942  8637 raft_consensus.cc:2243] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.254385  8637 raft_consensus.cc:2272] T d70263eac7b74896af9db829c2518019 P b196ee6e89b2464695c8220d77dcdb30 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.256520  8637 tablet_replica.cc:333] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30: stopping tablet replica
I20260709 12:25:37.256953  8637 raft_consensus.cc:2243] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.257316  8637 raft_consensus.cc:2272] T 9f40906f3d564ec8acba63581f7d8df6 P b196ee6e89b2464695c8220d77dcdb30 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.259076  8637 tablet_replica.cc:333] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30: stopping tablet replica
I20260709 12:25:37.259477  8637 raft_consensus.cc:2243] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.259846  8637 raft_consensus.cc:2272] T 78d391d80524431c90ec3ec0348a848d P b196ee6e89b2464695c8220d77dcdb30 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.261426  8637 tablet_replica.cc:333] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30: stopping tablet replica
I20260709 12:25:37.261861  8637 raft_consensus.cc:2243] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.262362  8637 raft_consensus.cc:2272] T ab9cc9b294414da9994f61f618ff3e7d P b196ee6e89b2464695c8220d77dcdb30 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.293150  8637 tablet_server.cc:196] TabletServer@127.8.111.65:0 shutdown complete.
W20260709 12:25:37.315114  9425 consensus_peers.cc:597] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 -> Peer b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665): Couldn't send request to peer b196ee6e89b2464695c8220d77dcdb30. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.316370  8637 tablet_server.cc:179] TabletServer@127.8.111.66:0 shutting down...
W20260709 12:25:37.332751  9351 consensus_peers.cc:597] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e -> Peer b196ee6e89b2464695c8220d77dcdb30 (127.8.111.65:38665): Couldn't send request to peer b196ee6e89b2464695c8220d77dcdb30. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38665: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.345893  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:37.346598  8637 tablet_replica.cc:333] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e: stopping tablet replica
I20260709 12:25:37.347226  8637 raft_consensus.cc:2243] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.348217  8637 raft_consensus.cc:2272] T 899bcc97677f4b169b627076ec798cdc P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.349967  8637 tablet_replica.cc:333] T 8099fdb4a59c47a89b57f9137a8932d3 P c74618ad69cd41f89213bdf7943bc66e: stopping tablet replica
I20260709 12:25:37.350575  8637 raft_consensus.cc:2243] T 8099fdb4a59c47a89b57f9137a8932d3 P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.351016  8637 raft_consensus.cc:2272] T 8099fdb4a59c47a89b57f9137a8932d3 P c74618ad69cd41f89213bdf7943bc66e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.352638  8637 tablet_replica.cc:333] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e: stopping tablet replica
I20260709 12:25:37.353122  8637 raft_consensus.cc:2243] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.353632  8637 raft_consensus.cc:2272] T 760a965208844aeba856202c350ec597 P c74618ad69cd41f89213bdf7943bc66e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.355222  8637 tablet_replica.cc:333] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e: stopping tablet replica
I20260709 12:25:37.355724  8637 raft_consensus.cc:2243] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.356189  8637 raft_consensus.cc:2272] T fa27643756124363a439a22cf9d38101 P c74618ad69cd41f89213bdf7943bc66e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.357805  8637 tablet_replica.cc:333] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e: stopping tablet replica
I20260709 12:25:37.358364  8637 raft_consensus.cc:2243] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.359184  8637 raft_consensus.cc:2272] T 78d391d80524431c90ec3ec0348a848d P c74618ad69cd41f89213bdf7943bc66e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.360930  8637 tablet_replica.cc:333] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e: stopping tablet replica
I20260709 12:25:37.361411  8637 raft_consensus.cc:2243] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.361826  8637 raft_consensus.cc:2272] T ab9cc9b294414da9994f61f618ff3e7d P c74618ad69cd41f89213bdf7943bc66e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.363509  8637 tablet_replica.cc:333] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e: stopping tablet replica
I20260709 12:25:37.363987  8637 raft_consensus.cc:2243] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.364398  8637 raft_consensus.cc:2272] T 17da24262ab34c6c847a08b645b7ef8c P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.366043  8637 tablet_replica.cc:333] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e: stopping tablet replica
I20260709 12:25:37.366544  8637 raft_consensus.cc:2243] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.366986  8637 raft_consensus.cc:2272] T 11128abd1e764a12b8d231570608b56d P c74618ad69cd41f89213bdf7943bc66e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.368960  8637 tablet_replica.cc:333] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e: stopping tablet replica
I20260709 12:25:37.369421  8637 raft_consensus.cc:2243] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.370291  8637 raft_consensus.cc:2272] T d70263eac7b74896af9db829c2518019 P c74618ad69cd41f89213bdf7943bc66e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.372378  8637 tablet_replica.cc:333] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e: stopping tablet replica
I20260709 12:25:37.372920  8637 raft_consensus.cc:2243] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.373498  8637 raft_consensus.cc:2272] T 9f40906f3d564ec8acba63581f7d8df6 P c74618ad69cd41f89213bdf7943bc66e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.405742  8637 tablet_server.cc:196] TabletServer@127.8.111.66:0 shutdown complete.
I20260709 12:25:37.433703  8637 tablet_server.cc:179] TabletServer@127.8.111.67:0 shutting down...
W20260709 12:25:37.456617  9422 consensus_peers.cc:597] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 -> Peer c74618ad69cd41f89213bdf7943bc66e (127.8.111.66:38911): Couldn't send request to peer c74618ad69cd41f89213bdf7943bc66e. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:38911: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:37.465204  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:37.465829  8637 tablet_replica.cc:333] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9: stopping tablet replica
I20260709 12:25:37.466485  8637 raft_consensus.cc:2243] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.466996  8637 raft_consensus.cc:2272] T 11128abd1e764a12b8d231570608b56d P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.469671  8637 tablet_replica.cc:333] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9: stopping tablet replica
I20260709 12:25:37.470395  8637 raft_consensus.cc:2243] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.470949  8637 raft_consensus.cc:2272] T 17da24262ab34c6c847a08b645b7ef8c P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.472976  8637 tablet_replica.cc:333] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9: stopping tablet replica
I20260709 12:25:37.473533  8637 raft_consensus.cc:2243] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.474025  8637 raft_consensus.cc:2272] T d70263eac7b74896af9db829c2518019 P d956b41d76f241dea0c0bf203220c9e9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.476024  8637 tablet_replica.cc:333] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9: stopping tablet replica
I20260709 12:25:37.477020  8637 raft_consensus.cc:2243] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.478070  8637 raft_consensus.cc:2272] T 9f40906f3d564ec8acba63581f7d8df6 P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.480074  8637 tablet_replica.cc:333] T 8099fdb4a59c47a89b57f9137a8932d3 P d956b41d76f241dea0c0bf203220c9e9: stopping tablet replica
I20260709 12:25:37.480659  8637 raft_consensus.cc:2243] T 8099fdb4a59c47a89b57f9137a8932d3 P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.481170  8637 raft_consensus.cc:2272] T 8099fdb4a59c47a89b57f9137a8932d3 P d956b41d76f241dea0c0bf203220c9e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.483078  8637 tablet_replica.cc:333] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9: stopping tablet replica
I20260709 12:25:37.483675  8637 raft_consensus.cc:2243] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.484117  8637 raft_consensus.cc:2272] T 899bcc97677f4b169b627076ec798cdc P d956b41d76f241dea0c0bf203220c9e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.485714  8637 tablet_replica.cc:333] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9: stopping tablet replica
I20260709 12:25:37.486207  8637 raft_consensus.cc:2243] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.487015  8637 raft_consensus.cc:2272] T fa27643756124363a439a22cf9d38101 P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.488602  8637 tablet_replica.cc:333] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9: stopping tablet replica
I20260709 12:25:37.489077  8637 raft_consensus.cc:2243] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.489475  8637 raft_consensus.cc:2272] T 760a965208844aeba856202c350ec597 P d956b41d76f241dea0c0bf203220c9e9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.491127  8637 tablet_replica.cc:333] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9: stopping tablet replica
I20260709 12:25:37.491611  8637 raft_consensus.cc:2243] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.492403  8637 raft_consensus.cc:2272] T ab9cc9b294414da9994f61f618ff3e7d P d956b41d76f241dea0c0bf203220c9e9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.494031  8637 tablet_replica.cc:333] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9: stopping tablet replica
I20260709 12:25:37.494493  8637 raft_consensus.cc:2243] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:37.494900  8637 raft_consensus.cc:2272] T 78d391d80524431c90ec3ec0348a848d P d956b41d76f241dea0c0bf203220c9e9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.522786  8637 tablet_server.cc:196] TabletServer@127.8.111.67:0 shutdown complete.
I20260709 12:25:37.541889  8637 master.cc:562] Master@127.8.111.126:42453 shutting down...
I20260709 12:25:37.566895  8637 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:37.567519  8637 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:37.567866  8637 tablet_replica.cc:333] T 00000000000000000000000000000000 P 890b899a7d8b4b1ba019190bd9acd55a: stopping tablet replica
I20260709 12:25:37.588418  8637 master.cc:584] Master@127.8.111.126:42453 shutdown complete.
b196ee6e89b2464695c8220d77dcdb30  5
c74618ad69cd41f89213bdf7943bc66e  4
d956b41d76f241dea0c0bf203220c9e9  1
b196ee6e89b2464695c8220d77dcdb30  3
c74618ad69cd41f89213bdf7943bc66e  4
d956b41d76f241dea0c0bf203220c9e9  3
b196ee6e89b2464695c8220d77dcdb30  8
c74618ad69cd41f89213bdf7943bc66e  1
d956b41d76f241dea0c0bf203220c9e9  1
b196ee6e89b2464695c8220d77dcdb30  4
c74618ad69cd41f89213bdf7943bc66e  3
d956b41d76f241dea0c0bf203220c9e9  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28579 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:25:37.633023  8637 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.111.126:43135
I20260709 12:25:37.634174  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:37.640117  9689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:37.640755  9688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:37.640813  9691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:37.642627  8637 server_base.cc:1061] running on GCE node
I20260709 12:25:37.643499  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:37.643687  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:37.643800  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783599937643789 us; error 0 us; skew 500 ppm
I20260709 12:25:37.644244  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:37.646579  8637 webserver.cc:533] Webserver started at http://127.8.111.126:38569/ using document root <none> and password file <none>
I20260709 12:25:37.647059  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:37.647272  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:37.647497  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:37.648559  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/master-0-root/instance:
uuid: "9af5d83221164294aea87056091c2259"
format_stamp: "Formatted at 2026-07-09 12:25:37 on dist-test-slave-044g"
I20260709 12:25:37.652801  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:25:37.655908  9696 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:37.656630  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:25:37.656924  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/master-0-root
uuid: "9af5d83221164294aea87056091c2259"
format_stamp: "Formatted at 2026-07-09 12:25:37 on dist-test-slave-044g"
I20260709 12:25:37.657217  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:37.665704  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:37.667088  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:37.706624  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.126:43135
I20260709 12:25:37.706720  9747 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.126:43135 every 8 connection(s)
I20260709 12:25:37.710461  9748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:37.719887  9748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259: Bootstrap starting.
I20260709 12:25:37.724519  9748 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:37.728526  9748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259: No bootstrap required, opened a new log
I20260709 12:25:37.730922  9748 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9af5d83221164294aea87056091c2259" member_type: VOTER }
I20260709 12:25:37.731330  9748 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:37.731603  9748 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9af5d83221164294aea87056091c2259, State: Initialized, Role: FOLLOWER
I20260709 12:25:37.732237  9748 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9af5d83221164294aea87056091c2259" member_type: VOTER }
I20260709 12:25:37.732709  9748 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:37.732968  9748 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:37.733253  9748 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:37.737357  9748 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9af5d83221164294aea87056091c2259" member_type: VOTER }
I20260709 12:25:37.737875  9748 leader_election.cc:304] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9af5d83221164294aea87056091c2259; no voters: 
I20260709 12:25:37.739028  9748 leader_election.cc:290] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:37.739338  9751 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:37.740679  9751 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259 [term 1 LEADER]: Becoming Leader. State: Replica: 9af5d83221164294aea87056091c2259, State: Running, Role: LEADER
I20260709 12:25:37.741396  9751 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9af5d83221164294aea87056091c2259" member_type: VOTER }
I20260709 12:25:37.742421  9748 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:37.746901  9753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9af5d83221164294aea87056091c2259. Latest consensus state: current_term: 1 leader_uuid: "9af5d83221164294aea87056091c2259" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9af5d83221164294aea87056091c2259" member_type: VOTER } }
I20260709 12:25:37.747687  9753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:37.747977  9752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9af5d83221164294aea87056091c2259" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9af5d83221164294aea87056091c2259" member_type: VOTER } }
I20260709 12:25:37.748574  9752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259 [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:37.749842  9758 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:37.754683  9758 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:37.758876  8637 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:37.763343  9758 catalog_manager.cc:1383] Generated new cluster ID: 484bd4fef67e40469447da79210ce349
I20260709 12:25:37.763614  9758 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:37.777423  9758 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:37.778797  9758 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:37.792696  9758 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259: Generated new TSK 0
I20260709 12:25:37.793292  9758 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:37.825228  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:37.839497  9769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:37.840803  9770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:37.844204  8637 server_base.cc:1061] running on GCE node
W20260709 12:25:37.844565  9772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:37.845695  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:37.845958  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:37.846181  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783599937846161 us; error 0 us; skew 500 ppm
I20260709 12:25:37.846969  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:37.849375  8637 webserver.cc:533] Webserver started at http://127.8.111.65:45969/ using document root <none> and password file <none>
I20260709 12:25:37.849869  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:37.850061  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:37.850399  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:37.851460  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-0-root/instance:
uuid: "4104e34a61b7448281d6d91ce23ebf71"
format_stamp: "Formatted at 2026-07-09 12:25:37 on dist-test-slave-044g"
I20260709 12:25:37.855837  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:25:37.859321  9777 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:37.860247  8637 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 12:25:37.860499  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-0-root
uuid: "4104e34a61b7448281d6d91ce23ebf71"
format_stamp: "Formatted at 2026-07-09 12:25:37 on dist-test-slave-044g"
I20260709 12:25:37.860754  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:37.879058  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:37.880223  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:37.881628  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:37.883903  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:37.884083  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:37.884387  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:37.884562  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:37.928447  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.65:38995
I20260709 12:25:37.928556  9839 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.65:38995 every 8 connection(s)
I20260709 12:25:37.933817  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:37.941169  9844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:37.942021  9845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:37.945343  8637 server_base.cc:1061] running on GCE node
W20260709 12:25:37.945415  9847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:37.946478  9840 heartbeater.cc:344] Connected to a master server at 127.8.111.126:43135
I20260709 12:25:37.946952  9840 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:37.947497  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:37.947706  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:37.947721  9840 heartbeater.cc:507] Master 127.8.111.126:43135 requested a full tablet report, sending...
I20260709 12:25:37.948148  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783599937948100 us; error 0 us; skew 500 ppm
I20260709 12:25:37.948864  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:37.950261  9713 ts_manager.cc:194] Registered new tserver with Master: 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:25:37.951646  8637 webserver.cc:533] Webserver started at http://127.8.111.66:35503/ using document root <none> and password file <none>
I20260709 12:25:37.952167  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:37.952448  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:37.952572  9713 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59972
I20260709 12:25:37.952720  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:37.954325  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-1-root/instance:
uuid: "963185e117384b2085d7cea02a64478b"
format_stamp: "Formatted at 2026-07-09 12:25:37 on dist-test-slave-044g"
I20260709 12:25:37.959056  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:25:37.963024  9852 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:37.963935  8637 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:25:37.964243  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-1-root
uuid: "963185e117384b2085d7cea02a64478b"
format_stamp: "Formatted at 2026-07-09 12:25:37 on dist-test-slave-044g"
I20260709 12:25:37.964543  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:37.978220  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:37.979516  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:37.981016  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:37.983256  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:37.983481  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:37.983718  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:37.983891  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:38.023738  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.66:34205
I20260709 12:25:38.023837  9914 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.66:34205 every 8 connection(s)
I20260709 12:25:38.028530  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:38.035506  9918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:38.037024  9919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:38.039915  9921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:38.040400  9915 heartbeater.cc:344] Connected to a master server at 127.8.111.126:43135
I20260709 12:25:38.040692  8637 server_base.cc:1061] running on GCE node
I20260709 12:25:38.040843  9915 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:38.041621  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:25:38.041637  9915 heartbeater.cc:507] Master 127.8.111.126:43135 requested a full tablet report, sending...
W20260709 12:25:38.041934  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:38.042194  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783599938042174 us; error 0 us; skew 500 ppm
I20260709 12:25:38.042842  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:38.044056  9713 ts_manager.cc:194] Registered new tserver with Master: 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:38.045578  8637 webserver.cc:533] Webserver started at http://127.8.111.67:41873/ using document root <none> and password file <none>
I20260709 12:25:38.045912  9713 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59986
I20260709 12:25:38.046213  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:38.046489  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:38.046818  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:38.048044  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-2-root/instance:
uuid: "b011791796d1457284b857d7d3422195"
format_stamp: "Formatted at 2026-07-09 12:25:38 on dist-test-slave-044g"
I20260709 12:25:38.052544  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:25:38.055742  9926 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:38.056531  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:25:38.056826  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-2-root
uuid: "b011791796d1457284b857d7d3422195"
format_stamp: "Formatted at 2026-07-09 12:25:38 on dist-test-slave-044g"
I20260709 12:25:38.057116  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:38.067351  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:38.068539  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:38.070039  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:38.072278  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:38.072507  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:38.072765  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:38.072943  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:38.116112  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.67:42253
I20260709 12:25:38.116338  9988 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.67:42253 every 8 connection(s)
I20260709 12:25:38.131490  9989 heartbeater.cc:344] Connected to a master server at 127.8.111.126:43135
I20260709 12:25:38.131925  9989 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:38.132620  9989 heartbeater.cc:507] Master 127.8.111.126:43135 requested a full tablet report, sending...
I20260709 12:25:38.135244  9713 ts_manager.cc:194] Registered new tserver with Master: b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:38.135478  8637 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015972188s
I20260709 12:25:38.136605  9713 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59992
I20260709 12:25:38.162438  9713 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60008:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:38.168509  9713 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:38.372794  9879 tablet_service.cc:1511] Processing CreateTablet for tablet 3ebec313878e48e88fcec9daadd369b9 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:38.373555  9954 tablet_service.cc:1511] Processing CreateTablet for tablet cbfc8e9bdb244a4c8679e7585cce700c (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:38.374326  9879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ebec313878e48e88fcec9daadd369b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.374867  9954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbfc8e9bdb244a4c8679e7585cce700c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.375514  9878 tablet_service.cc:1511] Processing CreateTablet for tablet ad53c1df0a9749d992b37564e8225118 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:38.376801  9878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad53c1df0a9749d992b37564e8225118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.379997  9877 tablet_service.cc:1511] Processing CreateTablet for tablet e55138bc5c8b46a1a4b5408bb8a06868 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:38.381352  9877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55138bc5c8b46a1a4b5408bb8a06868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.383996  9953 tablet_service.cc:1511] Processing CreateTablet for tablet 3ebec313878e48e88fcec9daadd369b9 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:38.385250  9953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ebec313878e48e88fcec9daadd369b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.373761  9880 tablet_service.cc:1511] Processing CreateTablet for tablet cbfc8e9bdb244a4c8679e7585cce700c (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:38.386107  9805 tablet_service.cc:1511] Processing CreateTablet for tablet cbfc8e9bdb244a4c8679e7585cce700c (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:38.387053  9880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbfc8e9bdb244a4c8679e7585cce700c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.387359  9805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbfc8e9bdb244a4c8679e7585cce700c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.387434  9951 tablet_service.cc:1511] Processing CreateTablet for tablet e55138bc5c8b46a1a4b5408bb8a06868 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:38.388753  9951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55138bc5c8b46a1a4b5408bb8a06868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.391408  9952 tablet_service.cc:1511] Processing CreateTablet for tablet ad53c1df0a9749d992b37564e8225118 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:38.392642  9952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad53c1df0a9749d992b37564e8225118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.396430  9876 tablet_service.cc:1511] Processing CreateTablet for tablet a47692d74f884d019a3ec583399bdb4c (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:38.397702  9876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a47692d74f884d019a3ec583399bdb4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.400311  9875 tablet_service.cc:1511] Processing CreateTablet for tablet 4b844d67afb64319be2e7e6a8ec99319 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:38.401600  9875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b844d67afb64319be2e7e6a8ec99319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.403422  9804 tablet_service.cc:1511] Processing CreateTablet for tablet 3ebec313878e48e88fcec9daadd369b9 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:38.404649  9804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ebec313878e48e88fcec9daadd369b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.412144  9874 tablet_service.cc:1511] Processing CreateTablet for tablet cb82dc8d0b87403f90e84b650a35abb0 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:38.413501  9874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb82dc8d0b87403f90e84b650a35abb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.420125  9803 tablet_service.cc:1511] Processing CreateTablet for tablet ad53c1df0a9749d992b37564e8225118 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:38.421520  9803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad53c1df0a9749d992b37564e8225118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.432652  9802 tablet_service.cc:1511] Processing CreateTablet for tablet e55138bc5c8b46a1a4b5408bb8a06868 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:38.434615  9802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55138bc5c8b46a1a4b5408bb8a06868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.438653  9874 tablet_service.cc:1511] Processing CreateTablet for tablet 511405268634431e9bf729e0fc87c838 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:38.442037  9874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 511405268634431e9bf729e0fc87c838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.443239  9878 tablet_service.cc:1511] Processing CreateTablet for tablet e31dc7ebba9947e381658ef28347706a (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:38.444638  9878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e31dc7ebba9947e381658ef28347706a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.449617  9801 tablet_service.cc:1511] Processing CreateTablet for tablet a47692d74f884d019a3ec583399bdb4c (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:38.450491  9875 tablet_service.cc:1511] Processing CreateTablet for tablet 9a7dd9ecad304177bbefcb8725c66393 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:38.450842  9801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a47692d74f884d019a3ec583399bdb4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.451676  9875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a7dd9ecad304177bbefcb8725c66393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.460582  9950 tablet_service.cc:1511] Processing CreateTablet for tablet a47692d74f884d019a3ec583399bdb4c (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:38.463678  9950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a47692d74f884d019a3ec583399bdb4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.468590  9877 tablet_service.cc:1511] Processing CreateTablet for tablet d1e4bd6e7a424475b1d707bfa268d54e (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:38.469616  9949 tablet_service.cc:1511] Processing CreateTablet for tablet 4b844d67afb64319be2e7e6a8ec99319 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:38.470501  9877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e4bd6e7a424475b1d707bfa268d54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.470976  9949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b844d67afb64319be2e7e6a8ec99319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.474826  9876 tablet_service.cc:1511] Processing CreateTablet for tablet 3290aa2b0ef349e78e838202fb70b358 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:38.476228  9876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3290aa2b0ef349e78e838202fb70b358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.477890  9872 tablet_service.cc:1511] Processing CreateTablet for tablet af4289b1f8fb44b9a1d46742954fab18 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:38.479212  9872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af4289b1f8fb44b9a1d46742954fab18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.478826  9804 tablet_service.cc:1511] Processing CreateTablet for tablet 4b844d67afb64319be2e7e6a8ec99319 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:38.479558  9873 tablet_service.cc:1511] Processing CreateTablet for tablet 59bb7b32528a4a0b83305a9131ca5f1e (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:38.480221  9804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b844d67afb64319be2e7e6a8ec99319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.480973  9873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59bb7b32528a4a0b83305a9131ca5f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.483192 10004 tablet_bootstrap.cc:492] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:38.491814  9800 tablet_service.cc:1511] Processing CreateTablet for tablet e31dc7ebba9947e381658ef28347706a (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:38.493237  9800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e31dc7ebba9947e381658ef28347706a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.494544 10005 tablet_bootstrap.cc:492] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:38.494611  9871 tablet_service.cc:1511] Processing CreateTablet for tablet b4a402ce065f4914a9fab2f516a37bcd (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:38.496171  9871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a402ce065f4914a9fab2f516a37bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.497241  9880 tablet_service.cc:1511] Processing CreateTablet for tablet 0e64098fbd794a1daa6778e4c06eb54e (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:38.498610  9880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e64098fbd794a1daa6778e4c06eb54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.505304  9799 tablet_service.cc:1511] Processing CreateTablet for tablet 511405268634431e9bf729e0fc87c838 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:38.506004  9948 tablet_service.cc:1511] Processing CreateTablet for tablet cb82dc8d0b87403f90e84b650a35abb0 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:38.507582  9798 tablet_service.cc:1511] Processing CreateTablet for tablet 9a7dd9ecad304177bbefcb8725c66393 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:38.507874  9947 tablet_service.cc:1511] Processing CreateTablet for tablet 511405268634431e9bf729e0fc87c838 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:38.509752  9946 tablet_service.cc:1511] Processing CreateTablet for tablet 9a7dd9ecad304177bbefcb8725c66393 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:38.511633  9945 tablet_service.cc:1511] Processing CreateTablet for tablet d1e4bd6e7a424475b1d707bfa268d54e (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:38.509650  9797 tablet_service.cc:1511] Processing CreateTablet for tablet d1e4bd6e7a424475b1d707bfa268d54e (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:38.511610  9796 tablet_service.cc:1511] Processing CreateTablet for tablet 3290aa2b0ef349e78e838202fb70b358 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:38.519434  9803 tablet_service.cc:1511] Processing CreateTablet for tablet 0e64098fbd794a1daa6778e4c06eb54e (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:38.520807  9803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e64098fbd794a1daa6778e4c06eb54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.521857  9804 tablet_service.cc:1511] Processing CreateTablet for tablet 59bb7b32528a4a0b83305a9131ca5f1e (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:38.523111  9804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59bb7b32528a4a0b83305a9131ca5f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.525758 10004 tablet_bootstrap.cc:654] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:38.535254  9953 tablet_service.cc:1511] Processing CreateTablet for tablet 0e64098fbd794a1daa6778e4c06eb54e (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:38.536612  9953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e64098fbd794a1daa6778e4c06eb54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.536375  9951 tablet_service.cc:1511] Processing CreateTablet for tablet b4a402ce065f4914a9fab2f516a37bcd (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:38.537621  9951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a402ce065f4914a9fab2f516a37bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.541491  9797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e4bd6e7a424475b1d707bfa268d54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.541620  9948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb82dc8d0b87403f90e84b650a35abb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.543314  9872 tablet_service.cc:1511] Processing CreateTablet for tablet 441af0e88f714cb3be023c9bdcd006fc (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:38.544528  9872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441af0e88f714cb3be023c9bdcd006fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.549772  9945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e4bd6e7a424475b1d707bfa268d54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.550407  9946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a7dd9ecad304177bbefcb8725c66393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.550935  9796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3290aa2b0ef349e78e838202fb70b358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.551568  9799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 511405268634431e9bf729e0fc87c838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.551247  9805 tablet_service.cc:1511] Processing CreateTablet for tablet cb82dc8d0b87403f90e84b650a35abb0 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:38.552266  9947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 511405268634431e9bf729e0fc87c838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.552763  9954 tablet_service.cc:1511] Processing CreateTablet for tablet 3290aa2b0ef349e78e838202fb70b358 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:38.553915  9954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3290aa2b0ef349e78e838202fb70b358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.554679  9798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a7dd9ecad304177bbefcb8725c66393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.562206  9805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb82dc8d0b87403f90e84b650a35abb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.570827  9879 tablet_service.cc:1511] Processing CreateTablet for tablet b97d7561bbd8444f9bbafa9c397d3f62 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:38.572193  9879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97d7561bbd8444f9bbafa9c397d3f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.575318  9801 tablet_service.cc:1511] Processing CreateTablet for tablet af4289b1f8fb44b9a1d46742954fab18 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:38.581904 10006 tablet_bootstrap.cc:492] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:38.591516  9804 tablet_service.cc:1511] Processing CreateTablet for tablet b4a402ce065f4914a9fab2f516a37bcd (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:38.594988  9801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af4289b1f8fb44b9a1d46742954fab18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.595582  9804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a402ce065f4914a9fab2f516a37bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.591548  9952 tablet_service.cc:1511] Processing CreateTablet for tablet e31dc7ebba9947e381658ef28347706a (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:38.599480  9952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e31dc7ebba9947e381658ef28347706a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.618558  9949 tablet_service.cc:1511] Processing CreateTablet for tablet 59bb7b32528a4a0b83305a9131ca5f1e (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:38.608966 10005 tablet_bootstrap.cc:654] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:38.591503  9802 tablet_service.cc:1511] Processing CreateTablet for tablet 441af0e88f714cb3be023c9bdcd006fc (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:38.622790 10004 tablet_bootstrap.cc:492] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:38.628839  9874 tablet_service.cc:1511] Processing CreateTablet for tablet 27036dabafd8427cac190478948639ae (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:38.640828  9802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441af0e88f714cb3be023c9bdcd006fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.644651  9798 tablet_service.cc:1511] Processing CreateTablet for tablet 27036dabafd8427cac190478948639ae (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:38.648353  9798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27036dabafd8427cac190478948639ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.648373  9945 tablet_service.cc:1511] Processing CreateTablet for tablet 441af0e88f714cb3be023c9bdcd006fc (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:38.646728  9949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59bb7b32528a4a0b83305a9131ca5f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.648923  9796 tablet_service.cc:1511] Processing CreateTablet for tablet b97d7561bbd8444f9bbafa9c397d3f62 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:38.651189  9871 tablet_service.cc:1511] Processing CreateTablet for tablet bae6a0d1c1c44960b4b110046bee07a8 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:38.652069  9945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441af0e88f714cb3be023c9bdcd006fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.638851 10004 ts_tablet_manager.cc:1403] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.156s	user 0.011s	sys 0.003s
I20260709 12:25:38.658170  9796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97d7561bbd8444f9bbafa9c397d3f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.661244  9948 tablet_service.cc:1511] Processing CreateTablet for tablet b97d7561bbd8444f9bbafa9c397d3f62 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:38.661679  9799 tablet_service.cc:1511] Processing CreateTablet for tablet bae6a0d1c1c44960b4b110046bee07a8 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:38.663654  9799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae6a0d1c1c44960b4b110046bee07a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.663909  9948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97d7561bbd8444f9bbafa9c397d3f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.665761  9804 tablet_service.cc:1511] Processing CreateTablet for tablet ab78f05fa6f4406a81716ded4d302aee (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:38.670866  9804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab78f05fa6f4406a81716ded4d302aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.669557  9880 tablet_service.cc:1511] Processing CreateTablet for tablet ab78f05fa6f4406a81716ded4d302aee (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:38.670925 10006 tablet_bootstrap.cc:654] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:38.687079  9875 tablet_service.cc:1511] Processing CreateTablet for tablet 0f77ade6a50544c9a6c3f56b3719a92e (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:38.689087  9878 tablet_service.cc:1511] Processing CreateTablet for tablet 7f56c0f50a014def9b283a94186feae6 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:38.673767  9871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae6a0d1c1c44960b4b110046bee07a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.677510  9951 tablet_service.cc:1511] Processing CreateTablet for tablet 27036dabafd8427cac190478948639ae (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:38.693517  9951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27036dabafd8427cac190478948639ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.668987 10004 raft_consensus.cc:359] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:38.694432 10004 raft_consensus.cc:385] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:38.694862 10004 raft_consensus.cc:740] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:38.695652 10004 consensus_queue.cc:260] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:38.710024  9801 tablet_service.cc:1511] Processing CreateTablet for tablet 0f77ade6a50544c9a6c3f56b3719a92e (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:38.632620  9950 tablet_service.cc:1511] Processing CreateTablet for tablet af4289b1f8fb44b9a1d46742954fab18 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:38.719305  9950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af4289b1f8fb44b9a1d46742954fab18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.722183  9797 tablet_service.cc:1511] Processing CreateTablet for tablet f93660c342af47199c6cec5c0424043a (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:38.725477  9800 tablet_service.cc:1511] Processing CreateTablet for tablet ecf7be2e7d02465d87ce4296e257c29b (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:38.728089  9877 tablet_service.cc:1511] Processing CreateTablet for tablet ecf7be2e7d02465d87ce4296e257c29b (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:38.730008  9875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f77ade6a50544c9a6c3f56b3719a92e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.732026  9946 tablet_service.cc:1511] Processing CreateTablet for tablet bae6a0d1c1c44960b4b110046bee07a8 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:38.733208  9946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bae6a0d1c1c44960b4b110046bee07a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.734599  9878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f56c0f50a014def9b283a94186feae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.717862  9873 tablet_service.cc:1511] Processing CreateTablet for tablet f93660c342af47199c6cec5c0424043a (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:38.746995 10004 ts_tablet_manager.cc:1434] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.081s	user 0.004s	sys 0.012s
I20260709 12:25:38.747759  9915 heartbeater.cc:499] Master 127.8.111.126:43135 was elected leader, sending a full tablet report...
I20260709 12:25:38.745477  9797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f93660c342af47199c6cec5c0424043a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.750365  9949 tablet_service.cc:1511] Processing CreateTablet for tablet ab78f05fa6f4406a81716ded4d302aee (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
W20260709 12:25:38.753856  9761 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:38.735915  9805 tablet_service.cc:1511] Processing CreateTablet for tablet 7f56c0f50a014def9b283a94186feae6 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:38.756907  9805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f56c0f50a014def9b283a94186feae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.745095  9874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27036dabafd8427cac190478948639ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.759166  9877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf7be2e7d02465d87ce4296e257c29b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.747901  9954 tablet_service.cc:1511] Processing CreateTablet for tablet 0f77ade6a50544c9a6c3f56b3719a92e (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:38.760373  9949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab78f05fa6f4406a81716ded4d302aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.761056  9947 tablet_service.cc:1511] Processing CreateTablet for tablet 7f56c0f50a014def9b283a94186feae6 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:38.762223  9801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f77ade6a50544c9a6c3f56b3719a92e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.762523  9947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f56c0f50a014def9b283a94186feae6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.763375  9873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f93660c342af47199c6cec5c0424043a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.763878 10004 tablet_bootstrap.cc:492] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:38.764530  9876 tablet_service.cc:1511] Processing CreateTablet for tablet fa3541b3559e488d9911972fd2250fc6 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:38.765796  9876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa3541b3559e488d9911972fd2250fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.772084  9954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f77ade6a50544c9a6c3f56b3719a92e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.775878 10006 tablet_bootstrap.cc:492] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:38.776428 10006 ts_tablet_manager.cc:1403] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.195s	user 0.006s	sys 0.007s
I20260709 12:25:38.784288  9953 tablet_service.cc:1511] Processing CreateTablet for tablet f93660c342af47199c6cec5c0424043a (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:38.786024  9953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f93660c342af47199c6cec5c0424043a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.794343  9880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab78f05fa6f4406a81716ded4d302aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.794945  9800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf7be2e7d02465d87ce4296e257c29b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.808517 10005 tablet_bootstrap.cc:492] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:38.812222 10005 ts_tablet_manager.cc:1403] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.345s	user 0.030s	sys 0.045s
I20260709 12:25:38.815061 10005 raft_consensus.cc:359] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:38.815770 10005 raft_consensus.cc:385] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:38.815534  9951 tablet_service.cc:1511] Processing CreateTablet for tablet fa3541b3559e488d9911972fd2250fc6 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:38.816073 10005 raft_consensus.cc:740] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:38.809026  9950 tablet_service.cc:1511] Processing CreateTablet for tablet ecf7be2e7d02465d87ce4296e257c29b (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:38.816829  9951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa3541b3559e488d9911972fd2250fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.817533  9950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf7be2e7d02465d87ce4296e257c29b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.816838 10005 consensus_queue.cc:260] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:38.822049  9796 tablet_service.cc:1511] Processing CreateTablet for tablet 6f86e0db5aaa4690a0351c44520f7baf (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:38.832103  9796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f86e0db5aaa4690a0351c44520f7baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.811286 10006 raft_consensus.cc:359] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:38.833287 10006 raft_consensus.cc:385] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:38.833678 10006 raft_consensus.cc:740] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:38.830730  9802 tablet_service.cc:1511] Processing CreateTablet for tablet fa3541b3559e488d9911972fd2250fc6 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:38.835069  9802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa3541b3559e488d9911972fd2250fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.837463 10006 consensus_queue.cc:260] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:38.843062  9801 tablet_service.cc:1511] Processing CreateTablet for tablet c0075a6cf83049839402dd3dbaa93adc (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:38.827975  9952 tablet_service.cc:1511] Processing CreateTablet for tablet 6f86e0db5aaa4690a0351c44520f7baf (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:38.847119  9952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f86e0db5aaa4690a0351c44520f7baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.852931  9801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0075a6cf83049839402dd3dbaa93adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.854084  9945 tablet_service.cc:1511] Processing CreateTablet for tablet c0075a6cf83049839402dd3dbaa93adc (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:38.854928  9871 tablet_service.cc:1511] Processing CreateTablet for tablet 6f86e0db5aaa4690a0351c44520f7baf (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:38.859787  9871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f86e0db5aaa4690a0351c44520f7baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.856832  9797 tablet_service.cc:1511] Processing CreateTablet for tablet 8367fec391344e099ca237f0942e4f6d (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:38.858551  9989 heartbeater.cc:499] Master 127.8.111.126:43135 was elected leader, sending a full tablet report...
I20260709 12:25:38.855479  9945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0075a6cf83049839402dd3dbaa93adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.882860 10006 ts_tablet_manager.cc:1434] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.106s	user 0.009s	sys 0.001s
I20260709 12:25:38.883888 10006 tablet_bootstrap.cc:492] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:38.895494 10004 tablet_bootstrap.cc:654] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:38.886664 10009 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.878145  9879 tablet_service.cc:1511] Processing CreateTablet for tablet c0075a6cf83049839402dd3dbaa93adc (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:38.906340  9948 tablet_service.cc:1511] Processing CreateTablet for tablet 8367fec391344e099ca237f0942e4f6d (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:38.907738  9948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8367fec391344e099ca237f0942e4f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.908982  9803 tablet_service.cc:1511] Processing CreateTablet for tablet a5bdaeb6ccf347499e2dff26efaf7deb (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:38.902536  9797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8367fec391344e099ca237f0942e4f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.925063  9803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5bdaeb6ccf347499e2dff26efaf7deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.926182 10005 ts_tablet_manager.cc:1434] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.114s	user 0.011s	sys 0.028s
I20260709 12:25:38.926987  9840 heartbeater.cc:499] Master 127.8.111.126:43135 was elected leader, sending a full tablet report...
I20260709 12:25:38.902704 10009 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:38.929903 10009 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:38.930454 10005 tablet_bootstrap.cc:492] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:38.952548  9801 tablet_service.cc:1511] Processing CreateTablet for tablet fb049358bf66417d84d91e61b68ff1bb (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:38.953862  9801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb049358bf66417d84d91e61b68ff1bb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:38.954499  9698 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 48421.7us
I20260709 12:25:38.955379  9872 tablet_service.cc:1511] Processing CreateTablet for tablet 8367fec391344e099ca237f0942e4f6d (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:38.956900  9879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0075a6cf83049839402dd3dbaa93adc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.943418  9874 tablet_service.cc:1511] Processing CreateTablet for tablet a5bdaeb6ccf347499e2dff26efaf7deb (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:38.960340  9874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5bdaeb6ccf347499e2dff26efaf7deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.962196 10005 tablet_bootstrap.cc:654] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:38.962615  9872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8367fec391344e099ca237f0942e4f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.974725  9948 tablet_service.cc:1511] Processing CreateTablet for tablet fb049358bf66417d84d91e61b68ff1bb (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:38.976768  9948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb049358bf66417d84d91e61b68ff1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:38.991267  9954 tablet_service.cc:1511] Processing CreateTablet for tablet a5bdaeb6ccf347499e2dff26efaf7deb (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:39.001132 10012 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.001664 10012 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:38.992569  9954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5bdaeb6ccf347499e2dff26efaf7deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.007308 10012 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:39.054073 10006 tablet_bootstrap.cc:654] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:39.055651  9800 tablet_service.cc:1511] Processing CreateTablet for tablet 264ab80fe3634a5390e84f23e4dd8c94 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:39.061041  9875 tablet_service.cc:1511] Processing CreateTablet for tablet 264ab80fe3634a5390e84f23e4dd8c94 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:39.069723  9797 tablet_service.cc:1511] Processing CreateTablet for tablet 4af4b34b71b641009c828e29f2c4cc41 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:39.075150  9800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264ab80fe3634a5390e84f23e4dd8c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.091368 10005 tablet_bootstrap.cc:492] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:39.091877 10005 ts_tablet_manager.cc:1403] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.162s	user 0.018s	sys 0.014s
I20260709 12:25:39.095731  9871 tablet_service.cc:1511] Processing CreateTablet for tablet 4af4b34b71b641009c828e29f2c4cc41 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:39.098134 10004 tablet_bootstrap.cc:492] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:39.088712  9878 tablet_service.cc:1511] Processing CreateTablet for tablet fb049358bf66417d84d91e61b68ff1bb (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:39.098862 10004 ts_tablet_manager.cc:1403] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.351s	user 0.009s	sys 0.033s
I20260709 12:25:39.100198  9797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af4b34b71b641009c828e29f2c4cc41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.108472  9796 tablet_service.cc:1511] Processing CreateTablet for tablet b6b2dfaf2fc345a8a7e88a8c1e9e8900 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:39.089780 10011 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.109767  9796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b2dfaf2fc345a8a7e88a8c1e9e8900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.109660 10011 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:39.118254  9798 tablet_service.cc:1511] Processing CreateTablet for tablet 02b16516f13c42bfae1f9f2e877ee307 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:39.119949  9798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b16516f13c42bfae1f9f2e877ee307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.123477  9805 tablet_service.cc:1511] Processing CreateTablet for tablet f0f4046979c94f6b9fcfd429cb2f454f (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:39.124697  9805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f4046979c94f6b9fcfd429cb2f454f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.114396  9875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264ab80fe3634a5390e84f23e4dd8c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.126641  9802 tablet_service.cc:1511] Processing CreateTablet for tablet 6bd0e88f609e4c15aadc811cb9ecf5a9 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:39.127843  9802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bd0e88f609e4c15aadc811cb9ecf5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.130915  9871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af4b34b71b641009c828e29f2c4cc41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.127859 10004 raft_consensus.cc:359] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } }
I20260709 12:25:39.131469 10004 raft_consensus.cc:385] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.131776 10004 raft_consensus.cc:740] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:39.132483 10004 consensus_queue.cc:260] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } }
I20260709 12:25:39.138571 10004 ts_tablet_manager.cc:1434] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.002s
I20260709 12:25:39.142491 10011 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:39.157400  9878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb049358bf66417d84d91e61b68ff1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.183324  9801 tablet_service.cc:1511] Processing CreateTablet for tablet 90aeaa3c967a48a4804d8960b26f02b5 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:39.186015  9801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90aeaa3c967a48a4804d8960b26f02b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.195035  9803 tablet_service.cc:1511] Processing CreateTablet for tablet 563b5b4a0da24676a96f01291cf312c7 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:39.196895  9803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563b5b4a0da24676a96f01291cf312c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.211125 10005 raft_consensus.cc:359] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:39.212256 10005 raft_consensus.cc:385] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.212706 10005 raft_consensus.cc:740] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:39.284776 10009 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.285470 10009 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } }
I20260709 12:25:39.314174  9804 tablet_service.cc:1511] Processing CreateTablet for tablet 55e4af3d6737421b9d77650fa7d44f8f (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:39.328996  9804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e4af3d6737421b9d77650fa7d44f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.176007 10004 tablet_bootstrap.cc:492] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:39.354359  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:39.382449 10005 consensus_queue.cc:260] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:39.383515  9815 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:39.383715 10009 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:25:39.384707 10006 tablet_bootstrap.cc:492] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:39.386162 10006 ts_tablet_manager.cc:1403] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.502s	user 0.038s	sys 0.018s
I20260709 12:25:39.386790  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:25:39.389029  9853 leader_election.cc:343] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.389943  9853 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:25:39.398984  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:39.399706  9964 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 0.
I20260709 12:25:39.400461 10009 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:39.401392  9778 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:39.399075 10006 raft_consensus.cc:359] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:39.402776 10011 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:39.402864 10009 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.403728 10011 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.402884 10006 raft_consensus.cc:385] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.403514 10009 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:39.404193 10011 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:39.404501 10006 raft_consensus.cc:740] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:39.407982 10006 consensus_queue.cc:260] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:39.411417 10011 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:39.411962  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:39.413493 10011 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:39.414264  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:39.415410  9815 raft_consensus.cc:2393] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 1: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:25:39.414620  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:39.417035  9964 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:39.420827 10006 ts_tablet_manager.cc:1434] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.008s
I20260709 12:25:39.424436  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:25:39.424662  9779 leader_election.cc:343] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.428280  9964 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:25:39.428187 10006 tablet_bootstrap.cc:492] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195: Bootstrap starting.
W20260709 12:25:39.427523  9779 leader_election.cc:343] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.433346 10009 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:39.431937  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:25:39.437654 10011 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:39.438122 10011 raft_consensus.cc:697] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:25:39.438983 10011 consensus_queue.cc:237] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:39.439533  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:39.440093  9815 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:39.445087 10006 tablet_bootstrap.cc:654] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:39.403616  9799 consensus_meta.cc:287] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.539s	user 0.001s	sys 0.015s
I20260709 12:25:39.425794  9802 tablet_service.cc:1511] Processing CreateTablet for tablet 92a71d859626422a835ad38ab2ba7bd7 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:39.449895  9802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92a71d859626422a835ad38ab2ba7bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.451804 10009 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:39.459420  9948 tablet_service.cc:1511] Processing CreateTablet for tablet 264ab80fe3634a5390e84f23e4dd8c94 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:39.460778 10006 tablet_bootstrap.cc:492] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:39.460996  9948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264ab80fe3634a5390e84f23e4dd8c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.461277 10006 ts_tablet_manager.cc:1403] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.037s	user 0.006s	sys 0.011s
I20260709 12:25:39.464399 10006 raft_consensus.cc:359] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:39.465176 10006 raft_consensus.cc:385] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.467752  9954 tablet_service.cc:1511] Processing CreateTablet for tablet 4af4b34b71b641009c828e29f2c4cc41 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:39.469101  9954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af4b34b71b641009c828e29f2c4cc41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.465494 10006 raft_consensus.cc:740] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
W20260709 12:25:39.475024  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 45673.5us
W20260709 12:25:39.479071  9698 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 274870us
W20260709 12:25:39.485587  9697 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 105588us
I20260709 12:25:39.488292  9951 tablet_service.cc:1511] Processing CreateTablet for tablet b6b2dfaf2fc345a8a7e88a8c1e9e8900 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:39.488932  9947 tablet_service.cc:1511] Processing CreateTablet for tablet f0f4046979c94f6b9fcfd429cb2f454f (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:39.489540  9951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b2dfaf2fc345a8a7e88a8c1e9e8900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.490073  9947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f4046979c94f6b9fcfd429cb2f454f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.491216  9872 tablet_service.cc:1511] Processing CreateTablet for tablet 90aeaa3c967a48a4804d8960b26f02b5 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:39.491328  9950 tablet_service.cc:1511] Processing CreateTablet for tablet 6bd0e88f609e4c15aadc811cb9ecf5a9 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:39.492444  9872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90aeaa3c967a48a4804d8960b26f02b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.492142  9873 tablet_service.cc:1511] Processing CreateTablet for tablet 02b16516f13c42bfae1f9f2e877ee307 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:39.493314  9873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b16516f13c42bfae1f9f2e877ee307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.493671  9952 tablet_service.cc:1511] Processing CreateTablet for tablet 563b5b4a0da24676a96f01291cf312c7 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:39.486120  9796 tablet_service.cc:1511] Processing CreateTablet for tablet be9677b33dcc4236a5656b7747c90d13 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:39.494261  9946 tablet_service.cc:1511] Processing CreateTablet for tablet 02b16516f13c42bfae1f9f2e877ee307 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:39.497088  9880 tablet_service.cc:1511] Processing CreateTablet for tablet f27b8e99a0274a2791f902106d779c23 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:39.495179  9876 tablet_service.cc:1511] Processing CreateTablet for tablet 55e4af3d6737421b9d77650fa7d44f8f (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:39.491216  9874 tablet_service.cc:1511] Processing CreateTablet for tablet b6b2dfaf2fc345a8a7e88a8c1e9e8900 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:39.495179  9877 tablet_service.cc:1511] Processing CreateTablet for tablet f0f4046979c94f6b9fcfd429cb2f454f (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:39.500349  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:39.500514  9815 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:39.496083  9953 tablet_service.cc:1511] Processing CreateTablet for tablet 90aeaa3c967a48a4804d8960b26f02b5 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:39.501052  9964 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:39.502017  9953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90aeaa3c967a48a4804d8960b26f02b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.496104  9949 tablet_service.cc:1511] Processing CreateTablet for tablet 55e4af3d6737421b9d77650fa7d44f8f (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:39.503209  9949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e4af3d6737421b9d77650fa7d44f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.495465  9797 tablet_service.cc:1511] Processing CreateTablet for tablet f27b8e99a0274a2791f902106d779c23 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:39.504277  9950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bd0e88f609e4c15aadc811cb9ecf5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.504925 10005 ts_tablet_manager.cc:1434] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.413s	user 0.009s	sys 0.004s
I20260709 12:25:39.505879 10005 tablet_bootstrap.cc:492] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:39.506918  9853 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:25:39.510478 10009 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:39.511518  9946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b16516f13c42bfae1f9f2e877ee307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.511363  9875 tablet_service.cc:1511] Processing CreateTablet for tablet 563b5b4a0da24676a96f01291cf312c7 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:39.513031  9878 tablet_service.cc:1511] Processing CreateTablet for tablet 6bd0e88f609e4c15aadc811cb9ecf5a9 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:39.495456  9796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be9677b33dcc4236a5656b7747c90d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.520574 10006 consensus_queue.cc:260] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:39.533165 10012 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.533615 10012 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:39.536674 10004 tablet_bootstrap.cc:654] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:39.537650 10012 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:39.538589  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:39.527458  9952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563b5b4a0da24676a96f01291cf312c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.539477 10006 ts_tablet_manager.cc:1434] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.002s
W20260709 12:25:39.540391  9927 leader_election.cc:343] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.542795  9880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f27b8e99a0274a2791f902106d779c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.542637  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:39.543584  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:39.543929  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:39.544576  9963 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:39.545921  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:39.546900  9876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e4af3d6737421b9d77650fa7d44f8f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:39.547463  9853 leader_election.cc:343] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:39.547554  9928 leader_election.cc:343] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.547951  9853 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:25:39.540518 10006 tablet_bootstrap.cc:492] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:39.548036  9928 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:25:39.550897  9874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b2dfaf2fc345a8a7e88a8c1e9e8900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.554716  9797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f27b8e99a0274a2791f902106d779c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.554991 10012 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:39.555821  9928 leader_election.cc:343] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:39.557713  9928 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:25:39.562786 10012 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:39.565580  9877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f4046979c94f6b9fcfd429cb2f454f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.574576 10006 tablet_bootstrap.cc:654] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:39.586685  9875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563b5b4a0da24676a96f01291cf312c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.587991  9963 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:39.590372  9879 tablet_service.cc:1511] Processing CreateTablet for tablet be9677b33dcc4236a5656b7747c90d13 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:39.590965  9803 tablet_service.cc:1511] Processing CreateTablet for tablet ce8d330ea5fd473c98b6e36199f7c07b (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:39.591710  9879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be9677b33dcc4236a5656b7747c90d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.592262  9803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce8d330ea5fd473c98b6e36199f7c07b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.598045  9878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bd0e88f609e4c15aadc811cb9ecf5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.578648 10009 raft_consensus.cc:697] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
W20260709 12:25:39.602609  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 55185.1us
I20260709 12:25:39.606787 10005 tablet_bootstrap.cc:654] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:39.626155  9805 tablet_service.cc:1511] Processing CreateTablet for tablet ecaeb132991949858ba7ff5186bd7024 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:39.637014  9802 tablet_service.cc:1511] Processing CreateTablet for tablet 052aa541571c4bea87eeb1ed2f45a1bf (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:39.643930 10009 consensus_queue.cc:237] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:39.650749  9949 tablet_service.cc:1511] Processing CreateTablet for tablet be9677b33dcc4236a5656b7747c90d13 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:39.651269 10031 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:39.654794  9804 tablet_service.cc:1511] Processing CreateTablet for tablet e528961028ca49b7a317cd20fbb343a8 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:39.660390  9871 tablet_service.cc:1511] Processing CreateTablet for tablet 92a71d859626422a835ad38ab2ba7bd7 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:39.661401  9799 tablet_service.cc:1511] Processing CreateTablet for tablet af001ec909824ed199d355fd69f43ede (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:39.662111  9871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92a71d859626422a835ad38ab2ba7bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.667013  9802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 052aa541571c4bea87eeb1ed2f45a1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.668700  9873 tablet_service.cc:1511] Processing CreateTablet for tablet ce8d330ea5fd473c98b6e36199f7c07b (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:39.670985  9873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce8d330ea5fd473c98b6e36199f7c07b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.675545  9954 tablet_service.cc:1511] Processing CreateTablet for tablet ce8d330ea5fd473c98b6e36199f7c07b (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:39.671324  9947 tablet_service.cc:1511] Processing CreateTablet for tablet 92a71d859626422a835ad38ab2ba7bd7 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:39.685595  9879 tablet_service.cc:1511] Processing CreateTablet for tablet 052aa541571c4bea87eeb1ed2f45a1bf (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:39.652520  9949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be9677b33dcc4236a5656b7747c90d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.700312  9804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e528961028ca49b7a317cd20fbb343a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.701005  9799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af001ec909824ed199d355fd69f43ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.708287 10004 tablet_bootstrap.cc:492] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:39.708427  9805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecaeb132991949858ba7ff5186bd7024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.708837 10004 ts_tablet_manager.cc:1403] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.554s	user 0.017s	sys 0.003s
I20260709 12:25:39.716662  9713 catalog_manager.cc:5697] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:39.718070  9796 tablet_service.cc:1511] Processing CreateTablet for tablet a95007be04144b799116ba6a2d753a1e (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:39.719355  9796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95007be04144b799116ba6a2d753a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.720431  9947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92a71d859626422a835ad38ab2ba7bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.722226  9801 tablet_service.cc:1511] Processing CreateTablet for tablet 5224954c61b74424bc8af520537e37ec (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:39.732982 10006 tablet_bootstrap.cc:492] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:39.733044  9872 tablet_service.cc:1511] Processing CreateTablet for tablet ecaeb132991949858ba7ff5186bd7024 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:39.733589 10006 ts_tablet_manager.cc:1403] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.193s	user 0.025s	sys 0.047s
I20260709 12:25:39.735761 10005 tablet_bootstrap.cc:492] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:39.736243 10005 ts_tablet_manager.cc:1403] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.231s	user 0.019s	sys 0.008s
I20260709 12:25:39.737072  9954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce8d330ea5fd473c98b6e36199f7c07b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.736825 10006 raft_consensus.cc:359] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } }
I20260709 12:25:39.737672 10006 raft_consensus.cc:385] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.739749  9877 tablet_service.cc:1511] Processing CreateTablet for tablet e528961028ca49b7a317cd20fbb343a8 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:39.740209  9803 tablet_service.cc:1511] Processing CreateTablet for tablet c1c0ea749e8a45d4935db42359f9df11 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:39.742595  9950 tablet_service.cc:1511] Processing CreateTablet for tablet 052aa541571c4bea87eeb1ed2f45a1bf (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:39.743940  9950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 052aa541571c4bea87eeb1ed2f45a1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.744741  9800 tablet_service.cc:1511] Processing CreateTablet for tablet 83a89bfaa6124501b656ed0691a7f711 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:39.737977 10006 raft_consensus.cc:740] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:39.731303  9801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5224954c61b74424bc8af520537e37ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.746325 10006 consensus_queue.cc:260] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } }
I20260709 12:25:39.748587 10006 ts_tablet_manager.cc:1434] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:25:39.750028  9803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c0ea749e8a45d4935db42359f9df11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.752774  9800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a89bfaa6124501b656ed0691a7f711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.753360  9875 tablet_service.cc:1511] Processing CreateTablet for tablet af001ec909824ed199d355fd69f43ede (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 12:25:39.756067  9761 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:39.757829  9880 tablet_service.cc:1511] Processing CreateTablet for tablet 5224954c61b74424bc8af520537e37ec (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:39.692723  9945 tablet_service.cc:1511] Processing CreateTablet for tablet f27b8e99a0274a2791f902106d779c23 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:39.759208  9945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f27b8e99a0274a2791f902106d779c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.736903  9879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 052aa541571c4bea87eeb1ed2f45a1bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.760062  9874 tablet_service.cc:1511] Processing CreateTablet for tablet a95007be04144b799116ba6a2d753a1e (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:39.761354  9874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95007be04144b799116ba6a2d753a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.763288  9878 tablet_service.cc:1511] Processing CreateTablet for tablet c1c0ea749e8a45d4935db42359f9df11 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:39.765573  9872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecaeb132991949858ba7ff5186bd7024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.769701  9878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c0ea749e8a45d4935db42359f9df11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.770473  9877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e528961028ca49b7a317cd20fbb343a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.771173  9880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5224954c61b74424bc8af520537e37ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.785180 10004 raft_consensus.cc:359] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:39.785938 10004 raft_consensus.cc:385] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.786257 10004 raft_consensus.cc:740] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:39.786360  9875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af001ec909824ed199d355fd69f43ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.812317 10006 tablet_bootstrap.cc:492] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:39.807897 10004 consensus_queue.cc:260] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:39.817910  9952 tablet_service.cc:1511] Processing CreateTablet for tablet ecaeb132991949858ba7ff5186bd7024 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:39.819785  9952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecaeb132991949858ba7ff5186bd7024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.788467  9873 tablet_service.cc:1511] Processing CreateTablet for tablet 83a89bfaa6124501b656ed0691a7f711 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:39.800123 10005 raft_consensus.cc:359] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } }
I20260709 12:25:39.818506 10004 ts_tablet_manager.cc:1434] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.109s	user 0.007s	sys 0.002s
I20260709 12:25:39.827059  9948 tablet_service.cc:1511] Processing CreateTablet for tablet e528961028ca49b7a317cd20fbb343a8 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:39.841262  9948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e528961028ca49b7a317cd20fbb343a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.843927 10004 tablet_bootstrap.cc:492] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:39.844403  9876 tablet_service.cc:1511] Processing CreateTablet for tablet 3e593a3b7d754d449a065a58afdb1b7a (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:39.848969  9804 tablet_service.cc:1511] Processing CreateTablet for tablet bcb5052194b44bc49f4db5030ce11988 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:39.823240 10005 raft_consensus.cc:385] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.850239  9804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcb5052194b44bc49f4db5030ce11988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.850481 10005 raft_consensus.cc:740] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:39.851402  9800 tablet_service.cc:1511] Processing CreateTablet for tablet 3e593a3b7d754d449a065a58afdb1b7a (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:39.851507 10005 consensus_queue.cc:260] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } }
I20260709 12:25:39.852908  9800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e593a3b7d754d449a065a58afdb1b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.853904 10005 ts_tablet_manager.cc:1434] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.117s	user 0.002s	sys 0.006s
I20260709 12:25:39.851616  9953 tablet_service.cc:1511] Processing CreateTablet for tablet 5224954c61b74424bc8af520537e37ec (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:39.856827  9953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5224954c61b74424bc8af520537e37ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.863524  9951 tablet_service.cc:1511] Processing CreateTablet for tablet af001ec909824ed199d355fd69f43ede (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:39.864986  9951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af001ec909824ed199d355fd69f43ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.875588  9945 tablet_service.cc:1511] Processing CreateTablet for tablet c1c0ea749e8a45d4935db42359f9df11 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:39.881294  9945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c0ea749e8a45d4935db42359f9df11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.875691  9946 tablet_service.cc:1511] Processing CreateTablet for tablet a95007be04144b799116ba6a2d753a1e (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:39.878410  9873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a89bfaa6124501b656ed0691a7f711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.886267 10006 tablet_bootstrap.cc:654] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:39.888671  9874 tablet_service.cc:1511] Processing CreateTablet for tablet bcb5052194b44bc49f4db5030ce11988 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:39.889082  9947 tablet_service.cc:1511] Processing CreateTablet for tablet 3e593a3b7d754d449a065a58afdb1b7a (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:39.889652  9801 tablet_service.cc:1511] Processing CreateTablet for tablet 02b534aa26dd41d5afe616e203520c1a (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:39.890496  9947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e593a3b7d754d449a065a58afdb1b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.890894  9801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b534aa26dd41d5afe616e203520c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.900731  9949 tablet_service.cc:1511] Processing CreateTablet for tablet 83a89bfaa6124501b656ed0691a7f711 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:39.911643 10005 tablet_bootstrap.cc:492] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:39.914522  9876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e593a3b7d754d449a065a58afdb1b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.921666  9950 tablet_service.cc:1511] Processing CreateTablet for tablet bcb5052194b44bc49f4db5030ce11988 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:39.922928  9874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcb5052194b44bc49f4db5030ce11988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.926630  9946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95007be04144b799116ba6a2d753a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.927923  9875 tablet_service.cc:1511] Processing CreateTablet for tablet 95440cd9ec714a699fca70a8a9b17e96 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:39.929189  9875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95440cd9ec714a699fca70a8a9b17e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.929672  9949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83a89bfaa6124501b656ed0691a7f711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.937536 10006 tablet_bootstrap.cc:492] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:39.938021 10006 ts_tablet_manager.cc:1403] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.126s	user 0.011s	sys 0.010s
I20260709 12:25:39.945387 10012 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.946266  9950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcb5052194b44bc49f4db5030ce11988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.945997 10012 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } }
I20260709 12:25:39.954511  9804 tablet_service.cc:1511] Processing CreateTablet for tablet 95440cd9ec714a699fca70a8a9b17e96 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:39.955806  9804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95440cd9ec714a699fca70a8a9b17e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.945014  9880 tablet_service.cc:1511] Processing CreateTablet for tablet 02b534aa26dd41d5afe616e203520c1a (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:39.960898  9880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b534aa26dd41d5afe616e203520c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.951704  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:39.978166  9802 tablet_service.cc:1511] Processing CreateTablet for tablet 816661d3711b4989a37fe8f5befcd6a4 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:39.979485  9802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 816661d3711b4989a37fe8f5befcd6a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.983867 10006 raft_consensus.cc:359] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:39.984579 10006 raft_consensus.cc:385] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:39.984905 10006 raft_consensus.cc:740] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:39.991257  9877 tablet_service.cc:1511] Processing CreateTablet for tablet 816661d3711b4989a37fe8f5befcd6a4 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:39.992986  9877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 816661d3711b4989a37fe8f5befcd6a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.992658  9873 tablet_service.cc:1511] Processing CreateTablet for tablet 8156e447e6a24044b5712dbb3a354b7f (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:39.994094  9873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8156e447e6a24044b5712dbb3a354b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.994200 10012 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:25:39.995313  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:39.995934  9815 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:39.997115  9927 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:39.997978 10012 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:39.998831  9804 tablet_service.cc:1511] Processing CreateTablet for tablet 8156e447e6a24044b5712dbb3a354b7f (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:40.000074  9804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8156e447e6a24044b5712dbb3a354b7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:39.998348 10012 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.003358 10012 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:39.984886 10011 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:25:40.005491  9796 tablet_service.cc:1511] Processing CreateTablet for tablet 3ffb5c0a23894c12bb5bd0d73c289106 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:40.006830 10006 consensus_queue.cc:260] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.008507  9796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ffb5c0a23894c12bb5bd0d73c289106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:40.010314 10012 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } }
I20260709 12:25:40.013633  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:40.021250  9954 tablet_service.cc:1511] Processing CreateTablet for tablet 02b534aa26dd41d5afe616e203520c1a (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:40.027092 10004 tablet_bootstrap.cc:654] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:39.998857  9890 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:40.035254  9948 tablet_service.cc:1511] Processing CreateTablet for tablet 95440cd9ec714a699fca70a8a9b17e96 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:40.035254  9871 tablet_service.cc:1511] Processing CreateTablet for tablet 3ffb5c0a23894c12bb5bd0d73c289106 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:40.047883  9954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b534aa26dd41d5afe616e203520c1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:40.056401  9952 tablet_service.cc:1511] Processing CreateTablet for tablet 8156e447e6a24044b5712dbb3a354b7f (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:40.058044  9952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8156e447e6a24044b5712dbb3a354b7f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:40.058122  9916 tablet.cc:2406] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:40.066707 10009 consensus_queue.cc:1048] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:40.072716  9945 tablet_service.cc:1511] Processing CreateTablet for tablet 3ffb5c0a23894c12bb5bd0d73c289106 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:40.084471  9945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ffb5c0a23894c12bb5bd0d73c289106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:40.088347 10009 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.088842 10009 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.091004 10009 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:40.093055  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:40.093781  9871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ffb5c0a23894c12bb5bd0d73c289106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:40.095947  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:40.097640  9853 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:25:40.099292 10009 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:40.099325  9951 tablet_service.cc:1511] Processing CreateTablet for tablet 816661d3711b4989a37fe8f5befcd6a4 (DEFAULT_TABLE table=test-workload [id=2104d965acd740c18427483cb0d3ea73]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:40.100839  9951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 816661d3711b4989a37fe8f5befcd6a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:40.103945  9890 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.108247  9948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95440cd9ec714a699fca70a8a9b17e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:40.108498 10005 tablet_bootstrap.cc:654] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.116675  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:40.117507  9815 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.122191 10012 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:25:40.144932 10004 tablet_bootstrap.cc:492] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:40.145440 10004 ts_tablet_manager.cc:1403] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.302s	user 0.015s	sys 0.030s
I20260709 12:25:40.156520  9815 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:40.158097  9927 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:25:40.171109 10006 ts_tablet_manager.cc:1434] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.233s	user 0.011s	sys 0.018s
I20260709 12:25:40.172199 10006 tablet_bootstrap.cc:492] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:40.176422 10011 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:40.178496 10039 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:40.179028 10039 raft_consensus.cc:697] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:40.179852 10039 consensus_queue.cc:237] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } }
I20260709 12:25:40.198814 10006 tablet_bootstrap.cc:654] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.206096 10004 raft_consensus.cc:359] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.212684 10004 raft_consensus.cc:385] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.213001 10004 raft_consensus.cc:740] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.223881 10004 consensus_queue.cc:260] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.226941 10004 ts_tablet_manager.cc:1434] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.081s	user 0.000s	sys 0.010s
I20260709 12:25:40.230242 10039 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.233781 10005 tablet_bootstrap.cc:492] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:40.232822 10039 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.234897 10005 ts_tablet_manager.cc:1403] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.328s	user 0.019s	sys 0.022s
I20260709 12:25:40.236646 10039 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:40.237267  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:40.245414 10006 tablet_bootstrap.cc:492] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:40.245275 10005 raft_consensus.cc:359] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.245937 10006 ts_tablet_manager.cc:1403] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.005s
I20260709 12:25:40.246038 10005 raft_consensus.cc:385] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.246186  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:40.246441 10005 raft_consensus.cc:740] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.247190 10005 consensus_queue.cc:260] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.247620 10047 consensus_queue.cc:1048] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:40.251976  9815 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:40.254647 10006 raft_consensus.cc:359] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.255386 10006 raft_consensus.cc:385] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.255676 10006 raft_consensus.cc:740] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
W20260709 12:25:40.256177  9928 leader_election.cc:343] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.256383 10006 consensus_queue.cc:260] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.256827  9927 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:25:40.258659 10006 ts_tablet_manager.cc:1434] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 12:25:40.259298 10042 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:40.259609 10006 tablet_bootstrap.cc:492] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:40.259783 10042 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.260277 10042 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.256898 10004 tablet_bootstrap.cc:492] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:40.270862  9711 catalog_manager.cc:5697] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:40.297703 10004 tablet_bootstrap.cc:654] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.305438 10042 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.310858  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:40.311484  9814 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.314224 10005 ts_tablet_manager.cc:1434] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.079s	user 0.020s	sys 0.004s
I20260709 12:25:40.314076  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:25:40.315623  9928 leader_election.cc:343] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.316923 10005 tablet_bootstrap.cc:492] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:40.321543  9814 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:40.310105 10042 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:40.322845  9927 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:25:40.323679 10042 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:40.324340 10006 tablet_bootstrap.cc:654] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.324242 10042 raft_consensus.cc:697] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:40.325171 10042 consensus_queue.cc:237] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.325495  9711 catalog_manager.cc:5697] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:40.329689 10004 tablet_bootstrap.cc:492] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:40.330161 10004 ts_tablet_manager.cc:1403] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.006s
I20260709 12:25:40.330624 10005 tablet_bootstrap.cc:654] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.332926 10004 raft_consensus.cc:359] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.333619 10004 raft_consensus.cc:385] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.333897 10004 raft_consensus.cc:740] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.336942 10004 consensus_queue.cc:260] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.341464 10005 tablet_bootstrap.cc:492] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:40.345166 10004 ts_tablet_manager.cc:1434] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:25:40.342077 10005 ts_tablet_manager.cc:1403] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.004s
I20260709 12:25:40.353240 10006 tablet_bootstrap.cc:492] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:40.353705 10006 ts_tablet_manager.cc:1403] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.094s	user 0.012s	sys 0.016s
I20260709 12:25:40.356745 10004 tablet_bootstrap.cc:492] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:40.349852 10005 raft_consensus.cc:359] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.357383 10005 raft_consensus.cc:385] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.357689 10005 raft_consensus.cc:740] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.358395 10005 consensus_queue.cc:260] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.360631 10005 ts_tablet_manager.cc:1434] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:25:40.361554 10005 tablet_bootstrap.cc:492] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:40.356386 10006 raft_consensus.cc:359] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.365226  9711 catalog_manager.cc:5697] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:40.366472 10006 raft_consensus.cc:385] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.366899 10006 raft_consensus.cc:740] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.367772 10005 tablet_bootstrap.cc:654] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.367640 10006 consensus_queue.cc:260] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.369987 10006 ts_tablet_manager.cc:1434] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:25:40.370971 10006 tablet_bootstrap.cc:492] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:40.376996 10006 tablet_bootstrap.cc:654] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.383111 10004 tablet_bootstrap.cc:654] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.391705 10005 tablet_bootstrap.cc:492] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:40.392136 10006 tablet_bootstrap.cc:492] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:40.392210 10005 ts_tablet_manager.cc:1403] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.008s
I20260709 12:25:40.392560 10006 ts_tablet_manager.cc:1403] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 12:25:40.394477 10006 raft_consensus.cc:359] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.395124 10006 raft_consensus.cc:385] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.395506 10006 raft_consensus.cc:740] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.395145 10005 raft_consensus.cc:359] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.396008 10005 raft_consensus.cc:385] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.396132 10004 tablet_bootstrap.cc:492] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:40.396354 10005 raft_consensus.cc:740] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.396193 10006 consensus_queue.cc:260] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.396842 10004 ts_tablet_manager.cc:1403] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.003s
I20260709 12:25:40.398208 10006 ts_tablet_manager.cc:1434] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:25:40.399415 10006 tablet_bootstrap.cc:492] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:40.399823 10004 raft_consensus.cc:359] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.400532 10004 raft_consensus.cc:385] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.400887 10004 raft_consensus.cc:740] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.401795 10004 consensus_queue.cc:260] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.404031 10004 ts_tablet_manager.cc:1434] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 12:25:40.405021 10004 tablet_bootstrap.cc:492] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:40.411242 10004 tablet_bootstrap.cc:654] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.413051 10005 consensus_queue.cc:260] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.422128 10006 tablet_bootstrap.cc:654] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.423400 10005 ts_tablet_manager.cc:1434] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.004s
I20260709 12:25:40.430521 10004 tablet_bootstrap.cc:492] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:40.431005 10004 ts_tablet_manager.cc:1403] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.009s
I20260709 12:25:40.432273 10005 tablet_bootstrap.cc:492] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:40.433645 10006 tablet_bootstrap.cc:492] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:40.434119 10006 ts_tablet_manager.cc:1403] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.003s
I20260709 12:25:40.433940 10004 raft_consensus.cc:359] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.434674 10004 raft_consensus.cc:385] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.434980 10004 raft_consensus.cc:740] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.435839 10004 consensus_queue.cc:260] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.437284 10006 raft_consensus.cc:359] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.437938 10006 raft_consensus.cc:385] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.438246 10006 raft_consensus.cc:740] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.439266 10005 tablet_bootstrap.cc:654] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.439055 10006 consensus_queue.cc:260] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.441494 10004 ts_tablet_manager.cc:1434] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:25:40.442466 10004 tablet_bootstrap.cc:492] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:40.446563 10006 ts_tablet_manager.cc:1434] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:25:40.447511 10006 tablet_bootstrap.cc:492] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:40.448407 10004 tablet_bootstrap.cc:654] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.464064 10006 tablet_bootstrap.cc:654] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.465021 10004 tablet_bootstrap.cc:492] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:40.465502 10004 ts_tablet_manager.cc:1403] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.006s
I20260709 12:25:40.468693 10004 raft_consensus.cc:359] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.469565 10004 raft_consensus.cc:385] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.469903 10004 raft_consensus.cc:740] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.470779 10004 consensus_queue.cc:260] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.473806 10004 ts_tablet_manager.cc:1434] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:40.475073 10004 tablet_bootstrap.cc:492] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:40.478030 10005 tablet_bootstrap.cc:492] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:40.478585 10005 ts_tablet_manager.cc:1403] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.014s
I20260709 12:25:40.479643 10051 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.480157 10051 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.480706 10004 tablet_bootstrap.cc:654] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.482376 10051 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:40.484387  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:40.485658  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:25:40.487128  9778 leader_election.cc:343] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.488157 10006 tablet_bootstrap.cc:492] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
W20260709 12:25:40.488058  9779 leader_election.cc:343] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.488638 10006 ts_tablet_manager.cc:1403] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.002s
I20260709 12:25:40.488544  9779 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:25:40.489599 10051 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:40.491236 10006 raft_consensus.cc:359] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.491990 10006 raft_consensus.cc:385] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.492223 10006 raft_consensus.cc:740] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.492336 10005 raft_consensus.cc:359] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.492849 10006 consensus_queue.cc:260] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.493119 10004 tablet_bootstrap.cc:492] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:40.493700 10004 ts_tablet_manager.cc:1403] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 12:25:40.494750 10006 ts_tablet_manager.cc:1434] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:25:40.493042 10005 raft_consensus.cc:385] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.496047 10005 raft_consensus.cc:740] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.496212 10004 raft_consensus.cc:359] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.496917 10004 raft_consensus.cc:385] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.495802 10006 tablet_bootstrap.cc:492] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:40.497274 10004 raft_consensus.cc:740] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.496980 10005 consensus_queue.cc:260] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.498096 10004 consensus_queue.cc:260] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.503902 10006 tablet_bootstrap.cc:654] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.504127 10005 ts_tablet_manager.cc:1434] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 12:25:40.504662 10004 ts_tablet_manager.cc:1434] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.003s
I20260709 12:25:40.505544 10004 tablet_bootstrap.cc:492] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:40.510921 10004 tablet_bootstrap.cc:654] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.511179 10005 tablet_bootstrap.cc:492] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:40.515697 10006 tablet_bootstrap.cc:492] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:40.516060 10004 tablet_bootstrap.cc:492] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:40.516137 10006 ts_tablet_manager.cc:1403] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 12:25:40.516608 10004 ts_tablet_manager.cc:1403] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:25:40.518818 10006 raft_consensus.cc:359] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.519500 10006 raft_consensus.cc:385] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.519220 10004 raft_consensus.cc:359] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.519806 10006 raft_consensus.cc:740] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.519939 10004 raft_consensus.cc:385] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.520280 10004 raft_consensus.cc:740] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.520500 10006 consensus_queue.cc:260] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.521175 10004 consensus_queue.cc:260] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.522701 10006 ts_tablet_manager.cc:1434] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:25:40.523439 10004 ts_tablet_manager.cc:1434] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:40.523595 10006 tablet_bootstrap.cc:492] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:40.524623 10004 tablet_bootstrap.cc:492] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:40.526224 10005 tablet_bootstrap.cc:654] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.528833 10006 tablet_bootstrap.cc:654] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.530839 10004 tablet_bootstrap.cc:654] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.532382 10047 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.533007 10047 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.536844  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:40.538403 10005 tablet_bootstrap.cc:492] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
W20260709 12:25:40.538767  9853 leader_election.cc:343] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.539063 10005 ts_tablet_manager.cc:1403] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.004s
I20260709 12:25:40.540165 10047 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:40.542253  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:40.543120  9964 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:40.543851 10005 raft_consensus.cc:359] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.544363  9853 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:40.546561 10005 raft_consensus.cc:385] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.546957 10006 tablet_bootstrap.cc:492] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:40.547026 10005 raft_consensus.cc:740] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.547466 10006 ts_tablet_manager.cc:1403] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.008s
I20260709 12:25:40.547806 10047 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:40.548200 10047 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.548527 10047 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.548388 10005 consensus_queue.cc:260] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.550181 10006 raft_consensus.cc:359] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.550889 10006 raft_consensus.cc:385] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.551152 10006 raft_consensus.cc:740] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.552186 10004 tablet_bootstrap.cc:492] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:40.551883 10006 consensus_queue.cc:260] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.552563 10005 ts_tablet_manager.cc:1434] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:25:40.552618 10004 ts_tablet_manager.cc:1403] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.017s
I20260709 12:25:40.553797 10006 ts_tablet_manager.cc:1434] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:40.554563 10006 tablet_bootstrap.cc:492] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:40.555737 10004 raft_consensus.cc:359] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.556354 10004 raft_consensus.cc:385] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.556625 10004 raft_consensus.cc:740] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.557296 10004 consensus_queue.cc:260] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.559680 10004 ts_tablet_manager.cc:1434] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:40.560510 10004 tablet_bootstrap.cc:492] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:40.560820 10047 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.564946 10005 tablet_bootstrap.cc:492] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:40.566183 10004 tablet_bootstrap.cc:654] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.568120 10006 tablet_bootstrap.cc:654] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.570382 10005 tablet_bootstrap.cc:654] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.573529 10054 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.574074 10054 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.576704 10054 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:40.576766  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:40.577584  9964 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.580060  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:40.581686  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:40.582537  9814 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:40.584544  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:40.585391  9963 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:40.585783  9964 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:40.586918 10047 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:40.589458 10005 tablet_bootstrap.cc:492] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:40.589915 10005 ts_tablet_manager.cc:1403] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.000s
W20260709 12:25:40.590772  9853 leader_election.cc:343] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.591733  9853 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:25:40.592418 10047 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:40.592904 10047 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.592702 10005 raft_consensus.cc:359] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.593096  9853 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:40.593333 10047 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.593403 10006 tablet_bootstrap.cc:492] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:40.593466 10005 raft_consensus.cc:385] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.593930 10005 raft_consensus.cc:740] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.594094 10006 ts_tablet_manager.cc:1403] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.009s
I20260709 12:25:40.594234 10054 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:40.595005 10054 raft_consensus.cc:697] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:40.594730 10005 consensus_queue.cc:260] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.596896 10005 ts_tablet_manager.cc:1434] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:25:40.597046 10006 raft_consensus.cc:359] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.597656 10006 raft_consensus.cc:385] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.597922 10006 raft_consensus.cc:740] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.598132 10005 tablet_bootstrap.cc:492] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:40.598615 10006 consensus_queue.cc:260] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.600574 10006 ts_tablet_manager.cc:1434] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:40.601128 10009 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.600852 10047 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.601570 10009 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.602640  9890 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.602860 10047 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:40.602821 10006 tablet_bootstrap.cc:492] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:40.603564 10009 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:40.604746 10004 tablet_bootstrap.cc:492] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:40.604983  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:40.605176 10004 ts_tablet_manager.cc:1403] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.045s	user 0.016s	sys 0.006s
I20260709 12:25:40.605536  9814 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.607903 10004 raft_consensus.cc:359] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.608536 10004 raft_consensus.cc:385] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.608803 10004 raft_consensus.cc:740] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.609457 10004 consensus_queue.cc:260] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.610296 10039 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.610351 10042 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.610878 10039 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.610942 10042 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.611894 10005 tablet_bootstrap.cc:654] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.612242  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:40.613013  9815 raft_consensus.cc:2393] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 1: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:25:40.613070 10039 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:40.614548 10006 tablet_bootstrap.cc:654] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.616879 10054 consensus_queue.cc:237] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.617261  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:40.614802  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:40.618783  9964 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.615302  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:40.620543  9813 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:40.621994  9927 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:40.616102  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:40.616549 10004 ts_tablet_manager.cc:1434] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:25:40.616360  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:25:40.623628  9928 leader_election.cc:343] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.624116 10004 tablet_bootstrap.cc:492] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:40.622992  9815 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
W20260709 12:25:40.624356  9928 leader_election.cc:343] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.625356  9927 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:25:40.625581  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:40.622855 10039 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:40.626579 10040 raft_consensus.cc:2804] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:40.626688 10039 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.626972 10040 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.627276 10039 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.627336 10040 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.613083 10042 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:40.633143 10005 tablet_bootstrap.cc:492] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:40.633541 10005 ts_tablet_manager.cc:1403] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.001s
I20260709 12:25:40.634012 10042 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:40.635329 10042 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.635746 10042 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.637688 10042 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:40.638406 10009 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.638878 10009 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.639045 10047 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.639662 10047 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.643890  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:40.644501  9889 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:40.641108 10005 raft_consensus.cc:359] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.645787 10005 raft_consensus.cc:385] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.646210 10005 raft_consensus.cc:740] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.647872 10005 consensus_queue.cc:260] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.644587 10039 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.643688 10047 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:40.640731 10009 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:40.655332  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:40.655704  9928 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:40.656112  9815 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:40.656584 10042 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:40.657007 10042 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.657387 10042 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.657454 10039 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:40.658635  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:40.659145  9813 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.659531 10006 tablet_bootstrap.cc:492] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:40.659967 10006 ts_tablet_manager.cc:1403] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.017s
I20260709 12:25:40.662129  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:25:40.663990  9928 leader_election.cc:343] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.668628 10005 ts_tablet_manager.cc:1434] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 12:25:40.674584  9813 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:40.679286 10005 tablet_bootstrap.cc:492] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:40.680130 10039 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.682751  9927 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:25:40.682564 10039 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.685184 10006 raft_consensus.cc:359] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.686022 10006 raft_consensus.cc:385] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.686410 10006 raft_consensus.cc:740] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.687314 10006 consensus_queue.cc:260] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.692365 10005 tablet_bootstrap.cc:654] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.692972 10004 tablet_bootstrap.cc:654] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.701354 10040 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.701973 10039 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:40.702648 10039 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.703114  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:40.703174 10039 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.703809  9889 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:40.684500  9853 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:25:40.706862  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:40.707757  9814 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:40.709833 10042 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.711884 10009 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.704236 10040 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:40.720427  9964 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:40.724144 10042 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:40.724687 10039 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:40.717854  9928 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:40.726996  9853 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:25:40.727763 10006 ts_tablet_manager.cc:1434] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.068s	user 0.011s	sys 0.006s
I20260709 12:25:40.728096 10085 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:40.728888 10006 tablet_bootstrap.cc:492] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:40.728761 10085 raft_consensus.cc:697] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:40.732272  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:40.734015 10092 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:40.733242 10039 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:40.736318  9853 leader_election.cc:343] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.738437 10092 raft_consensus.cc:697] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:40.739672 10092 consensus_queue.cc:237] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.742712  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:25:40.743016  9928 leader_election.cc:343] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.743130  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:40.743312  9889 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.743819  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:40.744391  9964 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:40.745538 10085 consensus_queue.cc:237] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.747028  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:40.747599  9888 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:40.747534  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:40.748453  9814 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:40.750524  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:25:40.736436 10040 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:40.751752  9963 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:40.752573 10054 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:40.753036 10054 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.753165 10040 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.753532 10054 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.753726 10040 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.738046 10039 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.756925 10039 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:40.750777  9928 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:40.758572  9853 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:40.759042  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:40.759684  9888 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:40.762560 10039 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:40.764966 10039 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.765434 10039 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:40.765983  9761 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:40.762064 10084 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:40.770455 10040 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.775467 10084 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.776074 10084 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.775590  9712 catalog_manager.cc:5697] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:40.778509  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:25:40.760927  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 78269.6us
I20260709 12:25:40.781656 10051 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.781391 10091 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:40.782749 10091 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.783113 10091 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.784665  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:40.785868  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:40.781380 10083 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.782135 10051 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:40.788058  9927 leader_election.cc:343] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.789564  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:40.790875 10051 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:40.791014  9812 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:40.791472  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:40.786445  9815 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.793342 10005 tablet_bootstrap.cc:492] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:40.793780 10005 ts_tablet_manager.cc:1403] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.115s	user 0.022s	sys 0.024s
I20260709 12:25:40.795429  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:40.795475 10084 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.796295  9963 raft_consensus.cc:2393] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 1: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:25:40.797472  9778 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:25:40.797969  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:40.799903  9814 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.799970 10040 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:40.798887 10009 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:40.790045 10054 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.801132  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:40.804685  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:40.805167  9889 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:40.805207  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:40.805956 10054 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:40.806174  9888 raft_consensus.cc:2393] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 1: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
W20260709 12:25:40.806331  9853 leader_election.cc:343] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.797983 10083 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.809402 10083 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:40.809237 10091 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.810638  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:40.811352  9963 raft_consensus.cc:2393] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 1: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:25:40.811257  9928 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:40.801544 10051 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.815328  9853 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:25:40.816354  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:40.816943  9812 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.816182  9711 catalog_manager.cc:5697] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:40.812233 10091 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:40.817981 10091 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:40.818513 10091 raft_consensus.cc:697] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:40.818686  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:40.819489 10091 consensus_queue.cc:237] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.822619  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:40.822894 10005 raft_consensus.cc:359] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.823779 10005 raft_consensus.cc:385] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.824039 10005 raft_consensus.cc:740] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.824680 10005 consensus_queue.cc:260] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.802780 10084 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:25:40.831664  9928 leader_election.cc:343] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.831136 10054 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:40.855948  9815 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:40.866117  9814 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:40.877115 10039 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.880264 10039 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:40.880968 10039 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.881584 10039 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.881628  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:40.884078  9963 raft_consensus.cc:2393] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 1: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:25:40.885073  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 82327.6us
I20260709 12:25:40.888312  9888 raft_consensus.cc:2393] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 1: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:25:40.888875 10005 ts_tablet_manager.cc:1434] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.095s	user 0.015s	sys 0.019s
I20260709 12:25:40.886111 10004 tablet_bootstrap.cc:492] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:40.889645 10004 ts_tablet_manager.cc:1403] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.266s	user 0.042s	sys 0.040s
I20260709 12:25:40.887709 10006 tablet_bootstrap.cc:654] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.884388  9812 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
W20260709 12:25:40.885214  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 69970.2us
I20260709 12:25:40.893221 10004 raft_consensus.cc:359] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.889948 10051 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:40.894577 10004 raft_consensus.cc:385] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.895346 10004 raft_consensus.cc:740] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.894107  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:40.896989 10039 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:40.897682 10054 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.897917  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:25:40.898422 10054 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.898833 10084 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:40.898802  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:40.899533 10084 raft_consensus.cc:697] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:40.899683  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:40.897294  9889 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.902727  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:40.900519 10084 consensus_queue.cc:237] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.906823  9711 catalog_manager.cc:5697] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:40.909128 10054 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:40.910081 10042 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:25:40.913388  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:25:40.915684  9927 leader_election.cc:343] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.917811  9927 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:25:40.917904  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:40.915148 10042 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:40.897655 10004 consensus_queue.cc:260] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.919544 10005 tablet_bootstrap.cc:492] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:40.928138  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:40.925096  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:40.938625 10006 tablet_bootstrap.cc:492] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:40.927496  9890 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:40.929960  9815 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.946116 10006 ts_tablet_manager.cc:1403] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.217s	user 0.019s	sys 0.009s
I20260709 12:25:40.936645  9889 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:40.929016 10091 raft_consensus.cc:2804] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:40.931099  9811 raft_consensus.cc:2393] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 1: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:25:40.949481  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:40.950188 10091 raft_consensus.cc:697] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:40.950546 10042 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:40.951145 10042 raft_consensus.cc:697] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:40.951005  9712 catalog_manager.cc:5697] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:40.951316 10091 consensus_queue.cc:237] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.952159 10042 consensus_queue.cc:237] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:40.930114  9853 leader_election.cc:343] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:40.955899  9927 leader_election.cc:343] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.956465  9927 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:25:40.957748 10040 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:25:40.962915  9853 leader_election.cc:343] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.963074  9928 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:40.963382  9853 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:25:40.964087 10040 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:40.964109 10084 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:40.964650 10040 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.965051 10040 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:40.965600 10006 raft_consensus.cc:359] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.966248 10006 raft_consensus.cc:385] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:40.966524 10006 raft_consensus.cc:740] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:40.967170 10006 consensus_queue.cc:260] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.970144 10005 tablet_bootstrap.cc:654] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.970959 10054 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.971462 10054 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:40.973426 10054 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:40.975435 10006 ts_tablet_manager.cc:1434] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.029s	user 0.000s	sys 0.006s
I20260709 12:25:40.976334 10006 tablet_bootstrap.cc:492] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:40.979493 10039 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:40.981341  9927 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:25:40.979458  9815 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:40.984521 10004 ts_tablet_manager.cc:1434] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.005s
I20260709 12:25:40.985795 10004 tablet_bootstrap.cc:492] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:40.986642 10006 tablet_bootstrap.cc:654] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:40.988056 10039 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:25:40.989202  9927 leader_election.cc:343] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.989660  9927 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:25:40.990309 10039 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:40.991137  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:25:40.992355  9853 leader_election.cc:343] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:40.993551  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:41.000954 10039 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.001483 10039 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:41.004181  9853 leader_election.cc:343] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:41.002672  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:41.004616  9853 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:25:41.006142 10039 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:41.007772  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:41.008248 10054 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:41.008623  9890 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:41.010022  9928 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:41.011065 10039 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:41.011650 10039 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.012063 10039 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:41.023913  9927 leader_election.cc:343] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:41.024928  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:41.027786 10040 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.039582 10005 tablet_bootstrap.cc:492] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:41.040079 10005 ts_tablet_manager.cc:1403] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.121s	user 0.011s	sys 0.016s
I20260709 12:25:41.040983 10054 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:41.043030 10040 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:41.042838 10005 raft_consensus.cc:359] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.043864 10005 raft_consensus.cc:385] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.044153 10005 raft_consensus.cc:740] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.044898 10005 consensus_queue.cc:260] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:41.048549  9927 leader_election.cc:343] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:41.055459 10005 ts_tablet_manager.cc:1434] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:25:41.056814 10005 tablet_bootstrap.cc:492] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:41.049316  9712 catalog_manager.cc:5697] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:41.071056  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:41.071866  9888 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.074046 10039 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.078639 10039 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:41.080749  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:41.081508  9890 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.090143 10004 tablet_bootstrap.cc:654] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.097674  9711 catalog_manager.cc:5697] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:41.140384 10100 log.cc:927] Time spent T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:25:41.141140  9711 catalog_manager.cc:5697] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.146610  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:41.147208 10006 tablet_bootstrap.cc:492] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:41.148300  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:41.155067 10006 ts_tablet_manager.cc:1403] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.179s	user 0.018s	sys 0.022s
I20260709 12:25:41.158669 10085 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:41.159348 10084 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:41.165647  9890 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:41.168162  9928 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:41.169425 10005 tablet_bootstrap.cc:654] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.170109 10091 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:41.169963 10006 raft_consensus.cc:359] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.170668 10006 raft_consensus.cc:385] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.170815 10091 raft_consensus.cc:697] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:41.170971 10006 raft_consensus.cc:740] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.171701 10006 consensus_queue.cc:260] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.171847 10091 consensus_queue.cc:237] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.173921 10006 ts_tablet_manager.cc:1434] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.003s
I20260709 12:25:41.174820 10006 tablet_bootstrap.cc:492] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195: Bootstrap starting.
W20260709 12:25:41.175343  9927 leader_election.cc:343] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:41.176792  9927 leader_election.cc:343] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:41.188788 10006 tablet_bootstrap.cc:654] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.177676  9888 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:41.195788  9928 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:41.198954 10039 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:41.199616 10039 raft_consensus.cc:697] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:41.200774 10039 consensus_queue.cc:237] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.203809 10004 tablet_bootstrap.cc:492] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:41.204321 10004 ts_tablet_manager.cc:1403] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.219s	user 0.016s	sys 0.004s
I20260709 12:25:41.204293 10084 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:41.208318 10004 raft_consensus.cc:359] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.208937 10004 raft_consensus.cc:385] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.210395 10004 raft_consensus.cc:740] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.211238 10004 consensus_queue.cc:260] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.213605  9888 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.213831 10004 ts_tablet_manager.cc:1434] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:25:41.214731 10004 tablet_bootstrap.cc:492] T 3290aa2b0ef349e78e838202fb70b358 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:41.220870 10004 tablet_bootstrap.cc:654] T 3290aa2b0ef349e78e838202fb70b358 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.222328 10040 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:41.223114 10005 tablet_bootstrap.cc:492] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:41.223534 10005 ts_tablet_manager.cc:1403] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.167s	user 0.008s	sys 0.004s
I20260709 12:25:41.226087 10005 raft_consensus.cc:359] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.232156 10005 raft_consensus.cc:385] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.232432 10005 raft_consensus.cc:740] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.233583 10005 consensus_queue.cc:260] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.235966 10005 ts_tablet_manager.cc:1434] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:25:41.236878 10005 tablet_bootstrap.cc:492] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:41.241228 10006 tablet_bootstrap.cc:492] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:41.242635 10040 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:41.241706 10006 ts_tablet_manager.cc:1403] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.006s
I20260709 12:25:41.246763 10006 raft_consensus.cc:359] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.247413 10006 raft_consensus.cc:385] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.250578 10005 tablet_bootstrap.cc:654] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.247669 10006 raft_consensus.cc:740] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.252601 10006 consensus_queue.cc:260] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.256229 10006 ts_tablet_manager.cc:1434] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:25:41.257194 10006 tablet_bootstrap.cc:492] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:41.262588 10004 tablet_bootstrap.cc:492] T 3290aa2b0ef349e78e838202fb70b358 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:41.263118 10004 ts_tablet_manager.cc:1403] T 3290aa2b0ef349e78e838202fb70b358 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.049s	user 0.023s	sys 0.010s
I20260709 12:25:41.265712 10004 raft_consensus.cc:359] T 3290aa2b0ef349e78e838202fb70b358 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.266482 10004 raft_consensus.cc:385] T 3290aa2b0ef349e78e838202fb70b358 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.266538 10006 tablet_bootstrap.cc:654] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.268342 10004 raft_consensus.cc:740] T 3290aa2b0ef349e78e838202fb70b358 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.269105 10004 consensus_queue.cc:260] T 3290aa2b0ef349e78e838202fb70b358 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.268409  9711 catalog_manager.cc:5697] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.271123 10004 ts_tablet_manager.cc:1434] T 3290aa2b0ef349e78e838202fb70b358 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:41.271827 10004 tablet_bootstrap.cc:492] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:41.276455 10004 tablet_bootstrap.cc:654] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.276786 10005 tablet_bootstrap.cc:492] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:41.277211 10005 ts_tablet_manager.cc:1403] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.000s
I20260709 12:25:41.279778 10005 raft_consensus.cc:359] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.281658 10005 raft_consensus.cc:385] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.281925 10005 raft_consensus.cc:740] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.282683 10005 consensus_queue.cc:260] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.285549 10005 ts_tablet_manager.cc:1434] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:41.287935 10005 tablet_bootstrap.cc:492] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:41.294790 10006 tablet_bootstrap.cc:492] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:41.295337 10004 tablet_bootstrap.cc:492] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:41.296140 10006 ts_tablet_manager.cc:1403] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.003s
I20260709 12:25:41.296571 10004 ts_tablet_manager.cc:1403] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.007s
I20260709 12:25:41.298943 10006 raft_consensus.cc:359] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.299161 10004 raft_consensus.cc:359] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.299659 10006 raft_consensus.cc:385] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.299847 10004 raft_consensus.cc:385] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.300036 10006 raft_consensus.cc:740] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.300194 10004 raft_consensus.cc:740] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.301065 10004 consensus_queue.cc:260] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.300973 10006 consensus_queue.cc:260] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.295542 10005 tablet_bootstrap.cc:654] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.304569 10006 ts_tablet_manager.cc:1434] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:41.307828 10006 tablet_bootstrap.cc:492] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:41.309473 10005 tablet_bootstrap.cc:492] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:41.309903 10005 ts_tablet_manager.cc:1403] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 12:25:41.312633 10005 raft_consensus.cc:359] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.314951 10006 tablet_bootstrap.cc:654] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.315047 10005 raft_consensus.cc:385] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.315438 10005 raft_consensus.cc:740] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.315603  9711 catalog_manager.cc:5697] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.316196 10005 consensus_queue.cc:260] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.306964 10004 ts_tablet_manager.cc:1434] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:25:41.317256 10084 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.317730 10084 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.318190 10004 tablet_bootstrap.cc:492] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:41.319792 10084 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:41.320976  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:41.321604  9964 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:41.321825  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:41.322474  9814 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:41.322844  9853 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:41.324420 10084 raft_consensus.cc:2804] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:41.324829 10084 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.325250 10084 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.326097 10005 ts_tablet_manager.cc:1434] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 12:25:41.329980 10005 tablet_bootstrap.cc:492] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:41.334746 10084 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.336180 10005 tablet_bootstrap.cc:654] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.336908 10084 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:41.337162 10006 tablet_bootstrap.cc:492] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:41.324797 10004 tablet_bootstrap.cc:654] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.337664 10006 ts_tablet_manager.cc:1403] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.030s	user 0.005s	sys 0.010s
I20260709 12:25:41.343456  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:41.344226  9814 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.348320 10039 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:41.349730  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:41.350610  9964 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.362488 10042 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:41.364876 10042 consensus_queue.cc:1048] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:41.369623 10084 consensus_queue.cc:1048] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:41.370846 10051 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.371369 10051 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.374198 10051 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:41.376257  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:41.377223  9890 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 0.
I20260709 12:25:41.379266 10091 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.379887 10091 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.383359  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:41.384195  9962 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 0.
I20260709 12:25:41.385485  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:25:41.390638 10055 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:41.391149 10055 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.391568 10055 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.399936  9814 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:41.403666 10091 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:41.404450 10091 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.405063 10091 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.409456  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:41.411459  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:41.413189 10084 consensus_queue.cc:1048] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:41.414710  9853 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:25:41.423038  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:41.423673 10084 raft_consensus.cc:2804] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:41.424711 10084 raft_consensus.cc:697] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:41.430102 10084 consensus_queue.cc:237] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.425812  9887 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.343082 10006 raft_consensus.cc:359] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.435341 10006 raft_consensus.cc:385] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.435639 10006 raft_consensus.cc:740] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
W20260709 12:25:41.418888  9927 leader_election.cc:343] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:41.423892  9890 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:41.443581  9928 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:41.444638 10042 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:41.445101 10042 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.445556 10042 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.452003 10091 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:41.452730  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:41.453595 10006 consensus_queue.cc:260] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.454736 10051 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.458406 10051 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.463166  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:41.465407 10051 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:25:41.455452  9928 leader_election.cc:343] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:41.466686  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:25:41.467435  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:41.468490 10040 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:41.468473  9890 raft_consensus.cc:2393] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 1: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:25:41.470602  9779 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:25:41.471980 10051 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.480469 10006 ts_tablet_manager.cc:1434] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.142s	user 0.007s	sys 0.001s
I20260709 12:25:41.481782 10006 tablet_bootstrap.cc:492] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:41.485183  9964 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:41.488540 10040 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:41.489933 10042 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.438463 10055 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.492697  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:41.495061 10091 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:41.501700  9812 raft_consensus.cc:2393] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 1: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:25:41.505205 10042 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:41.511955 10055 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:41.515049  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:41.516134  9963 raft_consensus.cc:2393] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 1: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:25:41.519843  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:41.520663  9888 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.522953 10039 consensus_queue.cc:1048] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:25:41.524379 10129 log.cc:927] Time spent T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.067s	user 0.003s	sys 0.000s
I20260709 12:25:41.538025  9888 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:25:41.539717  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:25:41.547657  9712 catalog_manager.cc:5697] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:41.576030 10091 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.576891 10091 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.581683  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:41.582856  9888 raft_consensus.cc:2393] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 1: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:25:41.589481 10055 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:41.590122 10055 raft_consensus.cc:697] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:25:41.591166 10005 tablet_bootstrap.cc:492] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:41.590986 10055 consensus_queue.cc:237] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.591609 10005 ts_tablet_manager.cc:1403] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.262s	user 0.075s	sys 0.160s
I20260709 12:25:41.597532 10005 raft_consensus.cc:359] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.598542 10004 tablet_bootstrap.cc:492] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:41.599033 10004 ts_tablet_manager.cc:1403] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.281s	user 0.074s	sys 0.180s
I20260709 12:25:41.599656 10091 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:41.593564 10051 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:41.602310  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:41.602749  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:41.604277 10004 raft_consensus.cc:359] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.604987 10004 raft_consensus.cc:385] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.605295 10004 raft_consensus.cc:740] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.598179 10005 raft_consensus.cc:385] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.601722  9928 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:25:41.605975 10004 consensus_queue.cc:260] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.606104 10005 raft_consensus.cc:740] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.607373 10005 consensus_queue.cc:260] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.608264  9812 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:41.609315 10004 ts_tablet_manager.cc:1434] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:41.610522 10042 consensus_queue.cc:1048] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:41.610988 10004 tablet_bootstrap.cc:492] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:41.612640 10005 ts_tablet_manager.cc:1434] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:25:41.614061 10006 tablet_bootstrap.cc:654] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.616647 10005 tablet_bootstrap.cc:492] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:41.620754 10042 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:41.626231 10005 tablet_bootstrap.cc:654] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.626456 10042 consensus_queue.cc:1048] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:41.627023 10004 tablet_bootstrap.cc:654] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.613066  9927 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:41.630527 10042 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:41.630888 10042 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.631222 10042 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:41.634358  9928 leader_election.cc:343] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:41.640509  9927 consensus_peers.cc:597] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:41.659322 10055 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.649658 10042 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.659835 10055 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.661684 10042 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:41.662016 10055 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:41.663539 10006 tablet_bootstrap.cc:492] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:41.663431  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:41.663497  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:41.664512 10006 ts_tablet_manager.cc:1403] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.183s	user 0.016s	sys 0.010s
I20260709 12:25:41.664908  9963 raft_consensus.cc:2393] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 1: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:25:41.664956  9890 raft_consensus.cc:2393] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 1: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:25:41.666209 10004 tablet_bootstrap.cc:492] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:41.666767 10004 ts_tablet_manager.cc:1403] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.015s
I20260709 12:25:41.667446  9779 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:25:41.667611 10006 raft_consensus.cc:359] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.668325 10006 raft_consensus.cc:385] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.668519 10055 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.668615 10006 raft_consensus.cc:740] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.669363 10006 consensus_queue.cc:260] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.666800 10005 tablet_bootstrap.cc:492] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:41.669759 10004 raft_consensus.cc:359] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.670540 10005 ts_tablet_manager.cc:1403] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.009s
I20260709 12:25:41.670536 10004 raft_consensus.cc:385] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.671530 10004 raft_consensus.cc:740] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.672333 10004 consensus_queue.cc:260] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.673014 10005 raft_consensus.cc:359] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.673638 10005 raft_consensus.cc:385] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.673900 10005 raft_consensus.cc:740] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.675033 10004 ts_tablet_manager.cc:1434] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 12:25:41.675966 10004 tablet_bootstrap.cc:492] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:41.676244 10006 ts_tablet_manager.cc:1434] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:25:41.676481 10055 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:41.677955 10005 consensus_queue.cc:260] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.680060 10005 ts_tablet_manager.cc:1434] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:25:41.680930 10005 tablet_bootstrap.cc:492] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:41.682173 10004 tablet_bootstrap.cc:654] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.677079 10006 tablet_bootstrap.cc:492] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:41.687448  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:25:41.692505  9928 leader_election.cc:343] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:41.694146 10004 tablet_bootstrap.cc:492] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:41.695201 10004 ts_tablet_manager.cc:1403] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.011s
I20260709 12:25:41.695986 10005 tablet_bootstrap.cc:654] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.698107 10006 tablet_bootstrap.cc:654] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.697836 10004 raft_consensus.cc:359] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.698758 10004 raft_consensus.cc:385] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.699136 10004 raft_consensus.cc:740] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.699872 10004 consensus_queue.cc:260] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.702165 10004 ts_tablet_manager.cc:1434] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:25:41.706612  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:41.707167  9811 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.710788 10004 tablet_bootstrap.cc:492] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:41.713882 10006 tablet_bootstrap.cc:492] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:41.714386 10006 ts_tablet_manager.cc:1403] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.007s
I20260709 12:25:41.716683 10005 tablet_bootstrap.cc:492] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:41.717121 10005 ts_tablet_manager.cc:1403] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.000s
I20260709 12:25:41.717657 10004 tablet_bootstrap.cc:654] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.717815  9811 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:41.719139  9927 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:25:41.720019 10039 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:41.719952 10005 raft_consensus.cc:359] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.720566 10039 raft_consensus.cc:697] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:41.720769 10005 raft_consensus.cc:385] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.721144 10005 raft_consensus.cc:740] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.721460 10039 consensus_queue.cc:237] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.725063  9712 catalog_manager.cc:5697] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:41.726814 10006 raft_consensus.cc:359] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.733572 10006 raft_consensus.cc:385] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.733940 10006 raft_consensus.cc:740] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.735989 10006 consensus_queue.cc:260] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.738057 10084 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.738734 10006 ts_tablet_manager.cc:1434] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 12:25:41.738629 10084 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.734608 10005 consensus_queue.cc:260] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.740769 10084 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:41.742256 10005 ts_tablet_manager.cc:1434] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 12:25:41.742702  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:41.743320  9811 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:41.743477 10005 tablet_bootstrap.cc:492] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:41.744728  9853 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:25:41.745764 10040 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.746207 10040 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.748131 10040 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:41.748647 10084 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:41.749009 10084 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.749347 10084 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.749176  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:41.750001  9811 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:41.751432  9927 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:41.752405 10039 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:41.752789 10039 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.753105 10006 tablet_bootstrap.cc:492] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:41.753165 10039 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.756297 10084 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.758424 10055 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.759166 10084 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:41.758885 10055 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.760366 10004 tablet_bootstrap.cc:492] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:41.762005  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:41.762809  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:41.763110 10040 consensus_queue.cc:1048] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:41.763423  9963 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 0.
W20260709 12:25:41.763542  9779 leader_election.cc:343] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:41.762063  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:41.762005  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:41.764397  9890 raft_consensus.cc:2393] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 1: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:25:41.764667  9811 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.760838 10004 ts_tablet_manager.cc:1403] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.050s	user 0.031s	sys 0.013s
I20260709 12:25:41.766057  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:41.764334  9713 catalog_manager.cc:5697] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.771770  9778 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:25:41.772576 10051 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:41.772775  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:41.772948 10051 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.773823 10051 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.774569 10055 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:41.776477  9811 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:41.777616  9853 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:25:41.778627 10009 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:41.779076 10009 raft_consensus.cc:697] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:41.779899 10009 consensus_queue.cc:237] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:41.783993  9761 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:41.784312 10004 raft_consensus.cc:359] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.784427 10039 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.785059 10004 raft_consensus.cc:385] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.785367 10004 raft_consensus.cc:740] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.785625  9962 raft_consensus.cc:2393] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 1: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:25:41.786026 10004 consensus_queue.cc:260] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.788110 10004 ts_tablet_manager.cc:1434] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.002s
I20260709 12:25:41.789184 10004 tablet_bootstrap.cc:492] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:41.795189 10039 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:41.796926  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:41.797735  9811 raft_consensus.cc:2393] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 1: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:25:41.798074  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:41.801156  9712 catalog_manager.cc:5697] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:41.802596 10006 tablet_bootstrap.cc:654] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.803167 10005 tablet_bootstrap.cc:654] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.806109 10051 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.809212  9928 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:25:41.810904 10040 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:41.812243 10004 tablet_bootstrap.cc:654] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.816152  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:25:41.817580  9779 leader_election.cc:343] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:41.823493 10051 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:41.824612  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:41.825229  9962 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.826314 10005 tablet_bootstrap.cc:492] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:41.826915 10005 ts_tablet_manager.cc:1403] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.084s	user 0.018s	sys 0.003s
I20260709 12:25:41.829857 10009 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.830535 10009 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.833164 10009 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:41.835564  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:41.836850  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:41.837385  9962 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:25:41.835861 10039 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:41.841104  9853 leader_election.cc:343] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:41.841356 10039 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.841566  9778 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
W20260709 12:25:41.841851  9853 leader_election.cc:343] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:41.842259  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:25:41.840296 10005 raft_consensus.cc:359] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.843411 10005 raft_consensus.cc:385] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.843441 10039 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:41.843791 10005 raft_consensus.cc:740] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.844219  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:41.844506 10005 consensus_queue.cc:260] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.845198  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:25:41.846306  9927 leader_election.cc:343] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:41.846545 10005 ts_tablet_manager.cc:1434] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:25:41.846989 10004 tablet_bootstrap.cc:492] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:41.847363 10009 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:41.847535  9928 leader_election.cc:343] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:41.847766 10005 tablet_bootstrap.cc:492] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:41.848001  9928 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:25:41.848361 10004 ts_tablet_manager.cc:1403] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.059s	user 0.024s	sys 0.006s
I20260709 12:25:41.849025 10039 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:41.849758 10051 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:41.850421 10051 raft_consensus.cc:697] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:25:41.851260 10004 raft_consensus.cc:359] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.851224 10051 consensus_queue.cc:237] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.852026 10004 raft_consensus.cc:385] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.852423 10004 raft_consensus.cc:740] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.853367 10005 tablet_bootstrap.cc:654] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.853204 10004 consensus_queue.cc:260] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.855660 10004 ts_tablet_manager.cc:1434] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:41.856614 10006 tablet_bootstrap.cc:492] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:41.856769 10004 tablet_bootstrap.cc:492] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:41.857311 10006 ts_tablet_manager.cc:1403] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.105s	user 0.010s	sys 0.009s
I20260709 12:25:41.860733 10006 raft_consensus.cc:359] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.861439 10006 raft_consensus.cc:385] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.861713 10006 raft_consensus.cc:740] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.862779 10006 consensus_queue.cc:260] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.864987 10006 ts_tablet_manager.cc:1434] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:25:41.866418 10006 tablet_bootstrap.cc:492] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:41.867843 10004 tablet_bootstrap.cc:654] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.869913 10009 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:41.879611 10006 tablet_bootstrap.cc:654] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.881475  9712 catalog_manager.cc:5697] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:41.888484 10004 tablet_bootstrap.cc:492] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:41.889110 10004 ts_tablet_manager.cc:1403] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.002s
I20260709 12:25:41.892438 10004 raft_consensus.cc:359] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.897473 10004 raft_consensus.cc:385] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.897771 10004 raft_consensus.cc:740] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.898087 10006 tablet_bootstrap.cc:492] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:41.898569 10006 ts_tablet_manager.cc:1403] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.000s
I20260709 12:25:41.898586 10004 consensus_queue.cc:260] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.898676 10005 tablet_bootstrap.cc:492] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:41.901577 10004 ts_tablet_manager.cc:1434] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:25:41.902468 10004 tablet_bootstrap.cc:492] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:41.902715 10054 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:41.902629 10006 raft_consensus.cc:359] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.906136 10006 raft_consensus.cc:385] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.906476 10006 raft_consensus.cc:740] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.907423 10006 consensus_queue.cc:260] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.908488 10004 tablet_bootstrap.cc:654] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.910256 10006 ts_tablet_manager.cc:1434] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:25:41.911178 10006 tablet_bootstrap.cc:492] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:41.918742 10006 tablet_bootstrap.cc:654] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.920495 10004 tablet_bootstrap.cc:492] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:41.921013 10004 ts_tablet_manager.cc:1403] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:25:41.921689 10005 ts_tablet_manager.cc:1403] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.018s
I20260709 12:25:41.923693 10004 raft_consensus.cc:359] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.924490 10004 raft_consensus.cc:385] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.924261 10005 raft_consensus.cc:359] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.924814 10004 raft_consensus.cc:740] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.924957 10005 raft_consensus.cc:385] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.925321 10005 raft_consensus.cc:740] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.925762 10004 consensus_queue.cc:260] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.925952 10005 consensus_queue.cc:260] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.927963 10005 ts_tablet_manager.cc:1434] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:41.928807 10005 tablet_bootstrap.cc:492] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:41.931587 10004 ts_tablet_manager.cc:1434] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:25:41.932511 10004 tablet_bootstrap.cc:492] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:41.938733 10004 tablet_bootstrap.cc:654] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.952432 10054 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.953087 10054 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.955719 10054 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:41.957902 10005 tablet_bootstrap.cc:654] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.957681  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:41.958678  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:41.959936  9963 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
W20260709 12:25:41.960163  9853 leader_election.cc:343] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:41.961234  9853 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:41.961958 10006 tablet_bootstrap.cc:492] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:41.962400 10054 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:41.962559 10006 ts_tablet_manager.cc:1403] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.034s
I20260709 12:25:41.962811 10054 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.963208 10054 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.966162 10004 tablet_bootstrap.cc:492] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:41.965932 10006 raft_consensus.cc:359] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.966689 10004 ts_tablet_manager.cc:1403] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.012s
I20260709 12:25:41.966744 10006 raft_consensus.cc:385] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.967084 10006 raft_consensus.cc:740] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.967810 10006 consensus_queue.cc:260] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.969609 10006 ts_tablet_manager.cc:1434] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:25:41.970387 10006 tablet_bootstrap.cc:492] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:41.974205 10006 tablet_bootstrap.cc:654] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:41.979391 10004 raft_consensus.cc:359] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.980247 10004 raft_consensus.cc:385] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.980551 10004 raft_consensus.cc:740] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.981220 10039 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.981389 10054 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.981839 10039 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.984503 10039 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:41.985603  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:41.987195  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:41.987649  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:41.988286  9887 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:41.989601 10006 tablet_bootstrap.cc:492] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:41.990087 10006 ts_tablet_manager.cc:1403] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
W20260709 12:25:41.990265  9927 leader_election.cc:343] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:41.981243 10004 consensus_queue.cc:260] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:41.992033  9853 leader_election.cc:343] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:41.994511 10004 ts_tablet_manager.cc:1434] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 12:25:41.995206  9928 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:41.995570 10006 raft_consensus.cc:359] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:41.996449 10006 raft_consensus.cc:385] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:41.996781 10006 raft_consensus.cc:740] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:41.996832 10039 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:41.997404 10039 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.997778 10039 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:41.998667 10004 tablet_bootstrap.cc:492] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:42.003335 10051 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.003795 10051 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.005263 10054 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:41.997778 10006 consensus_queue.cc:260] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.009425 10006 ts_tablet_manager.cc:1434] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 12:25:42.006001 10051 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:42.009233  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:42.010501 10006 tablet_bootstrap.cc:492] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:42.007140  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:42.011037  9962 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 0.
I20260709 12:25:42.012316  9778 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:42.014186 10005 tablet_bootstrap.cc:492] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:42.014827 10005 ts_tablet_manager.cc:1403] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.086s	user 0.017s	sys 0.023s
I20260709 12:25:42.014876 10004 tablet_bootstrap.cc:654] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:42.016355  9779 leader_election.cc:343] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:42.017391 10055 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:42.017791 10055 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.018209 10006 tablet_bootstrap.cc:654] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.018304 10055 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.017829 10005 raft_consensus.cc:359] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.018836 10005 raft_consensus.cc:385] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.019181 10005 raft_consensus.cc:740] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.020335 10005 consensus_queue.cc:260] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.021618 10133 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:42.029937  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:42.030769  9962 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.033896 10005 ts_tablet_manager.cc:1434] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:25:42.034003 10004 tablet_bootstrap.cc:492] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:42.034514 10004 ts_tablet_manager.cc:1403] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.003s
I20260709 12:25:42.034862 10005 tablet_bootstrap.cc:492] T 27036dabafd8427cac190478948639ae P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:42.037062 10004 raft_consensus.cc:359] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.037684 10004 raft_consensus.cc:385] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.037941 10004 raft_consensus.cc:740] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.038677 10004 consensus_queue.cc:260] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.041082 10084 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.041570 10084 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.042214 10004 ts_tablet_manager.cc:1434] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:42.043112 10004 tablet_bootstrap.cc:492] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:42.043737 10084 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:42.046131  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:25:42.047653  9853 leader_election.cc:343] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:42.049088  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:25:42.050398  9853 leader_election.cc:343] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:42.050904  9853 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:25:42.051806 10004 tablet_bootstrap.cc:654] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.052024 10084 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:42.053352 10039 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.054523 10006 tablet_bootstrap.cc:492] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:42.056473 10006 ts_tablet_manager.cc:1403] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.005s
I20260709 12:25:42.054570 10055 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.060061 10006 raft_consensus.cc:359] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.060539  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:42.060802 10006 raft_consensus.cc:385] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.061088 10006 raft_consensus.cc:740] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.061146  9963 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.061988 10006 consensus_queue.cc:260] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.064282 10006 ts_tablet_manager.cc:1434] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:42.065634  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:42.066239  9887 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.067620 10006 tablet_bootstrap.cc:492] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:42.073729  9963 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:25:42.075224  9778 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:42.076164 10051 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:42.076653 10051 raft_consensus.cc:697] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:25:42.077525 10051 consensus_queue.cc:237] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.084026 10006 tablet_bootstrap.cc:654] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.085943 10084 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.086618 10084 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.089341 10084 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:42.089720  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:42.090152  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:42.090760  9811 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
W20260709 12:25:42.091235  9927 leader_election.cc:343] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:42.092272 10039 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:42.055668  9962 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:42.094130 10055 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:42.094177  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:25:42.095268  9853 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:42.095520 10054 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:42.096050 10054 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.096133 10047 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:42.096525 10054 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.096766 10047 raft_consensus.cc:697] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:42.097725  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:42.098301  9888 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.097654 10047 consensus_queue.cc:237] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.105456  9888 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:42.106673  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:42.107673  9963 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:42.108353  9928 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:42.110337 10091 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.110915 10091 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.111358 10039 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:42.117451 10039 raft_consensus.cc:697] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:42.118698 10039 consensus_queue.cc:237] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.128441  9887 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:25:42.130388  9811 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.131599 10091 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:42.132133  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:42.133025 10006 tablet_bootstrap.cc:492] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:42.133376  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:42.051806 10005 tablet_bootstrap.cc:654] T 27036dabafd8427cac190478948639ae P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.138407 10006 ts_tablet_manager.cc:1403] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.071s	user 0.019s	sys 0.013s
W20260709 12:25:42.142139  9928 leader_election.cc:343] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:42.136252 10047 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.143671 10047 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:42.144564  9927 leader_election.cc:343] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:42.144999  9927 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:25:42.146140 10047 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:42.146261 10091 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:42.148008  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:42.147177  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:42.149665  9813 raft_consensus.cc:2393] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 1: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:25:42.149485 10054 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.151499  9853 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:25:42.154096 10047 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.155505 10054 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:42.158413  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:42.159004  9963 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.159852 10006 raft_consensus.cc:359] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.160509 10006 raft_consensus.cc:385] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.160777 10006 raft_consensus.cc:740] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.167409  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:42.168427  9813 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.167313 10133 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:42.161505 10006 consensus_queue.cc:260] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.176694 10006 ts_tablet_manager.cc:1434] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:25:42.177589 10006 tablet_bootstrap.cc:492] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:42.183533  9711 catalog_manager.cc:5697] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:42.185385  9813 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:42.186375  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:25:42.187024 10006 tablet_bootstrap.cc:654] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.187211 10084 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:42.187690 10084 raft_consensus.cc:697] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:42.188616 10084 consensus_queue.cc:237] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.184664 10047 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:42.201025  9712 catalog_manager.cc:5697] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:42.181809  9963 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:42.262353 10040 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:42.272049 10009 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.272743 10009 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.283695 10042 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:25:42.289503 10004 tablet_bootstrap.cc:492] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:42.289718 10005 tablet_bootstrap.cc:492] T 27036dabafd8427cac190478948639ae P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:42.289990 10004 ts_tablet_manager.cc:1403] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.247s	user 0.050s	sys 0.080s
I20260709 12:25:42.290153 10005 ts_tablet_manager.cc:1403] T 27036dabafd8427cac190478948639ae P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.255s	user 0.013s	sys 0.007s
I20260709 12:25:42.293088 10006 tablet_bootstrap.cc:492] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:42.293514 10006 ts_tablet_manager.cc:1403] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.116s	user 0.030s	sys 0.041s
I20260709 12:25:42.296912 10004 raft_consensus.cc:359] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.297063 10006 raft_consensus.cc:359] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.297626 10004 raft_consensus.cc:385] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.297789 10006 raft_consensus.cc:385] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.297936 10004 raft_consensus.cc:740] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.298111 10006 raft_consensus.cc:740] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.298664 10004 consensus_queue.cc:260] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.298852 10006 consensus_queue.cc:260] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.300225 10004 ts_tablet_manager.cc:1434] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:25:42.300355 10006 ts_tablet_manager.cc:1434] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:25:42.301258 10006 tablet_bootstrap.cc:492] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:42.302971 10004 tablet_bootstrap.cc:492] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:42.301925 10005 raft_consensus.cc:359] T 27036dabafd8427cac190478948639ae P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.303583 10005 raft_consensus.cc:385] T 27036dabafd8427cac190478948639ae P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.303828 10005 raft_consensus.cc:740] T 27036dabafd8427cac190478948639ae P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.302946 10009 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:42.305219 10005 consensus_queue.cc:260] T 27036dabafd8427cac190478948639ae P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.306586 10047 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:42.309790 10084 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.310072 10005 ts_tablet_manager.cc:1434] T 27036dabafd8427cac190478948639ae P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:25:42.310683  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:42.316969  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:42.322110 10084 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.322537  9963 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:42.322785 10005 tablet_bootstrap.cc:492] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:42.323051  9711 catalog_manager.cc:5697] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:42.323961  9853 leader_election.cc:343] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:42.324245 10084 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:42.327282  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:42.328258  9713 catalog_manager.cc:5697] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:42.336326  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:42.337122  9963 raft_consensus.cc:2393] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 1: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:25:42.345314 10006 tablet_bootstrap.cc:654] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.348891 10004 tablet_bootstrap.cc:654] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.349409  9853 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:42.352509 10005 tablet_bootstrap.cc:654] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.361541 10047 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:42.362092 10047 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.362592 10047 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.371100  9853 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:25:42.372458 10009 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.373320 10006 tablet_bootstrap.cc:492] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:42.373750 10006 ts_tablet_manager.cc:1403] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.073s	user 0.003s	sys 0.013s
I20260709 12:25:42.376400 10006 raft_consensus.cc:359] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.377041 10006 raft_consensus.cc:385] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.377331 10006 raft_consensus.cc:740] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.377943 10006 consensus_queue.cc:260] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.380445 10009 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:42.388093 10084 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:42.389366 10005 tablet_bootstrap.cc:492] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:42.389869 10005 ts_tablet_manager.cc:1403] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.010s
I20260709 12:25:42.396730 10006 ts_tablet_manager.cc:1434] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.004s
I20260709 12:25:42.397619 10006 tablet_bootstrap.cc:492] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:42.398532 10004 tablet_bootstrap.cc:492] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:42.399016 10004 ts_tablet_manager.cc:1403] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.096s	user 0.016s	sys 0.006s
I20260709 12:25:42.399322 10051 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:42.403700 10006 tablet_bootstrap.cc:654] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.392541 10005 raft_consensus.cc:359] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.409301 10005 raft_consensus.cc:385] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.401857 10004 raft_consensus.cc:359] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.410852 10004 raft_consensus.cc:385] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.411181 10004 raft_consensus.cc:740] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.410287 10005 raft_consensus.cc:740] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.411903 10004 consensus_queue.cc:260] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.412464 10005 consensus_queue.cc:260] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.420328 10005 ts_tablet_manager.cc:1434] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.003s
I20260709 12:25:42.420979 10004 ts_tablet_manager.cc:1434] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:25:42.427213 10004 tablet_bootstrap.cc:492] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:42.421655 10047 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.432055 10047 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:42.433277 10051 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:42.434691  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:42.435344  9961 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.436084 10004 tablet_bootstrap.cc:654] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.437886 10005 tablet_bootstrap.cc:492] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:42.439482  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:25:42.446676  9853 leader_election.cc:343] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:42.450039  9961 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:42.451637  9853 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:42.453002 10047 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:42.453727 10047 raft_consensus.cc:697] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:42.454843 10047 consensus_queue.cc:237] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.464269 10006 tablet_bootstrap.cc:492] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:42.465097 10006 ts_tablet_manager.cc:1403] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.068s	user 0.021s	sys 0.045s
I20260709 12:25:42.467597 10006 raft_consensus.cc:359] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.468269 10006 raft_consensus.cc:385] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.468641 10006 raft_consensus.cc:740] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.468304 10004 tablet_bootstrap.cc:492] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:42.469851 10004 ts_tablet_manager.cc:1403] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.003s
I20260709 12:25:42.469139 10005 tablet_bootstrap.cc:654] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.472254 10004 raft_consensus.cc:359] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.472903 10004 raft_consensus.cc:385] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.473173 10004 raft_consensus.cc:740] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.473788 10004 consensus_queue.cc:260] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.469336 10006 consensus_queue.cc:260] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.477152 10006 ts_tablet_manager.cc:1434] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 12:25:42.478181 10006 tablet_bootstrap.cc:492] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:42.479735 10004 ts_tablet_manager.cc:1434] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:25:42.481137 10004 tablet_bootstrap.cc:492] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:42.484527 10006 tablet_bootstrap.cc:654] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.487608 10004 tablet_bootstrap.cc:654] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.488304  9712 catalog_manager.cc:5697] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:42.495206 10084 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:42.495944 10055 consensus_queue.cc:1048] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:42.496907 10051 consensus_queue.cc:1048] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:42.497843 10040 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.498417 10040 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.500742 10040 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:42.502717  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:42.503523 10005 tablet_bootstrap.cc:492] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:42.504017 10005 ts_tablet_manager.cc:1403] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.004s
I20260709 12:25:42.504410  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:42.505241  9890 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
W20260709 12:25:42.506733  9927 leader_election.cc:343] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:42.508419 10005 raft_consensus.cc:359] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.509140 10005 raft_consensus.cc:385] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.509436 10005 raft_consensus.cc:740] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.510496 10091 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.510138 10005 consensus_queue.cc:260] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.511092 10091 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.512547 10005 ts_tablet_manager.cc:1434] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:42.513942 10091 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:42.515631  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:42.515892  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:42.516496  9887 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:42.517161 10005 tablet_bootstrap.cc:492] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:42.517477  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:42.518138  9812 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:42.519599  9927 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:42.520397 10040 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:42.520727 10040 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.521044 10040 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.525421 10005 tablet_bootstrap.cc:654] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.528098 10039 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:42.528539 10039 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.528892 10039 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.534833 10004 tablet_bootstrap.cc:492] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:42.535331 10004 ts_tablet_manager.cc:1403] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.004s
I20260709 12:25:42.539489 10004 raft_consensus.cc:359] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.540242 10004 raft_consensus.cc:385] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.540534 10004 raft_consensus.cc:740] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.541255 10004 consensus_queue.cc:260] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.542514 10091 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.539260 10039 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.542963 10091 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.544898 10091 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:42.544937 10039 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:42.547047  9813 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.549580  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:42.550388  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:42.550884  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:42.550984  9887 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:42.551455  9812 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.552335  9928 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:42.554613  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:42.555181  9890 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.558782 10054 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:42.559192  9927 leader_election.cc:343] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:42.567034 10091 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:42.567473 10091 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.567891 10091 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.569386 10004 ts_tablet_manager.cc:1434] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.002s
I20260709 12:25:42.574717 10006 tablet_bootstrap.cc:492] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:42.575182 10006 ts_tablet_manager.cc:1403] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.001s
I20260709 12:25:42.579243 10006 raft_consensus.cc:359] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.580207 10042 consensus_queue.cc:1048] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:42.580724 10004 tablet_bootstrap.cc:492] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:42.586305 10006 raft_consensus.cc:385] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.586680 10006 raft_consensus.cc:740] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.587435 10006 consensus_queue.cc:260] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.587746 10040 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.589648 10006 ts_tablet_manager.cc:1434] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:25:42.590512 10040 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:42.591383 10006 tablet_bootstrap.cc:492] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:42.595036  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:42.595707  9889 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.598786 10006 tablet_bootstrap.cc:654] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.600746 10004 tablet_bootstrap.cc:654] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.604081 10040 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.604534 10040 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.606658 10040 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:42.608711  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:42.608714 10039 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.610493  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:42.610582 10039 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.611922 10006 tablet_bootstrap.cc:492] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:42.612437 10006 ts_tablet_manager.cc:1403] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 12:25:42.613678  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:42.615120 10004 tablet_bootstrap.cc:492] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
W20260709 12:25:42.615562  9928 leader_election.cc:343] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:42.616386  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:42.618156 10004 ts_tablet_manager.cc:1403] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.000s
I20260709 12:25:42.618546  9888 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
W20260709 12:25:42.619864  9927 leader_election.cc:343] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:42.620196  9928 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:42.617058 10039 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:42.617147 10006 raft_consensus.cc:359] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.621412 10042 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:42.621183 10004 raft_consensus.cc:359] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.621598 10006 raft_consensus.cc:385] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.622166 10004 raft_consensus.cc:385] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.622236 10006 raft_consensus.cc:740] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.622473  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:42.622534 10004 raft_consensus.cc:740] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.621851 10042 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.623467 10042 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.623500 10004 consensus_queue.cc:260] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.623678 10006 consensus_queue.cc:260] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.625495 10004 ts_tablet_manager.cc:1434] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:42.626467 10004 tablet_bootstrap.cc:492] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:42.620276  9927 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:25:42.595729 10005 tablet_bootstrap.cc:492] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:42.631007 10005 ts_tablet_manager.cc:1403] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.114s	user 0.035s	sys 0.009s
I20260709 12:25:42.633242 10006 ts_tablet_manager.cc:1434] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.005s
I20260709 12:25:42.634262 10006 tablet_bootstrap.cc:492] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:42.635144  9889 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:42.639108  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:42.645008 10178 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:42.639860 10040 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:42.639652  9812 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:42.684918 10005 raft_consensus.cc:359] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.685925 10005 raft_consensus.cc:385] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.686261 10005 raft_consensus.cc:740] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.691035  9890 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:42.698735 10091 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.699613 10004 tablet_bootstrap.cc:654] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.702741 10005 consensus_queue.cc:260] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.704425 10005 ts_tablet_manager.cc:1434] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.009s
I20260709 12:25:42.705330 10084 consensus_queue.cc:1048] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:42.706694  9928 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:42.689564 10178 raft_consensus.cc:697] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:42.709548 10178 consensus_queue.cc:237] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.708215 10042 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.715059 10006 tablet_bootstrap.cc:654] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.725062 10042 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:42.729655 10091 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:42.730151 10005 tablet_bootstrap.cc:492] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:42.733894 10042 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:42.735946 10042 raft_consensus.cc:697] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:42.736865 10042 consensus_queue.cc:237] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:42.727747  9927 leader_election.cc:343] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:42.748708 10084 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.749257 10084 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.752022 10084 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:42.752424 10005 tablet_bootstrap.cc:654] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.756230  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:42.759696  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:42.760046  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:42.760391  9890 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.760924  9961 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
W20260709 12:25:42.765156  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 46147.1us
W20260709 12:25:42.767608  9927 leader_election.cc:343] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:42.769680 10004 tablet_bootstrap.cc:492] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:42.770130 10004 ts_tablet_manager.cc:1403] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.144s	user 0.012s	sys 0.005s
I20260709 12:25:42.770579  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:42.772250 10006 tablet_bootstrap.cc:492] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:42.772734 10006 ts_tablet_manager.cc:1403] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.139s	user 0.019s	sys 0.005s
W20260709 12:25:42.773615  9853 leader_election.cc:343] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:42.774658  9853 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:42.774549 10004 raft_consensus.cc:359] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.775333 10004 raft_consensus.cc:385] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.775516 10006 raft_consensus.cc:359] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.775677 10004 raft_consensus.cc:740] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.776427 10004 consensus_queue.cc:260] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.777287 10047 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:42.777627 10047 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.777936 10047 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.781323 10006 raft_consensus.cc:385] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.781728 10006 raft_consensus.cc:740] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.782642 10006 consensus_queue.cc:260] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.783142  9890 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:42.783420  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:42.784102  9889 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.787541 10047 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.810911  9713 catalog_manager.cc:5697] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:42.818902  9927 leader_election.cc:343] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:42.819320 10199 log.cc:927] Time spent T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 12:25:42.821290  9761 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:42.825416 10005 tablet_bootstrap.cc:492] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:42.826323 10005 ts_tablet_manager.cc:1403] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.096s	user 0.018s	sys 0.020s
I20260709 12:25:42.829898  9928 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:42.830212 10006 ts_tablet_manager.cc:1434] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.018s
I20260709 12:25:42.831612 10006 tablet_bootstrap.cc:492] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:42.833690  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:42.835636  9889 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:42.838191 10004 ts_tablet_manager.cc:1434] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.002s
I20260709 12:25:42.840013 10004 tablet_bootstrap.cc:492] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:42.838066 10178 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:42.846233 10178 raft_consensus.cc:697] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:42.847353 10178 consensus_queue.cc:237] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.858045 10047 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:42.862571  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:42.863677  9928 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:42.864938 10042 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:42.864813 10005 raft_consensus.cc:359] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.865505 10005 raft_consensus.cc:385] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.865803 10042 raft_consensus.cc:697] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:42.865767 10005 raft_consensus.cc:740] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:42.866711 10005 consensus_queue.cc:260] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.867364  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:42.867272 10054 consensus_queue.cc:1048] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:42.867955  9963 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.872246 10005 ts_tablet_manager.cc:1434] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.046s	user 0.002s	sys 0.004s
I20260709 12:25:42.873162 10005 tablet_bootstrap.cc:492] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
W20260709 12:25:42.875283  9853 leader_election.cc:343] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:42.886139  9963 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:42.890803 10091 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.890875 10051 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.891626 10091 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.891912 10051 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.894359 10091 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:42.896646  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:25:42.901211  9928 leader_election.cc:343] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:42.902420 10005 tablet_bootstrap.cc:654] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.903707 10051 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:42.904639  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:42.877976 10042 consensus_queue.cc:237] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.916108 10006 tablet_bootstrap.cc:654] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.916555  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:42.917938  9853 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:42.923178 10047 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:42.924906 10051 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:42.924880  9927 leader_election.cc:343] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:42.927289  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:42.928912 10051 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:42.929842  9927 consensus_peers.cc:597] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:42.930948 10051 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:42.926103 10047 raft_consensus.cc:697] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:42.931967 10004 tablet_bootstrap.cc:654] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:42.927429  9887 raft_consensus.cc:2393] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 1: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:25:42.933122 10054 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.932384 10047 consensus_queue.cc:237] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.933570 10054 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.934191  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:25:42.935810  9779 leader_election.cc:343] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:42.936553  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:42.937145  9961 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 0.
I20260709 12:25:42.937904 10005 tablet_bootstrap.cc:492] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:42.938589 10005 ts_tablet_manager.cc:1403] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.066s	user 0.014s	sys 0.015s
I20260709 12:25:42.938364  9778 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:25:42.939873 10055 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:42.940234 10055 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.940559 10055 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.940462  9779 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:25:42.941599 10133 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:42.938972 10054 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:42.943684 10009 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:42.954970  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:42.955826  9812 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:42.958921  9853 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:25:42.959924 10047 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:25:42.960389 10047 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:42.952374  9927 leader_election.cc:343] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:42.961040  9927 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:25:42.962591 10178 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:42.963189 10047 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:42.969844  9711 catalog_manager.cc:5697] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:42.978924 10006 tablet_bootstrap.cc:492] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:42.979394 10006 ts_tablet_manager.cc:1403] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.148s	user 0.008s	sys 0.008s
I20260709 12:25:42.974435  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:42.991745  9963 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:42.984369 10133 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:42.985553 10084 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.986603 10006 raft_consensus.cc:359] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.988022 10055 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.996840 10055 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:42.988500 10047 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.999769  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:25:43.001353  9779 leader_election.cc:343] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.004770  9711 catalog_manager.cc:5697] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:42.990903 10005 raft_consensus.cc:359] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.006508 10005 raft_consensus.cc:385] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.006810 10005 raft_consensus.cc:740] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.007617 10005 consensus_queue.cc:260] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:42.993850 10006 raft_consensus.cc:385] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:42.994205 10084 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.012753 10084 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:43.013808 10006 raft_consensus.cc:740] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.014511  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:43.014551 10006 consensus_queue.cc:260] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.015307  9963 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:43.016122  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:43.017647 10006 ts_tablet_manager.cc:1434] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 12:25:43.018567 10006 tablet_bootstrap.cc:492] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:43.021713 10004 tablet_bootstrap.cc:492] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:43.022203 10004 ts_tablet_manager.cc:1403] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.183s	user 0.013s	sys 0.002s
W20260709 12:25:43.018527  9853 consensus_peers.cc:597] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:43.023458 10047 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:25:43.024000  9853 leader_election.cc:343] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.024314 10005 ts_tablet_manager.cc:1434] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.085s	user 0.005s	sys 0.001s
I20260709 12:25:43.025245 10005 tablet_bootstrap.cc:492] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:43.025775  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:43.026394  9811 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:43.030839  9711 catalog_manager.cc:5697] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:43.032717  9811 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:25:43.032459  9711 catalog_manager.cc:5697] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:43.034847  9853 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:25:43.035861  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:43.036083 10006 tablet_bootstrap.cc:654] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.036064 10047 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:43.036470  9961 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:43.037600 10047 raft_consensus.cc:697] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:43.038519 10047 consensus_queue.cc:237] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.039458 10005 tablet_bootstrap.cc:654] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.035822  9853 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:43.042477 10218 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:25:43.042363  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 58001.6us
I20260709 12:25:43.042927 10218 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.043285 10218 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.045202  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:43.045794  9963 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.050590 10042 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.050907 10006 tablet_bootstrap.cc:492] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:43.051434 10006 ts_tablet_manager.cc:1403] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.000s
I20260709 12:25:43.050514 10218 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.053951 10218 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:43.053937 10006 raft_consensus.cc:359] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.054690 10006 raft_consensus.cc:385] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.051180 10042 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.057893 10005 tablet_bootstrap.cc:492] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:43.058574 10006 raft_consensus.cc:740] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.058178  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:43.059276 10006 consensus_queue.cc:260] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.058347 10005 ts_tablet_manager.cc:1403] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.005s
I20260709 12:25:43.057243 10004 raft_consensus.cc:359] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.061164 10004 raft_consensus.cc:385] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.061439 10004 raft_consensus.cc:740] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.062525 10005 raft_consensus.cc:359] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.062750  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:43.062973  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:43.063158 10005 raft_consensus.cc:385] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.063424  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:43.063760 10005 raft_consensus.cc:740] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.063994  9962 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:43.064255  9927 leader_election.cc:343] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.062433 10004 consensus_queue.cc:260] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.064477 10005 consensus_queue.cc:260] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:43.064806  9928 leader_election.cc:343] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.065217  9928 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:25:43.065964 10178 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:43.066540 10006 ts_tablet_manager.cc:1434] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:25:43.067435 10006 tablet_bootstrap.cc:492] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:43.067745 10004 ts_tablet_manager.cc:1434] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:25:43.068640 10004 tablet_bootstrap.cc:492] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:43.060258  9961 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:25:43.071623  9962 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:43.073962 10006 tablet_bootstrap.cc:654] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.074597 10004 tablet_bootstrap.cc:654] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.075394 10005 ts_tablet_manager.cc:1434] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 12:25:43.075968  9963 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:25:43.081630 10005 tablet_bootstrap.cc:492] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:43.082046  9778 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:25:43.073529 10042 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:25:43.076885  9853 leader_election.cc:343] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.084095 10051 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:43.084590 10051 raft_consensus.cc:697] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:25:43.085477  9853 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:43.085372 10051 consensus_queue.cc:237] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.086817 10218 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:43.087818 10218 raft_consensus.cc:697] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:43.088635 10218 consensus_queue.cc:237] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.089982 10005 tablet_bootstrap.cc:654] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.104950 10004 tablet_bootstrap.cc:492] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:43.105785 10004 ts_tablet_manager.cc:1403] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.007s
I20260709 12:25:43.108073 10004 raft_consensus.cc:359] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.108743 10004 raft_consensus.cc:385] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.110077 10006 tablet_bootstrap.cc:492] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:43.109077 10004 raft_consensus.cc:740] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.110793 10006 ts_tablet_manager.cc:1403] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.000s
I20260709 12:25:43.111019 10004 consensus_queue.cc:260] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.113055 10004 ts_tablet_manager.cc:1434] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 12:25:43.113914 10006 raft_consensus.cc:359] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.114686 10006 raft_consensus.cc:385] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.114945 10004 tablet_bootstrap.cc:492] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:43.114977 10006 raft_consensus.cc:740] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.115940 10006 consensus_queue.cc:260] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.118692 10006 ts_tablet_manager.cc:1434] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:43.119616 10006 tablet_bootstrap.cc:492] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:43.125754 10006 tablet_bootstrap.cc:654] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.125937 10004 tablet_bootstrap.cc:654] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.141196 10006 tablet_bootstrap.cc:492] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:43.141880 10006 ts_tablet_manager.cc:1403] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260709 12:25:43.145694 10006 raft_consensus.cc:359] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.155066 10006 raft_consensus.cc:385] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.155557 10006 raft_consensus.cc:740] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.156688 10006 consensus_queue.cc:260] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.159333 10006 ts_tablet_manager.cc:1434] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:25:43.161060 10006 tablet_bootstrap.cc:492] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:43.171387 10006 tablet_bootstrap.cc:654] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.183769  9711 catalog_manager.cc:5697] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:43.198518 10004 tablet_bootstrap.cc:492] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:43.199232 10004 ts_tablet_manager.cc:1403] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.084s	user 0.019s	sys 0.045s
I20260709 12:25:43.202783 10004 raft_consensus.cc:359] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.203745 10004 raft_consensus.cc:385] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.204134 10004 raft_consensus.cc:740] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.204783 10005 tablet_bootstrap.cc:492] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:43.205075 10004 consensus_queue.cc:260] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.207194 10005 ts_tablet_manager.cc:1403] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.126s	user 0.037s	sys 0.072s
I20260709 12:25:43.208449 10004 ts_tablet_manager.cc:1434] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:25:43.209331 10004 tablet_bootstrap.cc:492] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:43.209873 10005 raft_consensus.cc:359] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.210551 10005 raft_consensus.cc:385] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.210793 10005 raft_consensus.cc:740] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.211454 10005 consensus_queue.cc:260] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.214433 10005 ts_tablet_manager.cc:1434] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:43.215098 10222 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.215329 10005 tablet_bootstrap.cc:492] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:43.215620 10222 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.218717 10042 consensus_queue.cc:1048] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:43.220379 10004 tablet_bootstrap.cc:654] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.221138  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:43.221814  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:43.222599  9887 raft_consensus.cc:2393] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 1: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:25:43.223831  9779 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:25:43.218020 10222 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:43.225095 10051 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.227025 10006 tablet_bootstrap.cc:492] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:43.227476 10006 ts_tablet_manager.cc:1403] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.019s
I20260709 12:25:43.230481 10006 raft_consensus.cc:359] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.231304 10006 raft_consensus.cc:385] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.231613 10006 raft_consensus.cc:740] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.232064 10218 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.232537 10218 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.232442 10006 consensus_queue.cc:260] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.236219 10006 ts_tablet_manager.cc:1434] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:43.236999 10218 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:43.237370 10006 tablet_bootstrap.cc:492] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:43.240063  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:43.240899  9963 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:43.243158  9853 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:43.244403 10047 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:43.244781 10047 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.245110 10047 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.246018 10006 tablet_bootstrap.cc:654] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.250525 10005 tablet_bootstrap.cc:654] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.250147 10091 consensus_queue.cc:1048] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:43.252367  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:25:43.253808  9853 leader_election.cc:343] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.258798 10047 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.263579 10051 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:43.266772  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:43.267030 10091 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.267470 10091 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.265134  9713 catalog_manager.cc:5697] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 2, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 2 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:43.269059  9853 leader_election.cc:343] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.269913  9713 catalog_manager.cc:5697] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:43.271456 10042 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.271898 10042 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.275349  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:43.274155 10042 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:43.275946  9889 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:43.276823  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:43.276909  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:43.277864  9928 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:43.278864 10178 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:43.279198 10178 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.279529 10178 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.279736  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:25:43.281396  9928 leader_election.cc:343] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.283062 10222 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.283507 10222 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.288178 10005 tablet_bootstrap.cc:492] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:43.288477 10222 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:43.288625 10005 ts_tablet_manager.cc:1403] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.073s	user 0.006s	sys 0.006s
I20260709 12:25:43.290620  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:43.291338  9888 raft_consensus.cc:2393] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 1: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:25:43.291227 10005 raft_consensus.cc:359] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.291878 10005 raft_consensus.cc:385] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.292155 10005 raft_consensus.cc:740] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.293474  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:43.294894 10005 consensus_queue.cc:260] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.295163  9778 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:25:43.296386 10133 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.300771 10203 consensus_queue.cc:1048] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:43.304863  9927 leader_election.cc:343] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.305044 10005 ts_tablet_manager.cc:1434] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 12:25:43.305943 10005 tablet_bootstrap.cc:492] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:43.310907 10047 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:25:43.311197  9927 leader_election.cc:343] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.311623  9927 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:25:43.312389 10042 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:43.313963  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:43.314535  9963 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.315884 10005 tablet_bootstrap.cc:654] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.331113 10004 tablet_bootstrap.cc:492] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:43.331571 10004 ts_tablet_manager.cc:1403] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.122s	user 0.013s	sys 0.019s
I20260709 12:25:43.335168 10006 tablet_bootstrap.cc:492] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:43.335610 10006 ts_tablet_manager.cc:1403] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.098s	user 0.021s	sys 0.018s
I20260709 12:25:43.337021 10004 raft_consensus.cc:359] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.337697 10004 raft_consensus.cc:385] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.337956 10004 raft_consensus.cc:740] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.338011 10006 raft_consensus.cc:359] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.338696 10006 raft_consensus.cc:385] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.338790 10004 consensus_queue.cc:260] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.339257 10006 raft_consensus.cc:740] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.338856 10005 tablet_bootstrap.cc:492] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:43.340108 10005 ts_tablet_manager.cc:1403] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.003s
I20260709 12:25:43.339908 10006 consensus_queue.cc:260] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.340256 10039 consensus_queue.cc:1048] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:43.341135 10004 ts_tablet_manager.cc:1434] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:25:43.341820 10006 ts_tablet_manager.cc:1434] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:43.341995 10004 tablet_bootstrap.cc:492] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:43.342672 10005 raft_consensus.cc:359] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.343338 10005 raft_consensus.cc:385] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.343634 10005 raft_consensus.cc:740] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.344229 10005 consensus_queue.cc:260] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.347720 10222 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.348168 10222 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.349337 10004 tablet_bootstrap.cc:654] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.351009  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:43.351697  9962 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 1: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:25:43.352923 10222 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:43.353538  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:43.356026 10178 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.357220 10042 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.357930  9779 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:25:43.358321 10042 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.359761 10222 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.361531 10042 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:43.362293 10004 tablet_bootstrap.cc:492] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:43.277748 10091 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:43.346303 10005 ts_tablet_manager.cc:1434] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:25:43.362756 10004 ts_tablet_manager.cc:1403] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 12:25:43.364362 10006 tablet_bootstrap.cc:492] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:43.365195 10004 raft_consensus.cc:359] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.365820 10004 raft_consensus.cc:385] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.365952  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:43.366297 10004 raft_consensus.cc:740] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.367400 10005 tablet_bootstrap.cc:492] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:43.367079 10004 consensus_queue.cc:260] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.377775  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:43.378577 10004 ts_tablet_manager.cc:1434] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:25:43.379437 10004 tablet_bootstrap.cc:492] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
W20260709 12:25:43.380779  9927 leader_election.cc:343] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.382133 10005 tablet_bootstrap.cc:654] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.384837 10004 tablet_bootstrap.cc:654] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.371811 10133 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:43.371927 10222 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:43.396559 10047 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:43.401461 10004 tablet_bootstrap.cc:492] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:43.402061 10004 ts_tablet_manager.cc:1403] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.003s
I20260709 12:25:43.403362 10091 consensus_queue.cc:1048] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:43.404392 10133 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.404899 10133 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.405051 10004 raft_consensus.cc:359] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.405663 10004 raft_consensus.cc:385] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.405936 10004 raft_consensus.cc:740] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.406589 10004 consensus_queue.cc:260] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.408473  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:43.408722  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:43.409020 10004 ts_tablet_manager.cc:1434] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:43.409304  9887 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 0.
I20260709 12:25:43.409914 10004 tablet_bootstrap.cc:492] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:43.410503  9779 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:25:43.411370 10051 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:43.411779 10051 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.412161 10051 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.413262  9962 raft_consensus.cc:2393] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 1: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:25:43.414367 10133 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:43.414448 10178 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:25:43.412098  9928 leader_election.cc:343] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.418538  9928 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:25:43.419656  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:43.421901 10004 tablet_bootstrap.cc:654] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.426445 10042 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:43.437809 10006 tablet_bootstrap.cc:654] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.434774  9963 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:43.440346  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:43.441326  9887 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.456843  9853 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:43.457933 10054 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:43.458773 10054 raft_consensus.cc:697] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:43.459802 10054 consensus_queue.cc:237] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.469075 10042 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.469798 10042 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.472971 10042 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:43.473970 10039 consensus_queue.cc:1048] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:43.477072 10051 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.478416  9815 raft_consensus.cc:2393] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 1: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:25:43.480471  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:43.481654  9811 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:43.481865  9927 leader_election.cc:343] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.484983  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:43.485605  9888 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:43.489869 10054 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:43.490614  9812 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:25:43.495082 10004 tablet_bootstrap.cc:492] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:43.495162 10218 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:43.495700 10004 ts_tablet_manager.cc:1403] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.086s	user 0.020s	sys 0.019s
I20260709 12:25:43.497231  9888 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.498482 10004 raft_consensus.cc:359] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.499164 10004 raft_consensus.cc:385] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.499457 10004 raft_consensus.cc:740] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.500131 10004 consensus_queue.cc:260] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.502624  9928 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:43.504024 10004 ts_tablet_manager.cc:1434] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:25:43.504956  9815 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.505021 10005 tablet_bootstrap.cc:492] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:43.505805 10005 ts_tablet_manager.cc:1403] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.139s	user 0.039s	sys 0.027s
I20260709 12:25:43.507341 10006 tablet_bootstrap.cc:492] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:43.507793 10006 ts_tablet_manager.cc:1403] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.144s	user 0.009s	sys 0.010s
I20260709 12:25:43.508486 10005 raft_consensus.cc:359] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.509172 10005 raft_consensus.cc:385] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.509446 10005 raft_consensus.cc:740] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.510299 10005 consensus_queue.cc:260] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.511128 10054 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.511572 10054 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.512530 10005 ts_tablet_manager.cc:1434] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:25:43.513437 10054 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:43.514482 10051 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:43.516184 10178 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:43.516546 10178 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.516880 10178 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.517421  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:43.518091 10005 tablet_bootstrap.cc:492] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:43.518216  9963 raft_consensus.cc:2393] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 1: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:25:43.518620  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:43.525568 10005 tablet_bootstrap.cc:654] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.525707 10133 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:43.527077 10054 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:43.529065  9779 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:25:43.531069 10222 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:43.533631  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:43.536401  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:43.537271  9963 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:43.526221 10178 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:43.541633  9853 leader_election.cc:343] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.543656 10178 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:43.504951 10004 tablet_bootstrap.cc:492] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:43.554127  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:43.554703  9888 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.543776  9853 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:43.557940 10054 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:43.558349 10054 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.558734 10054 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.544446  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:25:43.560536  9927 leader_election.cc:343] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.544515  9887 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:43.550416 10222 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:43.563858  9928 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:43.563500  9712 catalog_manager.cc:5697] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:43.564845 10178 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:43.565488 10178 raft_consensus.cc:697] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:43.566453 10178 consensus_queue.cc:237] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.573087 10004 tablet_bootstrap.cc:654] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.573325 10042 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.573766 10042 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.576534 10042 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:43.577378 10054 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.578042  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:43.579015  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:25:43.580222  9927 leader_election.cc:343] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:43.581889  9928 leader_election.cc:343] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.580335  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:43.584316 10006 raft_consensus.cc:359] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:43.584657  9853 leader_election.cc:343] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.585403 10054 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:43.585621 10006 raft_consensus.cc:385] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.588938 10006 raft_consensus.cc:740] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.582243  9928 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:25:43.590780 10042 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:43.592442  9888 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:43.595057 10006 consensus_queue.cc:260] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.596925  9963 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:25:43.598079  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:43.598604  9963 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.598798 10005 tablet_bootstrap.cc:492] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:43.599282 10005 ts_tablet_manager.cc:1403] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.027s
I20260709 12:25:43.601878 10005 raft_consensus.cc:359] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.602603 10005 raft_consensus.cc:385] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.602907 10005 raft_consensus.cc:740] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.604714 10005 consensus_queue.cc:260] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.607537  9814 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.607635 10005 ts_tablet_manager.cc:1434] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:25:43.608729 10005 tablet_bootstrap.cc:492] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:43.608664  9963 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:43.610631  9928 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:43.612980 10203 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:43.614866 10039 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:43.615330 10039 raft_consensus.cc:697] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:43.616291  9853 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:43.616047 10039 consensus_queue.cc:237] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.616976 10054 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:43.618908 10054 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:43.619338 10054 raft_consensus.cc:697] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:43.620087 10054 consensus_queue.cc:237] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.621938  9713 catalog_manager.cc:5697] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:43.630133 10006 ts_tablet_manager.cc:1434] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.122s	user 0.006s	sys 0.003s
I20260709 12:25:43.639551 10006 tablet_bootstrap.cc:492] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:43.648887 10203 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:25:43.671476 10009 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:43.674945 10005 tablet_bootstrap.cc:654] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.707849 10006 tablet_bootstrap.cc:654] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.713004 10084 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.717825 10051 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.723440 10009 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.726302 10009 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.732904 10051 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.738955 10004 tablet_bootstrap.cc:492] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:43.739722 10004 ts_tablet_manager.cc:1403] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.235s	user 0.014s	sys 0.021s
I20260709 12:25:43.725874 10084 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.755227  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:43.759457 10218 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.791587  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:43.792500 10084 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:43.791584  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:43.793673  9964 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:43.796239 10051 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:43.792068 10218 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.788842 10009 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:25:43.791641  9779 leader_election.cc:343] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.799533 10006 tablet_bootstrap.cc:492] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:43.806478 10006 ts_tablet_manager.cc:1403] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.175s	user 0.019s	sys 0.006s
W20260709 12:25:43.806778  9853 leader_election.cc:343] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.807430  9853 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:43.808398  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:43.800415 10004 raft_consensus.cc:359] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.808995 10004 raft_consensus.cc:385] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.800962 10005 tablet_bootstrap.cc:492] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:43.809764 10005 ts_tablet_manager.cc:1403] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.201s	user 0.022s	sys 0.014s
I20260709 12:25:43.801875  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:43.811393  9964 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:43.813249 10005 raft_consensus.cc:359] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.809264 10004 raft_consensus.cc:740] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.813886 10005 raft_consensus.cc:385] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.805781  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:43.814983 10005 raft_consensus.cc:740] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.814589 10004 consensus_queue.cc:260] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.815652 10005 consensus_queue.cc:260] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.803351 10218 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:43.816982  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:43.817566  9964 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 0.
I20260709 12:25:43.823766 10005 ts_tablet_manager.cc:1434] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:25:43.824812 10005 tablet_bootstrap.cc:492] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:43.806025  9713 catalog_manager.cc:5697] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:43.835497 10004 ts_tablet_manager.cc:1434] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.002s
I20260709 12:25:43.837191 10269 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:43.839450 10004 tablet_bootstrap.cc:492] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:43.841533  9778 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:25:43.843253 10269 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.843855 10269 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:43.844488  9853 leader_election.cc:343] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.845561 10133 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:43.845939 10133 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.846251 10133 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.853688  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:43.854059  9853 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:25:43.855139  9853 leader_election.cc:343] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:43.856215  9853 leader_election.cc:343] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.856103 10006 raft_consensus.cc:359] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.856586  9853 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:25:43.856864 10006 raft_consensus.cc:385] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.857143 10006 raft_consensus.cc:740] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.855053 10009 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:43.857710 10009 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.858042 10009 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.859956 10084 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:43.866510 10006 consensus_queue.cc:260] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.865962 10133 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.874187 10009 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.874884 10005 tablet_bootstrap.cc:654] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.875649 10133 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:43.876427  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:25:43.877779  9779 leader_election.cc:343] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.879678 10009 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:43.879431  9711 catalog_manager.cc:5697] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:43.881683  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:43.882261  9964 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.887679 10004 tablet_bootstrap.cc:654] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.886606  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:43.892341 10269 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.894438 10269 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:43.900187 10004 tablet_bootstrap.cc:492] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:43.900662 10004 ts_tablet_manager.cc:1403] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.003s
I20260709 12:25:43.903149 10004 raft_consensus.cc:359] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.903889 10004 raft_consensus.cc:385] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.904147 10004 raft_consensus.cc:740] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.904773 10004 consensus_queue.cc:260] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.906042  9964 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:25:43.906965 10004 ts_tablet_manager.cc:1434] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:25:43.907294 10006 ts_tablet_manager.cc:1434] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.101s	user 0.004s	sys 0.003s
I20260709 12:25:43.907114  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:43.907946 10004 tablet_bootstrap.cc:492] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:43.908130  9961 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.908504 10006 tablet_bootstrap.cc:492] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:43.910984 10269 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.911450 10269 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.912382  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:43.912967  9962 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.913378 10269 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:43.917900 10004 tablet_bootstrap.cc:654] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.919121 10006 tablet_bootstrap.cc:654] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:43.922942  9962 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:43.923684  9961 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:43.924696  9778 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:25:43.926463 10133 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:43.926908 10133 raft_consensus.cc:697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:25:43.927693 10133 consensus_queue.cc:237] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:43.940989  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 45483us
W20260709 12:25:43.941985  9853 leader_election.cc:343] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:43.957301 10084 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.957804 10084 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:43.959488  9761 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:43.960853 10084 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:43.962496 10006 tablet_bootstrap.cc:492] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:43.962970 10006 ts_tablet_manager.cc:1403] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.001s
I20260709 12:25:43.965181 10006 raft_consensus.cc:359] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.965677 10006 raft_consensus.cc:385] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.965914 10006 raft_consensus.cc:740] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.966732  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:43.967365  9815 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:43.971943  9853 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:43.966563 10006 consensus_queue.cc:260] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.972708 10084 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:43.972837  9853 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:43.973592 10054 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:43.974128 10054 raft_consensus.cc:697] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:43.974977 10054 consensus_queue.cc:237] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.977511 10005 tablet_bootstrap.cc:492] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:43.978026 10005 ts_tablet_manager.cc:1403] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.153s	user 0.011s	sys 0.000s
I20260709 12:25:43.973340 10084 raft_consensus.cc:697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:43.978319  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:43.979183 10084 consensus_queue.cc:237] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.980825 10005 raft_consensus.cc:359] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.981468 10005 raft_consensus.cc:385] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.981748 10005 raft_consensus.cc:740] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.984071 10005 consensus_queue.cc:260] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.985549 10005 ts_tablet_manager.cc:1434] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:25:43.986370 10004 tablet_bootstrap.cc:492] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:43.986819 10006 ts_tablet_manager.cc:1434] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.004s
I20260709 12:25:43.986832 10004 ts_tablet_manager.cc:1403] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.079s	user 0.023s	sys 0.044s
I20260709 12:25:43.988003 10006 tablet_bootstrap.cc:492] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:43.986380 10005 tablet_bootstrap.cc:492] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:43.990264 10004 raft_consensus.cc:359] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.991016 10004 raft_consensus.cc:385] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:43.991381 10004 raft_consensus.cc:740] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:43.992182 10004 consensus_queue.cc:260] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:43.993950 10004 ts_tablet_manager.cc:1434] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:43.994908 10004 tablet_bootstrap.cc:492] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:43.995540 10005 tablet_bootstrap.cc:654] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:43.997931  9853 leader_election.cc:343] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:44.001971  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:44.002717  9713 catalog_manager.cc:5697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.004370  9713 catalog_manager.cc:5697] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.006018 10004 tablet_bootstrap.cc:654] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.007571  9710 catalog_manager.cc:5697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.014442  9815 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:44.016153 10006 tablet_bootstrap.cc:654] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.021853 10005 tablet_bootstrap.cc:492] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:44.022325 10005 ts_tablet_manager.cc:1403] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.011s
I20260709 12:25:44.024972 10005 raft_consensus.cc:359] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.025610 10005 raft_consensus.cc:385] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.025861 10005 raft_consensus.cc:740] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.026469 10005 consensus_queue.cc:260] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.027976 10005 ts_tablet_manager.cc:1434] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:44.028784 10005 tablet_bootstrap.cc:492] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:44.034469 10005 tablet_bootstrap.cc:654] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.041016  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:44.041658  9961 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
W20260709 12:25:44.049803  9853 consensus_peers.cc:597] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:44.051379 10006 tablet_bootstrap.cc:492] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
W20260709 12:25:44.051903  9853 consensus_peers.cc:597] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:44.051983 10006 ts_tablet_manager.cc:1403] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.010s
I20260709 12:25:44.053702  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:44.053746  9853 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:44.054580  9962 raft_consensus.cc:2393] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 1: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:25:44.054569 10269 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:44.055042 10269 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.055388 10269 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.061403 10006 raft_consensus.cc:359] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.062033 10006 raft_consensus.cc:385] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.062317 10006 raft_consensus.cc:740] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.063656 10006 consensus_queue.cc:260] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.064713 10004 tablet_bootstrap.cc:492] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:44.065559 10004 ts_tablet_manager.cc:1403] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.022s
I20260709 12:25:44.066534 10006 ts_tablet_manager.cc:1434] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.007s
I20260709 12:25:44.067792 10006 tablet_bootstrap.cc:492] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:44.069029 10004 raft_consensus.cc:359] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.069818 10004 raft_consensus.cc:385] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.070194 10004 raft_consensus.cc:740] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.071167 10004 consensus_queue.cc:260] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.073223 10084 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:44.076156 10006 tablet_bootstrap.cc:654] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.065742 10269 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.083047 10269 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:44.084627 10004 ts_tablet_manager.cc:1434] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 12:25:44.096164 10004 tablet_bootstrap.cc:492] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:44.101414  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:44.103343 10004 tablet_bootstrap.cc:654] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.103634 10203 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:44.104838  9853 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:25:44.107100 10084 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.117357 10084 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:44.120069 10203 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.120653 10203 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.122705 10203 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:25:44.123239  9853 leader_election.cc:343] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:44.125515  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:25:44.127099  9927 leader_election.cc:343] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:44.141052 10004 tablet_bootstrap.cc:492] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:44.140856  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:44.141636 10004 ts_tablet_manager.cc:1403] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.008s
I20260709 12:25:44.141538  9961 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.144502 10004 raft_consensus.cc:359] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.145280 10004 raft_consensus.cc:385] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.145581 10004 raft_consensus.cc:740] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.146377 10004 consensus_queue.cc:260] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.152347  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:44.152956  9888 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:44.166568 10051 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.167200 10051 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.169798 10051 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:44.170864 10004 ts_tablet_manager.cc:1434] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 12:25:44.171897  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:44.173079  9964 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 0.
I20260709 12:25:44.173542 10004 tablet_bootstrap.cc:492] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:44.175666  9778 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:44.176617 10051 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:44.177037 10051 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.177438 10051 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.185083 10004 tablet_bootstrap.cc:654] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.207650  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:44.208315  9889 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 0.
I20260709 12:25:44.210068 10133 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.210722 10133 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.213444 10133 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:44.215622  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:44.216476  9964 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 0.
I20260709 12:25:44.218593  9778 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:44.220530 10133 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:44.221920 10133 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.223419 10133 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.262607  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:44.263496  9889 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 0.
W20260709 12:25:44.267820  9927 consensus_peers.cc:597] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:44.272061  9961 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:44.272815 10084 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.286682 10084 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.287160 10004 tablet_bootstrap.cc:492] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:44.287590 10004 ts_tablet_manager.cc:1403] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.114s	user 0.039s	sys 0.046s
I20260709 12:25:44.288727 10084 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:44.290442 10006 tablet_bootstrap.cc:492] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:44.277609 10005 tablet_bootstrap.cc:492] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:44.276254 10051 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.283739 10269 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:44.290977 10006 ts_tablet_manager.cc:1403] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.223s	user 0.082s	sys 0.115s
I20260709 12:25:44.291049 10005 ts_tablet_manager.cc:1403] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.262s	user 0.081s	sys 0.124s
I20260709 12:25:44.279037 10133 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.294235 10133 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:44.294150 10006 raft_consensus.cc:359] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.295058 10006 raft_consensus.cc:385] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.295331 10006 raft_consensus.cc:740] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.295826  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:44.295939 10006 consensus_queue.cc:260] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.296435  9962 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.296695 10051 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:44.296200  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:44.290138 10004 raft_consensus.cc:359] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.298075 10006 ts_tablet_manager.cc:1434] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:25:44.298462 10004 raft_consensus.cc:385] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.307037  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:44.307467 10004 raft_consensus.cc:740] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.307610  9889 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.307770 10005 raft_consensus.cc:359] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.308486 10005 raft_consensus.cc:385] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.308164 10004 consensus_queue.cc:260] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.308774 10005 raft_consensus.cc:740] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.309032  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:44.309556  9888 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.309418 10005 consensus_queue.cc:260] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.310257 10004 ts_tablet_manager.cc:1434] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 12:25:44.299073 10006 tablet_bootstrap.cc:492] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:44.298163  9961 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.312353  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:44.312803 10005 ts_tablet_manager.cc:1434] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 12:25:44.301826  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:44.313683 10005 tablet_bootstrap.cc:492] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:44.302037 10205 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:44.305110 10203 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:44.317304 10042 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:44.318638 10042 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.318992 10042 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.311165 10004 tablet_bootstrap.cc:492] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
W20260709 12:25:44.354075  9853 leader_election.cc:343] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:44.379679  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 65678.6us
I20260709 12:25:44.384485 10287 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.398602  9888 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:25:44.401026 10042 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.402474  9853 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:44.392638 10287 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.410394 10042 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:44.410637  9779 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:25:44.411469 10051 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:44.412046 10051 raft_consensus.cc:697] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:25:44.413024 10051 consensus_queue.cc:237] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.415436 10004 tablet_bootstrap.cc:654] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.406953 10009 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:44.416859  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:44.419108  9889 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:25:44.433828 10009 raft_consensus.cc:697] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:44.449527 10009 consensus_queue.cc:237] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.451552  9779 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:25:44.447008 10287 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:44.444507  9961 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:25:44.473297 10133 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:44.486488  9853 leader_election.cc:343] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:44.487082  9853 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:25:44.475643 10269 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.490522 10133 raft_consensus.cc:697] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:25:44.520052 10300 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:44.500039 10269 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.521754  9814 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.523253  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:44.536351 10301 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:25:44.538570  9890 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.536373 10133 consensus_queue.cc:237] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.565511 10005 tablet_bootstrap.cc:654] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.548010 10300 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:25:44.560807  9962 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:25:44.591449  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:25:44.603164 10297 log.cc:927] Time spent T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:25:44.614774 10006 tablet_bootstrap.cc:654] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:44.623834  9927 leader_election.cc:343] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:44.628333 10286 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:44.631245  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:44.627502  9890 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
W20260709 12:25:44.656540  9927 leader_election.cc:343] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:44.669948 10005 tablet_bootstrap.cc:492] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:44.676036 10005 ts_tablet_manager.cc:1403] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.363s	user 0.028s	sys 0.029s
I20260709 12:25:44.680022  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:44.686702 10004 tablet_bootstrap.cc:492] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:44.687186 10004 ts_tablet_manager.cc:1403] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.376s	user 0.008s	sys 0.013s
I20260709 12:25:44.688076 10289 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:44.693069 10289 raft_consensus.cc:697] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:44.697615 10289 consensus_queue.cc:237] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.706447 10004 raft_consensus.cc:359] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.707131 10004 raft_consensus.cc:385] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.707417 10004 raft_consensus.cc:740] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.708097 10004 consensus_queue.cc:260] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.712222  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:44.713254 10004 ts_tablet_manager.cc:1434] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 12:25:44.718483 10004 tablet_bootstrap.cc:492] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
W20260709 12:25:44.725660  9928 leader_election.cc:343] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:44.730938  9928 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:25:44.731594 10042 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:44.749976  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:44.765992 10006 tablet_bootstrap.cc:492] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:44.766502 10006 ts_tablet_manager.cc:1403] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.468s	user 0.009s	sys 0.015s
W20260709 12:25:44.769872  9853 consensus_peers.cc:597] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:44.770502  9853 leader_election.cc:343] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:44.774137 10306 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:44.777932 10005 raft_consensus.cc:359] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.779066 10005 raft_consensus.cc:385] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.779328 10005 raft_consensus.cc:740] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.779906 10005 consensus_queue.cc:260] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.781973 10005 ts_tablet_manager.cc:1434] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.105s	user 0.002s	sys 0.001s
I20260709 12:25:44.794201 10006 raft_consensus.cc:359] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.795140 10006 raft_consensus.cc:385] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.795490 10006 raft_consensus.cc:740] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.798203 10006 consensus_queue.cc:260] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.792261 10286 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.814759 10006 ts_tablet_manager.cc:1434] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 12:25:44.816026 10006 tablet_bootstrap.cc:492] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:44.815510 10286 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.834857 10006 tablet_bootstrap.cc:654] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.838523 10004 tablet_bootstrap.cc:654] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:44.845855 10286 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:25:44.847257 10313 log.cc:927] Time spent T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:25:44.848579  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:44.852311  9959 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 0.
I20260709 12:25:44.878288  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:25:44.897444  9779 leader_election.cc:343] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:44.901353 10005 tablet_bootstrap.cc:492] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:44.911291 10303 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:25:44.906293 10325 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:44.917268  9778 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:25:44.919030 10051 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:44.919368 10051 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.919649 10051 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.926692 10286 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:44.927873 10051 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.933400 10006 tablet_bootstrap.cc:492] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:44.933874 10006 ts_tablet_manager.cc:1403] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.118s	user 0.030s	sys 0.038s
I20260709 12:25:44.934316  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:44.935087 10051 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:44.937114 10006 raft_consensus.cc:359] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.937798 10006 raft_consensus.cc:385] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.937628  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:44.938199 10006 raft_consensus.cc:740] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.938583  9961 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:44.938920 10006 consensus_queue.cc:260] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.940459 10006 ts_tablet_manager.cc:1434] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:25:44.941335 10006 tablet_bootstrap.cc:492] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:44.942865 10005 tablet_bootstrap.cc:654] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:44.945678  9779 leader_election.cc:343] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:44.943966 10269 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:44.963478  9713 catalog_manager.cc:5697] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.964684  9713 catalog_manager.cc:5697] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.972553 10004 tablet_bootstrap.cc:492] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:44.972286  9710 catalog_manager.cc:5697] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.961789  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:44.976715 10004 ts_tablet_manager.cc:1403] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.261s	user 0.014s	sys 0.022s
I20260709 12:25:44.977468 10294 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.981817 10051 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:44.987581 10294 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.989843  9961 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:25:44.995105 10004 raft_consensus.cc:359] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.995837 10004 raft_consensus.cc:385] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:44.996088 10004 raft_consensus.cc:740] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:44.996237 10294 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:44.996714 10004 consensus_queue.cc:260] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:44.997380  9778 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:25:45.000130 10004 ts_tablet_manager.cc:1434] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.003s
I20260709 12:25:45.001029 10004 tablet_bootstrap.cc:492] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:45.007261 10051 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:25:45.009125  9853 leader_election.cc:343] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.012181  9853 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:25:45.014310 10051 raft_consensus.cc:697] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:25:45.015398 10051 consensus_queue.cc:237] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.027951  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:45.031087 10298 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:45.022527  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:45.039080 10269 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.039544 10269 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.041497 10269 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:45.045459  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:25:45.049306  9853 leader_election.cc:343] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.047102  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:25:45.051096  9853 leader_election.cc:343] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.051476  9853 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:25:45.057528  9927 leader_election.cc:343] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.058557 10310 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.059070 10310 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.061223 10310 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:45.055958 10298 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:45.063329  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:45.064190  9962 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:45.068717  9853 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:45.063570  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:25:45.070585  9928 leader_election.cc:343] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.073065  9928 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:25:45.071606 10310 raft_consensus.cc:2804] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:45.075680 10320 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:45.076396  9853 consensus_peers.cc:597] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:45.074466 10310 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.078791 10310 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.082988 10005 tablet_bootstrap.cc:492] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:45.083603 10005 ts_tablet_manager.cc:1403] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.182s	user 0.021s	sys 0.012s
I20260709 12:25:45.095410 10006 tablet_bootstrap.cc:654] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.097021 10288 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:45.099537  9853 leader_election.cc:343] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.097496 10288 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.103000 10005 raft_consensus.cc:359] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.104050 10005 raft_consensus.cc:385] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.104328 10005 raft_consensus.cc:740] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.105429 10005 consensus_queue.cc:260] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.107435 10005 ts_tablet_manager.cc:1434] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:25:45.107668 10004 tablet_bootstrap.cc:654] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.110148 10288 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:45.111912  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:45.112532  9812 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:45.115664 10005 tablet_bootstrap.cc:492] T 02b16516f13c42bfae1f9f2e877ee307 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:45.116863  9927 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:45.117585 10042 raft_consensus.cc:2804] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:45.117913 10042 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.118220 10042 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.125682 10042 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.129269  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:45.129942  9813 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.141115 10042 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:45.143846  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:45.146727  9813 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:45.147024  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:45.151063  9927 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:45.148056 10310 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.144773  9884 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:45.154131 10005 tablet_bootstrap.cc:654] T 02b16516f13c42bfae1f9f2e877ee307 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.158501 10006 tablet_bootstrap.cc:492] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:45.159034 10006 ts_tablet_manager.cc:1403] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.218s	user 0.011s	sys 0.017s
I20260709 12:25:45.159816 10320 raft_consensus.cc:2804] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:45.162688 10325 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:45.163213 10320 raft_consensus.cc:697] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:45.164027 10320 consensus_queue.cc:237] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.168179 10310 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:45.170241  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:25:45.172618  9853 leader_election.cc:343] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.172781 10042 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:45.174700 10004 tablet_bootstrap.cc:492] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:45.175132 10004 ts_tablet_manager.cc:1403] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.174s	user 0.012s	sys 0.000s
I20260709 12:25:45.179433  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:45.180217  9955 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.183912 10006 raft_consensus.cc:359] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.186713 10006 raft_consensus.cc:385] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.184636 10005 tablet_bootstrap.cc:492] T 02b16516f13c42bfae1f9f2e877ee307 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:45.199843 10005 ts_tablet_manager.cc:1403] T 02b16516f13c42bfae1f9f2e877ee307 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.006s
I20260709 12:25:45.201027 10006 raft_consensus.cc:740] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.201973 10006 consensus_queue.cc:260] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.207442 10006 ts_tablet_manager.cc:1434] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.002s
I20260709 12:25:45.208631 10006 tablet_bootstrap.cc:492] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:45.209039 10004 raft_consensus.cc:359] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.209779 10004 raft_consensus.cc:385] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.210088 10004 raft_consensus.cc:740] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.210829 10004 consensus_queue.cc:260] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.212968 10004 ts_tablet_manager.cc:1434] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 12:25:45.217549 10004 tablet_bootstrap.cc:492] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
W20260709 12:25:45.219362  9761 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:45.225046 10005 raft_consensus.cc:359] T 02b16516f13c42bfae1f9f2e877ee307 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.225973 10005 raft_consensus.cc:385] T 02b16516f13c42bfae1f9f2e877ee307 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:25:45.226555  9927 consensus_peers.cc:597] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:45.226727 10005 raft_consensus.cc:740] T 02b16516f13c42bfae1f9f2e877ee307 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.232314 10005 consensus_queue.cc:260] T 02b16516f13c42bfae1f9f2e877ee307 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.236508 10006 tablet_bootstrap.cc:654] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.240711  9955 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:45.241264 10005 ts_tablet_manager.cc:1434] T 02b16516f13c42bfae1f9f2e877ee307 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.001s
I20260709 12:25:45.243093  9853 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:45.243253 10005 tablet_bootstrap.cc:492] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:45.244863 10310 raft_consensus.cc:2804] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:45.245126 10004 tablet_bootstrap.cc:654] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.245489 10310 raft_consensus.cc:697] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:45.247315 10310 consensus_queue.cc:237] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.260421 10005 tablet_bootstrap.cc:654] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.269624  9813 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.276067 10306 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.276589 10306 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.278916 10306 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:45.281428  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:25:45.283090  9853 leader_election.cc:343] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.283381  9711 catalog_manager.cc:5697] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:45.285907 10006 tablet_bootstrap.cc:492] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:45.286433 10006 ts_tablet_manager.cc:1403] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.078s	user 0.025s	sys 0.001s
I20260709 12:25:45.287293  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:25:45.288757  9853 leader_election.cc:343] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.289099  9853 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:25:45.289657 10310 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:45.289510 10006 raft_consensus.cc:359] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.290411 10006 raft_consensus.cc:385] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.290719 10006 raft_consensus.cc:740] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.291581 10006 consensus_queue.cc:260] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.304149 10005 tablet_bootstrap.cc:492] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:45.306869 10306 consensus_queue.cc:1048] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:45.315474 10005 ts_tablet_manager.cc:1403] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.072s	user 0.015s	sys 0.008s
I20260709 12:25:45.317660 10004 tablet_bootstrap.cc:492] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:45.318140 10004 ts_tablet_manager.cc:1403] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.101s	user 0.013s	sys 0.004s
I20260709 12:25:45.318222 10005 raft_consensus.cc:359] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.319082 10005 raft_consensus.cc:385] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.319411 10005 raft_consensus.cc:740] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.320195 10005 consensus_queue.cc:260] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.321084 10006 ts_tablet_manager.cc:1434] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:25:45.320973 10004 raft_consensus.cc:359] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.321655 10004 raft_consensus.cc:385] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.321921 10004 raft_consensus.cc:740] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.322609 10005 ts_tablet_manager.cc:1434] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:45.323487 10005 tablet_bootstrap.cc:492] T be9677b33dcc4236a5656b7747c90d13 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:45.322021 10006 tablet_bootstrap.cc:492] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:45.335409  9813 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.337375 10005 tablet_bootstrap.cc:654] T be9677b33dcc4236a5656b7747c90d13 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.338706 10004 consensus_queue.cc:260] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.343426 10004 ts_tablet_manager.cc:1434] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:25:45.344843 10004 tablet_bootstrap.cc:492] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:45.346033 10006 tablet_bootstrap.cc:654] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.351016 10004 tablet_bootstrap.cc:654] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.361510 10006 tablet_bootstrap.cc:492] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:45.362107 10006 ts_tablet_manager.cc:1403] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.000s
I20260709 12:25:45.345639  9710 catalog_manager.cc:5697] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:45.365633 10006 raft_consensus.cc:359] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.370064 10006 raft_consensus.cc:385] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.370446 10006 raft_consensus.cc:740] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.371426 10042 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.372040 10042 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.374490 10042 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:45.376873  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:45.379496  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:45.380345  9882 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
W20260709 12:25:45.381984  9927 leader_election.cc:343] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.385581  9928 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:45.388630 10287 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:45.389113 10287 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.389539 10287 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.389441  9713 catalog_manager.cc:5697] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:45.415241 10306 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.415742 10306 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.417865 10306 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:45.415666 10006 consensus_queue.cc:260] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.418530 10320 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.419025 10320 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.421093  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:45.421330  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:45.422353 10004 tablet_bootstrap.cc:492] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:45.422230  9959 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:45.422803 10004 ts_tablet_manager.cc:1403] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.078s	user 0.038s	sys 0.034s
I20260709 12:25:45.419006 10287 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:45.423087  9853 leader_election.cc:343] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.425736  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:45.426378  9853 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:45.426944 10287 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:25:45.427472  9927 leader_election.cc:343] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.428224 10310 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:45.428640 10310 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.428668 10006 ts_tablet_manager.cc:1434] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 12:25:45.429188 10310 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.429102 10004 raft_consensus.cc:359] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.429755 10004 raft_consensus.cc:385] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.430037 10004 raft_consensus.cc:740] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.429895  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:45.429883 10006 tablet_bootstrap.cc:492] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:45.430437  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:45.445395 10004 consensus_queue.cc:260] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.429966 10320 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:45.431649  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:25:45.446369  9927 leader_election.cc:343] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.446664  9884 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:45.447564  9928 leader_election.cc:343] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.448053 10004 ts_tablet_manager.cc:1434] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.025s	user 0.012s	sys 0.002s
I20260709 12:25:45.448009  9928 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:25:45.448778 10320 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:45.449009 10004 tablet_bootstrap.cc:492] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:45.450078 10005 tablet_bootstrap.cc:492] T be9677b33dcc4236a5656b7747c90d13 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:45.453733 10005 ts_tablet_manager.cc:1403] T be9677b33dcc4236a5656b7747c90d13 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.130s	user 0.025s	sys 0.055s
I20260709 12:25:45.453436  9711 catalog_manager.cc:5697] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:45.456821 10006 tablet_bootstrap.cc:654] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.456751 10005 raft_consensus.cc:359] T be9677b33dcc4236a5656b7747c90d13 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.457569 10005 raft_consensus.cc:385] T be9677b33dcc4236a5656b7747c90d13 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.457924 10004 tablet_bootstrap.cc:654] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.457901 10005 raft_consensus.cc:740] T be9677b33dcc4236a5656b7747c90d13 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.458940 10005 consensus_queue.cc:260] T be9677b33dcc4236a5656b7747c90d13 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.461419 10005 ts_tablet_manager.cc:1434] T be9677b33dcc4236a5656b7747c90d13 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:25:45.462502 10005 tablet_bootstrap.cc:492] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:45.453444 10310 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.469533 10005 tablet_bootstrap.cc:654] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.485661 10006 tablet_bootstrap.cc:492] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:45.486119 10006 ts_tablet_manager.cc:1403] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.004s
I20260709 12:25:45.488735 10006 raft_consensus.cc:359] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.489379 10006 raft_consensus.cc:385] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.489634 10006 raft_consensus.cc:740] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.490252 10006 consensus_queue.cc:260] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.492640 10006 ts_tablet_manager.cc:1434] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.005s
I20260709 12:25:45.493559 10006 tablet_bootstrap.cc:492] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:45.496011  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:25:45.497722  9853 leader_election.cc:343] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.500535 10004 tablet_bootstrap.cc:492] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:45.501006 10004 ts_tablet_manager.cc:1403] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.015s
I20260709 12:25:45.503479 10004 raft_consensus.cc:359] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.504098 10004 raft_consensus.cc:385] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.504302 10004 raft_consensus.cc:740] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.504956 10004 consensus_queue.cc:260] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.508599 10004 ts_tablet_manager.cc:1434] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:45.509450 10004 tablet_bootstrap.cc:492] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:45.509913 10005 tablet_bootstrap.cc:492] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:45.510685 10310 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:45.510906 10005 ts_tablet_manager.cc:1403] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.018s
I20260709 12:25:45.511623  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:45.512271  9959 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.514130 10006 tablet_bootstrap.cc:654] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.514632 10005 raft_consensus.cc:359] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.515290 10005 raft_consensus.cc:385] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.515563 10005 raft_consensus.cc:740] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.512794  9884 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:45.516842  9928 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:45.517814 10287 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:45.518123 10004 tablet_bootstrap.cc:654] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.518289 10287 raft_consensus.cc:697] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:45.519169 10287 consensus_queue.cc:237] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.526635 10005 consensus_queue.cc:260] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.529508 10005 ts_tablet_manager.cc:1434] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:25:45.530779 10005 tablet_bootstrap.cc:492] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:45.530920  9959 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:45.536676  9853 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:45.538539 10310 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:45.539008 10310 raft_consensus.cc:697] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:45.539786 10310 consensus_queue.cc:237] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.558200 10005 tablet_bootstrap.cc:654] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.560693 10004 tablet_bootstrap.cc:492] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:45.561221 10004 ts_tablet_manager.cc:1403] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.007s
I20260709 12:25:45.563201 10320 consensus_queue.cc:1048] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:45.567167 10004 raft_consensus.cc:359] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.567927 10004 raft_consensus.cc:385] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.568091 10006 tablet_bootstrap.cc:492] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:45.570199 10004 raft_consensus.cc:740] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.570595 10006 ts_tablet_manager.cc:1403] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.077s	user 0.009s	sys 0.003s
I20260709 12:25:45.571125 10004 consensus_queue.cc:260] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.569512  9884 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.573581 10004 ts_tablet_manager.cc:1434] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:25:45.573218  9713 catalog_manager.cc:5697] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:45.574697  9711 catalog_manager.cc:5697] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:45.574846 10004 tablet_bootstrap.cc:492] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:45.583091 10004 tablet_bootstrap.cc:654] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.586941 10320 consensus_queue.cc:1048] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:45.573267 10006 raft_consensus.cc:359] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.590030 10006 raft_consensus.cc:385] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.591146 10006 raft_consensus.cc:740] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.591889 10006 consensus_queue.cc:260] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.597410 10133 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:45.594170 10006 ts_tablet_manager.cc:1434] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.000s
I20260709 12:25:45.612331  9882 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.613099 10006 tablet_bootstrap.cc:492] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:45.646745 10287 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.647289 10287 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.648710 10286 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.649358 10287 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:45.649192 10286 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.650843  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:45.651373 10286 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:45.655808 10006 tablet_bootstrap.cc:654] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:45.656571  9927 leader_election.cc:343] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.657996 10286 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:25:45.663793 10005 tablet_bootstrap.cc:492] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:45.667131  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:45.667753  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:45.668673 10005 ts_tablet_manager.cc:1403] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.138s	user 0.025s	sys 0.000s
I20260709 12:25:45.674868 10005 raft_consensus.cc:359] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.676128 10005 raft_consensus.cc:385] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.676431 10005 raft_consensus.cc:740] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.665917  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:45.677706  9890 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:45.680322  9928 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:45.683009 10287 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:45.683586 10287 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.684101 10287 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.694434 10310 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.695235 10310 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.697861 10310 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:45.699527 10005 consensus_queue.cc:260] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.701133 10005 ts_tablet_manager.cc:1434] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 12:25:45.702008 10005 tablet_bootstrap.cc:492] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:45.711104  9809 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.711321  9779 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:25:45.715461 10005 tablet_bootstrap.cc:654] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.717293  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:25:45.718055  9853 consensus_peers.cc:597] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:45.725461 10005 tablet_bootstrap.cc:492] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:45.725967 10005 ts_tablet_manager.cc:1403] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:25:45.724870  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:25:45.727725  9853 leader_election.cc:343] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.728515 10005 raft_consensus.cc:359] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.729202 10005 raft_consensus.cc:385] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.729471 10005 raft_consensus.cc:740] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.730116 10005 consensus_queue.cc:260] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:45.731556  9853 leader_election.cc:343] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.731834 10005 ts_tablet_manager.cc:1434] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:25:45.731961  9853 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:25:45.732671 10310 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:45.732934 10005 tablet_bootstrap.cc:492] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:45.738884 10005 tablet_bootstrap.cc:654] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.747074 10286 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:45.763474 10005 tablet_bootstrap.cc:492] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:45.763953 10005 ts_tablet_manager.cc:1403] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.002s
I20260709 12:25:45.765933 10009 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.766433 10009 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.766371 10005 raft_consensus.cc:359] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.767244 10005 raft_consensus.cc:385] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.767515 10005 raft_consensus.cc:740] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.768152 10005 consensus_queue.cc:260] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.769322 10009 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:45.770323 10005 ts_tablet_manager.cc:1434] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 12:25:45.772087 10005 tablet_bootstrap.cc:492] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:45.772857  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:45.775063  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:45.775722  9813 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:45.777798 10005 tablet_bootstrap.cc:654] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.777837  9853 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:25:45.780197 10306 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:45.780661 10306 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.781111 10306 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.795197 10287 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.798615 10006 tablet_bootstrap.cc:492] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:45.802907 10004 tablet_bootstrap.cc:492] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:45.803265 10006 ts_tablet_manager.cc:1403] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.190s	user 0.008s	sys 0.007s
I20260709 12:25:45.803365 10004 ts_tablet_manager.cc:1403] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.229s	user 0.074s	sys 0.116s
I20260709 12:25:45.803712  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:25:45.805644  9927 leader_election.cc:343] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.806022 10004 raft_consensus.cc:359] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.806747 10004 raft_consensus.cc:385] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.807021 10004 raft_consensus.cc:740] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.807663 10004 consensus_queue.cc:260] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.808388 10287 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:45.811372 10004 ts_tablet_manager.cc:1434] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
W20260709 12:25:45.811820  9853 leader_election.cc:343] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.812263 10004 tablet_bootstrap.cc:492] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:45.818833 10004 tablet_bootstrap.cc:654] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.822728 10006 raft_consensus.cc:359] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.823665 10006 raft_consensus.cc:385] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.823982 10006 raft_consensus.cc:740] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.824802 10006 consensus_queue.cc:260] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.832338 10306 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.834996  9813 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.847519  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:45.848362  9890 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.852149 10310 consensus_queue.cc:1048] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:45.864089 10006 ts_tablet_manager.cc:1434] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.060s	user 0.004s	sys 0.001s
I20260709 12:25:45.864539 10133 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.878758 10133 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.884378 10133 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:45.884836  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:45.889760  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:45.890909  9955 raft_consensus.cc:2393] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 1: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:25:45.891443 10006 tablet_bootstrap.cc:492] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:45.892323  9778 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:25:45.893838 10133 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.872270  9890 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:45.899935  9928 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:45.902494 10306 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:45.908002  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:45.908542  9812 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:45.909639 10042 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:45.910089 10042 raft_consensus.cc:697] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:45.910789 10004 tablet_bootstrap.cc:492] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:45.911257 10004 ts_tablet_manager.cc:1403] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.099s	user 0.032s	sys 0.054s
I20260709 12:25:45.911026 10042 consensus_queue.cc:237] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.914137 10004 raft_consensus.cc:359] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.914839 10004 raft_consensus.cc:385] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.915102 10004 raft_consensus.cc:740] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.915723 10004 consensus_queue.cc:260] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.918300 10004 ts_tablet_manager.cc:1434] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:45.920980 10004 tablet_bootstrap.cc:492] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:45.920919  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:25:45.922206  9927 consensus_peers.cc:597] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:45.925470  9853 leader_election.cc:343] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.927071 10004 tablet_bootstrap.cc:654] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.929944 10005 tablet_bootstrap.cc:492] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:45.930389 10005 ts_tablet_manager.cc:1403] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.158s	user 0.030s	sys 0.096s
I20260709 12:25:45.933127 10005 raft_consensus.cc:359] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.933748 10005 raft_consensus.cc:385] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.934008 10005 raft_consensus.cc:740] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.934873 10005 consensus_queue.cc:260] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.937429 10005 ts_tablet_manager.cc:1434] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:45.937927 10004 tablet_bootstrap.cc:492] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:45.938341 10005 tablet_bootstrap.cc:492] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:45.938376 10004 ts_tablet_manager.cc:1403] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.002s
I20260709 12:25:45.941798 10004 raft_consensus.cc:359] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.942451 10004 raft_consensus.cc:385] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:45.942711 10004 raft_consensus.cc:740] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:45.944054  9812 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:45.945188  9853 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:25:45.945874 10306 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:45.946599 10306 raft_consensus.cc:697] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:45.947865 10306 consensus_queue.cc:237] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.949786 10006 tablet_bootstrap.cc:654] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.952469  9710 catalog_manager.cc:5697] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:45.955696 10005 tablet_bootstrap.cc:654] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.955215 10004 consensus_queue.cc:260] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.956516 10133 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:45.960703 10004 ts_tablet_manager.cc:1434] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:25:45.961938 10004 tablet_bootstrap.cc:492] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:45.971349 10004 tablet_bootstrap.cc:654] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:45.977365 10009 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.977905 10009 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.980499 10009 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:45.981796  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:45.983445  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:45.984010 10320 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.990826 10320 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:45.992906 10320 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:25:45.996744  9853 leader_election.cc:343] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:45.997359  9853 leader_election.cc:343] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.997664  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:45.998574 10005 tablet_bootstrap.cc:492] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:45.999267 10005 ts_tablet_manager.cc:1403] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.002s
W20260709 12:25:45.999886  9928 leader_election.cc:343] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:45.997723  9853 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:25:46.010965 10310 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:46.012984  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:25:46.014606  9927 leader_election.cc:343] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:46.014983  9927 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:25:46.015743 10042 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:46.025312 10005 raft_consensus.cc:359] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.035530 10004 tablet_bootstrap.cc:492] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:46.035966 10004 ts_tablet_manager.cc:1403] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.074s	user 0.034s	sys 0.018s
I20260709 12:25:46.039117 10005 raft_consensus.cc:385] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.039470 10005 raft_consensus.cc:740] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.040145 10005 consensus_queue.cc:260] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.040464  9710 catalog_manager.cc:5697] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:46.042200 10005 ts_tablet_manager.cc:1434] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.043s	user 0.003s	sys 0.001s
I20260709 12:25:46.042712 10004 raft_consensus.cc:359] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.043339 10004 raft_consensus.cc:385] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.043601 10004 raft_consensus.cc:740] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.043793 10005 tablet_bootstrap.cc:492] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:46.044207 10004 consensus_queue.cc:260] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.047155 10004 ts_tablet_manager.cc:1434] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:25:46.049677 10004 tablet_bootstrap.cc:492] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:46.051391 10006 tablet_bootstrap.cc:492] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:46.051836 10006 ts_tablet_manager.cc:1403] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.161s	user 0.028s	sys 0.010s
I20260709 12:25:46.053539 10005 tablet_bootstrap.cc:654] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:46.056866 10004 tablet_bootstrap.cc:654] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:46.060958 10005 tablet_bootstrap.cc:492] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:46.061363 10005 ts_tablet_manager.cc:1403] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.008s
I20260709 12:25:46.062080 10004 tablet_bootstrap.cc:492] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:46.063712 10004 ts_tablet_manager.cc:1403] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.003s
I20260709 12:25:46.063985 10006 raft_consensus.cc:359] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.064687 10006 raft_consensus.cc:385] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.064983 10006 raft_consensus.cc:740] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.065594 10006 consensus_queue.cc:260] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.066769 10004 raft_consensus.cc:359] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.067386 10004 raft_consensus.cc:385] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.067621 10004 raft_consensus.cc:740] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.069047 10004 consensus_queue.cc:260] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.070502 10005 raft_consensus.cc:359] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.070996 10004 ts_tablet_manager.cc:1434] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:25:46.071198 10005 raft_consensus.cc:385] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.071571 10005 raft_consensus.cc:740] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.071883 10004 tablet_bootstrap.cc:492] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:46.072431 10005 consensus_queue.cc:260] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.075035 10005 ts_tablet_manager.cc:1434] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:25:46.077572 10004 tablet_bootstrap.cc:654] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:46.079763 10306 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.080483 10042 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.080229 10306 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.080984 10005 tablet_bootstrap.cc:492] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:46.080936 10042 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.082239 10306 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:46.082819 10042 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:46.084342  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:46.086238  9959 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:46.086427 10306 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:46.087873 10005 tablet_bootstrap.cc:654] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:46.084697  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:46.091027 10310 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.084976  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:46.091576 10310 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.093575 10310 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:46.094693  9853 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:46.096321  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:46.097205 10320 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:46.098963  9927 leader_election.cc:343] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:46.099090  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:46.099472  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:46.099798  9959 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:46.095438 10310 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:46.101493 10310 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.101830 10310 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:46.106575  9853 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:46.107538 10306 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:25:46.107738  9853 leader_election.cc:343] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:46.107924 10306 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.108372 10306 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:46.109200  9853 leader_election.cc:343] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:46.090953  9883 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:46.111231  9928 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:46.112227 10320 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:46.112583 10320 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.112910 10320 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:46.117405 10306 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.127076 10310 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.129092 10310 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:46.067939 10006 ts_tablet_manager.cc:1434] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:25:46.129755 10320 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.131368 10269 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:46.132346  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:46.133067 10006 tablet_bootstrap.cc:492] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195: Bootstrap starting.
W20260709 12:25:46.133602  9927 leader_election.cc:343] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:46.133646  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:46.135681 10320 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:46.135787 10306 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:46.136806  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:46.137540  9883 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:46.138816  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:25:46.141367  9853 leader_election.cc:343] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:46.141925  9853 leader_election.cc:343] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:46.146872  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:46.147430  9959 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:46.164640  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:46.166445  9962 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:46.168977  9959 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:46.174646  9853 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:46.177666 10306 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:46.179263 10306 raft_consensus.cc:697] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:46.183135 10306 consensus_queue.cc:237] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.184748  9962 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:46.185334  9883 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:46.192893 10133 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.193378 10133 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.192725  9853 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:46.197177  9928 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:46.201049 10298 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:46.201536 10298 raft_consensus.cc:697] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:46.202323 10298 consensus_queue.cc:237] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.205665 10004 tablet_bootstrap.cc:492] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:46.206799  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:46.206131 10004 ts_tablet_manager.cc:1403] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.134s	user 0.011s	sys 0.006s
I20260709 12:25:46.202996 10287 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:46.199812 10133 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:46.229249 10287 raft_consensus.cc:697] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:46.248275 10006 tablet_bootstrap.cc:654] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:46.248654 10287 consensus_queue.cc:237] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.269819 10005 tablet_bootstrap.cc:492] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:46.270586 10005 ts_tablet_manager.cc:1403] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.190s	user 0.047s	sys 0.068s
I20260709 12:25:46.276521 10004 raft_consensus.cc:359] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.277513 10004 raft_consensus.cc:385] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.277845 10004 raft_consensus.cc:740] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.282811 10004 consensus_queue.cc:260] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.290195 10005 raft_consensus.cc:359] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.290901 10005 raft_consensus.cc:385] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.291167 10005 raft_consensus.cc:740] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.291765 10005 consensus_queue.cc:260] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:46.297899  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 57685.2us
I20260709 12:25:46.313701 10005 ts_tablet_manager.cc:1434] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.003s
I20260709 12:25:46.314872 10005 tablet_bootstrap.cc:492] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:46.318320 10004 ts_tablet_manager.cc:1434] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.106s	user 0.008s	sys 0.000s
I20260709 12:25:46.319590 10004 tablet_bootstrap.cc:492] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:46.282028  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:25:46.335031  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 78818.1us
I20260709 12:25:46.344166 10006 tablet_bootstrap.cc:492] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:46.344581 10006 ts_tablet_manager.cc:1403] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.212s	user 0.013s	sys 0.011s
I20260709 12:25:46.346745 10287 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.352965 10287 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.355316 10287 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:46.361541 10005 tablet_bootstrap.cc:654] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:46.362730 10006 raft_consensus.cc:359] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.363435 10006 raft_consensus.cc:385] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.363709 10006 raft_consensus.cc:740] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.365171 10006 consensus_queue.cc:260] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.367437 10006 ts_tablet_manager.cc:1434] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 12:25:46.368255 10006 tablet_bootstrap.cc:492] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:46.369093 10004 tablet_bootstrap.cc:654] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:46.375047 10006 tablet_bootstrap.cc:654] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:46.384940 10004 tablet_bootstrap.cc:492] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:46.385468 10004 ts_tablet_manager.cc:1403] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.003s
I20260709 12:25:46.387481 10005 tablet_bootstrap.cc:492] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:46.387957 10005 ts_tablet_manager.cc:1403] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.002s
I20260709 12:25:46.389979 10005 raft_consensus.cc:359] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.390693 10005 raft_consensus.cc:385] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.391213 10005 raft_consensus.cc:740] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.391788 10005 consensus_queue.cc:260] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.393499 10005 ts_tablet_manager.cc:1434] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:46.394170 10005 tablet_bootstrap.cc:492] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:46.394644 10006 tablet_bootstrap.cc:492] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:46.395084 10006 ts_tablet_manager.cc:1403] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.007s
I20260709 12:25:46.398113 10006 raft_consensus.cc:359] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.398810 10006 raft_consensus.cc:385] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.399120 10006 raft_consensus.cc:740] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.399922 10005 tablet_bootstrap.cc:654] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:46.399892 10006 consensus_queue.cc:260] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.401983 10006 ts_tablet_manager.cc:1434] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:46.402532 10298 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.402787 10006 tablet_bootstrap.cc:492] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:46.402971 10298 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.407343 10004 raft_consensus.cc:359] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.408195 10004 raft_consensus.cc:385] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.408551 10006 tablet_bootstrap.cc:654] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:46.411942 10005 tablet_bootstrap.cc:492] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:46.412374 10005 ts_tablet_manager.cc:1403] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.007s
I20260709 12:25:46.408524 10004 raft_consensus.cc:740] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.414847 10005 raft_consensus.cc:359] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.415688 10005 raft_consensus.cc:385] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.415961 10005 raft_consensus.cc:740] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.416551 10005 consensus_queue.cc:260] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.418619 10005 ts_tablet_manager.cc:1434] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:25:46.419341 10005 tablet_bootstrap.cc:492] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:46.424247 10404 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.424885 10404 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.424369 10397 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.429656 10397 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.424211 10005 tablet_bootstrap.cc:654] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:46.448544 10404 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:46.453137 10397 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:46.462836 10006 tablet_bootstrap.cc:492] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:46.463397 10006 ts_tablet_manager.cc:1403] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.018s
I20260709 12:25:46.466182  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:46.466674  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:46.466861  9962 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:46.467528  9955 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:46.467952 10006 raft_consensus.cc:359] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.468670 10006 raft_consensus.cc:385] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.468940 10006 raft_consensus.cc:740] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.469972 10006 consensus_queue.cc:260] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.471413 10006 ts_tablet_manager.cc:1434] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
W20260709 12:25:46.471900  9761 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:46.472256 10006 tablet_bootstrap.cc:492] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:46.476037  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:46.476706  9882 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:46.479441  9779 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:25:46.480697 10006 tablet_bootstrap.cc:654] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:46.481093 10133 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:46.493068  9928 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:46.494205 10399 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:46.494706 10399 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.495131 10399 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:46.498557 10006 tablet_bootstrap.cc:492] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:46.498986 10006 ts_tablet_manager.cc:1403] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.002s
I20260709 12:25:46.503242  9812 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:46.503420 10133 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.571091 10133 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.573889 10133 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:46.504278 10286 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.511878  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:46.507558  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:46.582592  9814 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:46.530784  9809 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:46.539388  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:46.591361  9807 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:46.512784 10399 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.598377 10399 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:46.603029  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:46.540508 10298 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:46.500008  9853 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:46.627030  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:46.632658  9882 raft_consensus.cc:2393] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 1: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:25:46.628499  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:46.633841  9815 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:46.561955 10325 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.638593 10325 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.642374 10325 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:46.644575 10042 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:46.649812  9815 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:46.652310 10298 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:46.661505 10298 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.661885 10298 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:46.510335 10006 raft_consensus.cc:359] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.667805 10006 raft_consensus.cc:385] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.668044 10006 raft_consensus.cc:740] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.668558 10006 consensus_queue.cc:260] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.669834 10006 ts_tablet_manager.cc:1434] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.171s	user 0.005s	sys 0.000s
W20260709 12:25:46.652635  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 152720us
I20260709 12:25:46.654227  9713 catalog_manager.cc:5697] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:46.672155  9853 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:46.672842 10269 raft_consensus.cc:2804] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:46.673175 10269 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.654022  9710 catalog_manager.cc:5697] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:46.673619 10269 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:46.674582 10006 tablet_bootstrap.cc:492] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:46.686877 10006 tablet_bootstrap.cc:654] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:46.690258 10298 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.698500 10004 consensus_queue.cc:260] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.699738  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:46.700021  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:46.701511  9778 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:25:46.701930  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:46.703106 10416 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:46.702584 10286 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.706545 10004 ts_tablet_manager.cc:1434] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.321s	user 0.013s	sys 0.000s
I20260709 12:25:46.706667  9813 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 0.
I20260709 12:25:46.707414 10004 tablet_bootstrap.cc:492] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b: Bootstrap starting.
I20260709 12:25:46.711205 10286 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:46.711755 10042 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:46.713389  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:46.714186  9958 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 0.
I20260709 12:25:46.716006  9778 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:46.717103 10286 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:46.717557 10286 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.717979 10286 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:46.721776 10004 tablet_bootstrap.cc:654] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:46.729976  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:46.723753  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:46.743144  9888 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:46.759155 10006 tablet_bootstrap.cc:492] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:46.759809 10006 ts_tablet_manager.cc:1403] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.085s	user 0.010s	sys 0.008s
I20260709 12:25:46.762387 10004 tablet_bootstrap.cc:492] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b: No bootstrap required, opened a new log
I20260709 12:25:46.763242 10004 ts_tablet_manager.cc:1403] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.000s
I20260709 12:25:46.693789 10298 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:46.837495  9815 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:46.846683 10203 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.847592 10203 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:46.852691  9927 consensus_peers.cc:597] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:46.853579  9927 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:46.859227 10006 raft_consensus.cc:359] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.860392 10006 raft_consensus.cc:385] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.860764 10006 raft_consensus.cc:740] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.861545 10006 consensus_queue.cc:260] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.867210  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:46.868566  9813 raft_consensus.cc:2393] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 1: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:25:46.872582 10310 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.873831 10006 ts_tablet_manager.cc:1434] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.114s	user 0.008s	sys 0.004s
I20260709 12:25:46.873342 10310 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.883488 10310 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:46.886950  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:46.887971  9887 raft_consensus.cc:2393] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 1: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:25:46.898532 10325 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.899335 10325 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.900328 10004 raft_consensus.cc:359] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.901077 10004 raft_consensus.cc:385] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:46.901342 10004 raft_consensus.cc:740] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Initialized, Role: FOLLOWER
I20260709 12:25:46.902226 10325 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:46.903718 10203 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:25:46.904405  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 51026.6us
I20260709 12:25:46.906767 10398 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:46.921440 10287 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.922253  9888 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:46.922092 10287 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.941256 10287 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:46.929215 10006 tablet_bootstrap.cc:492] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195: Bootstrap starting.
I20260709 12:25:46.913945 10286 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.947806  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:46.949011  9955 raft_consensus.cc:2393] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 1: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:25:46.771296 10269 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.972193 10287 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.973011 10287 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:46.975730 10287 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:46.977322 10286 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:46.988533  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:46.992949  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:46.901979 10004 consensus_queue.cc:260] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:47.001893  9890 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:47.003427 10006 tablet_bootstrap.cc:654] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.004626  9779 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
W20260709 12:25:47.006533  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 48202.6us
W20260709 12:25:47.011332 10005 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.110s	sys 0.165s
W20260709 12:25:47.011703 10005 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.110s	sys 0.165s
I20260709 12:25:47.013967 10269 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:47.015818 10004 ts_tablet_manager.cc:1434] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b: Time spent starting tablet: real 0.252s	user 0.006s	sys 0.000s
I20260709 12:25:47.027969 10398 raft_consensus.cc:697] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:47.029680 10398 consensus_queue.cc:237] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:47.035470  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 63194.1us
I20260709 12:25:47.046041  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:47.046885  9882 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:47.052664  9928 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:25:47.055240  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 57446.7us
I20260709 12:25:47.056962 10399 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.053475 10005 tablet_bootstrap.cc:492] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
W20260709 12:25:47.054929  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 80341.2us
I20260709 12:25:47.059221 10042 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:47.062758  9928 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:25:47.065443  9853 leader_election.cc:343] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.069742 10287 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.072624  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:47.072568 10287 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:47.070412 10203 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:47.075067 10425 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:47.075304 10203 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:47.075582  9853 leader_election.cc:343] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.078404 10203 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.078464  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:47.076195 10005 ts_tablet_manager.cc:1403] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.657s	user 0.117s	sys 0.168s
I20260709 12:25:47.076433 10287 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:47.088109 10269 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:47.088351  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:47.088114 10399 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:47.094004  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:47.094743  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:47.094604 10005 raft_consensus.cc:359] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:47.095499  9815 raft_consensus.cc:2393] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 1: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:25:47.095547 10005 raft_consensus.cc:385] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.096040 10005 raft_consensus.cc:740] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.095374  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:47.096789 10005 consensus_queue.cc:260] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:47.097365  9887 raft_consensus.cc:2393] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 1: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:25:47.098616 10005 ts_tablet_manager.cc:1434] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.005s
I20260709 12:25:47.098964  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:25:47.099453  9927 leader_election.cc:343] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.099617  9955 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:47.100155  9927 leader_election.cc:343] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.103699 10005 tablet_bootstrap.cc:492] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
W20260709 12:25:47.105038  9927 leader_election.cc:343] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.107353  9955 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:47.108356 10006 tablet_bootstrap.cc:492] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195: No bootstrap required, opened a new log
I20260709 12:25:47.108937 10006 ts_tablet_manager.cc:1403] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195: Time spent bootstrapping tablet: real 0.180s	user 0.018s	sys 0.009s
I20260709 12:25:47.110889  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:47.115803  9813 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.132428  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:47.133608  9882 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:47.138202  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:47.139089  9960 raft_consensus.cc:2393] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 1: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:25:47.141903  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:25:47.142542  9958 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:47.145222  9853 leader_election.cc:343] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.145713  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:25:47.147007 10396 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:47.156913  9928 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:47.160126 10400 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:47.161568  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:47.163573 10427 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:47.163977 10427 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.164314 10427 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.179697  9853 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:25:47.182811  9807 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.186796  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:47.188802 10009 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:25:47.184240 10269 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:47.205961  9779 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:25:47.196678 10203 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:47.224359  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 48358.1us
I20260709 12:25:47.225153  9779 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:25:47.205417 10310 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:25:47.234058 10006 raft_consensus.cc:359] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:47.234947 10006 raft_consensus.cc:385] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.235314 10006 raft_consensus.cc:740] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.241998 10203 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:47.232849 10286 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:25:47.247349  9928 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:47.248840 10006 consensus_queue.cc:260] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:47.252374 10414 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:25:47.252985 10437 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:47.252947 10414 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:47.253423 10437 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.253820 10437 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.246100 10325 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:47.248734 10269 raft_consensus.cc:697] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:47.249418  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:47.265270 10006 ts_tablet_manager.cc:1434] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195: Time spent starting tablet: real 0.156s	user 0.009s	sys 0.000s
I20260709 12:25:47.271137  9883 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.276724 10269 consensus_queue.cc:237] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:47.292430 10414 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:47.293285  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:47.296018 10005 tablet_bootstrap.cc:654] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:47.296339  9958 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:25:47.299564 10427 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:47.305641  9955 raft_consensus.cc:2393] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 1: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:25:47.307726 10427 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:47.308610  9883 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:47.322438  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:47.300385 10437 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:47.331962  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 97669.8us
I20260709 12:25:47.332461  9778 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:25:47.333822 10325 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:25:47.334225  9853 leader_election.cc:343] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.334997 10437 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:25:47.337406  9853 leader_election.cc:343] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.339260 10438 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:47.341930 10438 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:47.347287  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:47.350147  9853 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:47.350914 10438 raft_consensus.cc:2804] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:47.351380 10438 raft_consensus.cc:697] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:25:47.352259 10438 consensus_queue.cc:237] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:47.354678  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:47.365783  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:25:47.372908  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:47.373693  9888 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:47.380441  9927 leader_election.cc:343] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:47.381377  9927 leader_election.cc:343] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.382270  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:47.392494  9883 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.391103  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:25:47.390177  9927 leader_election.cc:343] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.392056  9710 catalog_manager.cc:5697] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:47.399431  9710 catalog_manager.cc:5697] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:47.403861 10005 tablet_bootstrap.cc:492] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:47.404392 10005 ts_tablet_manager.cc:1403] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.303s	user 0.002s	sys 0.011s
I20260709 12:25:47.405776  9888 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:47.416180  9928 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:47.440466  9928 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:47.431265 10437 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:47.463414 10042 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:47.482620 10042 raft_consensus.cc:697] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:47.499200 10437 raft_consensus.cc:697] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:47.500167 10437 consensus_queue.cc:237] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:47.501454 10042 consensus_queue.cc:237] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:47.502846 10446 log.cc:927] Time spent T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 12:25:47.572237  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 44286.6us
I20260709 12:25:47.583077  9883 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:47.583654 10438 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:47.590477 10005 raft_consensus.cc:359] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:47.591408 10005 raft_consensus.cc:385] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:47.591729 10005 raft_consensus.cc:740] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:47.614573 10005 consensus_queue.cc:260] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:47.616778 10005 ts_tablet_manager.cc:1434] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.212s	user 0.008s	sys 0.000s
I20260709 12:25:47.618054 10005 tablet_bootstrap.cc:492] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
W20260709 12:25:47.628098  9911 debug-util.cc:398] Leaking SignalData structure 0x7b080016ce40 after lost signal to thread 8640
W20260709 12:25:47.637079  9911 debug-util.cc:398] Leaking SignalData structure 0x7b08000a0520 after lost signal to thread 9747
W20260709 12:25:47.638847  9911 debug-util.cc:398] Leaking SignalData structure 0x7b0800291080 after lost signal to thread 9839
W20260709 12:25:47.640775  9911 debug-util.cc:398] Leaking SignalData structure 0x7b08001f7d00 after lost signal to thread 9914
I20260709 12:25:47.645488  9928 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:47.646875 10398 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:25:47.649590  9911 debug-util.cc:398] Leaking SignalData structure 0x7b08000fb5a0 after lost signal to thread 9988
I20260709 12:25:47.657542 10398 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:47.694303  9710 catalog_manager.cc:5697] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 0 to 1, leader changed from <none> to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:47.680807 10436 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.705885 10436 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:47.708249 10436 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:47.716312 10398 raft_consensus.cc:697] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:47.718158 10398 consensus_queue.cc:237] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:25:47.721709  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 45196.8us
I20260709 12:25:47.722604  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:25:47.732777  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:47.733480  9886 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 0.
I20260709 12:25:47.737931 10005 tablet_bootstrap.cc:654] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:47.746608  9927 leader_election.cc:343] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:47.737088 10427 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:25:47.774016  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:47.778435 10287 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:47.778872 10287 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.779212 10287 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.849303 10287 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:47.851395 10287 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:25:47.869812 10453 log.cc:927] Time spent T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.099s	user 0.004s	sys 0.004s
I20260709 12:25:47.872299  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:25:47.881068  9927 leader_election.cc:343] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:47.889173 10452 log.cc:927] Time spent T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:25:47.900117  9713 catalog_manager.cc:5697] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
W20260709 12:25:47.913757  9853 consensus_peers.cc:597] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:47.919250 10306 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:47.943475  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:25:47.944083  9885 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:47.947533 10298 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:47.952430  9710 catalog_manager.cc:5697] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:47.954402  9710 catalog_manager.cc:5697] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:47.955964  9710 catalog_manager.cc:5697] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:47.968093 10005 tablet_bootstrap.cc:492] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:47.968618 10005 ts_tablet_manager.cc:1403] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.351s	user 0.013s	sys 0.024s
I20260709 12:25:47.971947 10298 consensus_queue.cc:1048] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:47.983625  9885 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:25:48.009342  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:25:48.010228 10463 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:48.012233 10463 raft_consensus.cc:697] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:25:48.013216 10463 consensus_queue.cc:237] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:48.021152  9814 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:48.024003  9761 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:25:48.036759  9927 consensus_peers.cc:597] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:48.046345 10399 consensus_queue.cc:1048] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:48.050438 10399 consensus_queue.cc:1048] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:48.075881 10005 raft_consensus.cc:359] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:48.085824 10005 raft_consensus.cc:385] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.086248 10005 raft_consensus.cc:740] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.105325 10436 consensus_queue.cc:1048] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:48.162251 10437 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:48.189872 10005 consensus_queue.cc:260] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:48.204196 10005 ts_tablet_manager.cc:1434] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.235s	user 0.010s	sys 0.003s
I20260709 12:25:48.208967  9713 catalog_manager.cc:5697] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 0 to 1, leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:48.211197 10005 tablet_bootstrap.cc:492] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:48.222575 10005 tablet_bootstrap.cc:654] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:48.227195  9927 consensus_peers.cc:597] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:48.237526 10005 tablet_bootstrap.cc:492] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:48.237991 10005 ts_tablet_manager.cc:1403] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.010s
I20260709 12:25:48.240526 10005 raft_consensus.cc:359] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:48.241173 10005 raft_consensus.cc:385] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.241407 10005 raft_consensus.cc:740] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.242033 10005 consensus_queue.cc:260] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:48.243748 10005 ts_tablet_manager.cc:1434] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:25:48.244679 10005 tablet_bootstrap.cc:492] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:48.250329 10005 tablet_bootstrap.cc:654] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.257573 10414 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.258311 10414 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:48.264942  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:48.274328 10414 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:48.277501  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:48.279381  9779 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:25:48.282732 10414 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:48.320286 10005 tablet_bootstrap.cc:492] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:48.320868 10005 ts_tablet_manager.cc:1403] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.076s	user 0.017s	sys 0.045s
I20260709 12:25:48.324191 10005 raft_consensus.cc:359] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:48.324908 10005 raft_consensus.cc:385] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.325176 10005 raft_consensus.cc:740] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.326725 10005 consensus_queue.cc:260] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:48.328974 10005 ts_tablet_manager.cc:1434] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:25:48.337294 10005 tablet_bootstrap.cc:492] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:48.344372 10005 tablet_bootstrap.cc:654] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.395169 10005 tablet_bootstrap.cc:492] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:48.395651 10005 ts_tablet_manager.cc:1403] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.059s	user 0.023s	sys 0.022s
I20260709 12:25:48.398264 10005 raft_consensus.cc:359] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:48.403925 10005 raft_consensus.cc:385] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.404214 10005 raft_consensus.cc:740] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.405000 10005 consensus_queue.cc:260] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:48.407032 10005 ts_tablet_manager.cc:1434] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:25:48.414688 10005 tablet_bootstrap.cc:492] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71: Bootstrap starting.
I20260709 12:25:48.419096  9810 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.420320 10005 tablet_bootstrap.cc:654] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:48.430909 10413 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.431411 10413 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:48.433588 10413 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:48.438014  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:48.448958  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:48.461971  9778 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:25:48.482611 10413 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:48.486490  9811 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:48.499333  9927 consensus_peers.cc:597] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:48.551961  9812 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.565634 10414 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.566215 10414 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:48.569356  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:48.568842 10414 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:48.572028  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:48.573848  9779 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:25:48.575127 10413 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:48.582890 10005 tablet_bootstrap.cc:492] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71: No bootstrap required, opened a new log
I20260709 12:25:48.583317 10005 ts_tablet_manager.cc:1403] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71: Time spent bootstrapping tablet: real 0.169s	user 0.051s	sys 0.087s
I20260709 12:25:48.588167 10005 raft_consensus.cc:359] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:48.588918 10005 raft_consensus.cc:385] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:48.589233 10005 raft_consensus.cc:740] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Initialized, Role: FOLLOWER
I20260709 12:25:48.589865 10005 consensus_queue.cc:260] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:48.591270 10005 ts_tablet_manager.cc:1434] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:25:48.654093 10203 consensus_queue.cc:1048] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:48.761113 10414 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.761670 10414 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:25:48.763897 10414 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:48.764358  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:25:48.765031  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:25:48.766453  9778 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:25:48.767234 10414 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:48.831272  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260709 12:25:48.842555  9811 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:48.853633 10485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:48.860760  8637 server_base.cc:1061] running on GCE node
W20260709 12:25:48.863176 10488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:48.865733 10486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:48.877561  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:48.877830  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:48.878062  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783599948878045 us; error 0 us; skew 500 ppm
I20260709 12:25:48.878799  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:48.882367  8637 webserver.cc:533] Webserver started at http://127.8.111.68:42493/ using document root <none> and password file <none>
I20260709 12:25:48.882957  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:48.883206  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:48.883558  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:48.884902  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-3-root/instance:
uuid: "f5208640a51f493e930ce4f64ceeed0b"
format_stamp: "Formatted at 2026-07-09 12:25:48 on dist-test-slave-044g"
I20260709 12:25:48.887017  9811 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:48.899227  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.014s	user 0.005s	sys 0.009s
I20260709 12:25:48.911119 10495 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:48.912240  8637 fs_manager.cc:730] Time spent opening block manager: real 0.009s	user 0.001s	sys 0.006s
I20260709 12:25:48.912582  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-3-root
uuid: "f5208640a51f493e930ce4f64ceeed0b"
format_stamp: "Formatted at 2026-07-09 12:25:48 on dist-test-slave-044g"
I20260709 12:25:48.912943  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:48.955104  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:48.956525  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:48.958252  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:48.961549  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:48.961810  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:48.962198  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:48.962455  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:49.201865  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.68:37417
I20260709 12:25:49.202260 10557 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.68:37417 every 8 connection(s)
I20260709 12:25:49.236864  8637 auto_leader_rebalancer-test.cc:439] add a tserver: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:25:49.251744 10558 heartbeater.cc:344] Connected to a master server at 127.8.111.126:43135
I20260709 12:25:49.252123 10558 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:49.252825 10558 heartbeater.cc:507] Master 127.8.111.126:43135 requested a full tablet report, sending...
I20260709 12:25:49.255224  9713 ts_manager.cc:194] Registered new tserver with Master: f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:25:49.257243  9713 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56416
I20260709 12:25:50.249576  9957 consensus_queue.cc:237] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:50.257686  9809 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:50.261631 10558 heartbeater.cc:499] Master 127.8.111.126:43135 was elected leader, sending a full tablet report...
I20260709 12:25:50.282928  9886 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:50.284170 10399 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:50.289119 10437 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:50.329939 10203 raft_consensus.cc:2955] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:50.331797  9811 raft_consensus.cc:2955] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:50.349660  9713 catalog_manager.cc:5697] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.433039  9886 raft_consensus.cc:2955] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
W20260709 12:25:50.476610  9928 consensus_peers.cc:597] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4af4b34b71b641009c828e29f2c4cc41. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:50.480341  9886 consensus_queue.cc:237] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:50.524253  9811 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:50.525960  9957 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:50.527506 10310 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:50.535499 10465 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:25:50.554304  9854 consensus_peers.cc:597] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 052aa541571c4bea87eeb1ed2f45a1bf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:50.553200 10579 raft_consensus.cc:2955] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:50.560134  9811 raft_consensus.cc:2955] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:50.572072  9886 consensus_queue.cc:237] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
W20260709 12:25:50.589313  9854 consensus_peers.cc:597] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 02b16516f13c42bfae1f9f2e877ee307. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:50.592800  9712 catalog_manager.cc:5697] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:50.595341  9955 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:50.593555  9811 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:50.600788 10310 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:50.603323 10576 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:50.634629  9955 raft_consensus.cc:2955] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:50.645202 10310 raft_consensus.cc:2955] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:50.648815  9811 raft_consensus.cc:2955] T 02b16516f13c42bfae1f9f2e877ee307 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:50.650406  9957 raft_consensus.cc:2955] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:50.661005  9886 consensus_queue.cc:237] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:50.677515  9712 catalog_manager.cc:5697] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:50.683671  9854 consensus_peers.cc:597] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 27036dabafd8427cac190478948639ae. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:50.690445  9955 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:50.690899  9811 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:50.691946 10310 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:50.694692 10310 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:50.710317 10579 raft_consensus.cc:2955] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:50.713002  9955 raft_consensus.cc:2955] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:50.723997  9811 raft_consensus.cc:2955] T 27036dabafd8427cac190478948639ae P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:50.733940  9712 catalog_manager.cc:5697] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:50.831216 10587 ts_tablet_manager.cc:933] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:50.834381 10587 tablet_copy_client.cc:323] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.67:42253
I20260709 12:25:50.870846  9974 tablet_copy_service.cc:140] P b011791796d1457284b857d7d3422195: Received BeginTabletCopySession request for tablet 4af4b34b71b641009c828e29f2c4cc41 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:48438)
I20260709 12:25:50.871486  9974 tablet_copy_service.cc:161] P b011791796d1457284b857d7d3422195: Beginning new tablet copy session on tablet 4af4b34b71b641009c828e29f2c4cc41 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:48438: session id = f5208640a51f493e930ce4f64ceeed0b-4af4b34b71b641009c828e29f2c4cc41
I20260709 12:25:50.885841  9974 tablet_copy_source_session.cc:215] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:50.890072 10587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af4b34b71b641009c828e29f2c4cc41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:50.911202 10587 tablet_copy_client.cc:806] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:50.911957 10587 tablet_copy_client.cc:670] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:50.918491 10587 tablet_copy_client.cc:538] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:50.928579 10587 tablet_bootstrap.cc:492] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:25:50.959393 10587 tablet_bootstrap.cc:492] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:50.960558 10587 tablet_bootstrap.cc:492] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:25:50.961333 10587 ts_tablet_manager.cc:1403] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.012s
I20260709 12:25:50.964706 10587 raft_consensus.cc:359] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:50.965718 10587 raft_consensus.cc:740] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:25:50.966499 10587 consensus_queue.cc:260] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:50.975661 10587 ts_tablet_manager.cc:1434] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.008s
I20260709 12:25:50.986092  9974 tablet_copy_service.cc:342] P b011791796d1457284b857d7d3422195: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-4af4b34b71b641009c828e29f2c4cc41 received from {username='slave'} at 127.0.0.1:48438
I20260709 12:25:50.986660  9974 tablet_copy_service.cc:434] P b011791796d1457284b857d7d3422195: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-4af4b34b71b641009c828e29f2c4cc41 on tablet 4af4b34b71b641009c828e29f2c4cc41 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:25:51.017182 10587 ts_tablet_manager.cc:933] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:51.018898 10587 tablet_copy_client.cc:323] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.66:34205
I20260709 12:25:51.043437  9900 tablet_copy_service.cc:140] P 963185e117384b2085d7cea02a64478b: Received BeginTabletCopySession request for tablet 052aa541571c4bea87eeb1ed2f45a1bf from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:54428)
I20260709 12:25:51.044029  9900 tablet_copy_service.cc:161] P 963185e117384b2085d7cea02a64478b: Beginning new tablet copy session on tablet 052aa541571c4bea87eeb1ed2f45a1bf from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:54428: session id = f5208640a51f493e930ce4f64ceeed0b-052aa541571c4bea87eeb1ed2f45a1bf
I20260709 12:25:51.051242  9900 tablet_copy_source_session.cc:215] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:51.055076 10587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 052aa541571c4bea87eeb1ed2f45a1bf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:51.174181  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 72294.4us
I20260709 12:25:51.199194 10595 ts_tablet_manager.cc:933] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:51.200240 10587 tablet_copy_client.cc:806] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:51.201040 10587 tablet_copy_client.cc:670] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:51.237583 10595 tablet_copy_client.cc:323] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.66:34205
I20260709 12:25:51.244239 10587 tablet_copy_client.cc:538] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:51.251497  9900 tablet_copy_service.cc:140] P 963185e117384b2085d7cea02a64478b: Received BeginTabletCopySession request for tablet 02b16516f13c42bfae1f9f2e877ee307 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:54428)
I20260709 12:25:51.252084  9900 tablet_copy_service.cc:161] P 963185e117384b2085d7cea02a64478b: Beginning new tablet copy session on tablet 02b16516f13c42bfae1f9f2e877ee307 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:54428: session id = f5208640a51f493e930ce4f64ceeed0b-02b16516f13c42bfae1f9f2e877ee307
I20260709 12:25:51.252394 10600 ts_tablet_manager.cc:933] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:51.259281  9900 tablet_copy_source_session.cc:215] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:51.266180 10587 tablet_bootstrap.cc:492] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
W20260709 12:25:51.266850  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 47288.9us
I20260709 12:25:51.264022 10595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b16516f13c42bfae1f9f2e877ee307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.287155 10600 tablet_copy_client.cc:323] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.66:34205
I20260709 12:25:51.288980  9900 tablet_copy_service.cc:140] P 963185e117384b2085d7cea02a64478b: Received BeginTabletCopySession request for tablet 27036dabafd8427cac190478948639ae from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:54428)
I20260709 12:25:51.289498  9900 tablet_copy_service.cc:161] P 963185e117384b2085d7cea02a64478b: Beginning new tablet copy session on tablet 27036dabafd8427cac190478948639ae from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:54428: session id = f5208640a51f493e930ce4f64ceeed0b-27036dabafd8427cac190478948639ae
I20260709 12:25:51.296864  9900 tablet_copy_source_session.cc:215] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:51.300144 10600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27036dabafd8427cac190478948639ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:51.323843 10600 tablet_copy_client.cc:806] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:51.324412 10600 tablet_copy_client.cc:670] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:51.326028 10595 tablet_copy_client.cc:806] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:51.331867 10533 raft_consensus.cc:1217] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:25:51.339407 10595 tablet_copy_client.cc:670] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:51.348488 10595 tablet_copy_client.cc:538] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:51.334089 10587 tablet_bootstrap.cc:492] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:51.351238 10587 tablet_bootstrap.cc:492] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:25:51.351977 10587 ts_tablet_manager.cc:1403] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.010s
I20260709 12:25:51.357268 10595 tablet_bootstrap.cc:492] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:25:51.357972 10600 tablet_copy_client.cc:538] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:51.359002 10587 raft_consensus.cc:359] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:51.361150 10587 raft_consensus.cc:740] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:25:51.361838 10587 consensus_queue.cc:260] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:51.370930 10587 ts_tablet_manager.cc:1434] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 12:25:51.373678 10600 tablet_bootstrap.cc:492] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:25:51.376834  9899 tablet_copy_service.cc:342] P 963185e117384b2085d7cea02a64478b: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-052aa541571c4bea87eeb1ed2f45a1bf received from {username='slave'} at 127.0.0.1:54428
I20260709 12:25:51.377394  9899 tablet_copy_service.cc:434] P 963185e117384b2085d7cea02a64478b: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-052aa541571c4bea87eeb1ed2f45a1bf on tablet 052aa541571c4bea87eeb1ed2f45a1bf with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:25:51.419356 10595 tablet_bootstrap.cc:492] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:51.420531 10595 tablet_bootstrap.cc:492] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:25:51.421346 10595 ts_tablet_manager.cc:1403] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.064s	user 0.022s	sys 0.004s
I20260709 12:25:51.424701 10595 raft_consensus.cc:359] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:51.425634 10595 raft_consensus.cc:740] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:25:51.426383 10595 consensus_queue.cc:260] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:51.436721 10600 tablet_bootstrap.cc:492] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:51.437707 10600 tablet_bootstrap.cc:492] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:25:51.438472 10600 ts_tablet_manager.cc:1403] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.009s
I20260709 12:25:51.442381 10595 ts_tablet_manager.cc:1434] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:25:51.443434 10600 raft_consensus.cc:359] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:51.451617 10600 raft_consensus.cc:740] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:25:51.454295 10600 consensus_queue.cc:260] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:51.460410  9899 tablet_copy_service.cc:342] P 963185e117384b2085d7cea02a64478b: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-02b16516f13c42bfae1f9f2e877ee307 received from {username='slave'} at 127.0.0.1:54428
I20260709 12:25:51.460856  9899 tablet_copy_service.cc:434] P 963185e117384b2085d7cea02a64478b: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-02b16516f13c42bfae1f9f2e877ee307 on tablet 02b16516f13c42bfae1f9f2e877ee307 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:25:51.463896 10600 ts_tablet_manager.cc:1434] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 12:25:51.477895  9899 tablet_copy_service.cc:342] P 963185e117384b2085d7cea02a64478b: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-27036dabafd8427cac190478948639ae received from {username='slave'} at 127.0.0.1:54428
I20260709 12:25:51.478412  9899 tablet_copy_service.cc:434] P 963185e117384b2085d7cea02a64478b: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-27036dabafd8427cac190478948639ae on tablet 27036dabafd8427cac190478948639ae with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:25:51.512836 10533 raft_consensus.cc:1217] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:25:51.543809 10533 raft_consensus.cc:1217] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:25:51.766731 10533 raft_consensus.cc:1217] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:25:51.808146 10203 raft_consensus.cc:1064] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:25:51.811450 10203 consensus_queue.cc:237] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:51.837872 10533 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:51.839458  9886 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:51.839965  9809 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:51.842264 10399 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:51.847800 10437 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:51.859706 10399 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:51.885183 10606 raft_consensus.cc:2955] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:51.888343  9886 raft_consensus.cc:2955] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:51.895292 10533 raft_consensus.cc:2955] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:51.905622  9809 raft_consensus.cc:2955] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:51.916342  9710 catalog_manager.cc:5697] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:51.980752  9956 consensus_queue.cc:237] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:51.991418  9809 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:51.992125 10533 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:51.993012 10606 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:51.993882 10608 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:52.002839 10399 raft_consensus.cc:2955] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.005005  9809 raft_consensus.cc:2955] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.012202 10533 raft_consensus.cc:2955] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.021723  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4af4b34b71b641009c828e29f2c4cc41 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:52.037503  9711 catalog_manager.cc:5697] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:52.070765 10596 raft_consensus.cc:1064] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:25:52.073342 10596 consensus_queue.cc:237] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:52.098266 10533 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:52.098649  9956 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:52.100504 10579 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:52.105695 10579 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:52.105791  9871 tablet_service.cc:1558] Processing DeleteTablet for tablet 4af4b34b71b641009c828e29f2c4cc41 with delete_type TABLET_DATA_TOMBSTONED (TS 963185e117384b2085d7cea02a64478b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57650
I20260709 12:25:52.115423  9814 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:52.124436 10579 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:52.127370 10617 tablet_replica.cc:333] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:25:52.128368 10617 raft_consensus.cc:2243] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.129048 10617 raft_consensus.cc:2272] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.141269 10617 ts_tablet_manager.cc:1916] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:52.140697 10597 raft_consensus.cc:2955] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.150107  9956 raft_consensus.cc:2955] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.166291 10596 raft_consensus.cc:1064] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:25:52.175469  9814 raft_consensus.cc:2955] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.175644 10533 raft_consensus.cc:2955] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.169597 10596 consensus_queue.cc:237] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:52.180348  9713 catalog_manager.cc:5697] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.190008 10617 ts_tablet_manager.cc:1929] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:25:52.193238 10617 log.cc:1199] T 4af4b34b71b641009c828e29f2c4cc41 P 963185e117384b2085d7cea02a64478b: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-1-root/wals/4af4b34b71b641009c828e29f2c4cc41
I20260709 12:25:52.211755  9886 consensus_queue.cc:237] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:52.220438  9809 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:52.223572 10576 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:52.224941  9698 catalog_manager.cc:5028] TS 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): tablet 4af4b34b71b641009c828e29f2c4cc41 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:25:52.229409 10531 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:52.230719 10579 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:52.232574 10532 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:52.236065 10597 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:52.255766 10598 raft_consensus.cc:2955] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.259764 10533 raft_consensus.cc:2955] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.270855  9955 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:52.271618  9811 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:52.282332 10576 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:52.284107  9698 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 052aa541571c4bea87eeb1ed2f45a1bf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:52.298053  9712 catalog_manager.cc:5697] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:52.299482 10624 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:25:52.307047  9811 raft_consensus.cc:2955] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.332917  9951 tablet_service.cc:1558] Processing DeleteTablet for tablet 052aa541571c4bea87eeb1ed2f45a1bf with delete_type TABLET_DATA_TOMBSTONED (TS b011791796d1457284b857d7d3422195 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55938
I20260709 12:25:52.358124 10624 raft_consensus.cc:2955] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.366124  9811 raft_consensus.cc:2955] T 02b16516f13c42bfae1f9f2e877ee307 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.369112 10628 tablet_replica.cc:333] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:25:52.369997  9956 raft_consensus.cc:2955] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.387692 10533 raft_consensus.cc:2955] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.407385  9712 catalog_manager.cc:5697] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:52.392179 10597 raft_consensus.cc:1064] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:25:52.422797 10597 consensus_queue.cc:237] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:52.438194  9888 consensus_queue.cc:237] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:52.446631  9957 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:52.448592 10624 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:52.451539 10533 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:52.454980 10598 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:52.457399 10576 raft_consensus.cc:2955] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.464562 10531 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:52.464136  9957 raft_consensus.cc:2955] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.466244 10622 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:52.475178 10532 raft_consensus.cc:2955] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.481617  9698 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 02b16516f13c42bfae1f9f2e877ee307 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:52.492551  9713 catalog_manager.cc:5697] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.497460  9814 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:52.503070  9957 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:52.503918 10579 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:52.517206 10596 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:52.520017  9802 tablet_service.cc:1558] Processing DeleteTablet for tablet 02b16516f13c42bfae1f9f2e877ee307 with delete_type TABLET_DATA_TOMBSTONED (TS 4104e34a61b7448281d6d91ce23ebf71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46484
I20260709 12:25:52.524027 10628 raft_consensus.cc:2243] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.524796 10628 raft_consensus.cc:2272] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.532995 10631 tablet_replica.cc:333] T 02b16516f13c42bfae1f9f2e877ee307 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:25:52.533998 10631 raft_consensus.cc:2243] T 02b16516f13c42bfae1f9f2e877ee307 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.544179 10596 raft_consensus.cc:2955] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.549549 10628 ts_tablet_manager.cc:1916] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:52.561766 10631 raft_consensus.cc:2272] T 02b16516f13c42bfae1f9f2e877ee307 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.570371  9814 raft_consensus.cc:2955] T 27036dabafd8427cac190478948639ae P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.588985 10631 ts_tablet_manager.cc:1916] T 02b16516f13c42bfae1f9f2e877ee307 P 4104e34a61b7448281d6d91ce23ebf71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:52.588186 10532 raft_consensus.cc:2955] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.613353  9711 catalog_manager.cc:5697] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.651156 10628 ts_tablet_manager.cc:1929] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:25:52.655128  9888 consensus_queue.cc:237] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:52.658535 10631 ts_tablet_manager.cc:1929] T 02b16516f13c42bfae1f9f2e877ee307 P 4104e34a61b7448281d6d91ce23ebf71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:25:52.658994 10631 log.cc:1199] T 02b16516f13c42bfae1f9f2e877ee307 P 4104e34a61b7448281d6d91ce23ebf71: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-0-root/wals/02b16516f13c42bfae1f9f2e877ee307
I20260709 12:25:52.661403 10532 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:52.651662 10628 log.cc:1199] T 052aa541571c4bea87eeb1ed2f45a1bf P b011791796d1457284b857d7d3422195: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-2-root/wals/052aa541571c4bea87eeb1ed2f45a1bf
I20260709 12:25:52.663282 10598 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:52.664331  9697 catalog_manager.cc:5028] TS b011791796d1457284b857d7d3422195 (127.8.111.67:42253): tablet 052aa541571c4bea87eeb1ed2f45a1bf (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:25:52.665134  9697 catalog_manager.cc:5028] TS 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): tablet 02b16516f13c42bfae1f9f2e877ee307 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:25:52.670794 10579 raft_consensus.cc:2955] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.682878 10532 raft_consensus.cc:2955] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.698925  9698 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 27036dabafd8427cac190478948639ae with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:52.698851  9957 raft_consensus.cc:2955] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.701900  9713 catalog_manager.cc:5697] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.714946  9802 tablet_service.cc:1558] Processing DeleteTablet for tablet 27036dabafd8427cac190478948639ae with delete_type TABLET_DATA_TOMBSTONED (TS 4104e34a61b7448281d6d91ce23ebf71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46484
I20260709 12:25:52.716261 10631 tablet_replica.cc:333] T 27036dabafd8427cac190478948639ae P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:25:52.717398 10631 raft_consensus.cc:2243] T 27036dabafd8427cac190478948639ae P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.718171 10631 raft_consensus.cc:2272] T 27036dabafd8427cac190478948639ae P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.724699  9955 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:52.727741 10579 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:52.728873 10631 ts_tablet_manager.cc:1916] T 27036dabafd8427cac190478948639ae P 4104e34a61b7448281d6d91ce23ebf71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:52.734395  9955 raft_consensus.cc:2955] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:52.749877 10631 ts_tablet_manager.cc:1929] T 27036dabafd8427cac190478948639ae P 4104e34a61b7448281d6d91ce23ebf71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:25:52.750341 10631 log.cc:1199] T 27036dabafd8427cac190478948639ae P 4104e34a61b7448281d6d91ce23ebf71: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-0-root/wals/27036dabafd8427cac190478948639ae
I20260709 12:25:52.751971  9697 catalog_manager.cc:5028] TS 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): tablet 27036dabafd8427cac190478948639ae (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:25:53.804315  9888 consensus_queue.cc:237] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:53.812175  9955 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:53.813017  9809 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:25:53.813787  9854 consensus_peers.cc:597] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab78f05fa6f4406a81716ded4d302aee. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:53.815238 10622 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:53.816200 10598 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:53.824178 10579 raft_consensus.cc:2955] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:53.827160  9809 raft_consensus.cc:2955] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:53.827852  9955 raft_consensus.cc:2955] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:53.853552  9711 catalog_manager.cc:5697] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:53.913592  9814 consensus_queue.cc:237] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:53.927335  9955 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:53.929032 10627 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:53.932948  9888 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:53.934495 10627 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:53.953786 10634 raft_consensus.cc:2955] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
W20260709 12:25:53.957314  9779 consensus_peers.cc:597] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 563b5b4a0da24676a96f01291cf312c7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:53.966543  9957 raft_consensus.cc:2955] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:53.988394  9814 consensus_queue.cc:237] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:53.991050  9886 raft_consensus.cc:2955] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:54.012943  9713 catalog_manager.cc:5697] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
W20260709 12:25:54.080667  9779 consensus_peers.cc:597] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6bd0e88f609e4c15aadc811cb9ecf5a9. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:54.081533  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 52482.6us
I20260709 12:25:54.085551  9957 raft_consensus.cc:1275] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:54.086843 10627 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:54.101205  9886 raft_consensus.cc:1275] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:54.101375 10627 raft_consensus.cc:2955] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:54.106612 10650 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:54.133421  9956 raft_consensus.cc:2955] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:54.141443  9955 consensus_queue.cc:237] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:54.153852  9711 catalog_manager.cc:5697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:54.184149  9928 consensus_peers.cc:597] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c1c0ea749e8a45d4935db42359f9df11. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:54.189348  9888 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:54.191468 10656 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:54.192446  9886 raft_consensus.cc:2955] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:54.194640  9812 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:54.196501 10655 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:54.226526 10659 raft_consensus.cc:2955] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:54.233830  9886 raft_consensus.cc:2955] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:54.265172  9712 catalog_manager.cc:5697] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:54.278858  9810 raft_consensus.cc:2955] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:54.330117 10664 ts_tablet_manager.cc:933] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:54.336870 10664 tablet_copy_client.cc:323] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.66:34205
I20260709 12:25:54.338481  9899 tablet_copy_service.cc:140] P 963185e117384b2085d7cea02a64478b: Received BeginTabletCopySession request for tablet ab78f05fa6f4406a81716ded4d302aee from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:54428)
I20260709 12:25:54.338965  9899 tablet_copy_service.cc:161] P 963185e117384b2085d7cea02a64478b: Beginning new tablet copy session on tablet ab78f05fa6f4406a81716ded4d302aee from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:54428: session id = f5208640a51f493e930ce4f64ceeed0b-ab78f05fa6f4406a81716ded4d302aee
I20260709 12:25:54.347081  9899 tablet_copy_source_session.cc:215] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:54.351055 10664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab78f05fa6f4406a81716ded4d302aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.368460 10664 tablet_copy_client.cc:806] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:54.369246 10664 tablet_copy_client.cc:670] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:54.372685 10664 tablet_copy_client.cc:538] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:54.380810 10664 tablet_bootstrap.cc:492] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:25:54.485481 10667 ts_tablet_manager.cc:933] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:25:54.515916 10667 tablet_copy_client.cc:323] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.65:38995
I20260709 12:25:54.528743 10664 tablet_bootstrap.cc:492] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:54.529861 10664 tablet_bootstrap.cc:492] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:25:54.530805 10664 ts_tablet_manager.cc:1403] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.150s	user 0.034s	sys 0.022s
I20260709 12:25:54.540105 10664 raft_consensus.cc:359] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:54.541054 10664 raft_consensus.cc:740] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:25:54.541997 10664 consensus_queue.cc:260] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:54.544684  9825 tablet_copy_service.cc:140] P 4104e34a61b7448281d6d91ce23ebf71: Received BeginTabletCopySession request for tablet 563b5b4a0da24676a96f01291cf312c7 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:34802)
I20260709 12:25:54.545480  9825 tablet_copy_service.cc:161] P 4104e34a61b7448281d6d91ce23ebf71: Beginning new tablet copy session on tablet 563b5b4a0da24676a96f01291cf312c7 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:34802: session id = f5208640a51f493e930ce4f64ceeed0b-563b5b4a0da24676a96f01291cf312c7
I20260709 12:25:54.560204  9825 tablet_copy_source_session.cc:215] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:54.565021 10667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563b5b4a0da24676a96f01291cf312c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.566174 10664 ts_tablet_manager.cc:1434] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.013s
I20260709 12:25:54.569804  9899 tablet_copy_service.cc:342] P 963185e117384b2085d7cea02a64478b: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-ab78f05fa6f4406a81716ded4d302aee received from {username='slave'} at 127.0.0.1:54428
I20260709 12:25:54.570225  9899 tablet_copy_service.cc:434] P 963185e117384b2085d7cea02a64478b: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-ab78f05fa6f4406a81716ded4d302aee on tablet ab78f05fa6f4406a81716ded4d302aee with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:25:54.581336 10667 tablet_copy_client.cc:806] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:54.581982 10667 tablet_copy_client.cc:670] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:54.585659 10667 tablet_copy_client.cc:538] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:54.595491 10667 tablet_bootstrap.cc:492] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:25:54.625447 10667 tablet_bootstrap.cc:492] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:54.626585 10667 tablet_bootstrap.cc:492] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:25:54.627319 10667 ts_tablet_manager.cc:1403] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.032s	user 0.023s	sys 0.004s
I20260709 12:25:54.628458 10664 ts_tablet_manager.cc:933] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:54.630883 10667 raft_consensus.cc:359] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:54.631893 10667 raft_consensus.cc:740] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:25:54.632592 10667 consensus_queue.cc:260] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:54.635455 10667 ts_tablet_manager.cc:1434] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:25:54.637848  9825 tablet_copy_service.cc:342] P 4104e34a61b7448281d6d91ce23ebf71: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-563b5b4a0da24676a96f01291cf312c7 received from {username='slave'} at 127.0.0.1:34802
I20260709 12:25:54.638500  9825 tablet_copy_service.cc:434] P 4104e34a61b7448281d6d91ce23ebf71: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-563b5b4a0da24676a96f01291cf312c7 on tablet 563b5b4a0da24676a96f01291cf312c7 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:25:54.641129 10664 tablet_copy_client.cc:323] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.67:42253
I20260709 12:25:54.643340  9974 tablet_copy_service.cc:140] P b011791796d1457284b857d7d3422195: Received BeginTabletCopySession request for tablet c1c0ea749e8a45d4935db42359f9df11 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:48438)
I20260709 12:25:54.643959  9974 tablet_copy_service.cc:161] P b011791796d1457284b857d7d3422195: Beginning new tablet copy session on tablet c1c0ea749e8a45d4935db42359f9df11 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:48438: session id = f5208640a51f493e930ce4f64ceeed0b-c1c0ea749e8a45d4935db42359f9df11
I20260709 12:25:54.652136  9974 tablet_copy_source_session.cc:215] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:54.686005 10664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1c0ea749e8a45d4935db42359f9df11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.687119 10667 ts_tablet_manager.cc:933] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:25:54.697250 10667 tablet_copy_client.cc:323] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.65:38995
I20260709 12:25:54.699138  9825 tablet_copy_service.cc:140] P 4104e34a61b7448281d6d91ce23ebf71: Received BeginTabletCopySession request for tablet 6bd0e88f609e4c15aadc811cb9ecf5a9 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:34802)
I20260709 12:25:54.699661  9825 tablet_copy_service.cc:161] P 4104e34a61b7448281d6d91ce23ebf71: Beginning new tablet copy session on tablet 6bd0e88f609e4c15aadc811cb9ecf5a9 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:34802: session id = f5208640a51f493e930ce4f64ceeed0b-6bd0e88f609e4c15aadc811cb9ecf5a9
I20260709 12:25:54.705931 10664 tablet_copy_client.cc:806] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:54.706548 10664 tablet_copy_client.cc:670] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:54.709759  9825 tablet_copy_source_session.cc:215] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:54.710707 10664 tablet_copy_client.cc:538] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:54.713243 10667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bd0e88f609e4c15aadc811cb9ecf5a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.722455 10664 tablet_bootstrap.cc:492] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:25:54.725353 10532 raft_consensus.cc:1217] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:25:54.750949 10667 tablet_copy_client.cc:806] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:54.760095 10667 tablet_copy_client.cc:670] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:54.763751 10667 tablet_copy_client.cc:538] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:54.773597 10667 tablet_bootstrap.cc:492] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:25:54.823988 10664 tablet_bootstrap.cc:492] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:54.824159 10667 tablet_bootstrap.cc:492] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:54.825063 10664 tablet_bootstrap.cc:492] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:25:54.826627 10667 tablet_bootstrap.cc:492] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:25:54.827366 10667 ts_tablet_manager.cc:1403] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.011s
I20260709 12:25:54.825871 10664 ts_tablet_manager.cc:1403] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.104s	user 0.029s	sys 0.006s
I20260709 12:25:54.831284 10667 raft_consensus.cc:359] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:54.832397 10667 raft_consensus.cc:740] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:25:54.832986 10664 raft_consensus.cc:359] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:54.833073 10667 consensus_queue.cc:260] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:54.834084 10664 raft_consensus.cc:740] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:25:54.834830 10664 consensus_queue.cc:260] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:54.836783 10664 ts_tablet_manager.cc:1434] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:54.836863 10667 ts_tablet_manager.cc:1434] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:25:54.838814  9974 tablet_copy_service.cc:342] P b011791796d1457284b857d7d3422195: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-c1c0ea749e8a45d4935db42359f9df11 received from {username='slave'} at 127.0.0.1:48438
I20260709 12:25:54.839263  9974 tablet_copy_service.cc:434] P b011791796d1457284b857d7d3422195: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-c1c0ea749e8a45d4935db42359f9df11 on tablet c1c0ea749e8a45d4935db42359f9df11 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:25:54.838829  9825 tablet_copy_service.cc:342] P 4104e34a61b7448281d6d91ce23ebf71: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-6bd0e88f609e4c15aadc811cb9ecf5a9 received from {username='slave'} at 127.0.0.1:34802
I20260709 12:25:54.841656  9825 tablet_copy_service.cc:434] P 4104e34a61b7448281d6d91ce23ebf71: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-6bd0e88f609e4c15aadc811cb9ecf5a9 on tablet 6bd0e88f609e4c15aadc811cb9ecf5a9 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:25:54.882853 10532 raft_consensus.cc:1217] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:25:55.025936 10532 raft_consensus.cc:1217] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:25:55.114248 10532 raft_consensus.cc:1217] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:25:55.128614 10653 raft_consensus.cc:1064] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:25:55.137496 10653 consensus_queue.cc:237] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:55.152981 10532 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:55.155073  9814 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:55.155124 10653 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:55.156301  9957 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:55.157706 10598 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:55.161966 10654 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:55.207127 10653 raft_consensus.cc:2955] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.220701  9810 raft_consensus.cc:2955] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.242825 10532 raft_consensus.cc:2955] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.262267  9711 catalog_manager.cc:5697] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.297652  9957 raft_consensus.cc:2955] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.357554  9888 consensus_queue.cc:237] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:55.370805 10532 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:55.372270  9810 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:55.373767 10654 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:55.375435 10682 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:55.389231 10532 raft_consensus.cc:2955] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.390230 10654 raft_consensus.cc:2955] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.393260  9814 raft_consensus.cc:2955] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.403623  9698 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ab78f05fa6f4406a81716ded4d302aee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:55.409898  9713 catalog_manager.cc:5697] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.413386 10650 raft_consensus.cc:1064] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:25:55.416548 10650 consensus_queue.cc:237] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:55.425017  9951 tablet_service.cc:1558] Processing DeleteTablet for tablet ab78f05fa6f4406a81716ded4d302aee with delete_type TABLET_DATA_TOMBSTONED (TS b011791796d1457284b857d7d3422195 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55938
I20260709 12:25:55.429857 10687 tablet_replica.cc:333] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:25:55.432849 10532 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:55.434155 10687 raft_consensus.cc:2243] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.437433 10651 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:55.437793 10687 raft_consensus.cc:2272] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.444368  9886 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:55.445958  9957 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:55.450242 10627 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:55.454959 10627 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:55.457973 10687 ts_tablet_manager.cc:1916] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:55.483194 10651 raft_consensus.cc:2955] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.489555 10687 ts_tablet_manager.cc:1929] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:25:55.490100 10687 log.cc:1199] T ab78f05fa6f4406a81716ded4d302aee P b011791796d1457284b857d7d3422195: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-2-root/wals/ab78f05fa6f4406a81716ded4d302aee
I20260709 12:25:55.490833  9956 raft_consensus.cc:2955] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.491948  9697 catalog_manager.cc:5028] TS b011791796d1457284b857d7d3422195 (127.8.111.67:42253): tablet ab78f05fa6f4406a81716ded4d302aee (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:25:55.498729  9890 raft_consensus.cc:2955] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.499213 10532 raft_consensus.cc:2955] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.510447  9710 catalog_manager.cc:5697] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.534242  9812 consensus_queue.cc:237] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:55.541184 10532 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:55.542564 10689 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:55.543458  9958 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:55.545190 10689 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:55.550980 10689 raft_consensus.cc:2955] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.554419  9956 raft_consensus.cc:2955] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.556466 10532 raft_consensus.cc:2955] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.562978  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 563b5b4a0da24676a96f01291cf312c7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:55.574414  9710 catalog_manager.cc:5697] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:55.590440  9871 tablet_service.cc:1558] Processing DeleteTablet for tablet 563b5b4a0da24676a96f01291cf312c7 with delete_type TABLET_DATA_TOMBSTONED (TS 963185e117384b2085d7cea02a64478b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57650
I20260709 12:25:55.594000 10693 tablet_replica.cc:333] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:25:55.595948 10657 raft_consensus.cc:1064] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:25:55.598588 10657 consensus_queue.cc:237] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:55.618064 10693 raft_consensus.cc:2243] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.618858 10693 raft_consensus.cc:2272] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.621894 10532 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:55.622659 10693 ts_tablet_manager.cc:1916] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:55.623257  9890 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:55.626541 10677 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:55.628125 10659 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:55.634590  9812 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:55.640275 10693 ts_tablet_manager.cc:1929] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:25:55.640795 10693 log.cc:1199] T 563b5b4a0da24676a96f01291cf312c7 P 963185e117384b2085d7cea02a64478b: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-1-root/wals/563b5b4a0da24676a96f01291cf312c7
I20260709 12:25:55.642580  9698 catalog_manager.cc:5028] TS 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): tablet 563b5b4a0da24676a96f01291cf312c7 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:25:55.639093 10656 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:25:55.676676 10651 raft_consensus.cc:1064] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:25:55.678529 10659 raft_consensus.cc:2955] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.679234 10651 consensus_queue.cc:237] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:55.684365 10531 raft_consensus.cc:2955] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.687657  9810 raft_consensus.cc:2955] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.702098  9713 catalog_manager.cc:5697] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.706096  9888 raft_consensus.cc:2955] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.720816  9958 raft_consensus.cc:1275] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:55.722160  9886 raft_consensus.cc:1275] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:55.722365 10689 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:55.722231 10531 raft_consensus.cc:1275] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:55.725883 10650 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:55.727635 10689 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:55.741442  9958 consensus_queue.cc:237] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:55.746094 10650 raft_consensus.cc:2955] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.747784  9888 raft_consensus.cc:2955] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.752125 10531 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:55.753481  9812 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:55.754772 10532 raft_consensus.cc:2955] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.760828 10695 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:55.762432 10656 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:55.768095  9958 raft_consensus.cc:2955] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.774114 10659 raft_consensus.cc:2955] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.780072  9810 raft_consensus.cc:2955] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.780625 10531 raft_consensus.cc:2955] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.789615  9712 catalog_manager.cc:5697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:55.802829  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c1c0ea749e8a45d4935db42359f9df11 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:55.812857  9712 catalog_manager.cc:5697] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.831825  9810 consensus_queue.cc:237] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:55.845518 10531 raft_consensus.cc:1275] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:55.847486  9886 raft_consensus.cc:1275] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:55.849612 10650 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:55.851020 10651 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:55.855095  9871 tablet_service.cc:1558] Processing DeleteTablet for tablet c1c0ea749e8a45d4935db42359f9df11 with delete_type TABLET_DATA_TOMBSTONED (TS 963185e117384b2085d7cea02a64478b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57650
I20260709 12:25:55.855981 10693 tablet_replica.cc:333] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:25:55.856971 10693 raft_consensus.cc:2243] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.857662 10693 raft_consensus.cc:2272] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.863945 10651 raft_consensus.cc:2955] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.867738 10693 ts_tablet_manager.cc:1916] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:55.865808 10531 raft_consensus.cc:2955] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.883109  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6bd0e88f609e4c15aadc811cb9ecf5a9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:55.884445  9712 catalog_manager.cc:5697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.900434 10693 ts_tablet_manager.cc:1929] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:25:55.902058  9951 tablet_service.cc:1558] Processing DeleteTablet for tablet 6bd0e88f609e4c15aadc811cb9ecf5a9 with delete_type TABLET_DATA_TOMBSTONED (TS b011791796d1457284b857d7d3422195 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55938
I20260709 12:25:55.900991 10693 log.cc:1199] T c1c0ea749e8a45d4935db42359f9df11 P 963185e117384b2085d7cea02a64478b: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-1-root/wals/c1c0ea749e8a45d4935db42359f9df11
I20260709 12:25:55.903575 10687 tablet_replica.cc:333] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:25:55.904611 10687 raft_consensus.cc:2243] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:55.905325 10687 raft_consensus.cc:2272] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:55.905066  9886 raft_consensus.cc:2955] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:55.906106  9698 catalog_manager.cc:5028] TS 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): tablet c1c0ea749e8a45d4935db42359f9df11 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:25:55.909770 10687 ts_tablet_manager.cc:1916] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:55.922473 10687 ts_tablet_manager.cc:1929] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:25:55.922783 10687 log.cc:1199] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P b011791796d1457284b857d7d3422195: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-2-root/wals/6bd0e88f609e4c15aadc811cb9ecf5a9
I20260709 12:25:55.923988  9697 catalog_manager.cc:5028] TS b011791796d1457284b857d7d3422195 (127.8.111.67:42253): tablet 6bd0e88f609e4c15aadc811cb9ecf5a9 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
W20260709 12:25:57.002684  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 52063.5us
I20260709 12:25:57.070515  9956 consensus_queue.cc:237] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:57.077602  9886 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:57.078459  9810 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:25:57.078379  9928 consensus_peers.cc:597] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b844d67afb64319be2e7e6a8ec99319. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:57.079666 10707 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:57.080652 10708 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:57.092933 10677 raft_consensus.cc:2955] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:57.099385  9809 raft_consensus.cc:2955] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:57.113618  9888 raft_consensus.cc:2955] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:57.116436  9957 consensus_queue.cc:237] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:57.122165  9712 catalog_manager.cc:5697] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
W20260709 12:25:57.135878  9928 consensus_peers.cc:597] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6f86e0db5aaa4690a0351c44520f7baf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:57.138254  9888 raft_consensus.cc:1275] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:57.138877  9812 raft_consensus.cc:1275] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:57.140059 10677 consensus_queue.cc:1048] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:57.140976 10703 consensus_queue.cc:1048] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:57.162506 10703 raft_consensus.cc:2955] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:57.166699  9888 raft_consensus.cc:2955] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:57.173601  9809 raft_consensus.cc:2955] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:57.178299  9958 consensus_queue.cc:237] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:57.189504  9712 catalog_manager.cc:5697] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:57.199836  9928 consensus_peers.cc:597] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a95007be04144b799116ba6a2d753a1e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:57.201574  9886 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:57.202675  9812 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:57.203174 10677 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:57.204599 10707 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:57.213945 10707 raft_consensus.cc:2955] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:57.216153  9888 raft_consensus.cc:2955] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:57.233692  9712 catalog_manager.cc:5697] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:57.235443  9809 raft_consensus.cc:2955] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:57.243136  9888 consensus_queue.cc:237] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:57.251834  9809 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:25:57.251863  9854 consensus_peers.cc:597] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b6b2dfaf2fc345a8a7e88a8c1e9e8900. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:57.253647  9957 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:25:57.253669 10704 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:57.255887 10704 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:57.265369 10654 raft_consensus.cc:2955] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:57.275053  9809 raft_consensus.cc:2955] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:57.295094  9958 raft_consensus.cc:2955] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:25:57.296801  9712 catalog_manager.cc:5697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.600883 10726 ts_tablet_manager.cc:933] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:57.608502 10726 tablet_copy_client.cc:323] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.67:42253
I20260709 12:25:57.610818  9974 tablet_copy_service.cc:140] P b011791796d1457284b857d7d3422195: Received BeginTabletCopySession request for tablet 4b844d67afb64319be2e7e6a8ec99319 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:48438)
I20260709 12:25:57.611418  9974 tablet_copy_service.cc:161] P b011791796d1457284b857d7d3422195: Beginning new tablet copy session on tablet 4b844d67afb64319be2e7e6a8ec99319 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:48438: session id = f5208640a51f493e930ce4f64ceeed0b-4b844d67afb64319be2e7e6a8ec99319
I20260709 12:25:57.620625  9974 tablet_copy_source_session.cc:215] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:57.624874 10726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b844d67afb64319be2e7e6a8ec99319. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.643975 10726 tablet_copy_client.cc:806] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:57.644693 10726 tablet_copy_client.cc:670] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:57.655369 10728 ts_tablet_manager.cc:933] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:57.656196 10726 tablet_copy_client.cc:538] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:57.657675 10728 tablet_copy_client.cc:323] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.67:42253
I20260709 12:25:57.659363  9974 tablet_copy_service.cc:140] P b011791796d1457284b857d7d3422195: Received BeginTabletCopySession request for tablet 6f86e0db5aaa4690a0351c44520f7baf from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:48438)
I20260709 12:25:57.659873  9974 tablet_copy_service.cc:161] P b011791796d1457284b857d7d3422195: Beginning new tablet copy session on tablet 6f86e0db5aaa4690a0351c44520f7baf from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:48438: session id = f5208640a51f493e930ce4f64ceeed0b-6f86e0db5aaa4690a0351c44520f7baf
I20260709 12:25:57.666760 10726 tablet_bootstrap.cc:492] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:25:57.669898  9974 tablet_copy_source_session.cc:215] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:57.674477 10728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f86e0db5aaa4690a0351c44520f7baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.695189 10728 tablet_copy_client.cc:806] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:57.695839 10728 tablet_copy_client.cc:670] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:57.700165 10728 tablet_copy_client.cc:538] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:57.702199 10726 tablet_bootstrap.cc:492] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:57.703333 10726 tablet_bootstrap.cc:492] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:25:57.704135 10726 ts_tablet_manager.cc:1403] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.010s
I20260709 12:25:57.707759 10726 raft_consensus.cc:359] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:57.708750 10726 raft_consensus.cc:740] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:25:57.709554 10726 consensus_queue.cc:260] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:57.712409 10728 tablet_bootstrap.cc:492] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:25:57.728250 10726 ts_tablet_manager.cc:1434] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.011s
I20260709 12:25:57.730261  9974 tablet_copy_service.cc:342] P b011791796d1457284b857d7d3422195: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-4b844d67afb64319be2e7e6a8ec99319 received from {username='slave'} at 127.0.0.1:48438
I20260709 12:25:57.730763  9974 tablet_copy_service.cc:434] P b011791796d1457284b857d7d3422195: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-4b844d67afb64319be2e7e6a8ec99319 on tablet 4b844d67afb64319be2e7e6a8ec99319 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:25:57.745420 10728 tablet_bootstrap.cc:492] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:57.746356 10728 tablet_bootstrap.cc:492] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:25:57.746986 10728 ts_tablet_manager.cc:1403] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.011s
I20260709 12:25:57.749907 10728 raft_consensus.cc:359] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:57.750793 10728 raft_consensus.cc:740] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:25:57.751459 10728 consensus_queue.cc:260] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:57.753779 10728 ts_tablet_manager.cc:1434] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:57.755596  9974 tablet_copy_service.cc:342] P b011791796d1457284b857d7d3422195: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-6f86e0db5aaa4690a0351c44520f7baf received from {username='slave'} at 127.0.0.1:48438
I20260709 12:25:57.756013  9974 tablet_copy_service.cc:434] P b011791796d1457284b857d7d3422195: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-6f86e0db5aaa4690a0351c44520f7baf on tablet 6f86e0db5aaa4690a0351c44520f7baf with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:25:57.761082 10728 ts_tablet_manager.cc:933] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:25:57.762673 10728 tablet_copy_client.cc:323] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.66:34205
I20260709 12:25:57.764564  9899 tablet_copy_service.cc:140] P 963185e117384b2085d7cea02a64478b: Received BeginTabletCopySession request for tablet b6b2dfaf2fc345a8a7e88a8c1e9e8900 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:54428)
I20260709 12:25:57.765012  9899 tablet_copy_service.cc:161] P 963185e117384b2085d7cea02a64478b: Beginning new tablet copy session on tablet b6b2dfaf2fc345a8a7e88a8c1e9e8900 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:54428: session id = f5208640a51f493e930ce4f64ceeed0b-b6b2dfaf2fc345a8a7e88a8c1e9e8900
I20260709 12:25:57.772451  9899 tablet_copy_source_session.cc:215] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:57.775591 10728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b2dfaf2fc345a8a7e88a8c1e9e8900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.784554 10726 ts_tablet_manager.cc:933] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:25:57.786266 10726 tablet_copy_client.cc:323] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.67:42253
I20260709 12:25:57.787911  9974 tablet_copy_service.cc:140] P b011791796d1457284b857d7d3422195: Received BeginTabletCopySession request for tablet a95007be04144b799116ba6a2d753a1e from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:48438)
I20260709 12:25:57.788065 10728 tablet_copy_client.cc:806] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:57.788414  9974 tablet_copy_service.cc:161] P b011791796d1457284b857d7d3422195: Beginning new tablet copy session on tablet a95007be04144b799116ba6a2d753a1e from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:48438: session id = f5208640a51f493e930ce4f64ceeed0b-a95007be04144b799116ba6a2d753a1e
I20260709 12:25:57.788614 10728 tablet_copy_client.cc:670] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:57.791913 10728 tablet_copy_client.cc:538] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:57.796492  9974 tablet_copy_source_session.cc:215] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:57.799376 10728 tablet_bootstrap.cc:492] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:25:57.800410 10726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a95007be04144b799116ba6a2d753a1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:57.818308 10726 tablet_copy_client.cc:806] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:57.819216 10726 tablet_copy_client.cc:670] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:57.823441 10726 tablet_copy_client.cc:538] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:57.839533 10726 tablet_bootstrap.cc:492] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:25:57.837522 10728 tablet_bootstrap.cc:492] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:57.840869 10728 tablet_bootstrap.cc:492] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:25:57.841952 10728 ts_tablet_manager.cc:1403] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.009s
I20260709 12:25:57.844465 10728 raft_consensus.cc:359] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:57.848444 10728 raft_consensus.cc:740] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:25:57.849144 10728 consensus_queue.cc:260] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:57.851889 10728 ts_tablet_manager.cc:1434] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:25:57.855746  9899 tablet_copy_service.cc:342] P 963185e117384b2085d7cea02a64478b: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-b6b2dfaf2fc345a8a7e88a8c1e9e8900 received from {username='slave'} at 127.0.0.1:54428
I20260709 12:25:57.856146  9899 tablet_copy_service.cc:434] P 963185e117384b2085d7cea02a64478b: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-b6b2dfaf2fc345a8a7e88a8c1e9e8900 on tablet b6b2dfaf2fc345a8a7e88a8c1e9e8900 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:25:57.883466 10726 tablet_bootstrap.cc:492] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:57.884490 10726 tablet_bootstrap.cc:492] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:25:57.885233 10726 ts_tablet_manager.cc:1403] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.007s
I20260709 12:25:57.888967 10726 raft_consensus.cc:359] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:57.890915 10726 raft_consensus.cc:740] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:25:57.891599 10726 consensus_queue.cc:260] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:25:57.899217 10726 ts_tablet_manager.cc:1434] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:25:57.901005  9974 tablet_copy_service.cc:342] P b011791796d1457284b857d7d3422195: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-a95007be04144b799116ba6a2d753a1e received from {username='slave'} at 127.0.0.1:48438
I20260709 12:25:57.901438  9974 tablet_copy_service.cc:434] P b011791796d1457284b857d7d3422195: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-a95007be04144b799116ba6a2d753a1e on tablet a95007be04144b799116ba6a2d753a1e with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:25:57.981607 10532 raft_consensus.cc:1217] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:25:58.141602 10532 raft_consensus.cc:1217] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:25:58.214037 10532 raft_consensus.cc:1217] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:25:58.242204 10532 raft_consensus.cc:1217] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:25:58.364416 10677 raft_consensus.cc:1064] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:25:58.366202 10677 consensus_queue.cc:237] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:58.372403  9888 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:58.373128 10532 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:58.373814 10708 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:58.376618 10708 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:58.378293  9810 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:58.379773 10738 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:58.399456 10738 raft_consensus.cc:2955] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:58.408004  9810 raft_consensus.cc:2955] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:58.422984 10532 raft_consensus.cc:2955] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:58.428364  9711 catalog_manager.cc:5697] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:58.447460  9888 raft_consensus.cc:2955] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:58.486698  9957 consensus_queue.cc:237] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:58.491288 10532 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:58.493551 10738 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:58.493968  9886 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:58.495345 10738 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:58.501004 10677 raft_consensus.cc:2955] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:58.505403 10532 raft_consensus.cc:2955] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:58.509843  9888 raft_consensus.cc:2955] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:58.513043  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4b844d67afb64319be2e7e6a8ec99319 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:58.520876  9712 catalog_manager.cc:5697] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:58.536595  9802 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b844d67afb64319be2e7e6a8ec99319 with delete_type TABLET_DATA_TOMBSTONED (TS 4104e34a61b7448281d6d91ce23ebf71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46484
I20260709 12:25:58.541821 10746 tablet_replica.cc:333] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:25:58.543017 10746 raft_consensus.cc:2243] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:58.543818 10746 raft_consensus.cc:2272] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:58.548568 10746 ts_tablet_manager.cc:1916] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:58.564587 10746 ts_tablet_manager.cc:1929] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:25:58.565088 10746 log.cc:1199] T 4b844d67afb64319be2e7e6a8ec99319 P 4104e34a61b7448281d6d91ce23ebf71: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-0-root/wals/4b844d67afb64319be2e7e6a8ec99319
I20260709 12:25:58.566846  9697 catalog_manager.cc:5028] TS 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): tablet 4b844d67afb64319be2e7e6a8ec99319 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:25:58.652115 10704 raft_consensus.cc:1064] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:25:58.654711 10704 consensus_queue.cc:237] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:58.658365 10677 raft_consensus.cc:1064] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:25:58.661165 10677 consensus_queue.cc:237] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:58.665491 10532 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:58.669486 10682 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:58.670305  9810 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:58.675349 10654 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:58.680245  9957 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:58.694722 10704 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:58.701907 10682 raft_consensus.cc:2955] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:58.703416  9809 raft_consensus.cc:2955] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:58.741652 10532 raft_consensus.cc:2955] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:58.785142  9712 catalog_manager.cc:5697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:58.792173 10533 raft_consensus.cc:1275] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:58.799274 10754 consensus_queue.cc:1048] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:58.803079  9888 consensus_queue.cc:237] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:58.809353  9958 raft_consensus.cc:2955] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:58.845109  9809 raft_consensus.cc:1275] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:58.848145 10677 consensus_queue.cc:1048] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:58.849370  9809 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:58.866110 10738 raft_consensus.cc:1064] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:25:58.877321 10654 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:58.882074  9888 raft_consensus.cc:1275] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:58.885684 10677 consensus_queue.cc:1048] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:58.885566 10682 raft_consensus.cc:2955] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:58.883474 10738 consensus_queue.cc:237] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:58.894847  9812 raft_consensus.cc:2955] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:58.909564 10531 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:58.918907 10748 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:58.938845 10532 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:58.940804 10754 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:58.943774  9885 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:58.946866  9814 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:25:58.951514  9698 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b6b2dfaf2fc345a8a7e88a8c1e9e8900 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:58.955252 10738 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:58.961673  9712 catalog_manager.cc:5697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:58.967443 10708 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:58.980345  9951 tablet_service.cc:1558] Processing DeleteTablet for tablet b6b2dfaf2fc345a8a7e88a8c1e9e8900 with delete_type TABLET_DATA_TOMBSTONED (TS b011791796d1457284b857d7d3422195 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55938
I20260709 12:25:58.972143 10533 raft_consensus.cc:2955] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:58.996902 10761 tablet_replica.cc:333] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:25:59.001148 10761 raft_consensus.cc:2243] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.002564 10707 raft_consensus.cc:2955] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:59.003978 10761 raft_consensus.cc:2272] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.008983  9885 raft_consensus.cc:2955] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:59.020017 10532 raft_consensus.cc:2955] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:59.024267 10761 ts_tablet_manager.cc:1916] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:59.026039  9814 raft_consensus.cc:2955] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:59.035429 10738 raft_consensus.cc:2955] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:59.049607  9810 raft_consensus.cc:2955] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:59.055832 10531 raft_consensus.cc:2955] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:59.063265  9711 catalog_manager.cc:5697] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:59.068401 10761 ts_tablet_manager.cc:1929] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:25:59.068986 10761 log.cc:1199] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P b011791796d1457284b857d7d3422195: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-2-root/wals/b6b2dfaf2fc345a8a7e88a8c1e9e8900
I20260709 12:25:59.072275  9713 catalog_manager.cc:5697] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:59.080170  9697 catalog_manager.cc:5028] TS b011791796d1457284b857d7d3422195 (127.8.111.67:42253): tablet b6b2dfaf2fc345a8a7e88a8c1e9e8900 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:25:59.093626  9886 raft_consensus.cc:2955] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:59.102648  9956 consensus_queue.cc:237] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:59.120312 10532 raft_consensus.cc:1275] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:59.120656  9885 raft_consensus.cc:1275] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:59.124086 10738 consensus_queue.cc:1048] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:59.124886 10754 consensus_queue.cc:1048] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:59.137269  9956 consensus_queue.cc:237] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:25:59.136885 10753 raft_consensus.cc:2955] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:59.141042  9885 raft_consensus.cc:2955] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:59.142838  9810 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:59.145203 10738 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:59.149487 10531 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:25:59.156910 10707 raft_consensus.cc:2955] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:59.162822  9814 raft_consensus.cc:2955] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:59.161931  9712 catalog_manager.cc:5697] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:59.169777  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6f86e0db5aaa4690a0351c44520f7baf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:59.170827 10532 raft_consensus.cc:2955] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:59.175576 10738 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:59.180331  9802 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f86e0db5aaa4690a0351c44520f7baf with delete_type TABLET_DATA_TOMBSTONED (TS 4104e34a61b7448281d6d91ce23ebf71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46484
I20260709 12:25:59.185803  9710 catalog_manager.cc:5697] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:59.191897  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a95007be04144b799116ba6a2d753a1e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:59.201269 10533 raft_consensus.cc:2955] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:25:59.211606  9871 tablet_service.cc:1558] Processing DeleteTablet for tablet a95007be04144b799116ba6a2d753a1e with delete_type TABLET_DATA_TOMBSTONED (TS 963185e117384b2085d7cea02a64478b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57650
I20260709 12:25:59.216580 10764 tablet_replica.cc:333] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:25:59.217497 10764 raft_consensus.cc:2243] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.218191 10764 raft_consensus.cc:2272] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.224228 10764 ts_tablet_manager.cc:1916] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:59.225441 10765 tablet_replica.cc:333] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:25:59.227063 10765 raft_consensus.cc:2243] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:59.227831 10765 raft_consensus.cc:2272] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:59.233906 10765 ts_tablet_manager.cc:1916] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:59.241102 10764 ts_tablet_manager.cc:1929] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:25:59.241580 10764 log.cc:1199] T 6f86e0db5aaa4690a0351c44520f7baf P 4104e34a61b7448281d6d91ce23ebf71: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-0-root/wals/6f86e0db5aaa4690a0351c44520f7baf
I20260709 12:25:59.243040  9697 catalog_manager.cc:5028] TS 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): tablet 6f86e0db5aaa4690a0351c44520f7baf (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:25:59.248768 10765 ts_tablet_manager.cc:1929] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:25:59.249184 10765 log.cc:1199] T a95007be04144b799116ba6a2d753a1e P 963185e117384b2085d7cea02a64478b: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-1-root/wals/a95007be04144b799116ba6a2d753a1e
I20260709 12:25:59.250726  9698 catalog_manager.cc:5028] TS 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): tablet a95007be04144b799116ba6a2d753a1e (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:00.290531  9956 consensus_queue.cc:237] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
W20260709 12:26:00.296698  9928 consensus_peers.cc:597] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: be9677b33dcc4236a5656b7747c90d13. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:00.296856  9886 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:00.296949  9814 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:00.298081 10754 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:00.298898 10738 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:00.313931 10754 raft_consensus.cc:2955] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:00.321915  9886 raft_consensus.cc:2955] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:00.331601  9810 raft_consensus.cc:2955] T be9677b33dcc4236a5656b7747c90d13 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:00.340853  9814 consensus_queue.cc:237] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:00.341886  9712 catalog_manager.cc:5697] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
W20260709 12:26:00.360221  9779 consensus_peers.cc:597] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ad53c1df0a9749d992b37564e8225118. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:00.361999  9956 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:00.362110  9886 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:00.363656 10766 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:00.366211 10627 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:00.375854 10627 raft_consensus.cc:2955] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:00.377709  9956 raft_consensus.cc:2955] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:00.377771  9886 raft_consensus.cc:2955] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:00.394829  9713 catalog_manager.cc:5697] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:00.396667  9956 consensus_queue.cc:237] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:00.419323  9886 raft_consensus.cc:1275] T 3290aa2b0ef349e78e838202fb70b358 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:00.421105  9814 raft_consensus.cc:1275] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:00.421314 10754 consensus_queue.cc:1048] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:00.422356 10771 consensus_queue.cc:1048] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:00.424573  9928 consensus_peers.cc:597] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3290aa2b0ef349e78e838202fb70b358. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:00.430590 10772 raft_consensus.cc:2955] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:00.432339  9810 raft_consensus.cc:2955] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:00.439983  9885 raft_consensus.cc:2955] T 3290aa2b0ef349e78e838202fb70b358 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:00.443563  9886 consensus_queue.cc:237] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:00.449903  9710 catalog_manager.cc:5697] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:00.464025  9854 consensus_peers.cc:597] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b97d7561bbd8444f9bbafa9c397d3f62. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:00.464047  9956 raft_consensus.cc:1275] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:00.464208  9810 raft_consensus.cc:1275] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:00.466387 10748 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:00.468115 10682 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:00.476737 10748 raft_consensus.cc:2955] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:00.478156  9810 raft_consensus.cc:2955] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:00.479846  9956 raft_consensus.cc:2955] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:00.500093  9712 catalog_manager.cc:5697] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:00.881984 10786 ts_tablet_manager.cc:933] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:26:00.884281 10786 tablet_copy_client.cc:323] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.65:38995
I20260709 12:26:00.885972  9825 tablet_copy_service.cc:140] P 4104e34a61b7448281d6d91ce23ebf71: Received BeginTabletCopySession request for tablet ad53c1df0a9749d992b37564e8225118 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:34802)
I20260709 12:26:00.886523  9825 tablet_copy_service.cc:161] P 4104e34a61b7448281d6d91ce23ebf71: Beginning new tablet copy session on tablet ad53c1df0a9749d992b37564e8225118 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:34802: session id = f5208640a51f493e930ce4f64ceeed0b-ad53c1df0a9749d992b37564e8225118
I20260709 12:26:00.894340  9825 tablet_copy_source_session.cc:215] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:00.897130 10786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad53c1df0a9749d992b37564e8225118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.908640 10786 tablet_copy_client.cc:806] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:00.909302 10786 tablet_copy_client.cc:670] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:00.911055 10788 ts_tablet_manager.cc:933] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:00.915141 10786 tablet_copy_client.cc:538] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:00.915587 10788 tablet_copy_client.cc:323] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.67:42253
I20260709 12:26:00.917223  9974 tablet_copy_service.cc:140] P b011791796d1457284b857d7d3422195: Received BeginTabletCopySession request for tablet be9677b33dcc4236a5656b7747c90d13 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:48438)
I20260709 12:26:00.917752  9974 tablet_copy_service.cc:161] P b011791796d1457284b857d7d3422195: Beginning new tablet copy session on tablet be9677b33dcc4236a5656b7747c90d13 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:48438: session id = f5208640a51f493e930ce4f64ceeed0b-be9677b33dcc4236a5656b7747c90d13
I20260709 12:26:00.924472 10786 tablet_bootstrap.cc:492] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:00.925976  9974 tablet_copy_source_session.cc:215] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:00.929325 10788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be9677b33dcc4236a5656b7747c90d13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:00.956235 10788 tablet_copy_client.cc:806] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:00.956956 10788 tablet_copy_client.cc:670] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:00.961603 10788 tablet_copy_client.cc:538] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:00.963332 10786 tablet_bootstrap.cc:492] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:00.964303 10786 tablet_bootstrap.cc:492] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:00.964989 10786 ts_tablet_manager.cc:1403] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.007s
I20260709 12:26:00.968408 10786 raft_consensus.cc:359] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:00.969285 10786 raft_consensus.cc:740] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:00.969985 10786 consensus_queue.cc:260] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:00.979945 10786 ts_tablet_manager.cc:1434] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.007s
I20260709 12:26:00.982023  9825 tablet_copy_service.cc:342] P 4104e34a61b7448281d6d91ce23ebf71: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-ad53c1df0a9749d992b37564e8225118 received from {username='slave'} at 127.0.0.1:34802
I20260709 12:26:00.982498  9825 tablet_copy_service.cc:434] P 4104e34a61b7448281d6d91ce23ebf71: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-ad53c1df0a9749d992b37564e8225118 on tablet ad53c1df0a9749d992b37564e8225118 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:00.983191 10788 tablet_bootstrap.cc:492] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:00.997098 10786 ts_tablet_manager.cc:933] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:00.998755 10786 tablet_copy_client.cc:323] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.67:42253
I20260709 12:26:01.000391  9974 tablet_copy_service.cc:140] P b011791796d1457284b857d7d3422195: Received BeginTabletCopySession request for tablet 3290aa2b0ef349e78e838202fb70b358 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:48438)
I20260709 12:26:01.000916  9974 tablet_copy_service.cc:161] P b011791796d1457284b857d7d3422195: Beginning new tablet copy session on tablet 3290aa2b0ef349e78e838202fb70b358 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:48438: session id = f5208640a51f493e930ce4f64ceeed0b-3290aa2b0ef349e78e838202fb70b358
I20260709 12:26:01.009799  9974 tablet_copy_source_session.cc:215] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:01.018245 10786 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3290aa2b0ef349e78e838202fb70b358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.022907 10793 ts_tablet_manager.cc:933] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:01.032171 10793 tablet_copy_client.cc:323] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.66:34205
I20260709 12:26:01.033923  9899 tablet_copy_service.cc:140] P 963185e117384b2085d7cea02a64478b: Received BeginTabletCopySession request for tablet b97d7561bbd8444f9bbafa9c397d3f62 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:54428)
I20260709 12:26:01.034554  9899 tablet_copy_service.cc:161] P 963185e117384b2085d7cea02a64478b: Beginning new tablet copy session on tablet b97d7561bbd8444f9bbafa9c397d3f62 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:54428: session id = f5208640a51f493e930ce4f64ceeed0b-b97d7561bbd8444f9bbafa9c397d3f62
I20260709 12:26:01.041961 10786 tablet_copy_client.cc:806] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:01.042006  9899 tablet_copy_source_session.cc:215] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:01.042785 10786 tablet_copy_client.cc:670] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:01.046613 10786 tablet_copy_client.cc:538] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:01.047626 10793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b97d7561bbd8444f9bbafa9c397d3f62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:01.049304 10788 tablet_bootstrap.cc:492] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:01.050239 10788 tablet_bootstrap.cc:492] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:01.051188 10788 ts_tablet_manager.cc:1403] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.068s	user 0.023s	sys 0.026s
I20260709 12:26:01.055887 10786 tablet_bootstrap.cc:492] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:01.058084 10788 raft_consensus.cc:359] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:01.060117 10788 raft_consensus.cc:740] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:01.060832 10788 consensus_queue.cc:260] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:01.063755 10788 ts_tablet_manager.cc:1434] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:26:01.066295  9974 tablet_copy_service.cc:342] P b011791796d1457284b857d7d3422195: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-be9677b33dcc4236a5656b7747c90d13 received from {username='slave'} at 127.0.0.1:48438
I20260709 12:26:01.066731  9974 tablet_copy_service.cc:434] P b011791796d1457284b857d7d3422195: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-be9677b33dcc4236a5656b7747c90d13 on tablet be9677b33dcc4236a5656b7747c90d13 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:01.112978 10786 tablet_bootstrap.cc:492] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:01.113973 10786 tablet_bootstrap.cc:492] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:01.115089 10786 ts_tablet_manager.cc:1403] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.059s	user 0.029s	sys 0.020s
I20260709 12:26:01.122119 10793 tablet_copy_client.cc:806] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:01.122728 10793 tablet_copy_client.cc:670] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:01.119729 10786 raft_consensus.cc:359] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:01.123741 10786 raft_consensus.cc:740] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:01.124416 10786 consensus_queue.cc:260] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:01.126597 10793 tablet_copy_client.cc:538] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:01.127907 10786 ts_tablet_manager.cc:1434] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:26:01.129932  9974 tablet_copy_service.cc:342] P b011791796d1457284b857d7d3422195: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-3290aa2b0ef349e78e838202fb70b358 received from {username='slave'} at 127.0.0.1:48438
I20260709 12:26:01.130357  9974 tablet_copy_service.cc:434] P b011791796d1457284b857d7d3422195: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-3290aa2b0ef349e78e838202fb70b358 on tablet 3290aa2b0ef349e78e838202fb70b358 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:01.141136 10793 tablet_bootstrap.cc:492] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:01.184930 10793 tablet_bootstrap.cc:492] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:01.185855 10793 tablet_bootstrap.cc:492] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:01.186568 10793 ts_tablet_manager.cc:1403] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.046s	user 0.029s	sys 0.017s
I20260709 12:26:01.189417 10793 raft_consensus.cc:359] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:01.190232 10793 raft_consensus.cc:740] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:01.190871 10793 consensus_queue.cc:260] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:01.193279 10793 ts_tablet_manager.cc:1434] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 12:26:01.194839  9899 tablet_copy_service.cc:342] P 963185e117384b2085d7cea02a64478b: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-b97d7561bbd8444f9bbafa9c397d3f62 received from {username='slave'} at 127.0.0.1:54428
I20260709 12:26:01.195241  9899 tablet_copy_service.cc:434] P 963185e117384b2085d7cea02a64478b: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-b97d7561bbd8444f9bbafa9c397d3f62 on tablet b97d7561bbd8444f9bbafa9c397d3f62 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:01.320493 10532 raft_consensus.cc:1217] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:01.381179 10532 raft_consensus.cc:1217] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:01.492280 10533 raft_consensus.cc:1217] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:01.504685 10533 raft_consensus.cc:1217] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:01.750981 10627 raft_consensus.cc:1064] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:01.752691 10627 consensus_queue.cc:237] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:01.759956  9956 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:01.759971 10533 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:01.762568 10801 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:01.764526  9886 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:01.767238 10801 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:01.769629 10801 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:01.783092 10801 raft_consensus.cc:2955] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:01.785092  9886 raft_consensus.cc:2955] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:01.793352 10532 raft_consensus.cc:2955] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:01.803663  9956 raft_consensus.cc:2955] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:01.809368  9713 catalog_manager.cc:5697] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.848948  9814 consensus_queue.cc:237] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:01.854586 10532 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:01.855876  9885 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:01.855917 10797 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:01.857388 10801 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:01.867084 10532 raft_consensus.cc:2955] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:01.863262 10797 raft_consensus.cc:2955] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:01.873808  9885 raft_consensus.cc:2955] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:01.879391  9710 catalog_manager.cc:5697] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:01.881052  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ad53c1df0a9749d992b37564e8225118 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:01.935132  9951 tablet_service.cc:1558] Processing DeleteTablet for tablet ad53c1df0a9749d992b37564e8225118 with delete_type TABLET_DATA_TOMBSTONED (TS b011791796d1457284b857d7d3422195 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55938
I20260709 12:26:01.938541 10810 tablet_replica.cc:333] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:26:01.939599 10810 raft_consensus.cc:2243] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:01.940382 10810 raft_consensus.cc:2272] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:01.943054 10748 raft_consensus.cc:1064] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:01.945726 10799 raft_consensus.cc:1064] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:01.945441 10748 consensus_queue.cc:237] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:01.951872 10810 ts_tablet_manager.cc:1916] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:01.948696 10799 consensus_queue.cc:237] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:01.960942 10532 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:01.961789  9886 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:01.963260 10738 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:01.967489 10798 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:01.971433  9814 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:01.978063 10754 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:01.986689 10810 ts_tablet_manager.cc:1929] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:01.988056 10810 log.cc:1199] T ad53c1df0a9749d992b37564e8225118 P b011791796d1457284b857d7d3422195: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-2-root/wals/ad53c1df0a9749d992b37564e8225118
I20260709 12:26:01.989821  9697 catalog_manager.cc:5028] TS b011791796d1457284b857d7d3422195 (127.8.111.67:42253): tablet ad53c1df0a9749d992b37564e8225118 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:02.009351 10532 raft_consensus.cc:1275] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:02.010119  9956 raft_consensus.cc:1275] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:02.011037 10767 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:02.011608 10814 raft_consensus.cc:2955] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.017158 10682 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:02.020524  9814 raft_consensus.cc:1275] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:02.022081 10767 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:02.032862  9809 raft_consensus.cc:2955] T be9677b33dcc4236a5656b7747c90d13 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.037796  9886 raft_consensus.cc:2955] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.040428 10767 raft_consensus.cc:2955] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.049491  9957 raft_consensus.cc:2955] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.049571  9814 raft_consensus.cc:2955] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.059578  9711 catalog_manager.cc:5697] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.066136 10532 raft_consensus.cc:2955] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.067924 10754 raft_consensus.cc:1064] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:02.071928 10754 consensus_queue.cc:237] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:02.098582  9886 raft_consensus.cc:1275] T 3290aa2b0ef349e78e838202fb70b358 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:02.100792 10738 consensus_queue.cc:1048] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:02.104264 10532 raft_consensus.cc:1275] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:02.105180  9956 consensus_queue.cc:237] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:02.110069 10814 consensus_queue.cc:1048] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:02.107759  9809 raft_consensus.cc:1275] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:02.094055 10533 raft_consensus.cc:2955] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.113130 10814 consensus_queue.cc:1048] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:26:02.115988 10532 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:02.118680  9885 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:02.123754 10738 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:02.127635 10754 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:02.127903  9713 catalog_manager.cc:5697] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:02.131179 10754 raft_consensus.cc:2955] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.132872  9885 raft_consensus.cc:2955] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.151665  9890 consensus_queue.cc:237] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:02.159242  9814 raft_consensus.cc:1275] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:02.160799 10821 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:02.162899  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet be9677b33dcc4236a5656b7747c90d13 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:02.168316 10798 raft_consensus.cc:2955] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.171114 10531 raft_consensus.cc:1275] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:02.170980  9809 raft_consensus.cc:2955] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.176754 10533 raft_consensus.cc:2955] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.177994 10748 raft_consensus.cc:2955] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.180610 10821 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:02.171624  9712 catalog_manager.cc:5697] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.183666 10531 raft_consensus.cc:2955] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.183944  9810 raft_consensus.cc:2955] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.189757  9698 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b97d7561bbd8444f9bbafa9c397d3f62 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:02.200325  9886 raft_consensus.cc:2955] T 3290aa2b0ef349e78e838202fb70b358 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.202581  9713 catalog_manager.cc:5697] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.205509 10532 raft_consensus.cc:2955] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.240021  9802 tablet_service.cc:1558] Processing DeleteTablet for tablet be9677b33dcc4236a5656b7747c90d13 with delete_type TABLET_DATA_TOMBSTONED (TS 4104e34a61b7448281d6d91ce23ebf71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46484
I20260709 12:26:02.249753  9712 catalog_manager.cc:5697] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.259385 10826 tablet_replica.cc:333] T be9677b33dcc4236a5656b7747c90d13 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:26:02.260375 10826 raft_consensus.cc:2243] T be9677b33dcc4236a5656b7747c90d13 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.261668 10826 raft_consensus.cc:2272] T be9677b33dcc4236a5656b7747c90d13 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.264748 10826 ts_tablet_manager.cc:1916] T be9677b33dcc4236a5656b7747c90d13 P 4104e34a61b7448281d6d91ce23ebf71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:02.265767  9951 tablet_service.cc:1558] Processing DeleteTablet for tablet b97d7561bbd8444f9bbafa9c397d3f62 with delete_type TABLET_DATA_TOMBSTONED (TS b011791796d1457284b857d7d3422195 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55938
I20260709 12:26:02.266712 10810 tablet_replica.cc:333] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:26:02.267678 10810 raft_consensus.cc:2243] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.268407 10810 raft_consensus.cc:2272] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.271911 10810 ts_tablet_manager.cc:1916] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:02.273110  9957 consensus_queue.cc:237] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:02.280345 10532 raft_consensus.cc:1275] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:02.281886 10798 consensus_queue.cc:1048] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:02.285317  9809 raft_consensus.cc:1275] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:02.287052 10798 consensus_queue.cc:1048] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:02.290537 10810 ts_tablet_manager.cc:1929] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:02.290997 10810 log.cc:1199] T b97d7561bbd8444f9bbafa9c397d3f62 P b011791796d1457284b857d7d3422195: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-2-root/wals/b97d7561bbd8444f9bbafa9c397d3f62
I20260709 12:26:02.293452  9697 catalog_manager.cc:5028] TS b011791796d1457284b857d7d3422195 (127.8.111.67:42253): tablet b97d7561bbd8444f9bbafa9c397d3f62 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:02.293977 10532 raft_consensus.cc:2955] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.292742 10754 raft_consensus.cc:2955] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.305415  9814 raft_consensus.cc:2955] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.306892 10826 ts_tablet_manager.cc:1929] T be9677b33dcc4236a5656b7747c90d13 P 4104e34a61b7448281d6d91ce23ebf71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:02.307346 10826 log.cc:1199] T be9677b33dcc4236a5656b7747c90d13 P 4104e34a61b7448281d6d91ce23ebf71: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-0-root/wals/be9677b33dcc4236a5656b7747c90d13
I20260709 12:26:02.308979  9697 catalog_manager.cc:5028] TS 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): tablet be9677b33dcc4236a5656b7747c90d13 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:02.310352  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3290aa2b0ef349e78e838202fb70b358 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:02.319032  9712 catalog_manager.cc:5697] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:02.331900  9871 tablet_service.cc:1558] Processing DeleteTablet for tablet 3290aa2b0ef349e78e838202fb70b358 with delete_type TABLET_DATA_TOMBSTONED (TS 963185e117384b2085d7cea02a64478b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57650
I20260709 12:26:02.333678 10827 tablet_replica.cc:333] T 3290aa2b0ef349e78e838202fb70b358 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:26:02.334647 10827 raft_consensus.cc:2243] T 3290aa2b0ef349e78e838202fb70b358 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:02.335444 10827 raft_consensus.cc:2272] T 3290aa2b0ef349e78e838202fb70b358 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:02.338759 10827 ts_tablet_manager.cc:1916] T 3290aa2b0ef349e78e838202fb70b358 P 963185e117384b2085d7cea02a64478b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:02.351114 10827 ts_tablet_manager.cc:1929] T 3290aa2b0ef349e78e838202fb70b358 P 963185e117384b2085d7cea02a64478b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:02.351379 10827 log.cc:1199] T 3290aa2b0ef349e78e838202fb70b358 P 963185e117384b2085d7cea02a64478b: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-1-root/wals/3290aa2b0ef349e78e838202fb70b358
I20260709 12:26:02.352572  9698 catalog_manager.cc:5028] TS 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): tablet 3290aa2b0ef349e78e838202fb70b358 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:03.407822  9890 consensus_queue.cc:237] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:03.413910  9957 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:03.416119  9809 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:03.416582  9854 consensus_peers.cc:597] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cb82dc8d0b87403f90e84b650a35abb0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:03.417104 10748 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.418174 10831 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.424544 10817 raft_consensus.cc:2955] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:03.426219  9957 raft_consensus.cc:2955] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:03.427482  9809 raft_consensus.cc:2955] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:03.440965  9809 consensus_queue.cc:237] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:03.442446  9710 catalog_manager.cc:5697] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 2 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:03.457700  9957 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:03.458179  9779 consensus_peers.cc:597] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 55e4af3d6737421b9d77650fa7d44f8f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:03.459208 10797 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.459848  9890 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:03.461922 10828 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.477167 10797 raft_consensus.cc:2955] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:03.480240  9957 raft_consensus.cc:2955] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:03.495378  9886 raft_consensus.cc:2955] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:03.503899  9712 catalog_manager.cc:5697] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.507357  9956 consensus_queue.cc:237] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
W20260709 12:26:03.516000  9928 consensus_peers.cc:597] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b4a402ce065f4914a9fab2f516a37bcd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:03.516909  9810 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:03.518865 10738 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.520385  9886 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:03.522440 10798 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.536022  9809 raft_consensus.cc:2955] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:03.533893 10798 raft_consensus.cc:2955] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:03.570304  9886 consensus_queue.cc:237] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:03.573591  9885 raft_consensus.cc:2955] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:03.574937  9712 catalog_manager.cc:5697] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:03.601572  9854 consensus_peers.cc:597] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fb049358bf66417d84d91e61b68ff1bb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:03.601956  9956 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:03.604099  9810 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:03.605985 10829 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.611340 10817 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:03.618997 10829 raft_consensus.cc:2955] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:03.621373  9957 raft_consensus.cc:2955] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:03.629101  9809 raft_consensus.cc:2955] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:03.640539  9712 catalog_manager.cc:5697] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:03.911216 10851 ts_tablet_manager.cc:933] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:03.914119 10851 tablet_copy_client.cc:323] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.66:34205
I20260709 12:26:03.915633  9899 tablet_copy_service.cc:140] P 963185e117384b2085d7cea02a64478b: Received BeginTabletCopySession request for tablet cb82dc8d0b87403f90e84b650a35abb0 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:54428)
I20260709 12:26:03.916115  9899 tablet_copy_service.cc:161] P 963185e117384b2085d7cea02a64478b: Beginning new tablet copy session on tablet cb82dc8d0b87403f90e84b650a35abb0 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:54428: session id = f5208640a51f493e930ce4f64ceeed0b-cb82dc8d0b87403f90e84b650a35abb0
I20260709 12:26:03.921363  9899 tablet_copy_source_session.cc:215] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:03.924358 10851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb82dc8d0b87403f90e84b650a35abb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:03.940081 10851 tablet_copy_client.cc:806] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:03.940623 10851 tablet_copy_client.cc:670] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:03.946050 10851 tablet_copy_client.cc:538] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:03.953372 10851 tablet_bootstrap.cc:492] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:03.971264 10851 tablet_bootstrap.cc:492] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:03.972163 10851 tablet_bootstrap.cc:492] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:03.972738 10851 ts_tablet_manager.cc:1403] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 12:26:03.975148 10851 raft_consensus.cc:359] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:03.975930 10851 raft_consensus.cc:740] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:03.976576 10851 consensus_queue.cc:260] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:03.980019 10851 ts_tablet_manager.cc:1434] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:26:03.984495  9899 tablet_copy_service.cc:342] P 963185e117384b2085d7cea02a64478b: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-cb82dc8d0b87403f90e84b650a35abb0 received from {username='slave'} at 127.0.0.1:54428
I20260709 12:26:03.985397  9899 tablet_copy_service.cc:434] P 963185e117384b2085d7cea02a64478b: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-cb82dc8d0b87403f90e84b650a35abb0 on tablet cb82dc8d0b87403f90e84b650a35abb0 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:03.988126 10851 ts_tablet_manager.cc:933] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:03.996444 10851 tablet_copy_client.cc:323] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.67:42253
I20260709 12:26:03.998693  9974 tablet_copy_service.cc:140] P b011791796d1457284b857d7d3422195: Received BeginTabletCopySession request for tablet b4a402ce065f4914a9fab2f516a37bcd from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:48438)
I20260709 12:26:03.999198  9974 tablet_copy_service.cc:161] P b011791796d1457284b857d7d3422195: Beginning new tablet copy session on tablet b4a402ce065f4914a9fab2f516a37bcd from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:48438: session id = f5208640a51f493e930ce4f64ceeed0b-b4a402ce065f4914a9fab2f516a37bcd
I20260709 12:26:04.006206  9974 tablet_copy_source_session.cc:215] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:04.009110 10851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a402ce065f4914a9fab2f516a37bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.024492 10851 tablet_copy_client.cc:806] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:04.025029 10851 tablet_copy_client.cc:670] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:04.028564 10851 tablet_copy_client.cc:538] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:04.036172 10851 tablet_bootstrap.cc:492] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:04.055436 10851 tablet_bootstrap.cc:492] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:04.056188 10851 tablet_bootstrap.cc:492] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:04.056746 10851 ts_tablet_manager.cc:1403] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.001s
I20260709 12:26:04.059763 10851 raft_consensus.cc:359] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:04.060465 10851 raft_consensus.cc:740] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:04.061043 10851 consensus_queue.cc:260] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:04.063400 10851 ts_tablet_manager.cc:1434] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:26:04.069154  9974 tablet_copy_service.cc:342] P b011791796d1457284b857d7d3422195: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-b4a402ce065f4914a9fab2f516a37bcd received from {username='slave'} at 127.0.0.1:48438
I20260709 12:26:04.069635  9974 tablet_copy_service.cc:434] P b011791796d1457284b857d7d3422195: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-b4a402ce065f4914a9fab2f516a37bcd on tablet b4a402ce065f4914a9fab2f516a37bcd with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:04.099272 10851 ts_tablet_manager.cc:933] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:26:04.116894 10851 tablet_copy_client.cc:323] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.65:38995
I20260709 12:26:04.118655  9825 tablet_copy_service.cc:140] P 4104e34a61b7448281d6d91ce23ebf71: Received BeginTabletCopySession request for tablet 55e4af3d6737421b9d77650fa7d44f8f from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:34802)
I20260709 12:26:04.119170  9825 tablet_copy_service.cc:161] P 4104e34a61b7448281d6d91ce23ebf71: Beginning new tablet copy session on tablet 55e4af3d6737421b9d77650fa7d44f8f from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:34802: session id = f5208640a51f493e930ce4f64ceeed0b-55e4af3d6737421b9d77650fa7d44f8f
I20260709 12:26:04.125509  9825 tablet_copy_source_session.cc:215] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:04.128980 10851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55e4af3d6737421b9d77650fa7d44f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.129707 10855 ts_tablet_manager.cc:933] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:04.146600 10851 tablet_copy_client.cc:806] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:04.147250 10851 tablet_copy_client.cc:670] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:04.153100 10851 tablet_copy_client.cc:538] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:04.165926 10851 tablet_bootstrap.cc:492] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:04.169493 10855 tablet_copy_client.cc:323] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.66:34205
I20260709 12:26:04.171332  9899 tablet_copy_service.cc:140] P 963185e117384b2085d7cea02a64478b: Received BeginTabletCopySession request for tablet fb049358bf66417d84d91e61b68ff1bb from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:54428)
I20260709 12:26:04.171897  9899 tablet_copy_service.cc:161] P 963185e117384b2085d7cea02a64478b: Beginning new tablet copy session on tablet fb049358bf66417d84d91e61b68ff1bb from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:54428: session id = f5208640a51f493e930ce4f64ceeed0b-fb049358bf66417d84d91e61b68ff1bb
I20260709 12:26:04.184799  9899 tablet_copy_source_session.cc:215] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:04.188473 10855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb049358bf66417d84d91e61b68ff1bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:04.191476 10851 tablet_bootstrap.cc:492] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:04.192516 10851 tablet_bootstrap.cc:492] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:04.193228 10851 ts_tablet_manager.cc:1403] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.004s
I20260709 12:26:04.196317 10851 raft_consensus.cc:359] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:04.197170 10851 raft_consensus.cc:740] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:04.197788 10851 consensus_queue.cc:260] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:04.201056 10851 ts_tablet_manager.cc:1434] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:04.203220  9825 tablet_copy_service.cc:342] P 4104e34a61b7448281d6d91ce23ebf71: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-55e4af3d6737421b9d77650fa7d44f8f received from {username='slave'} at 127.0.0.1:34802
I20260709 12:26:04.203656  9825 tablet_copy_service.cc:434] P 4104e34a61b7448281d6d91ce23ebf71: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-55e4af3d6737421b9d77650fa7d44f8f on tablet 55e4af3d6737421b9d77650fa7d44f8f with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:04.209508 10855 tablet_copy_client.cc:806] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:04.210129 10855 tablet_copy_client.cc:670] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:04.214180 10855 tablet_copy_client.cc:538] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:04.222877 10855 tablet_bootstrap.cc:492] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:04.248734 10855 tablet_bootstrap.cc:492] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:04.249650 10855 tablet_bootstrap.cc:492] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:04.250320 10855 ts_tablet_manager.cc:1403] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.014s
I20260709 12:26:04.253827 10855 raft_consensus.cc:359] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:04.254684 10855 raft_consensus.cc:740] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:04.255314 10855 consensus_queue.cc:260] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:04.257656 10855 ts_tablet_manager.cc:1434] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:26:04.259369  9899 tablet_copy_service.cc:342] P 963185e117384b2085d7cea02a64478b: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-fb049358bf66417d84d91e61b68ff1bb received from {username='slave'} at 127.0.0.1:54428
I20260709 12:26:04.259768  9899 tablet_copy_service.cc:434] P 963185e117384b2085d7cea02a64478b: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-fb049358bf66417d84d91e61b68ff1bb on tablet fb049358bf66417d84d91e61b68ff1bb with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:04.493213 10532 raft_consensus.cc:1217] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:26:04.554548 10532 raft_consensus.cc:1217] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:04.627065 10532 raft_consensus.cc:1217] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:04.671083 10532 raft_consensus.cc:1217] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:04.894749 10829 raft_consensus.cc:1064] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:04.897251 10829 consensus_queue.cc:237] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:04.904286 10532 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:04.905380  9957 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:04.905697 10817 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:04.907509 10817 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:04.923218  9810 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:04.925668 10817 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:04.943512 10817 raft_consensus.cc:2955] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:04.945487  9957 raft_consensus.cc:2955] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:04.958223 10532 raft_consensus.cc:2955] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:04.962831  9810 raft_consensus.cc:2955] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:04.967664  9710 catalog_manager.cc:5697] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.014621  9890 consensus_queue.cc:237] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:05.020864  9957 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:05.022220 10532 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:05.022380 10748 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:05.024705 10748 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:05.028602 10829 raft_consensus.cc:2955] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.031193  9957 raft_consensus.cc:2955] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.039186  9698 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cb82dc8d0b87403f90e84b650a35abb0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:05.039939 10532 raft_consensus.cc:2955] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.045697  9711 catalog_manager.cc:5697] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New cstate: current_term: 2 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.063947  9802 tablet_service.cc:1558] Processing DeleteTablet for tablet cb82dc8d0b87403f90e84b650a35abb0 with delete_type TABLET_DATA_TOMBSTONED (TS 4104e34a61b7448281d6d91ce23ebf71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46484
I20260709 12:26:05.065716 10873 tablet_replica.cc:333] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:26:05.071065 10873 raft_consensus.cc:2243] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:05.071883 10873 raft_consensus.cc:2272] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:05.075742 10873 ts_tablet_manager.cc:1916] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:05.091264 10873 ts_tablet_manager.cc:1929] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:26:05.091656 10873 log.cc:1199] T cb82dc8d0b87403f90e84b650a35abb0 P 4104e34a61b7448281d6d91ce23ebf71: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-0-root/wals/cb82dc8d0b87403f90e84b650a35abb0
I20260709 12:26:05.093089  9697 catalog_manager.cc:5028] TS 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): tablet cb82dc8d0b87403f90e84b650a35abb0 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:05.103291 10846 raft_consensus.cc:1064] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:05.105835 10846 consensus_queue.cc:237] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:05.116761  9886 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:05.116811 10532 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:05.118556 10738 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:05.119992  9814 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:05.120285 10738 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:26:05.122772 10846 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:05.149381 10875 raft_consensus.cc:2955] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.155233  9886 raft_consensus.cc:2955] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.162218 10532 raft_consensus.cc:2955] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.177829  9711 catalog_manager.cc:5697] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.187916 10817 raft_consensus.cc:1064] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:05.190184 10817 consensus_queue.cc:237] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:05.191627  9809 raft_consensus.cc:2955] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.207507 10533 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:05.214738 10865 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:05.244035  9957 consensus_queue.cc:237] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:05.246006  9956 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:05.248039  9810 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:05.248178 10881 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:05.252563  9886 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:05.252553 10532 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:05.254913 10875 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:05.270205 10846 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:05.273533 10829 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:05.283973 10858 raft_consensus.cc:1064] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:05.286993 10738 raft_consensus.cc:2955] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.288710 10532 raft_consensus.cc:2955] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.290170  9886 raft_consensus.cc:2955] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.290614 10858 consensus_queue.cc:237] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:05.302790  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b4a402ce065f4914a9fab2f516a37bcd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:05.322006 10880 raft_consensus.cc:2955] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.328125  9712 catalog_manager.cc:5697] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.332269  9957 raft_consensus.cc:2955] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.343799  9810 raft_consensus.cc:2955] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.349256  9802 tablet_service.cc:1558] Processing DeleteTablet for tablet b4a402ce065f4914a9fab2f516a37bcd with delete_type TABLET_DATA_TOMBSTONED (TS 4104e34a61b7448281d6d91ce23ebf71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46484
I20260709 12:26:05.348462 10531 raft_consensus.cc:2955] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.350293 10873 tablet_replica.cc:333] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:26:05.355535 10873 raft_consensus.cc:2243] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:05.356155 10873 raft_consensus.cc:2272] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:05.359555 10873 ts_tablet_manager.cc:1916] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:05.367440  9711 catalog_manager.cc:5697] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.374538 10531 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:05.375026  9957 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:05.381987 10863 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:05.384256 10863 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:05.390949  9890 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:05.391498  9886 consensus_queue.cc:237] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:05.393108 10883 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:05.404964 10532 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:05.410142  9810 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:05.416424 10865 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:05.400781 10873 ts_tablet_manager.cc:1929] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:05.417299 10881 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:05.424733 10873 log.cc:1199] T b4a402ce065f4914a9fab2f516a37bcd P 4104e34a61b7448281d6d91ce23ebf71: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-0-root/wals/b4a402ce065f4914a9fab2f516a37bcd
I20260709 12:26:05.426398  9697 catalog_manager.cc:5028] TS 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): tablet b4a402ce065f4914a9fab2f516a37bcd (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:05.427642 10880 raft_consensus.cc:2955] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.429234  9810 raft_consensus.cc:2955] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.483561 10532 raft_consensus.cc:2955] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.485121  9698 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fb049358bf66417d84d91e61b68ff1bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:26:05.490494  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 59357.6us
I20260709 12:26:05.495875  9713 catalog_manager.cc:5697] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.502525 10887 raft_consensus.cc:2955] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.505244  9890 raft_consensus.cc:2955] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.509406 10532 raft_consensus.cc:2955] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.523679  9713 catalog_manager.cc:5697] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.525702  9956 raft_consensus.cc:2955] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.553031  9951 tablet_service.cc:1558] Processing DeleteTablet for tablet fb049358bf66417d84d91e61b68ff1bb with delete_type TABLET_DATA_TOMBSTONED (TS b011791796d1457284b857d7d3422195 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55938
I20260709 12:26:05.562470  9810 consensus_queue.cc:237] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:05.568048 10892 tablet_replica.cc:333] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:26:05.569216 10892 raft_consensus.cc:2243] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:05.570037 10532 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:05.570024 10892 raft_consensus.cc:2272] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:05.570356  9956 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:05.571765 10887 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:05.575656 10892 ts_tablet_manager.cc:1916] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:05.578851 10891 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:05.582221 10858 raft_consensus.cc:2955] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.588409  9957 raft_consensus.cc:2955] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.591799 10532 raft_consensus.cc:2955] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.595309  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 55e4af3d6737421b9d77650fa7d44f8f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:05.605958  9712 catalog_manager.cc:5697] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:05.614244 10892 ts_tablet_manager.cc:1929] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:05.614956 10892 log.cc:1199] T fb049358bf66417d84d91e61b68ff1bb P b011791796d1457284b857d7d3422195: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-2-root/wals/fb049358bf66417d84d91e61b68ff1bb
I20260709 12:26:05.617831  9697 catalog_manager.cc:5028] TS b011791796d1457284b857d7d3422195 (127.8.111.67:42253): tablet fb049358bf66417d84d91e61b68ff1bb (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:05.621556  9871 tablet_service.cc:1558] Processing DeleteTablet for tablet 55e4af3d6737421b9d77650fa7d44f8f with delete_type TABLET_DATA_TOMBSTONED (TS 963185e117384b2085d7cea02a64478b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57650
I20260709 12:26:05.623545 10893 tablet_replica.cc:333] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:26:05.624327 10893 raft_consensus.cc:2243] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:05.625123 10893 raft_consensus.cc:2272] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:05.628363 10893 ts_tablet_manager.cc:1916] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:05.639225 10893 ts_tablet_manager.cc:1929] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:05.639585 10893 log.cc:1199] T 55e4af3d6737421b9d77650fa7d44f8f P 963185e117384b2085d7cea02a64478b: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-1-root/wals/55e4af3d6737421b9d77650fa7d44f8f
I20260709 12:26:05.641001  9698 catalog_manager.cc:5028] TS 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): tablet 55e4af3d6737421b9d77650fa7d44f8f (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:06.685315  9958 consensus_queue.cc:237] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:06.690697  9810 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:06.691929  9928 consensus_peers.cc:597] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 90aeaa3c967a48a4804d8960b26f02b5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:06.692051 10894 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:06.692741  9890 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:06.694021 10895 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:06.703094 10847 raft_consensus.cc:2955] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:06.705477  9814 raft_consensus.cc:2955] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:06.709051  9890 raft_consensus.cc:2955] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:06.721812  9713 catalog_manager.cc:5697] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:06.743007  9957 consensus_queue.cc:237] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:06.750092  9814 raft_consensus.cc:1275] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:06.752498 10895 consensus_queue.cc:1048] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:06.754690  9928 consensus_peers.cc:597] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fa3541b3559e488d9911972fd2250fc6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:06.755379  9890 raft_consensus.cc:1275] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:06.758340 10875 consensus_queue.cc:1048] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:06.762692 10895 raft_consensus.cc:2955] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:06.772119  9809 raft_consensus.cc:2955] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:06.775354  9885 raft_consensus.cc:2955] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:06.794704  9711 catalog_manager.cc:5697] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.797401  9885 consensus_queue.cc:237] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
W20260709 12:26:06.814527  9854 consensus_peers.cc:597] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f0f4046979c94f6b9fcfd429cb2f454f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:06.815843  9957 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:06.815900  9809 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:06.817235 10902 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:06.818048 10903 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:06.826507 10902 raft_consensus.cc:2955] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:06.828794  9957 raft_consensus.cc:2955] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:06.829978  9814 raft_consensus.cc:2955] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:06.847115  9711 catalog_manager.cc:5697] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:06.865530  9957 consensus_queue.cc:237] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
W20260709 12:26:06.882088  9928 consensus_peers.cc:597] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a5bdaeb6ccf347499e2dff26efaf7deb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:06.883210  9885 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:06.884617  9809 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:06.885511 10875 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:06.886570 10895 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:06.895388 10847 raft_consensus.cc:2955] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:06.896935  9809 raft_consensus.cc:2955] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:06.897955  9885 raft_consensus.cc:2955] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:06.914101  9711 catalog_manager.cc:5697] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:07.092643 10917 ts_tablet_manager.cc:933] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:07.096172 10917 tablet_copy_client.cc:323] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.67:42253
I20260709 12:26:07.098587  9974 tablet_copy_service.cc:140] P b011791796d1457284b857d7d3422195: Received BeginTabletCopySession request for tablet 90aeaa3c967a48a4804d8960b26f02b5 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:48438)
I20260709 12:26:07.099344  9974 tablet_copy_service.cc:161] P b011791796d1457284b857d7d3422195: Beginning new tablet copy session on tablet 90aeaa3c967a48a4804d8960b26f02b5 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:48438: session id = f5208640a51f493e930ce4f64ceeed0b-90aeaa3c967a48a4804d8960b26f02b5
I20260709 12:26:07.115360  9974 tablet_copy_source_session.cc:215] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:07.120754 10917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90aeaa3c967a48a4804d8960b26f02b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:07.176879 10917 tablet_copy_client.cc:806] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:07.177764 10917 tablet_copy_client.cc:670] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:07.185695 10917 tablet_copy_client.cc:538] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:07.196446 10917 tablet_bootstrap.cc:492] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:07.234958 10917 tablet_bootstrap.cc:492] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:07.236424 10917 tablet_bootstrap.cc:492] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:07.238427 10917 ts_tablet_manager.cc:1403] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.010s
I20260709 12:26:07.254536 10920 ts_tablet_manager.cc:933] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:07.255412 10921 ts_tablet_manager.cc:933] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:07.264199 10917 raft_consensus.cc:359] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:07.266060 10917 raft_consensus.cc:740] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:07.267056 10917 consensus_queue.cc:260] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:07.269644 10920 tablet_copy_client.cc:323] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.66:34205
I20260709 12:26:07.274675 10921 tablet_copy_client.cc:323] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.67:42253
I20260709 12:26:07.276185  9899 tablet_copy_service.cc:140] P 963185e117384b2085d7cea02a64478b: Received BeginTabletCopySession request for tablet f0f4046979c94f6b9fcfd429cb2f454f from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:54428)
I20260709 12:26:07.276782  9899 tablet_copy_service.cc:161] P 963185e117384b2085d7cea02a64478b: Beginning new tablet copy session on tablet f0f4046979c94f6b9fcfd429cb2f454f from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:54428: session id = f5208640a51f493e930ce4f64ceeed0b-f0f4046979c94f6b9fcfd429cb2f454f
I20260709 12:26:07.277233 10917 ts_tablet_manager.cc:1434] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.038s	user 0.014s	sys 0.000s
I20260709 12:26:07.282439  9974 tablet_copy_service.cc:140] P b011791796d1457284b857d7d3422195: Received BeginTabletCopySession request for tablet fa3541b3559e488d9911972fd2250fc6 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:48438)
I20260709 12:26:07.282991  9974 tablet_copy_service.cc:161] P b011791796d1457284b857d7d3422195: Beginning new tablet copy session on tablet fa3541b3559e488d9911972fd2250fc6 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:48438: session id = f5208640a51f493e930ce4f64ceeed0b-fa3541b3559e488d9911972fd2250fc6
I20260709 12:26:07.284752  9973 tablet_copy_service.cc:342] P b011791796d1457284b857d7d3422195: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-90aeaa3c967a48a4804d8960b26f02b5 received from {username='slave'} at 127.0.0.1:48438
I20260709 12:26:07.285370  9973 tablet_copy_service.cc:434] P b011791796d1457284b857d7d3422195: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-90aeaa3c967a48a4804d8960b26f02b5 on tablet 90aeaa3c967a48a4804d8960b26f02b5 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:07.302906  9974 tablet_copy_source_session.cc:215] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:07.311597 10921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa3541b3559e488d9911972fd2250fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:07.314214  9899 tablet_copy_source_session.cc:215] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:07.318041 10920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0f4046979c94f6b9fcfd429cb2f454f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:07.327574 10921 tablet_copy_client.cc:806] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:07.335624 10921 tablet_copy_client.cc:670] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:07.336206 10920 tablet_copy_client.cc:806] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:07.336812 10920 tablet_copy_client.cc:670] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:07.341619 10920 tablet_copy_client.cc:538] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:07.342449 10921 tablet_copy_client.cc:538] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:07.351936 10920 tablet_bootstrap.cc:492] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:07.352794 10921 tablet_bootstrap.cc:492] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:07.375366 10921 tablet_bootstrap.cc:492] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:07.376473 10921 tablet_bootstrap.cc:492] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:07.377254 10921 ts_tablet_manager.cc:1403] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.013s
I20260709 12:26:07.378849 10917 ts_tablet_manager.cc:933] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:07.380844 10921 raft_consensus.cc:359] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:07.381898 10921 raft_consensus.cc:740] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:07.382741 10921 consensus_queue.cc:260] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:07.384717 10920 tablet_bootstrap.cc:492] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:07.386391 10921 ts_tablet_manager.cc:1434] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 12:26:07.386503 10920 tablet_bootstrap.cc:492] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:07.388495 10920 ts_tablet_manager.cc:1403] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.037s	user 0.025s	sys 0.000s
I20260709 12:26:07.389448  9974 tablet_copy_service.cc:342] P b011791796d1457284b857d7d3422195: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-fa3541b3559e488d9911972fd2250fc6 received from {username='slave'} at 127.0.0.1:48438
I20260709 12:26:07.389880  9974 tablet_copy_service.cc:434] P b011791796d1457284b857d7d3422195: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-fa3541b3559e488d9911972fd2250fc6 on tablet fa3541b3559e488d9911972fd2250fc6 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:07.395509 10917 tablet_copy_client.cc:323] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.67:42253
I20260709 12:26:07.398219  9974 tablet_copy_service.cc:140] P b011791796d1457284b857d7d3422195: Received BeginTabletCopySession request for tablet a5bdaeb6ccf347499e2dff26efaf7deb from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:48438)
I20260709 12:26:07.398736  9974 tablet_copy_service.cc:161] P b011791796d1457284b857d7d3422195: Beginning new tablet copy session on tablet a5bdaeb6ccf347499e2dff26efaf7deb from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:48438: session id = f5208640a51f493e930ce4f64ceeed0b-a5bdaeb6ccf347499e2dff26efaf7deb
I20260709 12:26:07.400770 10920 raft_consensus.cc:359] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:07.401736 10920 raft_consensus.cc:740] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:07.402488 10920 consensus_queue.cc:260] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:07.407935  9974 tablet_copy_source_session.cc:215] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:07.407213 10920 ts_tablet_manager.cc:1434] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:26:07.410401  9899 tablet_copy_service.cc:342] P 963185e117384b2085d7cea02a64478b: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-f0f4046979c94f6b9fcfd429cb2f454f received from {username='slave'} at 127.0.0.1:54428
I20260709 12:26:07.410935  9899 tablet_copy_service.cc:434] P 963185e117384b2085d7cea02a64478b: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-f0f4046979c94f6b9fcfd429cb2f454f on tablet f0f4046979c94f6b9fcfd429cb2f454f with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:07.412488 10917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5bdaeb6ccf347499e2dff26efaf7deb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:07.433710 10917 tablet_copy_client.cc:806] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:07.434434 10917 tablet_copy_client.cc:670] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:07.445634 10917 tablet_copy_client.cc:538] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:07.456014 10917 tablet_bootstrap.cc:492] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:07.491060 10917 tablet_bootstrap.cc:492] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:07.492404 10917 tablet_bootstrap.cc:492] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:07.493110 10917 ts_tablet_manager.cc:1403] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.037s	user 0.023s	sys 0.009s
I20260709 12:26:07.495618 10917 raft_consensus.cc:359] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:07.496454 10917 raft_consensus.cc:740] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:07.496949 10917 consensus_queue.cc:260] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:07.499253 10917 ts_tablet_manager.cc:1434] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:26:07.502519  9974 tablet_copy_service.cc:342] P b011791796d1457284b857d7d3422195: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-a5bdaeb6ccf347499e2dff26efaf7deb received from {username='slave'} at 127.0.0.1:48438
I20260709 12:26:07.502930  9974 tablet_copy_service.cc:434] P b011791796d1457284b857d7d3422195: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-a5bdaeb6ccf347499e2dff26efaf7deb on tablet a5bdaeb6ccf347499e2dff26efaf7deb with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:07.519016 10533 raft_consensus.cc:1217] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:07.646471 10531 raft_consensus.cc:1217] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:07.835951 10531 raft_consensus.cc:1217] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:07.934846 10533 raft_consensus.cc:1217] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:08.087085 10895 raft_consensus.cc:1064] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:08.089119 10895 consensus_queue.cc:237] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:08.095546  9886 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:08.096251  9809 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:08.096379 10533 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:08.097210 10895 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:26:08.099747 10875 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:08.101266 10931 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:08.118758 10894 raft_consensus.cc:2955] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.124295  9809 raft_consensus.cc:2955] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.126817  9886 raft_consensus.cc:2955] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.137478 10533 raft_consensus.cc:2955] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.144287  9713 catalog_manager.cc:5697] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.188030  9956 consensus_queue.cc:237] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:08.194551 10531 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:08.195405  9809 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:08.195776 10895 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:08.196724 10931 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:08.202590 10875 raft_consensus.cc:2955] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.204216  9809 raft_consensus.cc:2955] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.210837 10531 raft_consensus.cc:2955] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.213486  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 90aeaa3c967a48a4804d8960b26f02b5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:08.235394  9712 catalog_manager.cc:5697] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.245044 10829 raft_consensus.cc:1064] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:08.250257 10829 consensus_queue.cc:237] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:08.251273  9871 tablet_service.cc:1558] Processing DeleteTablet for tablet 90aeaa3c967a48a4804d8960b26f02b5 with delete_type TABLET_DATA_TOMBSTONED (TS 963185e117384b2085d7cea02a64478b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57650
I20260709 12:26:08.286679 10531 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:08.288290 10902 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:08.289660 10940 tablet_replica.cc:333] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:26:08.292517  9956 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:08.294064 10940 raft_consensus.cc:2243] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:08.294386 10902 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:08.294921 10940 raft_consensus.cc:2272] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:08.295783  9809 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:08.298413 10829 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:08.303917 10940 ts_tablet_manager.cc:1916] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:08.313560 10875 raft_consensus.cc:1064] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:08.337327 10875 consensus_queue.cc:237] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:08.340058 10940 ts_tablet_manager.cc:1929] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:08.346633 10940 log.cc:1199] T 90aeaa3c967a48a4804d8960b26f02b5 P 963185e117384b2085d7cea02a64478b: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-1-root/wals/90aeaa3c967a48a4804d8960b26f02b5
I20260709 12:26:08.348847  9698 catalog_manager.cc:5028] TS 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): tablet 90aeaa3c967a48a4804d8960b26f02b5 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:08.357052 10829 raft_consensus.cc:2955] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.362180 10533 raft_consensus.cc:1275] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:08.363420  9814 raft_consensus.cc:1275] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:08.364981 10895 consensus_queue.cc:1048] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:08.374507  9888 raft_consensus.cc:1275] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:08.377010 10895 consensus_queue.cc:1048] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:08.376833  9956 raft_consensus.cc:2955] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.378949 10895 consensus_queue.cc:1048] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:08.372782  9809 raft_consensus.cc:2955] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.395733  9710 catalog_manager.cc:5697] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.400899 10895 raft_consensus.cc:1064] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:08.403676 10895 consensus_queue.cc:237] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:08.425482 10533 raft_consensus.cc:2955] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.458395  9885 consensus_queue.cc:237] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:08.466158 10948 log.cc:927] Time spent T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:26:08.473116 10533 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:08.480374 10950 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:08.481282 10894 raft_consensus.cc:2955] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.506964  9809 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:08.511373 10902 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:08.519604  9888 raft_consensus.cc:2955] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.524150 10902 raft_consensus.cc:2955] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.534667 10531 raft_consensus.cc:2955] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.541510 10532 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:08.545210  9890 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:08.546096  9812 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:08.561312  9814 raft_consensus.cc:2955] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.574579  9698 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f0f4046979c94f6b9fcfd429cb2f454f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:08.582706  9710 catalog_manager.cc:5697] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.583400 10939 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:08.592420 10954 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:08.601507 10939 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:26:08.588514  9711 catalog_manager.cc:5697] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.621465 10531 raft_consensus.cc:2955] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.627251  9951 tablet_service.cc:1558] Processing DeleteTablet for tablet f0f4046979c94f6b9fcfd429cb2f454f with delete_type TABLET_DATA_TOMBSTONED (TS b011791796d1457284b857d7d3422195 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55938
I20260709 12:26:08.631754 10958 tablet_replica.cc:333] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:26:08.633075 10958 raft_consensus.cc:2243] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:08.634071 10958 raft_consensus.cc:2272] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:08.679999 10958 ts_tablet_manager.cc:1916] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:08.697682 10939 raft_consensus.cc:2955] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.698581  9812 raft_consensus.cc:2955] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.703670  9885 raft_consensus.cc:2955] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.719340  9957 consensus_queue.cc:237] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:08.723610 10958 ts_tablet_manager.cc:1929] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:08.724195 10958 log.cc:1199] T f0f4046979c94f6b9fcfd429cb2f454f P b011791796d1457284b857d7d3422195: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-2-root/wals/f0f4046979c94f6b9fcfd429cb2f454f
I20260709 12:26:08.729442  9814 raft_consensus.cc:2955] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.731860  9697 catalog_manager.cc:5028] TS b011791796d1457284b857d7d3422195 (127.8.111.67:42253): tablet f0f4046979c94f6b9fcfd429cb2f454f (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:08.733494 10532 raft_consensus.cc:1275] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:08.739627 10532 raft_consensus.cc:2955] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.744678  9885 raft_consensus.cc:1275] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:08.747529 10939 consensus_queue.cc:1048] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:08.753621 10953 consensus_queue.cc:1048] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:08.753338  9710 catalog_manager.cc:5697] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.761405 10931 raft_consensus.cc:2955] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.782548 10532 raft_consensus.cc:2955] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.787320  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fa3541b3559e488d9911972fd2250fc6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:08.788174  9885 raft_consensus.cc:2955] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.793503  9957 consensus_queue.cc:237] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:08.802654  9713 catalog_manager.cc:5697] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.805111 10529 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:08.807538 10931 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:08.802961  9814 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:08.810827 10931 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:08.818966 10953 raft_consensus.cc:2955] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.828363  9814 raft_consensus.cc:2955] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.836898 10529 raft_consensus.cc:2955] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.839536  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a5bdaeb6ccf347499e2dff26efaf7deb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:08.845060  9802 tablet_service.cc:1558] Processing DeleteTablet for tablet fa3541b3559e488d9911972fd2250fc6 with delete_type TABLET_DATA_TOMBSTONED (TS 4104e34a61b7448281d6d91ce23ebf71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46484
I20260709 12:26:08.846724  9712 catalog_manager.cc:5697] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index 3 to 4, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:08.857617  9871 tablet_service.cc:1558] Processing DeleteTablet for tablet a5bdaeb6ccf347499e2dff26efaf7deb with delete_type TABLET_DATA_TOMBSTONED (TS 963185e117384b2085d7cea02a64478b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57650
I20260709 12:26:08.861178 10961 tablet_replica.cc:333] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:26:08.862967 10961 raft_consensus.cc:2243] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:08.863739 10961 raft_consensus.cc:2272] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:08.867381 10960 tablet_replica.cc:333] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:26:08.867416 10961 ts_tablet_manager.cc:1916] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:08.868431 10960 raft_consensus.cc:2243] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:08.869072 10960 raft_consensus.cc:2272] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:08.873600 10960 ts_tablet_manager.cc:1916] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:08.884183 10961 ts_tablet_manager.cc:1929] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:08.884670 10961 log.cc:1199] T a5bdaeb6ccf347499e2dff26efaf7deb P 963185e117384b2085d7cea02a64478b: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-1-root/wals/a5bdaeb6ccf347499e2dff26efaf7deb
I20260709 12:26:08.886263  9698 catalog_manager.cc:5028] TS 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): tablet a5bdaeb6ccf347499e2dff26efaf7deb (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:08.887988 10960 ts_tablet_manager.cc:1929] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:08.888355 10960 log.cc:1199] T fa3541b3559e488d9911972fd2250fc6 P 4104e34a61b7448281d6d91ce23ebf71: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-0-root/wals/fa3541b3559e488d9911972fd2250fc6
I20260709 12:26:08.889770  9697 catalog_manager.cc:5028] TS 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): tablet fa3541b3559e488d9911972fd2250fc6 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:09.238546  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:09.287070  9885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:09.287664  9885 raft_consensus.cc:606] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:09.290604  9885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27036dabafd8427cac190478948639ae"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:09.291158  9885 raft_consensus.cc:606] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:09.302904  9957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5224954c61b74424bc8af520537e37ec"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:26:09.303402  9957 raft_consensus.cc:606] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:09.305814  9885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:09.306602  9885 raft_consensus.cc:606] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:09.308944  9885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:09.309433  9885 raft_consensus.cc:606] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:09.311749  9885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:09.312206  9885 raft_consensus.cc:606] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:09.313186  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:26:09.314460  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:09.315285  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:09.381886 10829 raft_consensus.cc:993] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:09.382385 10950 raft_consensus.cc:1081] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:09.383790  9814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46496
I20260709 12:26:09.384392  9814 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:09.384793  9814 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:09.389848  9814 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:09.392175  9814 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:09.392333  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:09.393019  9888 raft_consensus.cc:3055] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:09.393314  9888 raft_consensus.cc:740] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:09.393944  9888 consensus_queue.cc:260] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:09.394870  9888 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:09.395124  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:09.395643  9957 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:09.399662  9888 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:09.400452  9957 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:09.400931  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:09.401753 10887 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:09.402662 10887 raft_consensus.cc:697] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:09.403584 10887 consensus_queue.cc:237] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:09.412707  9712 catalog_manager.cc:5697] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 2, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:09.448621 10950 raft_consensus.cc:993] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b: : Instructing follower f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:09.449142 10950 raft_consensus.cc:1081] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Signalling peer f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:09.450778 10529 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:36672
I20260709 12:26:09.451328 10529 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:09.451634 10529 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:09.456313 10529 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:09.458519 10529 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:09.459211  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:09.459785  9809 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:09.459923  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:09.460554  9888 raft_consensus.cc:3055] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:09.460861  9888 raft_consensus.cc:740] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:09.461004 10829 raft_consensus.cc:993] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b: : Instructing follower f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:09.461493 10829 raft_consensus.cc:1081] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Signalling peer f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:09.461537  9888 consensus_queue.cc:260] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:09.462914 10532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27036dabafd8427cac190478948639ae"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:36672
I20260709 12:26:09.462978  9888 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:09.463374 10532 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:09.463691 10532 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:09.466094  9809 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:09.467320 10496 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:09.468321 10532 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:09.469187 10970 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:09.470461  9888 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:09.471081 10532 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:09.471618  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:09.472455  9885 raft_consensus.cc:3055] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:09.472384  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:09.472924  9885 raft_consensus.cc:740] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:09.473054  9957 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:09.474534  9885 consensus_queue.cc:260] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:09.475670  9885 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:09.480088 10970 raft_consensus.cc:697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:09.480995 10970 consensus_queue.cc:237] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:09.481794  9957 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:09.483106 10496 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:09.483924 10971 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:09.486361 10971 raft_consensus.cc:697] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:09.487162 10971 consensus_queue.cc:237] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:09.494217  9885 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:09.496362  9712 catalog_manager.cc:5697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 1 to 2, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 2 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:09.509927  9712 catalog_manager.cc:5697] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 1 to 2, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 2 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:09.511394 10953 raft_consensus.cc:993] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:09.511858 10951 raft_consensus.cc:1081] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:09.513363  9809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5224954c61b74424bc8af520537e37ec"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46504
I20260709 12:26:09.513796  9809 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:09.514070  9809 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:09.520265  9809 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:09.521788  9809 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:09.522305  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:09.522742  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:09.522830  9885 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:09.523288  9957 raft_consensus.cc:3055] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:09.523569  9957 raft_consensus.cc:740] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:09.524294  9957 consensus_queue.cc:260] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:09.526402  9957 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:09.528791 10950 raft_consensus.cc:993] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:09.529260 10829 raft_consensus.cc:1081] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:09.529551  9885 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:09.530604  9809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46496
I20260709 12:26:09.530709  9779 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:09.531248  9809 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:09.531487 10887 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:09.531672  9809 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:09.531984 10887 raft_consensus.cc:697] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:09.532250  9957 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:09.532831 10887 consensus_queue.cc:237] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:09.538647  9809 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:09.540802  9809 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:09.541262  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:09.541326  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:09.541895  9885 raft_consensus.cc:3055] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:09.541968  9957 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:09.544430  9712 catalog_manager.cc:5697] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 2, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:09.543280  9885 raft_consensus.cc:740] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:09.548130  9885 consensus_queue.cc:260] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:09.548763  9957 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:09.549316  9885 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:09.549868  9778 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:09.550628 10887 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:09.550963 10887 raft_consensus.cc:697] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:09.551580 10887 consensus_queue.cc:237] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:09.557186  9885 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:09.564852  9712 catalog_manager.cc:5697] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 2, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:09.713785 10950 raft_consensus.cc:993] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:09.714236 10829 raft_consensus.cc:1081] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:09.715387  9809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46496
I20260709 12:26:09.715857  9809 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:09.716120  9809 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:09.720471  9809 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:09.721794  9809 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:09.722512  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:09.722671  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:09.723177  9956 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:09.723181  9885 raft_consensus.cc:3055] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:09.723740  9885 raft_consensus.cc:740] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:09.724432  9885 consensus_queue.cc:260] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:09.725569  9885 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:09.729429  9956 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:09.730327  9885 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:09.730355  9778 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:09.731223 10887 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:09.731590 10887 raft_consensus.cc:697] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:09.732281 10887 consensus_queue.cc:237] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:09.751905  9712 catalog_manager.cc:5697] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 2, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:09.846683  9885 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:09.848009 10887 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:09.857187  9956 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:09.859169 10887 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:09.906510  9957 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:09.907753 10971 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:09.928108  9885 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:09.929416 10972 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:09.945063  9888 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:09.956034 10972 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:09.964365  9885 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:09.966427  9957 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:09.969331  9812 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:09.969983  9814 consensus_queue.cc:237] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:09.970477 10965 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:09.971150 10970 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:09.971767 10965 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:09.991586  9956 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:09.993109 10887 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:10.010973  9779 consensus_peers.cc:597] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: af4289b1f8fb44b9a1d46742954fab18. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:10.013969  9958 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:10.015590 10980 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:10.048841  9885 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:10.051272 10980 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:10.060544 10992 log.cc:927] Time spent T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:26:10.072971 10980 raft_consensus.cc:2955] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:10.079931  9888 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:10.083612 10887 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:10.085053  9957 raft_consensus.cc:2955] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:10.146507  9814 consensus_queue.cc:237] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:10.166169  9957 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:26:10.166045  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 84269.9us
I20260709 12:26:10.167966 10965 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:10.169986  9888 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:10.176275 10887 raft_consensus.cc:2955] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:10.178186  9956 raft_consensus.cc:2955] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:10.187712  9711 catalog_manager.cc:5697] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:10.200706  9957 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:10.201768 10887 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:10.203035  9888 consensus_queue.cc:237] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
W20260709 12:26:10.208649  9779 consensus_peers.cc:597] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 264ab80fe3634a5390e84f23e4dd8c94. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:10.209113  9711 catalog_manager.cc:5697] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index -1 to 3, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:10.210064 10996 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:10.228641  9885 raft_consensus.cc:2955] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:10.236030  9886 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:10.237618 10965 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:10.240463  9890 raft_consensus.cc:2955] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
W20260709 12:26:10.243817  9854 consensus_peers.cc:597] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e528961028ca49b7a317cd20fbb343a8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:10.250562  9956 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:10.251482  9814 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:10.254703 10950 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:10.258832 10987 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:10.276459 10987 raft_consensus.cc:2955] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:10.279299  9814 raft_consensus.cc:2955] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:10.280055  9956 raft_consensus.cc:2955] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:10.292917  9956 consensus_queue.cc:237] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:10.300671  9712 catalog_manager.cc:5697] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
W20260709 12:26:10.310829  9928 consensus_peers.cc:597] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 441af0e88f714cb3be023c9bdcd006fc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:10.313898  9886 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:10.316030  9814 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:10.317499 10953 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:10.319416 10999 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:10.352723  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:10.360702 10951 raft_consensus.cc:2955] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:10.362023  9814 raft_consensus.cc:2955] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:10.378366  9885 raft_consensus.cc:2955] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:10.379850  9713 catalog_manager.cc:5697] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:10.431010  9957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:26:10.431596  9957 raft_consensus.cc:606] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:10.436565  9886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:10.437081  9886 raft_consensus.cc:606] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:10.439929  9886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:10.440418  9886 raft_consensus.cc:606] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:10.442998  9885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:10.443506  9885 raft_consensus.cc:606] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:10.446497  9885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:10.447010  9885 raft_consensus.cc:606] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:10.448326  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:10.450205  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:10.450953  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:10.541440 11009 ts_tablet_manager.cc:933] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:26:10.544310 11009 tablet_copy_client.cc:323] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.65:38995
I20260709 12:26:10.545984  9825 tablet_copy_service.cc:140] P 4104e34a61b7448281d6d91ce23ebf71: Received BeginTabletCopySession request for tablet af4289b1f8fb44b9a1d46742954fab18 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:34802)
I20260709 12:26:10.546507  9825 tablet_copy_service.cc:161] P 4104e34a61b7448281d6d91ce23ebf71: Beginning new tablet copy session on tablet af4289b1f8fb44b9a1d46742954fab18 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:34802: session id = f5208640a51f493e930ce4f64ceeed0b-af4289b1f8fb44b9a1d46742954fab18
I20260709 12:26:10.549280 10987 raft_consensus.cc:993] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:10.549754 10987 raft_consensus.cc:1081] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:10.551867  9814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46496
I20260709 12:26:10.552363  9814 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:10.552685  9814 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:10.555987  9825 tablet_copy_source_session.cc:215] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:10.559428 11009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af4289b1f8fb44b9a1d46742954fab18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:10.559128  9814 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:10.567129  9814 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:10.568176  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:10.568800  9886 raft_consensus.cc:3055] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:10.569072  9886 raft_consensus.cc:740] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:10.569855  9886 consensus_queue.cc:260] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:10.570848  9886 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:10.575088  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:10.575723  9957 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:10.579037  9886 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:10.580824  9779 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:10.582536 10887 raft_consensus.cc:2804] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:10.582957 10887 raft_consensus.cc:697] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:10.583710 10887 consensus_queue.cc:237] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:10.585281  9957 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:10.596190 11009 tablet_copy_client.cc:806] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:10.596731 11009 tablet_copy_client.cc:670] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:10.600488 11009 tablet_copy_client.cc:538] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:10.603097  9711 catalog_manager.cc:5697] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 2, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:10.607308 11009 tablet_bootstrap.cc:492] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:10.635207 11009 tablet_bootstrap.cc:492] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:10.636142 11009 tablet_bootstrap.cc:492] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:10.636785 11009 ts_tablet_manager.cc:1403] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.004s
I20260709 12:26:10.639744 11009 raft_consensus.cc:359] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:10.640560 11009 raft_consensus.cc:740] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:10.641191 11009 consensus_queue.cc:260] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:10.646808 11009 ts_tablet_manager.cc:1434] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:26:10.648608  9825 tablet_copy_service.cc:342] P 4104e34a61b7448281d6d91ce23ebf71: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-af4289b1f8fb44b9a1d46742954fab18 received from {username='slave'} at 127.0.0.1:34802
I20260709 12:26:10.649050  9825 tablet_copy_service.cc:434] P 4104e34a61b7448281d6d91ce23ebf71: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-af4289b1f8fb44b9a1d46742954fab18 on tablet af4289b1f8fb44b9a1d46742954fab18 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:10.658530 11009 ts_tablet_manager.cc:933] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:26:10.660195 11009 tablet_copy_client.cc:323] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.65:38995
I20260709 12:26:10.661209 10829 raft_consensus.cc:993] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b: : Instructing follower f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:10.661620 10829 raft_consensus.cc:1081] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Signalling peer f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:10.663156  9825 tablet_copy_service.cc:140] P 4104e34a61b7448281d6d91ce23ebf71: Received BeginTabletCopySession request for tablet 264ab80fe3634a5390e84f23e4dd8c94 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:34802)
I20260709 12:26:10.663188 10532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:36672
I20260709 12:26:10.663904  9825 tablet_copy_service.cc:161] P 4104e34a61b7448281d6d91ce23ebf71: Beginning new tablet copy session on tablet 264ab80fe3634a5390e84f23e4dd8c94 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:34802: session id = f5208640a51f493e930ce4f64ceeed0b-264ab80fe3634a5390e84f23e4dd8c94
I20260709 12:26:10.664112 10532 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:10.664741 10532 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:10.671772  9825 tablet_copy_source_session.cc:215] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:10.674783 11009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 264ab80fe3634a5390e84f23e4dd8c94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:10.675103 10532 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:10.679972  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:10.680526  9886 raft_consensus.cc:3055] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:10.680878  9886 raft_consensus.cc:740] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:10.681602  9886 consensus_queue.cc:260] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:10.679693 10532 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:10.682680  9886 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:10.686569  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:10.687047  9957 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:10.690799 11009 tablet_copy_client.cc:806] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:10.691459 11009 tablet_copy_client.cc:670] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:10.696128  9957 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:10.696380  9886 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:10.696859 11009 tablet_copy_client.cc:538] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:10.700615 10496 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:10.701555 10972 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:10.702021 10972 raft_consensus.cc:697] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 3 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:10.702862 10972 consensus_queue.cc:237] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:10.706070 11009 tablet_bootstrap.cc:492] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:10.737329 10987 raft_consensus.cc:993] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:10.737867 10950 raft_consensus.cc:1081] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:10.741768 11014 ts_tablet_manager.cc:933] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:10.744818  9814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46496
I20260709 12:26:10.747879  9814 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:10.748540  9814 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:10.765027  9814 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:10.765520  9711 catalog_manager.cc:5697] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 2 to 3, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 3 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:10.781010  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:10.781603  9885 raft_consensus.cc:3055] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:10.781899  9885 raft_consensus.cc:740] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:10.782869  9885 consensus_queue.cc:260] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:10.783658 11009 tablet_bootstrap.cc:492] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:10.783952  9885 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:10.784667 11009 tablet_bootstrap.cc:492] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:10.785401 11009 ts_tablet_manager.cc:1403] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.080s	user 0.030s	sys 0.003s
I20260709 12:26:10.788527 11009 raft_consensus.cc:359] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:10.789387 11009 raft_consensus.cc:740] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:10.790477 11009 consensus_queue.cc:260] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:10.795589 11014 tablet_copy_client.cc:323] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.66:34205
I20260709 12:26:10.796218  9885 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:10.797596  9899 tablet_copy_service.cc:140] P 963185e117384b2085d7cea02a64478b: Received BeginTabletCopySession request for tablet e528961028ca49b7a317cd20fbb343a8 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:54428)
I20260709 12:26:10.798137  9899 tablet_copy_service.cc:161] P 963185e117384b2085d7cea02a64478b: Beginning new tablet copy session on tablet e528961028ca49b7a317cd20fbb343a8 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:54428: session id = f5208640a51f493e930ce4f64ceeed0b-e528961028ca49b7a317cd20fbb343a8
I20260709 12:26:10.798358 11009 ts_tablet_manager.cc:1434] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.007s
I20260709 12:26:10.799851  9779 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:10.800701 10887 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:10.801118 10887 raft_consensus.cc:697] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:10.801316  9825 tablet_copy_service.cc:342] P 4104e34a61b7448281d6d91ce23ebf71: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-264ab80fe3634a5390e84f23e4dd8c94 received from {username='slave'} at 127.0.0.1:34802
I20260709 12:26:10.801787  9825 tablet_copy_service.cc:434] P 4104e34a61b7448281d6d91ce23ebf71: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-264ab80fe3634a5390e84f23e4dd8c94 on tablet 264ab80fe3634a5390e84f23e4dd8c94 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:10.801864 10887 consensus_queue.cc:237] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:10.807174  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:10.807709  9957 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:10.817914  9814 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:10.818720  9957 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:10.823721  9899 tablet_copy_source_session.cc:215] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:10.829202 11014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e528961028ca49b7a317cd20fbb343a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:10.835553  9711 catalog_manager.cc:5697] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 2, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:10.846261 11014 tablet_copy_client.cc:806] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:10.846887 11014 tablet_copy_client.cc:670] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:10.851245 11009 ts_tablet_manager.cc:933] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:10.859553 11009 tablet_copy_client.cc:323] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.67:42253
I20260709 12:26:10.861358  9974 tablet_copy_service.cc:140] P b011791796d1457284b857d7d3422195: Received BeginTabletCopySession request for tablet 441af0e88f714cb3be023c9bdcd006fc from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:48438)
I20260709 12:26:10.861898  9974 tablet_copy_service.cc:161] P b011791796d1457284b857d7d3422195: Beginning new tablet copy session on tablet 441af0e88f714cb3be023c9bdcd006fc from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:48438: session id = f5208640a51f493e930ce4f64ceeed0b-441af0e88f714cb3be023c9bdcd006fc
I20260709 12:26:10.863191 11014 tablet_copy_client.cc:538] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:10.871217  9974 tablet_copy_source_session.cc:215] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:10.872812 11014 tablet_bootstrap.cc:492] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:10.875303 11009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 441af0e88f714cb3be023c9bdcd006fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:10.890295 10999 raft_consensus.cc:993] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:10.890831 10999 raft_consensus.cc:1081] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:10.891945 11009 tablet_copy_client.cc:806] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:10.892452 11009 tablet_copy_client.cc:670] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:10.892606  9812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46504
I20260709 12:26:10.893108  9812 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:10.893424  9812 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:10.897678  9812 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:10.900130  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:10.900707  9886 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:10.903847 11009 tablet_copy_client.cc:538] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:10.913375 11009 tablet_bootstrap.cc:492] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:10.920670  9886 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:10.925304  9779 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:10.926102 10887 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:10.928650 10887 raft_consensus.cc:697] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:10.929445 10887 consensus_queue.cc:237] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:10.935223 11014 tablet_bootstrap.cc:492] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:10.936246 11014 tablet_bootstrap.cc:492] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:10.936939 11014 ts_tablet_manager.cc:1403] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.064s	user 0.025s	sys 0.025s
I20260709 12:26:10.939945 11014 raft_consensus.cc:359] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:10.940840 11014 raft_consensus.cc:740] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:10.941540 11014 consensus_queue.cc:260] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:10.943307 11009 tablet_bootstrap.cc:492] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:10.945326 11014 ts_tablet_manager.cc:1434] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:26:10.952824 11009 tablet_bootstrap.cc:492] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:10.953665 11009 ts_tablet_manager.cc:1403] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.040s	user 0.018s	sys 0.011s
I20260709 12:26:10.956499  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:10.957068  9957 raft_consensus.cc:3055] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:10.956774 11009 raft_consensus.cc:359] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:10.957391  9957 raft_consensus.cc:740] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:10.957578 11009 raft_consensus.cc:740] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:10.958166  9957 consensus_queue.cc:260] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:10.958218 11009 consensus_queue.cc:260] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:10.959144  9957 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:10.952798  9885 raft_consensus.cc:1240] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:10.961323 11009 ts_tablet_manager.cc:1434] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:26:10.963948  9812 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:10.967185  9957 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:10.971225  9974 tablet_copy_service.cc:342] P b011791796d1457284b857d7d3422195: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-441af0e88f714cb3be023c9bdcd006fc received from {username='slave'} at 127.0.0.1:48438
I20260709 12:26:10.971617  9974 tablet_copy_service.cc:434] P b011791796d1457284b857d7d3422195: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-441af0e88f714cb3be023c9bdcd006fc on tablet 441af0e88f714cb3be023c9bdcd006fc with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:10.972586  9713 catalog_manager.cc:5697] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 2, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:10.974295  9899 tablet_copy_service.cc:342] P 963185e117384b2085d7cea02a64478b: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-e528961028ca49b7a317cd20fbb343a8 received from {username='slave'} at 127.0.0.1:54428
I20260709 12:26:10.974716  9899 tablet_copy_service.cc:434] P 963185e117384b2085d7cea02a64478b: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-e528961028ca49b7a317cd20fbb343a8 on tablet e528961028ca49b7a317cd20fbb343a8 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:10.976393 10987 raft_consensus.cc:993] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b: : Instructing follower f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:10.976984 10950 raft_consensus.cc:1081] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Signalling peer f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:10.979522 10532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:36672
I20260709 12:26:10.980232 10532 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:10.980686 10532 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:10.994489 10532 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:10.996933  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:10.997323  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:10.997562  9814 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:10.997910  9885 raft_consensus.cc:3055] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:10.998261  9885 raft_consensus.cc:740] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:10.999015  9885 consensus_queue.cc:260] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:10.999789  9885 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:10.996882 10532 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:11.007217  9814 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:11.012334 10496 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:11.013216 10972 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:11.013783 10972 raft_consensus.cc:697] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:11.014698 10972 consensus_queue.cc:237] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:11.005913  9885 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:11.027976 10529 raft_consensus.cc:1217] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:11.045495  9885 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:11.048454 10996 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:11.055418  9713 catalog_manager.cc:5697] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 1 to 2, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 2 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.088318  9957 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:11.090075 10965 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:11.105116 10532 raft_consensus.cc:1217] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:11.157884 10532 raft_consensus.cc:1217] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:26:11.189114  9885 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:11.190374 10972 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:11.211009  9957 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:11.212852 11032 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:11.279320 10532 raft_consensus.cc:1217] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:11.393383  9885 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:11.394770 10887 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:11.405786  9957 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:11.408864 10965 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:11.476084  9810 raft_consensus.cc:1275] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:11.477417 11032 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:11.490513  9885 raft_consensus.cc:1275] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:11.491966 11032 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:11.498804  9886 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:11.504421 11035 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:11.507032  9957 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:11.508450 11035 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:11.515703 10965 raft_consensus.cc:1064] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:11.518376 10965 consensus_queue.cc:237] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:11.522679  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:11.570406  9957 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:11.571678 10532 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:11.571772  9886 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:11.572921 10887 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:11.582903 10965 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:11.584971 10965 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:11.623270 11042 raft_consensus.cc:2955] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:11.627524  9956 raft_consensus.cc:2955] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:11.641435  9886 raft_consensus.cc:2955] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:11.645156 10529 raft_consensus.cc:2955] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:11.668016 10987 raft_consensus.cc:1064] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:11.661312  9711 catalog_manager.cc:5697] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:11.671128 10987 consensus_queue.cc:237] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:11.694227  9957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:26:11.695019  9957 raft_consensus.cc:606] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:11.699352 10529 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:11.700667  9957 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:11.701898 10950 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:11.704576 10950 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:11.740950  9814 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:11.741518 10965 raft_consensus.cc:1064] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:11.743747  9810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5224954c61b74424bc8af520537e37ec"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:26:11.744315  9810 raft_consensus.cc:606] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:26:11.743956 10965 consensus_queue.cc:237] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:11.745355  9814 consensus_queue.cc:237] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:11.747203  9956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:26:11.747769  9956 raft_consensus.cc:606] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:11.752588 10529 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:11.754959  9886 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:11.754899 11042 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:11.756662 10887 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:11.758800  9956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:26:11.759357  9956 raft_consensus.cc:606] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:11.766868  9958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:26:11.767438  9958 raft_consensus.cc:606] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:11.769635  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:11.771210  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:11.770727 10996 raft_consensus.cc:2955] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:11.771961  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:11.772109 10529 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:11.774384  9958 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:11.774922 10529 raft_consensus.cc:2955] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:11.775847 11035 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:11.781432  9886 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:11.783310 10887 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:11.787789  9886 raft_consensus.cc:2955] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:11.791877 11042 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:11.791909 10950 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:26:11.793542  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet af4289b1f8fb44b9a1d46742954fab18 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:11.799176 11054 raft_consensus.cc:2955] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:11.811385  9957 raft_consensus.cc:2955] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:11.820683  9712 catalog_manager.cc:5697] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index 3 to 4, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.838447 10953 raft_consensus.cc:993] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:11.838938 10953 raft_consensus.cc:1081] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:11.842126  9810 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46504
I20260709 12:26:11.842698  9810 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:11.843077  9810 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:11.842826 10532 raft_consensus.cc:2955] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:11.848783  9951 tablet_service.cc:1558] Processing DeleteTablet for tablet af4289b1f8fb44b9a1d46742954fab18 with delete_type TABLET_DATA_TOMBSTONED (TS b011791796d1457284b857d7d3422195 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55938
I20260709 12:26:11.850317 11048 raft_consensus.cc:993] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195: : Instructing follower f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:11.850899 11047 raft_consensus.cc:1081] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Signalling peer f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:11.852563 10531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:36670
I20260709 12:26:11.853228 10531 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:11.853648 10531 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:11.856492  9710 catalog_manager.cc:5697] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.860409 10531 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:11.862316 10531 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:11.863287  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:11.863508  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:11.863871  9956 raft_consensus.cc:3055] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:11.864219  9956 raft_consensus.cc:740] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:11.864290  9885 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:11.864966  9956 consensus_queue.cc:260] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:11.866075  9956 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:11.875113  9956 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:11.876261 10496 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:11.877269 11038 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:11.877679 11048 raft_consensus.cc:1064] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:11.877740 11038 raft_consensus.cc:697] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:26:11.878226 11048 raft_consensus.cc:1068] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195: Unable to promote non-voter f5208640a51f493e930ce4f64ceeed0b: Service unavailable: leader transfer in progress
I20260709 12:26:11.878890 11038 consensus_queue.cc:237] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:11.863886  9810 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:11.888804  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:11.889328  9955 raft_consensus.cc:3055] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:11.889598  9955 raft_consensus.cc:740] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:11.890341  9955 consensus_queue.cc:260] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:11.891659  9955 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:11.913491 11048 raft_consensus.cc:993] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:11.913980 11048 raft_consensus.cc:1081] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
W20260709 12:26:11.898908  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 60094us
I20260709 12:26:11.916528  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:11.917008  9809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46504
I20260709 12:26:11.917631  9809 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:11.917982  9809 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:11.917052  9890 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:11.926666  9890 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:11.936983  9885 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:11.933933  9890 consensus_queue.cc:237] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:11.943665  9712 catalog_manager.cc:5697] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 1 to 2, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 2 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.853240 11065 tablet_replica.cc:333] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:26:11.934022  9809 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:11.953701 10532 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:11.954401  9810 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:11.953830  9809 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:11.928529  9955 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:11.956372 10987 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:11.956624  9957 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:11.958654 11054 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:11.959537  9778 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:11.961443 10996 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:11.962042 10996 raft_consensus.cc:697] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:11.963315 10996 consensus_queue.cc:237] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:11.974347 11054 raft_consensus.cc:2955] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:12.002452 11042 raft_consensus.cc:2955] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:12.004572  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:12.010512  9955 raft_consensus.cc:3055] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:12.010921  9955 raft_consensus.cc:740] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:12.011729  9955 consensus_queue.cc:260] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:12.011488  9962 raft_consensus.cc:2955] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:12.020422 11065 raft_consensus.cc:2243] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.021291 11065 raft_consensus.cc:2272] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.023100 10532 raft_consensus.cc:2955] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:12.025657 11065 ts_tablet_manager.cc:1916] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:12.030591  9698 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e528961028ca49b7a317cd20fbb343a8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:12.012974  9955 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.043990  9955 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:12.043754  9711 catalog_manager.cc:5697] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index 3 to 4, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:12.045519  9778 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:12.047317  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:12.048044  9886 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.053614 11065 ts_tablet_manager.cc:1929] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:12.054080 11065 log.cc:1199] T af4289b1f8fb44b9a1d46742954fab18 P b011791796d1457284b857d7d3422195: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-2-root/wals/af4289b1f8fb44b9a1d46742954fab18
I20260709 12:26:12.054149  9886 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
W20260709 12:26:12.119428  9779 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.8.111.126:43135, user_credentials={real_user=slave}} blocked reactor thread for 54330.2us
I20260709 12:26:12.090999  9957 raft_consensus.cc:2955] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:12.114789  9888 raft_consensus.cc:2955] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:12.055763 10965 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:12.126534 10965 raft_consensus.cc:697] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:12.127359 10965 consensus_queue.cc:237] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:12.133854  9697 catalog_manager.cc:5028] TS b011791796d1457284b857d7d3422195 (127.8.111.67:42253): tablet af4289b1f8fb44b9a1d46742954fab18 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:12.148516 10532 raft_consensus.cc:2955] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:12.150487  9711 catalog_manager.cc:5697] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 2, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.155771  9713 catalog_manager.cc:5697] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:12.162576  9812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46484
I20260709 12:26:12.163100  9812 raft_consensus.cc:606] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:26:12.166734 10965 raft_consensus.cc:993] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:26:12.167469 10996 raft_consensus.cc:1081] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:26:12.169036  9886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5224954c61b74424bc8af520537e37ec"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:57658
I20260709 12:26:12.169533  9886 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:12.169878  9886 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:12.176096  9886 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:12.176563  9711 catalog_manager.cc:5697] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 2, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.178747  9886 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:12.180557  9809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46484
I20260709 12:26:12.181093  9809 raft_consensus.cc:606] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Received request to transfer leadership
W20260709 12:26:12.182265  9697 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 441af0e88f714cb3be023c9bdcd006fc already in progress [suppressed 5 similar messages]
I20260709 12:26:12.182396  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:12.183007  9957 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:12.185199  9809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46484
I20260709 12:26:12.185714  9809 raft_consensus.cc:606] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:26:12.187156 11047 raft_consensus.cc:993] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195: : Instructing follower f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:12.187579 11047 raft_consensus.cc:1081] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Signalling peer f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:12.188503  9802 tablet_service.cc:1558] Processing DeleteTablet for tablet e528961028ca49b7a317cd20fbb343a8 with delete_type TABLET_DATA_TOMBSTONED (TS 4104e34a61b7448281d6d91ce23ebf71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46484
I20260709 12:26:12.190447 10532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:36670
I20260709 12:26:12.190945 10532 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:12.191251 10532 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.192579  9957 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:12.194178  9809 consensus_queue.cc:237] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:12.195209  9761 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:26:12.195596  9761 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 441af0e88f714cb3be023c9bdcd006fc already in progress
W20260709 12:26:12.195915  9761 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 441af0e88f714cb3be023c9bdcd006fc already in progress
I20260709 12:26:12.200266 10532 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:12.200989  9957 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:12.200790  9853 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:12.204187 10996 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:12.204802 10532 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:12.205942 11054 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:12.208082 11054 raft_consensus.cc:697] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:12.208906 11054 consensus_queue.cc:237] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:12.207531  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:12.210841  9812 raft_consensus.cc:3055] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:12.211133  9812 raft_consensus.cc:740] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:12.211544  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:12.212113 10532 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:12.211807  9812 consensus_queue.cc:260] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:12.211896 10887 raft_consensus.cc:2955] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:12.212085  9809 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.212983  9812 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:12.222878  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 264ab80fe3634a5390e84f23e4dd8c94 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:12.213465 11061 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:26:12.229343 10529 raft_consensus.cc:2955] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:12.232211  9809 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:12.233570 10496 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:12.234541 11038 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:12.205406  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:12.235198 11038 raft_consensus.cc:697] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:12.235730  9957 raft_consensus.cc:3055] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:12.234566  9955 raft_consensus.cc:2955] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:12.236099 11038 consensus_queue.cc:237] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:12.240468  9812 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:12.251588  9711 catalog_manager.cc:5697] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index 4 to 5, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.265457  9957 raft_consensus.cc:740] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:12.266258  9957 consensus_queue.cc:260] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:12.267438  9957 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:12.269335  9712 catalog_manager.cc:5697] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 1 to 2, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 2 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:12.277882  9710 catalog_manager.cc:5697] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 2 to 3, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 3 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.286535  9871 tablet_service.cc:1558] Processing DeleteTablet for tablet 264ab80fe3634a5390e84f23e4dd8c94 with delete_type TABLET_DATA_TOMBSTONED (TS 963185e117384b2085d7cea02a64478b not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:57650
I20260709 12:26:12.303012 11071 tablet_replica.cc:333] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:26:12.304167 11071 raft_consensus.cc:2243] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.309393 11071 pending_rounds.cc:70] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71: Trying to abort 1 pending ops.
I20260709 12:26:12.309823 11071 pending_rounds.cc:77] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305625483956989952 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "e528961028ca49b7a317cd20fbb343a8" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } } }
I20260709 12:26:12.311537 11071 raft_consensus.cc:2917] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:26:12.312085 11071 raft_consensus.cc:2889] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:26:12.312569 11071 raft_consensus.cc:2272] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.318701 11074 tablet_replica.cc:333] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:26:12.319125  9957 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:12.319782 11071 ts_tablet_manager.cc:1916] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:12.324321  9888 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:12.325762 11038 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:12.319732 11074 raft_consensus.cc:2243] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.327154 11074 raft_consensus.cc:2272] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.334045 11074 ts_tablet_manager.cc:1916] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:12.339924 11071 ts_tablet_manager.cc:1929] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:12.340459 11071 log.cc:1199] T e528961028ca49b7a317cd20fbb343a8 P 4104e34a61b7448281d6d91ce23ebf71: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-0-root/wals/e528961028ca49b7a317cd20fbb343a8
I20260709 12:26:12.342633  9697 catalog_manager.cc:5028] TS 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): tablet e528961028ca49b7a317cd20fbb343a8 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:12.349572 11074 ts_tablet_manager.cc:1929] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:26:12.350064 11074 log.cc:1199] T 264ab80fe3634a5390e84f23e4dd8c94 P 963185e117384b2085d7cea02a64478b: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-1-root/wals/264ab80fe3634a5390e84f23e4dd8c94
I20260709 12:26:12.351868  9698 catalog_manager.cc:5028] TS 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): tablet 264ab80fe3634a5390e84f23e4dd8c94 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:12.358165  9957 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:12.359630 11038 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:12.399534 10529 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Advancing to term 2
I20260709 12:26:12.405543 10529 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:12.406890 11061 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:12.408329  9957 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:12.409667 11061 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:12.416332 10887 raft_consensus.cc:1064] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
W20260709 12:26:12.416707 10887 raft_consensus.cc:1068] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71: Unable to promote non-voter f5208640a51f493e930ce4f64ceeed0b: Service unavailable: leader transfer in progress
I20260709 12:26:12.420632 11061 raft_consensus.cc:993] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower b011791796d1457284b857d7d3422195 to start an election
I20260709 12:26:12.421114 11042 raft_consensus.cc:1081] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Signalling peer b011791796d1457284b857d7d3422195 to start an election
I20260709 12:26:12.423022  9955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc"
dest_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55952
I20260709 12:26:12.423694  9955 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:12.424063  9955 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:12.427716  9886 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:12.430956 10887 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:12.436769 10996 raft_consensus.cc:1064] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
W20260709 12:26:12.437167 10996 raft_consensus.cc:1068] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71: Unable to promote non-voter f5208640a51f493e930ce4f64ceeed0b: Service unavailable: leader transfer in progress
I20260709 12:26:12.438205  9955 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:12.439347  9957 raft_consensus.cc:1240] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:12.442948 10887 consensus_queue.cc:1059] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:12.443943 11061 raft_consensus.cc:3055] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:12.444375 11061 raft_consensus.cc:740] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:12.445181 11061 consensus_queue.cc:260] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:12.446520 11061 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:12.443861  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:12.451083  9955 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:12.453150  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:12.453605  9886 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:12.457762  9886 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:12.458446  9812 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:12.458762  9928 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:12.459533 11047 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:12.460011 11047 raft_consensus.cc:697] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:12.460860 11047 consensus_queue.cc:237] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:12.472119  9711 catalog_manager.cc:5697] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 2 to 3, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 3 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.625856  9812 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:12.627138 11054 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:12.633216  9886 raft_consensus.cc:1275] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:12.634725 11061 consensus_queue.cc:1048] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.637401  9955 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:12.639189 11054 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:12.644454  9957 raft_consensus.cc:1275] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:12.645783 11061 consensus_queue.cc:1048] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:12.650215  9812 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:12.653066 11038 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:12.693578  9955 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:12.695530 10972 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:12.914681  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:12.941443  9886 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:12.942837 10998 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:12.954080  9810 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:12.955755  9886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:12.959281  9886 raft_consensus.cc:606] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:12.958025 10529 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Advancing to term 3
I20260709 12:26:12.955931 11047 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:26:12.967504 10529 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 3 LEARNER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:12.970250 11047 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:12.970759  9957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:26:12.971323  9957 raft_consensus.cc:606] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:12.976377  9812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:26:12.976907  9812 raft_consensus.cc:606] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:12.988059  9957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:26:12.988623  9957 raft_consensus.cc:606] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:26:12.989997 11092 raft_consensus.cc:1064] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:12.991145  9957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:26:12.991642  9957 raft_consensus.cc:606] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:12.993889 11092 consensus_queue.cc:237] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:12.995472  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:12.997212  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:12.998574  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:13.002331  9810 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:13.003288 10529 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 3 LEARNER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:13.004259 11093 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:13.005146  9886 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:13.010228 11093 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:13.010978 11091 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:13.030069 11093 raft_consensus.cc:2955] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:13.031935 10529 raft_consensus.cc:2955] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:13.044973  9810 raft_consensus.cc:2955] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:13.051347 11091 raft_consensus.cc:993] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:13.051846 10998 raft_consensus.cc:1081] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:13.055351  9812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46504
I20260709 12:26:13.055879  9812 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:13.056357  9812 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.055820  9711 catalog_manager.cc:5697] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index 2 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:13.056843  9886 raft_consensus.cc:2955] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:13.068567  9812 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:13.071753  9812 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:13.071972  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:13.077524  9888 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.072620  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:13.082777  9957 raft_consensus.cc:3055] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:13.083200  9957 raft_consensus.cc:740] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:13.083956  9957 consensus_queue.cc:260] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:13.085063  9957 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.095351  9888 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:13.098495  9779 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:13.099646 10965 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:13.100793 10965 raft_consensus.cc:697] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:13.102177 10965 consensus_queue.cc:237] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:13.100911  9957 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:13.112391 10998 raft_consensus.cc:993] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195: : Instructing follower f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:13.113348 11091 raft_consensus.cc:1081] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Signalling peer f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:13.115567 10532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:36670
I20260709 12:26:13.116088 10532 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:13.116437 10532 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.126253 10532 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:13.129112  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:13.129690  9812 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.129419  9955 consensus_queue.cc:237] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:13.131403  9712 catalog_manager.cc:5697] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 2, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:13.135787 10529 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:13.137689  9812 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:13.138964 10496 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:13.138743 11091 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:13.140828 10972 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:13.141391 10972 raft_consensus.cc:697] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:13.142802 10972 consensus_queue.cc:237] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:13.146371  9886 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:13.148746 11047 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:13.149618 10532 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:13.151454  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:13.152105  9955 raft_consensus.cc:3055] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:13.152463  9955 raft_consensus.cc:740] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:13.153241  9955 consensus_queue.cc:260] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:13.157074  9955 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.156201 11091 raft_consensus.cc:2955] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:13.155244 10532 raft_consensus.cc:2955] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:13.160772  9886 raft_consensus.cc:2955] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:13.163951  9955 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:13.173334  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 441af0e88f714cb3be023c9bdcd006fc with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:13.174247  9712 catalog_manager.cc:5697] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 1 to 2, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 2 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:13.183320  9710 catalog_manager.cc:5697] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 5 to 6, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New cstate: current_term: 3 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:13.194887  9802 tablet_service.cc:1558] Processing DeleteTablet for tablet 441af0e88f714cb3be023c9bdcd006fc with delete_type TABLET_DATA_TOMBSTONED (TS 4104e34a61b7448281d6d91ce23ebf71 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:46484
I20260709 12:26:13.207717 11099 tablet_replica.cc:333] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:26:13.208791 11099 raft_consensus.cc:2243] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.209590 11099 raft_consensus.cc:2272] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.212988 11099 ts_tablet_manager.cc:1916] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:13.230427 11099 ts_tablet_manager.cc:1929] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:26:13.230810 11099 log.cc:1199] T 441af0e88f714cb3be023c9bdcd006fc P 4104e34a61b7448281d6d91ce23ebf71: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-0-root/wals/441af0e88f714cb3be023c9bdcd006fc
I20260709 12:26:13.232221  9697 catalog_manager.cc:5028] TS 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): tablet 441af0e88f714cb3be023c9bdcd006fc (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:13.343662  9810 consensus_queue.cc:237] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:13.348829  9955 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:13.349277  9886 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:26:13.349285  9779 consensus_peers.cc:597] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e55138bc5c8b46a1a4b5408bb8a06868. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.350180 10965 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:13.351377 10996 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.357182 11068 raft_consensus.cc:993] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b: : Instructing follower f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:13.357663 11054 raft_consensus.cc:1081] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Signalling peer f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:13.359133 10532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:36672
I20260709 12:26:13.359612 10532 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:13.359930 10532 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.366329 10532 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:13.373629 11061 raft_consensus.cc:993] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:13.374550 10532 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:13.374871  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:13.375099 11061 raft_consensus.cc:1081] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Signalling peer f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:13.375480  9888 raft_consensus.cc:3055] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:13.375799  9888 raft_consensus.cc:740] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:13.376462  9888 consensus_queue.cc:260] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:13.376063 11061 raft_consensus.cc:2955] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:13.376854 10532 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:26:13.377583 10532 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:13.377693  9888 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.378064 10532 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.380851  9956 raft_consensus.cc:2955] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:13.383471  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:13.384035  9957 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.385900 10532 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:13.390123  9886 raft_consensus.cc:2955] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:13.399166  9810 consensus_queue.cc:237] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:13.402099 10532 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:13.401834  9712 catalog_manager.cc:5697] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index -1 to 3, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:13.402411  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:13.403347  9812 raft_consensus.cc:3055] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:13.403707  9812 raft_consensus.cc:740] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:13.404542  9812 consensus_queue.cc:260] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:13.405746  9812 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.406266  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:13.406894  9955 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.422628  9812 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:13.424062  9888 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:13.424011 10496 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:13.461449 10497 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:13.462467 11038 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:13.461620 11032 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:13.466306  9956 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:13.466944  9957 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:13.468221  9888 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:13.473956 10996 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:13.474928 11061 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:13.477336  9779 consensus_peers.cc:597] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 92a71d859626422a835ad38ab2ba7bd7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.479750  9955 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:13.481585 11038 raft_consensus.cc:697] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:13.482573 11038 consensus_queue.cc:237] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:13.492949 11032 raft_consensus.cc:697] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:13.497478  9713 catalog_manager.cc:5697] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 1 to 2, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 2 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:13.499562 11032 consensus_queue.cc:237] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:13.502619 10965 raft_consensus.cc:2955] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:13.510775  9955 raft_consensus.cc:2955] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:13.514658  9888 raft_consensus.cc:2955] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:13.521384 11091 raft_consensus.cc:993] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:26:13.521878 11091 raft_consensus.cc:1081] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:26:13.525159  9713 catalog_manager.cc:5697] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 1 to 2, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 2 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:13.528168  9885 consensus_queue.cc:237] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:13.529054  9710 catalog_manager.cc:5697] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:13.535006  9886 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:57652
I20260709 12:26:13.535585  9886 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:13.535972  9886 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.545217  9886 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:13.553953  9886 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:13.554602  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:13.555956  9810 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.566341  9810 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:13.567981  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:13.568745 11068 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:13.569221 11068 raft_consensus.cc:697] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:13.570091 11068 consensus_queue.cc:237] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:13.571882  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:13.572461  9957 raft_consensus.cc:3055] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:13.572742  9957 raft_consensus.cc:740] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:13.573519  9957 consensus_queue.cc:260] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:13.574545  9957 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:13.583405  9957 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
W20260709 12:26:13.589908  9854 consensus_peers.cc:597] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a7dd9ecad304177bbefcb8725c66393. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.591986  9957 raft_consensus.cc:1275] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:13.593393  9812 raft_consensus.cc:1275] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:13.593508 11054 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:13.594799 11068 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:13.608666 11068 raft_consensus.cc:2955] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:13.610904  9957 raft_consensus.cc:2955] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:13.613159  9810 raft_consensus.cc:2955] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:13.626573  9955 consensus_queue.cc:237] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:13.626921  9713 catalog_manager.cc:5697] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:13.641065  9710 catalog_manager.cc:5697] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 1 to 2, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 2 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:13.642496  9809 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:13.644758 11047 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:13.646934  9886 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:13.654753  9928 consensus_peers.cc:597] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 511405268634431e9bf729e0fc87c838. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.655630 11047 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:13.659888  9955 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:13.661481 11106 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:13.678517 11092 raft_consensus.cc:2955] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:13.683127  9810 raft_consensus.cc:2955] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:13.687263  9886 raft_consensus.cc:2955] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:13.689318  9956 raft_consensus.cc:1275] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:13.691347 11105 consensus_queue.cc:1048] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:13.704507  9810 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:13.710738  9710 catalog_manager.cc:5697] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:13.713353 11032 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:13.715946  9886 raft_consensus.cc:1275] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:13.719970 11105 consensus_queue.cc:1048] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:13.796422 11129 ts_tablet_manager.cc:933] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:26:13.811738 11129 tablet_copy_client.cc:323] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.65:38995
I20260709 12:26:13.825791  9825 tablet_copy_service.cc:140] P 4104e34a61b7448281d6d91ce23ebf71: Received BeginTabletCopySession request for tablet e55138bc5c8b46a1a4b5408bb8a06868 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:34802)
I20260709 12:26:13.826357  9825 tablet_copy_service.cc:161] P 4104e34a61b7448281d6d91ce23ebf71: Beginning new tablet copy session on tablet e55138bc5c8b46a1a4b5408bb8a06868 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:34802: session id = f5208640a51f493e930ce4f64ceeed0b-e55138bc5c8b46a1a4b5408bb8a06868
I20260709 12:26:13.833854  9825 tablet_copy_source_session.cc:215] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:13.846128 11129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e55138bc5c8b46a1a4b5408bb8a06868. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.873950 11129 tablet_copy_client.cc:806] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:13.874517 11129 tablet_copy_client.cc:670] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:13.878187 11129 tablet_copy_client.cc:538] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:13.884922 11129 tablet_bootstrap.cc:492] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:13.903568 11129 tablet_bootstrap.cc:492] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:13.904408 11129 tablet_bootstrap.cc:492] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:13.905045 11129 ts_tablet_manager.cc:1403] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.020s	user 0.020s	sys 0.000s
I20260709 12:26:13.907948 11129 raft_consensus.cc:359] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:13.908771 11129 raft_consensus.cc:740] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:13.909519 11129 consensus_queue.cc:260] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:13.912739 11129 ts_tablet_manager.cc:1434] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:13.915087  9825 tablet_copy_service.cc:342] P 4104e34a61b7448281d6d91ce23ebf71: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-e55138bc5c8b46a1a4b5408bb8a06868 received from {username='slave'} at 127.0.0.1:34802
I20260709 12:26:13.915539  9825 tablet_copy_service.cc:434] P 4104e34a61b7448281d6d91ce23ebf71: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-e55138bc5c8b46a1a4b5408bb8a06868 on tablet e55138bc5c8b46a1a4b5408bb8a06868 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:13.916729  9957 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:13.918536 11032 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:13.929980  9956 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:13.931537 11032 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:13.939766  9812 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:13.947290 11038 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:13.951869  9888 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:13.951875 11129 ts_tablet_manager.cc:933] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:26:13.954566 11106 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:13.962934  9812 raft_consensus.cc:1275] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:13.964639 10987 consensus_queue.cc:1048] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:13.996649  9957 raft_consensus.cc:1275] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:14.010054 11116 consensus_queue.cc:1048] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:14.079289  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:14.100620 11129 tablet_copy_client.cc:323] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.65:38995
I20260709 12:26:14.102566  9825 tablet_copy_service.cc:140] P 4104e34a61b7448281d6d91ce23ebf71: Received BeginTabletCopySession request for tablet 92a71d859626422a835ad38ab2ba7bd7 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:34802)
I20260709 12:26:14.103260  9825 tablet_copy_service.cc:161] P 4104e34a61b7448281d6d91ce23ebf71: Beginning new tablet copy session on tablet 92a71d859626422a835ad38ab2ba7bd7 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:34802: session id = f5208640a51f493e930ce4f64ceeed0b-92a71d859626422a835ad38ab2ba7bd7
I20260709 12:26:14.111173 11140 ts_tablet_manager.cc:933] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:14.114480  9825 tablet_copy_source_session.cc:215] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:14.117756 11129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92a71d859626422a835ad38ab2ba7bd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:14.171978 11140 tablet_copy_client.cc:323] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.66:34205
I20260709 12:26:14.174235  9899 tablet_copy_service.cc:140] P 963185e117384b2085d7cea02a64478b: Received BeginTabletCopySession request for tablet 9a7dd9ecad304177bbefcb8725c66393 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:54428)
I20260709 12:26:14.174811  9899 tablet_copy_service.cc:161] P 963185e117384b2085d7cea02a64478b: Beginning new tablet copy session on tablet 9a7dd9ecad304177bbefcb8725c66393 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:54428: session id = f5208640a51f493e930ce4f64ceeed0b-9a7dd9ecad304177bbefcb8725c66393
I20260709 12:26:14.179136 11129 tablet_copy_client.cc:806] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:14.179854 11129 tablet_copy_client.cc:670] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:14.183712  9957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:26:14.184419  9957 raft_consensus.cc:606] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:26:14.187500  9899 tablet_copy_source_session.cc:215] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:14.190794 11142 ts_tablet_manager.cc:933] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:14.190865 11140 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a7dd9ecad304177bbefcb8725c66393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:14.192997  9886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:14.193570  9886 raft_consensus.cc:606] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:14.197270  9957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:26:14.197804  9957 raft_consensus.cc:606] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:14.201074  9810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:26:14.201689  9810 raft_consensus.cc:606] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:26:14.203421  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:26:14.204970  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:14.205643  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:14.209542 11068 raft_consensus.cc:993] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:14.210021 11068 raft_consensus.cc:1081] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:14.213728  9810 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46496
I20260709 12:26:14.215081 11129 tablet_copy_client.cc:538] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:14.226742 10532 raft_consensus.cc:1217] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:26:14.228971  9810 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.229463  9810 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.249604 11142 tablet_copy_client.cc:323] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.67:42253
I20260709 12:26:14.232496 11129 tablet_bootstrap.cc:492] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:14.253813  9974 tablet_copy_service.cc:140] P b011791796d1457284b857d7d3422195: Received BeginTabletCopySession request for tablet 511405268634431e9bf729e0fc87c838 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:48438)
I20260709 12:26:14.254384  9974 tablet_copy_service.cc:161] P b011791796d1457284b857d7d3422195: Beginning new tablet copy session on tablet 511405268634431e9bf729e0fc87c838 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:48438: session id = f5208640a51f493e930ce4f64ceeed0b-511405268634431e9bf729e0fc87c838
I20260709 12:26:14.259317 11140 tablet_copy_client.cc:806] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:14.259984 11140 tablet_copy_client.cc:670] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:14.261673  9974 tablet_copy_source_session.cc:215] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:14.267058 11142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 511405268634431e9bf729e0fc87c838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:14.271380 11140 tablet_copy_client.cc:538] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:14.277702  9810 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:14.280397  9810 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:14.281065 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:14.281629 10532 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.283241  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:14.283831  9886 raft_consensus.cc:3055] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:14.284134  9886 raft_consensus.cc:740] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:14.288156 10532 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:14.289247  9779 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:14.290985 11105 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:14.291450 11105 raft_consensus.cc:697] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:14.292237 11105 consensus_queue.cc:237] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:14.295362 11142 tablet_copy_client.cc:806] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:14.295962 11142 tablet_copy_client.cc:670] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:14.284883  9886 consensus_queue.cc:260] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:14.308127 11142 tablet_copy_client.cc:538] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:14.308521 11140 tablet_bootstrap.cc:492] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:14.308426  9886 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.304270 11129 tablet_bootstrap.cc:492] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:14.310575 11129 tablet_bootstrap.cc:492] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:14.311312 11129 ts_tablet_manager.cc:1403] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.010s
I20260709 12:26:14.314109 11129 raft_consensus.cc:359] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:14.315013 11129 raft_consensus.cc:740] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:14.315768 11129 consensus_queue.cc:260] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:14.316350  9710 catalog_manager.cc:5697] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 2, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.318686 11129 ts_tablet_manager.cc:1434] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:26:14.321875  9825 tablet_copy_service.cc:342] P 4104e34a61b7448281d6d91ce23ebf71: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-92a71d859626422a835ad38ab2ba7bd7 received from {username='slave'} at 127.0.0.1:34802
I20260709 12:26:14.322397  9825 tablet_copy_service.cc:434] P 4104e34a61b7448281d6d91ce23ebf71: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-92a71d859626422a835ad38ab2ba7bd7 on tablet 92a71d859626422a835ad38ab2ba7bd7 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:14.325349  9886 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:14.350769 10532 raft_consensus.cc:1217] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:14.388392 11142 tablet_bootstrap.cc:492] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:14.394244 11140 tablet_bootstrap.cc:492] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:14.395751 11140 tablet_bootstrap.cc:492] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:14.396526 11140 ts_tablet_manager.cc:1403] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.088s	user 0.025s	sys 0.017s
I20260709 12:26:14.399720 11140 raft_consensus.cc:359] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:14.404922 11140 raft_consensus.cc:740] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:14.405719 11140 consensus_queue.cc:260] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:14.422498 11140 ts_tablet_manager.cc:1434] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:26:14.424712 11092 raft_consensus.cc:993] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:14.425211 11091 raft_consensus.cc:1081] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:14.428043  9899 tablet_copy_service.cc:342] P 963185e117384b2085d7cea02a64478b: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-9a7dd9ecad304177bbefcb8725c66393 received from {username='slave'} at 127.0.0.1:54428
I20260709 12:26:14.428450  9899 tablet_copy_service.cc:434] P 963185e117384b2085d7cea02a64478b: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-9a7dd9ecad304177bbefcb8725c66393 on tablet 9a7dd9ecad304177bbefcb8725c66393 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:14.430539  9810 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46504
I20260709 12:26:14.431104  9810 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.431437  9810 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.433950 11142 tablet_bootstrap.cc:492] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:14.435304 11142 tablet_bootstrap.cc:492] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:14.436058 11142 ts_tablet_manager.cc:1403] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.095s	user 0.019s	sys 0.014s
I20260709 12:26:14.442813  9810 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } }
I20260709 12:26:14.445560  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:14.445823  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:14.446130  9886 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.446473  9956 raft_consensus.cc:3055] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:14.446067 11142 raft_consensus.cc:359] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:14.446791  9956 raft_consensus.cc:740] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:14.447039 11142 raft_consensus.cc:740] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:14.447542  9956 consensus_queue.cc:260] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } }
I20260709 12:26:14.447703 11142 consensus_queue.cc:260] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:14.448626  9956 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.450124 11142 ts_tablet_manager.cc:1434] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.000s
I20260709 12:26:14.452677  9974 tablet_copy_service.cc:342] P b011791796d1457284b857d7d3422195: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-511405268634431e9bf729e0fc87c838 received from {username='slave'} at 127.0.0.1:48438
I20260709 12:26:14.453071  9974 tablet_copy_service.cc:434] P b011791796d1457284b857d7d3422195: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-511405268634431e9bf729e0fc87c838 on tablet 511405268634431e9bf729e0fc87c838 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:14.457124  9810 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:14.462819  9956 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:14.463150  9886 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:14.464249  9779 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:14.465050 11105 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:14.465533 11105 raft_consensus.cc:697] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:14.466391 11105 consensus_queue.cc:237] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } }
I20260709 12:26:14.475528  9713 catalog_manager.cc:5697] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 2, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:14.607705 11047 raft_consensus.cc:993] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:26:14.608209 11091 raft_consensus.cc:1081] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:26:14.609802  9888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:57652
I20260709 12:26:14.610359  9888 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.610742  9888 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.617484  9888 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:14.619098 11128 raft_consensus.cc:993] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:26:14.620451 11128 raft_consensus.cc:1081] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:26:14.622437  9888 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:14.624508  9888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:57658
I20260709 12:26:14.625061  9888 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.625443  9888 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:14.627024  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:14.627701  9810 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.627941  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:14.628799  9956 raft_consensus.cc:3055] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:14.629117  9956 raft_consensus.cc:740] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:14.629823  9956 consensus_queue.cc:260] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:14.631036  9956 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:14.643779  9888 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:14.648144  9888 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:14.646595  9956 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:14.651372 10532 raft_consensus.cc:1217] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:14.652643  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:14.653232  9809 raft_consensus.cc:3055] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:14.653540  9809 raft_consensus.cc:740] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:14.654224  9809 consensus_queue.cc:260] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:14.655373  9809 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:14.662462  9810 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:14.666721  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:14.667361  9956 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:14.667982  9853 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:14.673408 11068 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:14.674448 11068 raft_consensus.cc:697] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:14.675760 11068 consensus_queue.cc:237] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:14.682452  9809 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:14.683712  9853 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:14.684676 11116 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:14.685467 11116 raft_consensus.cc:697] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:14.686419 11116 consensus_queue.cc:237] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:14.693161 10996 raft_consensus.cc:1064] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:14.695313  9956 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:14.696240 10996 consensus_queue.cc:237] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:14.712095  9956 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:14.712306 10532 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:14.716228 11105 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:14.718371 11105 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:14.721557 10532 raft_consensus.cc:1217] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:14.724869  9886 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:14.726079 10532 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:14.729502 11128 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:14.735927 11128 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:14.717108  9713 catalog_manager.cc:5697] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 1 to 2, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 2 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.778589  9713 catalog_manager.cc:5697] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 2 to 3, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 3 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.789919 11128 raft_consensus.cc:1064] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:14.874130 11128 consensus_queue.cc:237] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:14.883239  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 90869.4us
I20260709 12:26:14.929423  9890 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:26:15.009709  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 56399.9us
I20260709 12:26:15.025226  9957 raft_consensus.cc:2955] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:15.080646 11166 raft_consensus.cc:2955] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
W20260709 12:26:15.088757  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 147739us
I20260709 12:26:15.090984 10996 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:15.126071  9956 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.133167  9886 raft_consensus.cc:2955] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:15.148203 10532 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:15.149814  9888 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.155593  9713 catalog_manager.cc:5697] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index 3 to 4, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:15.169433  9887 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:26:15.193943  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 50324us
I20260709 12:26:15.195207 11166 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:15.199360  9955 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:15.208237  9962 raft_consensus.cc:1275] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.211285 11170 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:15.217563 10987 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:15.219332  9810 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:15.222029 10987 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.219918  9956 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:15.224960 10532 raft_consensus.cc:2955] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:15.283147 11105 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:15.293141 11170 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:15.311810  9809 consensus_queue.cc:237] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:15.314885 10987 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:15.316753 11170 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:15.331009  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:15.379037 11116 raft_consensus.cc:1064] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:15.385722 11116 consensus_queue.cc:237] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:15.411741  9810 raft_consensus.cc:1275] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:15.424808 11190 raft_consensus.cc:1064] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:15.425016 10532 raft_consensus.cc:1275] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:15.426426 11183 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:15.431910 10532 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:15.433097  9888 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:15.438500  9962 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "511405268634431e9bf729e0fc87c838"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:26:15.445726 11185 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.453400  9956 raft_consensus.cc:1275] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:15.457866 11068 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:15.458114 11190 consensus_queue.cc:237] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:15.482213 11175 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:26:15.476756 11196 log.cc:927] Time spent T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:26:15.494040  9812 raft_consensus.cc:1275] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:15.511431  9958 raft_consensus.cc:2955] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:15.532662 11169 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:26:15.532809 11162 raft_consensus.cc:2955] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:15.535341 10987 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:15.568668 11105 raft_consensus.cc:2955] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:15.570998  9886 raft_consensus.cc:2955] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:15.575348 10532 raft_consensus.cc:2955] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:15.702374  9962 raft_consensus.cc:606] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:26:15.704509 10987 raft_consensus.cc:2955] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:15.716784 10529 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:15.721616 11047 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:15.634127  9887 raft_consensus.cc:2955] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:15.748628  9712 catalog_manager.cc:5697] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:15.785058 10531 raft_consensus.cc:2955] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:15.799360  9955 raft_consensus.cc:2955] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
W20260709 12:26:15.820017  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 50315.8us
I20260709 12:26:15.824148  9812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:26:15.824749  9812 raft_consensus.cc:606] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:15.827425  9809 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:15.834434  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e55138bc5c8b46a1a4b5408bb8a06868 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:15.836016 11190 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:15.838634  9811 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:26:15.839277  9811 raft_consensus.cc:606] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Received request to transfer leadership to TS b011791796d1457284b857d7d3422195
I20260709 12:26:15.840185 10532 raft_consensus.cc:2955] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:15.838755  9813 raft_consensus.cc:2955] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:15.844369  9890 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:15.849244  9886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:15.850070  9886 raft_consensus.cc:606] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:15.853689  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:26:15.856089 11205 raft_consensus.cc:993] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:15.862702  9710 catalog_manager.cc:5697] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 4 to 5, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:15.874368 11091 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:15.882927 11162 raft_consensus.cc:1081] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Signalling peer f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:15.905296  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:15.906159  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:15.949505  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 90190us
I20260709 12:26:15.961524 11116 raft_consensus.cc:993] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:15.975178 11116 raft_consensus.cc:1081] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:15.977556 10530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:26:15.978466 10530 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:15.978950 10530 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.011121  9814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46496
I20260709 12:26:16.011758  9814 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:16.012102  9814 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:16.042092 11215 log.cc:927] Time spent T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:26:16.038782  9814 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:16.049654  9814 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:16.050065  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:16.051061  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:16.051174  9887 raft_consensus.cc:3055] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:16.051309 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:16.051556  9887 raft_consensus.cc:740] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:16.051581  9955 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.052891 10529 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.059386 10529 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:16.032681 10530 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:16.064697  9955 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:16.068178  9778 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:16.075781 11222 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:16.076347 11222 raft_consensus.cc:697] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:16.078775  9887 consensus_queue.cc:260] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:16.078949 11222 consensus_queue.cc:237] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:16.087613  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:16.094882  9810 raft_consensus.cc:2955] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:16.082201 11213 raft_consensus.cc:2955] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:16.096210  9814 raft_consensus.cc:3055] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:16.096552  9814 raft_consensus.cc:740] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:16.090801  9887 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.107728  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:16.108487  9886 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.111289  9814 consensus_queue.cc:260] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:16.112434  9814 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.115620 11206 raft_consensus.cc:993] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower b011791796d1457284b857d7d3422195 to start an election
I20260709 12:26:16.116271 11205 raft_consensus.cc:1081] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Signalling peer b011791796d1457284b857d7d3422195 to start an election
I20260709 12:26:16.119745  9887 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:16.117290 10530 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:16.116955 10527 raft_consensus.cc:2955] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:16.126736  9890 raft_consensus.cc:2955] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:16.123838  9956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7"
dest_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55952
I20260709 12:26:16.124253 11047 raft_consensus.cc:993] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:26:16.129324  9956 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:16.129455 11047 raft_consensus.cc:1081] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:26:16.129730  9956 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.133031  9887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "511405268634431e9bf729e0fc87c838"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:57652
I20260709 12:26:16.137365  9956 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:16.139891  9886 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:16.139990  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:16.142745  9813 raft_consensus.cc:3055] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:16.143035  9813 raft_consensus.cc:740] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:16.143762  9813 consensus_queue.cc:260] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:16.144374  9814 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:16.145103  9813 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.145483 10496 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:16.146488 11176 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:16.147119 11176 raft_consensus.cc:697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:16.147997 11176 consensus_queue.cc:237] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:16.153138  9887 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:16.154251  9887 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.155573  9956 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:16.156793  9813 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:16.156844  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:16.157564 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:16.157840  9890 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.158167 10527 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.169966  9890 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:16.171080  9928 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:16.173365 11047 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:16.173804 11047 raft_consensus.cc:697] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 2 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:16.174566 11047 consensus_queue.cc:237] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:16.175228 10527 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:16.184561  9711 catalog_manager.cc:5697] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 2 to 3, term changed from 1 to 2, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to <none>, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:16.186443  9951 tablet_service.cc:1558] Processing DeleteTablet for tablet e55138bc5c8b46a1a4b5408bb8a06868 with delete_type TABLET_DATA_TOMBSTONED (TS b011791796d1457284b857d7d3422195 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:55938
I20260709 12:26:16.187506  9887 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:16.199741  9712 catalog_manager.cc:5697] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:16.206391  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:16.206753  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:16.206975  9810 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.207304  9956 raft_consensus.cc:3055] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:16.207610  9956 raft_consensus.cc:740] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:16.208364  9956 consensus_queue.cc:260] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:16.209645  9956 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.211433 11226 tablet_replica.cc:333] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:26:16.212453 11226 raft_consensus.cc:2243] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:16.213101 11226 raft_consensus.cc:2272] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:16.217906  9887 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:16.218109  9956 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:16.219062  9810 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:16.220846  9853 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:16.222184 11172 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:16.222784 11172 raft_consensus.cc:697] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:16.224200 11172 consensus_queue.cc:237] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:16.230005  9697 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 92a71d859626422a835ad38ab2ba7bd7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4104e34a61b7448281d6d91ce23ebf71 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:16.233237 11226 ts_tablet_manager.cc:1916] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:16.234011 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:16.234643 10527 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:16.247104  9711 catalog_manager.cc:5697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 1 to 2, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 2 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:16.258023 10527 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:16.257876  9713 catalog_manager.cc:5697] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 1 to 2, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 2 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:16.266767 11226 ts_tablet_manager.cc:1929] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:26:16.270361 11226 log.cc:1199] T e55138bc5c8b46a1a4b5408bb8a06868 P b011791796d1457284b857d7d3422195: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-2-root/wals/e55138bc5c8b46a1a4b5408bb8a06868
I20260709 12:26:16.268147  9710 catalog_manager.cc:5697] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: leader changed from <none> to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:16.271927  9697 catalog_manager.cc:5028] TS b011791796d1457284b857d7d3422195 (127.8.111.67:42253): tablet e55138bc5c8b46a1a4b5408bb8a06868 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:16.299543  9712 catalog_manager.cc:5697] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 1 to 2, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 2 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:16.496101  9955 raft_consensus.cc:1275] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:16.497520 11206 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:16.518249 10527 raft_consensus.cc:1275] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:16.519433 11206 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:16.537789  9890 raft_consensus.cc:1275] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:16.541447 11222 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:16.544086  9810 raft_consensus.cc:1275] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:16.545387 10972 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:16.599722  9890 raft_consensus.cc:1275] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:16.601195 10972 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:16.627600  9887 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:16.632432 10527 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:16.634075 11172 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:16.643741 11047 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:16.671375  9810 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:16.677893 11172 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:16.691526  9955 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:16.693145 11209 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:16.713068 10527 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:16.715760 11213 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:16.736123  9813 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:16.737901 11047 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:16.872923  9887 consensus_queue.cc:237] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 3, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:16.877948 10527 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:16.879360 11237 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:16.880272  9955 consensus_queue.cc:237] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 3, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:16.884766 11234 raft_consensus.cc:2955] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:16.892275 10530 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:16.895044  9810 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:16.894570 11047 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:16.896773 10527 raft_consensus.cc:2955] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:16.904951 11213 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:16.908409  9698 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 511405268634431e9bf729e0fc87c838 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 6)
I20260709 12:26:16.911789  9711 catalog_manager.cc:5697] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 3 to 5, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New cstate: current_term: 2 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:16.925405 11192 raft_consensus.cc:2955] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:16.930864  9810 raft_consensus.cc:2955] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:16.940598 10527 raft_consensus.cc:2955] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:16.953351  9802 tablet_service.cc:1558] Processing DeleteTablet for tablet 511405268634431e9bf729e0fc87c838 with delete_type TABLET_DATA_TOMBSTONED (TS 4104e34a61b7448281d6d91ce23ebf71 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:46484
I20260709 12:26:16.954813  9813 consensus_queue.cc:237] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 3, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:16.962111  9713 catalog_manager.cc:5697] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 3 to 5, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New cstate: current_term: 2 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:16.966928 10527 raft_consensus.cc:1275] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:16.968828 11242 tablet_replica.cc:333] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:26:16.972040 11242 raft_consensus.cc:2243] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:16.972832 11242 raft_consensus.cc:2272] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:16.973345  9955 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:16.972805 11206 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:16.975858  9871 tablet_service.cc:1558] Processing DeleteTablet for tablet 92a71d859626422a835ad38ab2ba7bd7 with delete_type TABLET_DATA_TOMBSTONED (TS 963185e117384b2085d7cea02a64478b not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:57650
I20260709 12:26:16.980536  9890 raft_consensus.cc:1275] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:16.982437 11242 ts_tablet_manager.cc:1916] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:16.983500 11155 raft_consensus.cc:2955] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:16.985122 10527 raft_consensus.cc:2955] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:16.994588 11234 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:16.996598  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9a7dd9ecad304177bbefcb8725c66393 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:16.999415 11206 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:17.002115  9713 catalog_manager.cc:5697] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 3 to 5, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:17.011253 11243 tablet_replica.cc:333] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:26:17.011528  9890 raft_consensus.cc:2955] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:17.016762  9955 raft_consensus.cc:2955] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:17.023079  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 92a71d859626422a835ad38ab2ba7bd7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 6)
I20260709 12:26:17.024058  9951 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a7dd9ecad304177bbefcb8725c66393 with delete_type TABLET_DATA_TOMBSTONED (TS b011791796d1457284b857d7d3422195 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:55938
I20260709 12:26:17.031873 11244 tablet_replica.cc:333] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:26:17.033272 11244 raft_consensus.cc:2243] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.034268 11244 raft_consensus.cc:2272] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.045564 11244 ts_tablet_manager.cc:1916] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:26:17.127663  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 79730.7us
W20260709 12:26:17.129659  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 83191.6us
I20260709 12:26:17.161443 11242 ts_tablet_manager.cc:1929] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:26:17.162022 11242 log.cc:1199] T 511405268634431e9bf729e0fc87c838 P 4104e34a61b7448281d6d91ce23ebf71: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-0-root/wals/511405268634431e9bf729e0fc87c838
I20260709 12:26:17.163730  9697 catalog_manager.cc:5028] TS 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): tablet 511405268634431e9bf729e0fc87c838 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:17.179809 11244 ts_tablet_manager.cc:1929] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:26:17.180356 11244 log.cc:1199] T 9a7dd9ecad304177bbefcb8725c66393 P b011791796d1457284b857d7d3422195: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-2-root/wals/9a7dd9ecad304177bbefcb8725c66393
I20260709 12:26:17.187363 11243 raft_consensus.cc:2243] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.188097 11243 raft_consensus.cc:2272] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.194237 11243 ts_tablet_manager.cc:1916] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:17.212437 11243 ts_tablet_manager.cc:1929] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:26:17.212898 11243 log.cc:1199] T 92a71d859626422a835ad38ab2ba7bd7 P 963185e117384b2085d7cea02a64478b: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-1-root/wals/92a71d859626422a835ad38ab2ba7bd7
I20260709 12:26:17.240051  9697 catalog_manager.cc:5028] TS b011791796d1457284b857d7d3422195 (127.8.111.67:42253): tablet 9a7dd9ecad304177bbefcb8725c66393 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:17.246850  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:17.248102  9698 catalog_manager.cc:5028] TS 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): tablet 92a71d859626422a835ad38ab2ba7bd7 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:17.335799  9956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:26:17.336971  9956 raft_consensus.cc:606] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:26:17.340799  9885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:17.341382  9885 raft_consensus.cc:606] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:17.344133  9810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:26:17.344599  9810 raft_consensus.cc:606] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Received request to transfer leadership to TS b011791796d1457284b857d7d3422195
I20260709 12:26:17.347334  9885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:17.347846  9885 raft_consensus.cc:606] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:17.349051  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:26:17.350241  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:17.351343  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:17.464533 11213 raft_consensus.cc:993] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:26:17.465269 11213 raft_consensus.cc:1081] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:26:17.467816  9885 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:57652
I20260709 12:26:17.468703  9885 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:17.469830  9885 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.486251  9885 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:17.492027  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:17.492823  9810 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.493916  9885 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:17.492844 11237 raft_consensus.cc:993] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b: : Instructing follower f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:17.494869 11235 raft_consensus.cc:1081] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Signalling peer f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:17.494366  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:17.495638  9958 raft_consensus.cc:3055] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:17.495924  9958 raft_consensus.cc:740] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:17.496685 10530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:36672
I20260709 12:26:17.497349 10530 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:17.497008  9958 consensus_queue.cc:260] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:17.497740 10530 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.498415  9958 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.501547  9810 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:17.503193  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:17.505628 11237 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:17.506181 11237 raft_consensus.cc:697] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:17.508004  9958 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:17.507236 11237 consensus_queue.cc:237] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:17.510700 10530 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:17.517184  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:17.542779  9810 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.542181  9713 catalog_manager.cc:5697] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 1 to 2, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 2 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:17.551769 10530 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:17.554982 11205 raft_consensus.cc:993] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower b011791796d1457284b857d7d3422195 to start an election
I20260709 12:26:17.552211  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:17.555260  9810 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:17.555498 11205 raft_consensus.cc:1081] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Signalling peer b011791796d1457284b857d7d3422195 to start an election
I20260709 12:26:17.555744  9885 raft_consensus.cc:3055] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:17.556176  9885 raft_consensus.cc:740] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:17.556620 10496 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:17.557181  9885 consensus_queue.cc:260] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:17.557863 11176 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:17.558646  9958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e"
dest_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55952
I20260709 12:26:17.558956  9885 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.559250  9958 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:17.560874  9958 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:17.560192 11176 raft_consensus.cc:697] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:17.563318 11176 consensus_queue.cc:237] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:17.569089  9958 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:17.569406  9885 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:17.572192  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:17.572515  9958 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:17.572733  9810 raft_consensus.cc:3055] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:17.573087  9810 raft_consensus.cc:740] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:17.573872  9810 consensus_queue.cc:260] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:17.574885  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:17.575182  9810 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:17.575487  9885 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:17.582118 11237 raft_consensus.cc:993] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:17.582620 11237 raft_consensus.cc:1081] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:17.582653  9885 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:17.584195  9928 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:17.585476 11192 raft_consensus.cc:2804] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:17.585942 11192 raft_consensus.cc:697] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:17.586897 11192 consensus_queue.cc:237] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:17.606602  9813 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46496
I20260709 12:26:17.607362  9813 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:17.608001  9813 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:17.609022  9713 catalog_manager.cc:5697] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 1 to 2, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 2 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.612114  9810 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:17.623673  9710 catalog_manager.cc:5697] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 2 to 3, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 3 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.628209  9813 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:17.630218  9813 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:17.631927  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:17.631989  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:17.632462  9885 raft_consensus.cc:3055] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:17.632575  9955 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:17.632807  9885 raft_consensus.cc:740] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:17.633746  9885 consensus_queue.cc:260] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:17.634970  9885 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:17.643182  9885 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:17.644196  9955 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:17.644419  9779 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:17.645444 11206 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:17.645957 11206 raft_consensus.cc:697] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:17.646935 11206 consensus_queue.cc:237] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:17.655987  9710 catalog_manager.cc:5697] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 2 to 3, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 3 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:17.895313  9955 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:17.896709 11236 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:17.907306  9813 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:17.909113 11237 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:18.043165  9958 raft_consensus.cc:1275] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:18.046129 11205 consensus_queue.cc:1048] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:18.058671  9885 raft_consensus.cc:1275] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:18.062317 11155 consensus_queue.cc:1048] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:18.098423  9885 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:18.099538 11192 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:18.112617  9813 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:18.114146 11192 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:18.135562  9810 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:18.137425  9885 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:18.139060 11176 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:18.142133 11176 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:18.143508  9810 consensus_queue.cc:237] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:18.170176  9885 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:26:18.170341  9779 consensus_peers.cc:597] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cbfc8e9bdb244a4c8679e7585cce700c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:18.173982  9955 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:18.174238 11205 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:18.177522 11210 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:18.211494 11206 raft_consensus.cc:2955] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:18.213514  9885 raft_consensus.cc:2955] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:18.215664  9955 raft_consensus.cc:2955] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:18.228737  9813 consensus_queue.cc:237] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:18.230262  9711 catalog_manager.cc:5697] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index -1 to 3, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:18.236295  9958 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:18.237751 11205 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:18.241372  9779 consensus_peers.cc:597] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f77ade6a50544c9a6c3f56b3719a92e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:18.243258  9887 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:18.253181 11206 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:18.266162 11205 raft_consensus.cc:2955] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:18.267225  9958 raft_consensus.cc:2955] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:18.326885  9887 raft_consensus.cc:2955] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:18.339545  9885 consensus_queue.cc:237] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:18.368952  9713 catalog_manager.cc:5697] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:18.376149  9813 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:26:18.374536  9854 consensus_peers.cc:597] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5224954c61b74424bc8af520537e37ec. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:18.377405 11235 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:18.378902  9955 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:18.380317 11236 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:18.388953 11236 raft_consensus.cc:2955] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:18.390846  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:18.391170  9813 raft_consensus.cc:2955] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:18.395349  9955 raft_consensus.cc:2955] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:18.403611  9885 consensus_queue.cc:237] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:18.405592  9710 catalog_manager.cc:5697] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index -1 to 4, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 3 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:18.475111  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 65325.4us
W20260709 12:26:18.519698  9854 consensus_peers.cc:597] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bcb5052194b44bc49f4db5030ce11988. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:18.521765  9955 raft_consensus.cc:1275] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:18.526593  9814 raft_consensus.cc:1275] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:18.527691 11237 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:18.530818 11235 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:18.551326 11237 raft_consensus.cc:2955] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:18.552951  9814 raft_consensus.cc:2955] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:18.562036  9956 raft_consensus.cc:2955] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:18.569170  9711 catalog_manager.cc:5697] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:18.603371  9885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:18.603948  9885 raft_consensus.cc:606] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:18.608559  9814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:26:18.609076  9814 raft_consensus.cc:606] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:26:18.611565  9956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:26:18.612113  9956 raft_consensus.cc:606] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:26:18.613334  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:18.614998  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:18.615692  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:18.706563 11285 ts_tablet_manager.cc:933] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:26:18.710914 11285 tablet_copy_client.cc:323] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.65:38995
I20260709 12:26:18.713135  9825 tablet_copy_service.cc:140] P 4104e34a61b7448281d6d91ce23ebf71: Received BeginTabletCopySession request for tablet 0f77ade6a50544c9a6c3f56b3719a92e from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:34802)
I20260709 12:26:18.713685  9825 tablet_copy_service.cc:161] P 4104e34a61b7448281d6d91ce23ebf71: Beginning new tablet copy session on tablet 0f77ade6a50544c9a6c3f56b3719a92e from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:34802: session id = f5208640a51f493e930ce4f64ceeed0b-0f77ade6a50544c9a6c3f56b3719a92e
I20260709 12:26:18.714219 11287 ts_tablet_manager.cc:933] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:26:18.715998 11287 tablet_copy_client.cc:323] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.65:38995
I20260709 12:26:18.717536  9824 tablet_copy_service.cc:140] P 4104e34a61b7448281d6d91ce23ebf71: Received BeginTabletCopySession request for tablet cbfc8e9bdb244a4c8679e7585cce700c from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:34802)
I20260709 12:26:18.718068  9824 tablet_copy_service.cc:161] P 4104e34a61b7448281d6d91ce23ebf71: Beginning new tablet copy session on tablet cbfc8e9bdb244a4c8679e7585cce700c from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:34802: session id = f5208640a51f493e930ce4f64ceeed0b-cbfc8e9bdb244a4c8679e7585cce700c
I20260709 12:26:18.722431  9825 tablet_copy_source_session.cc:215] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:18.725766  9824 tablet_copy_source_session.cc:215] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:18.726040 11285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f77ade6a50544c9a6c3f56b3719a92e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:18.728837 11287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbfc8e9bdb244a4c8679e7585cce700c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:18.742653 11285 tablet_copy_client.cc:806] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:18.743319 11285 tablet_copy_client.cc:670] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:18.770505 11287 tablet_copy_client.cc:806] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:18.771134 11287 tablet_copy_client.cc:670] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:18.777833 11285 tablet_copy_client.cc:538] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:18.778836 11287 tablet_copy_client.cc:538] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:18.792718 11287 tablet_bootstrap.cc:492] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:18.806423 11236 raft_consensus.cc:993] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:18.806948 11236 raft_consensus.cc:1081] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:18.808048 11290 ts_tablet_manager.cc:933] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:18.808724  9813 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46496
I20260709 12:26:18.809250  9813 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:18.809587  9813 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.813541 11285 tablet_bootstrap.cc:492] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:18.816557  9813 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:18.822130  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:18.822885  9887 raft_consensus.cc:3055] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:18.822935  9813 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:18.823232  9887 raft_consensus.cc:740] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:18.823174 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:18.823838 10530 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.824169  9887 consensus_queue.cc:260] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:18.828598  9887 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.832549 10530 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:18.833971  9779 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:18.835119 11155 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:18.835362  9887 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:18.835593 11155 raft_consensus.cc:697] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:18.836585 11155 consensus_queue.cc:237] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:18.876894 11290 tablet_copy_client.cc:323] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.66:34205
I20260709 12:26:18.878839  9899 tablet_copy_service.cc:140] P 963185e117384b2085d7cea02a64478b: Received BeginTabletCopySession request for tablet 5224954c61b74424bc8af520537e37ec from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:54428)
I20260709 12:26:18.879398  9899 tablet_copy_service.cc:161] P 963185e117384b2085d7cea02a64478b: Beginning new tablet copy session on tablet 5224954c61b74424bc8af520537e37ec from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:54428: session id = f5208640a51f493e930ce4f64ceeed0b-5224954c61b74424bc8af520537e37ec
I20260709 12:26:18.879226  9710 catalog_manager.cc:5697] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 2, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:18.882500 11285 tablet_bootstrap.cc:492] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:18.883486 11285 tablet_bootstrap.cc:492] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:18.884191 11285 ts_tablet_manager.cc:1403] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.071s	user 0.022s	sys 0.003s
I20260709 12:26:18.884457 11287 tablet_bootstrap.cc:492] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:18.885363 11287 tablet_bootstrap.cc:492] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:18.886099 11287 ts_tablet_manager.cc:1403] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.094s	user 0.024s	sys 0.018s
I20260709 12:26:18.887406 11285 raft_consensus.cc:359] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:18.888267 11285 raft_consensus.cc:740] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:18.888940 11285 consensus_queue.cc:260] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:18.889882 11287 raft_consensus.cc:359] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:18.890726 11287 raft_consensus.cc:740] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:18.894586 11285 ts_tablet_manager.cc:1434] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.006s
I20260709 12:26:18.891394 11287 consensus_queue.cc:260] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:18.896358  9824 tablet_copy_service.cc:342] P 4104e34a61b7448281d6d91ce23ebf71: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-0f77ade6a50544c9a6c3f56b3719a92e received from {username='slave'} at 127.0.0.1:34802
I20260709 12:26:18.896893  9824 tablet_copy_service.cc:434] P 4104e34a61b7448281d6d91ce23ebf71: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-0f77ade6a50544c9a6c3f56b3719a92e on tablet 0f77ade6a50544c9a6c3f56b3719a92e with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:18.900072 11287 ts_tablet_manager.cc:1434] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.003s
I20260709 12:26:18.901748  9824 tablet_copy_service.cc:342] P 4104e34a61b7448281d6d91ce23ebf71: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-cbfc8e9bdb244a4c8679e7585cce700c received from {username='slave'} at 127.0.0.1:34802
I20260709 12:26:18.902127  9824 tablet_copy_service.cc:434] P 4104e34a61b7448281d6d91ce23ebf71: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-cbfc8e9bdb244a4c8679e7585cce700c on tablet cbfc8e9bdb244a4c8679e7585cce700c with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:18.904285 11287 ts_tablet_manager.cc:933] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:18.908843  9899 tablet_copy_source_session.cc:215] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:18.910108 11287 tablet_copy_client.cc:323] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.66:34205
I20260709 12:26:18.919106  9899 tablet_copy_service.cc:140] P 963185e117384b2085d7cea02a64478b: Received BeginTabletCopySession request for tablet bcb5052194b44bc49f4db5030ce11988 from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:54428)
I20260709 12:26:18.920137 11290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5224954c61b74424bc8af520537e37ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:18.919735  9899 tablet_copy_service.cc:161] P 963185e117384b2085d7cea02a64478b: Beginning new tablet copy session on tablet bcb5052194b44bc49f4db5030ce11988 from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:54428: session id = f5208640a51f493e930ce4f64ceeed0b-bcb5052194b44bc49f4db5030ce11988
I20260709 12:26:18.928758  9899 tablet_copy_source_session.cc:215] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:18.932904 11205 raft_consensus.cc:993] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:26:18.933208 11287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcb5052194b44bc49f4db5030ce11988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:18.933351 11205 raft_consensus.cc:1081] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:26:18.934949  9885 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:57658
I20260709 12:26:18.935478  9885 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:18.935827  9885 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.942737  9885 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:18.943645 11290 tablet_copy_client.cc:806] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:18.944258 11290 tablet_copy_client.cc:670] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:18.945448  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:18.946002  9813 raft_consensus.cc:3055] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:18.946345  9813 raft_consensus.cc:740] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:18.946525  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:18.947052  9958 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.947106  9813 consensus_queue.cc:260] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:18.948216  9813 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.953365  9958 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:18.953850  9813 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:18.958397  9885 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:18.958348  9853 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:18.961208 11234 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:18.961660 11234 raft_consensus.cc:697] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:18.962556 11234 consensus_queue.cc:237] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:18.964371 11278 raft_consensus.cc:993] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:26:18.964876 11278 raft_consensus.cc:1081] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:26:18.968447 11287 tablet_copy_client.cc:806] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:18.969027 11287 tablet_copy_client.cc:670] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:18.970814  9885 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:57652
I20260709 12:26:18.971429  9885 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:18.972102  9885 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.973418 11290 tablet_copy_client.cc:538] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:18.982563 11287 tablet_copy_client.cc:538] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:18.985364  9885 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:18.987969  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:18.988500  9958 raft_consensus.cc:3055] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:18.988811  9958 raft_consensus.cc:740] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:18.989845  9958 consensus_queue.cc:260] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:18.990893  9958 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.991091 11287 tablet_bootstrap.cc:492] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:18.996192 11290 tablet_bootstrap.cc:492] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:18.999475  9885 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:18.999644  9710 catalog_manager.cc:5697] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 1 to 2, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 2 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.000519 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:19.006703 10530 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.002810  9958 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:19.027056  9853 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:19.028420 11237 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.028937 11237 raft_consensus.cc:697] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:19.029855 11237 consensus_queue.cc:237] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:19.044463 10530 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:19.047235 11287 tablet_bootstrap.cc:492] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:19.048143 11287 tablet_bootstrap.cc:492] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:19.048839 11287 ts_tablet_manager.cc:1403] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.058s	user 0.027s	sys 0.013s
I20260709 12:26:19.054684 11287 raft_consensus.cc:359] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:19.055965 11287 raft_consensus.cc:740] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:19.056679 11287 consensus_queue.cc:260] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:19.063608 11287 ts_tablet_manager.cc:1434] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.005s
I20260709 12:26:19.065109  9885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:57650
I20260709 12:26:19.065789  9885 raft_consensus.cc:606] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Received request to transfer leadership
I20260709 12:26:19.066399  9899 tablet_copy_service.cc:342] P 963185e117384b2085d7cea02a64478b: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-bcb5052194b44bc49f4db5030ce11988 received from {username='slave'} at 127.0.0.1:54428
I20260709 12:26:19.066852  9899 tablet_copy_service.cc:434] P 963185e117384b2085d7cea02a64478b: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-bcb5052194b44bc49f4db5030ce11988 on tablet bcb5052194b44bc49f4db5030ce11988 with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:19.069582  9713 catalog_manager.cc:5697] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 1 to 2, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 2 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.073253  9885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:57650
I20260709 12:26:19.073874  9885 raft_consensus.cc:606] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Received request to transfer leadership
W20260709 12:26:19.074962  9698 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 0f77ade6a50544c9a6c3f56b3719a92e already in progress
I20260709 12:26:19.076536 11290 tablet_bootstrap.cc:492] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:19.077489 11290 tablet_bootstrap.cc:492] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:19.077726  9885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:57650
I20260709 12:26:19.078956  9885 raft_consensus.cc:606] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Received request to transfer leadership
W20260709 12:26:19.083683  9761 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:26:19.084127  9761 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 0f77ade6a50544c9a6c3f56b3719a92e already in progress
W20260709 12:26:19.084406  9761 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 0f77ade6a50544c9a6c3f56b3719a92e already in progress
I20260709 12:26:19.078207 11290 ts_tablet_manager.cc:1403] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.082s	user 0.030s	sys 0.007s
I20260709 12:26:19.091871 11290 raft_consensus.cc:359] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:19.092535 11290 raft_consensus.cc:740] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:19.093108 11290 consensus_queue.cc:260] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:19.095589 11290 ts_tablet_manager.cc:1434] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:19.097606  9899 tablet_copy_service.cc:342] P 963185e117384b2085d7cea02a64478b: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-5224954c61b74424bc8af520537e37ec received from {username='slave'} at 127.0.0.1:54428
I20260709 12:26:19.098016  9899 tablet_copy_service.cc:434] P 963185e117384b2085d7cea02a64478b: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-5224954c61b74424bc8af520537e37ec on tablet 5224954c61b74424bc8af520537e37ec with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:19.153012 10530 raft_consensus.cc:1217] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:26:19.201540 10530 raft_consensus.cc:1217] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:26:19.333214 10530 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:19.334589 11210 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:19.358343  9958 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:19.377024 10527 raft_consensus.cc:1217] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:19.358343  9887 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:19.382979 11235 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:19.402123 11235 raft_consensus.cc:993] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b: : Instructing follower b011791796d1457284b857d7d3422195 to start an election
I20260709 12:26:19.402946 11235 raft_consensus.cc:1081] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Signalling peer b011791796d1457284b857d7d3422195 to start an election
I20260709 12:26:19.408100  9955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e"
dest_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55946
I20260709 12:26:19.426344  9955 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:19.426761  9955 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:19.430725 11205 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:19.492797  9955 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:19.496562  9955 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:19.505581 10530 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Advancing to term 2
I20260709 12:26:19.514317 10530 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:19.515707 11234 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:19.543119 11311 raft_consensus.cc:1064] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
W20260709 12:26:19.543731 11311 raft_consensus.cc:1068] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b: Unable to promote non-voter f5208640a51f493e930ce4f64ceeed0b: Service unavailable: leader transfer in progress
I20260709 12:26:19.546037  9813 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:19.548061 11234 raft_consensus.cc:1064] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:19.548694  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:19.549330  9810 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:19.550552 11234 consensus_queue.cc:237] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:19.555455 11237 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:19.564038  9810 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
W20260709 12:26:19.567377 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 63821.6us
I20260709 12:26:19.574832 10530 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 3 LEARNER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:19.576435 11311 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:19.577970  9814 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:19.578644  9958 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:19.580531 11311 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:19.582916  9810 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 12:26:19.584484  9927 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:19.585311 11192 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:19.586328  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:19.586407 11192 raft_consensus.cc:697] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:19.587055  9885 raft_consensus.cc:3055] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:19.587407  9885 raft_consensus.cc:740] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:19.588111  9885 consensus_queue.cc:260] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:19.589048 11310 consensus_queue.cc:1059] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:19.590312 10527 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:19.591986 11237 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:19.597666 11234 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:19.602226  9885 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:19.587828 11192 consensus_queue.cc:237] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:19.630913  9810 raft_consensus.cc:2955] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:19.634392 11235 raft_consensus.cc:2955] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:19.649062 10527 raft_consensus.cc:2955] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:19.653517  9958 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:19.659137 11311 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:19.661019  9885 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:19.657018  9713 catalog_manager.cc:5697] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 2 to 3, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 3 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.658233  9710 catalog_manager.cc:5697] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index 4 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:19.671382  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:19.672910  9958 raft_consensus.cc:2955] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } attrs { replace: true } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:19.675513 11205 raft_consensus.cc:1064] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:19.677735 11205 consensus_queue.cc:237] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:19.704701 10527 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:19.707406 11210 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:19.731398  9885 consensus_queue.cc:237] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:19.738134  9956 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:19.740106 11307 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:19.741420 10530 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:19.742973 11309 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:19.746523  9813 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:19.747524  9885 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:19.749070 11237 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:19.766570 11205 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:19.766157 11237 raft_consensus.cc:2955] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:19.779454 10530 raft_consensus.cc:2955] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:19.779625  9813 raft_consensus.cc:2955] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:19.790215 11205 raft_consensus.cc:2955] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:19.792589  9958 raft_consensus.cc:2955] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:19.795310  9698 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5224954c61b74424bc8af520537e37ec with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:19.800537  9885 raft_consensus.cc:2955] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:19.806941  9711 catalog_manager.cc:5697] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 5 to 6, VOTER b011791796d1457284b857d7d3422195 (127.8.111.67) evicted. New cstate: current_term: 3 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:19.815599 10527 raft_consensus.cc:2955] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:19.826683  9951 tablet_service.cc:1558] Processing DeleteTablet for tablet 5224954c61b74424bc8af520537e37ec with delete_type TABLET_DATA_TOMBSTONED (TS b011791796d1457284b857d7d3422195 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:55938
I20260709 12:26:19.849794  9711 catalog_manager.cc:5697] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 3 to 4, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:19.858995 11330 tablet_replica.cc:333] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:26:19.860345 11330 raft_consensus.cc:2243] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:19.866762  9814 consensus_queue.cc:237] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:19.867214 11330 raft_consensus.cc:2272] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:19.870987 11330 ts_tablet_manager.cc:1916] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:19.874231 10530 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:19.874234  9958 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:19.875720 11205 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:19.877661 11205 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:19.883716  9814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:26:19.885282  9814 raft_consensus.cc:606] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Received request to transfer leadership to TS b011791796d1457284b857d7d3422195
I20260709 12:26:19.883219 11327 raft_consensus.cc:2955] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:19.886207 10530 raft_consensus.cc:2955] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:19.892964  9885 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af001ec909824ed199d355fd69f43ede"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:19.893522  9885 raft_consensus.cc:606] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:19.894905  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:19.896139  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:19.896893  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:19.894972  9958 raft_consensus.cc:2955] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:19.907888 11330 ts_tablet_manager.cc:1929] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:26:19.908515 11330 log.cc:1199] T 5224954c61b74424bc8af520537e37ec P b011791796d1457284b857d7d3422195: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-2-root/wals/5224954c61b74424bc8af520537e37ec
I20260709 12:26:19.910079  9697 catalog_manager.cc:5028] TS b011791796d1457284b857d7d3422195 (127.8.111.67:42253): tablet 5224954c61b74424bc8af520537e37ec (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:19.911302  9713 catalog_manager.cc:5697] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 4 to 5, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:19.913028  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cbfc8e9bdb244a4c8679e7585cce700c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:19.924618  9871 tablet_service.cc:1558] Processing DeleteTablet for tablet cbfc8e9bdb244a4c8679e7585cce700c with delete_type TABLET_DATA_TOMBSTONED (TS 963185e117384b2085d7cea02a64478b not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:57650
I20260709 12:26:19.926548 11331 tablet_replica.cc:333] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:26:19.927942 11331 raft_consensus.cc:2243] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:19.928754 11331 raft_consensus.cc:2272] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:19.932710 11331 ts_tablet_manager.cc:1916] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:19.952263 11331 ts_tablet_manager.cc:1929] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:26:19.952762 11331 log.cc:1199] T cbfc8e9bdb244a4c8679e7585cce700c P 963185e117384b2085d7cea02a64478b: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-1-root/wals/cbfc8e9bdb244a4c8679e7585cce700c
I20260709 12:26:19.954772  9698 catalog_manager.cc:5028] TS 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): tablet cbfc8e9bdb244a4c8679e7585cce700c (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:19.964912 11237 raft_consensus.cc:1064] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:19.967042 11237 consensus_queue.cc:237] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:19.974417 10530 raft_consensus.cc:1275] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:19.976205  9958 raft_consensus.cc:1275] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:19.976670 11311 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:19.977814 11234 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:19.978706  9814 raft_consensus.cc:1275] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:19.980592 11234 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:19.993256 11234 raft_consensus.cc:2955] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:20.008168 10530 raft_consensus.cc:2955] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:20.008985  9814 raft_consensus.cc:2955] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:20.025619  9710 catalog_manager.cc:5697] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:20.036192  9958 raft_consensus.cc:2955] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:20.057621  9885 consensus_queue.cc:237] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:20.066587  9887 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:20.068077 11192 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:20.082662  9958 raft_consensus.cc:1275] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:20.084007 11237 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:20.085208 10527 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Advancing to term 3
I20260709 12:26:20.096040  9813 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:20.083170 10530 raft_consensus.cc:1275] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:20.098461 11311 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:20.101642 11278 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:20.117314 11338 raft_consensus.cc:2955] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:20.126766 10527 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 3 LEARNER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:20.131760 11278 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:20.132890 11310 raft_consensus.cc:993] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:20.133402 11310 raft_consensus.cc:1081] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:20.136253  9810 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af001ec909824ed199d355fd69f43ede"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46496
I20260709 12:26:20.136765  9810 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:20.137089  9810 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:20.146323 10529 raft_consensus.cc:2955] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:20.160327  9810 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:20.186973 11192 raft_consensus.cc:1064] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:20.189353 11192 consensus_queue.cc:237] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:20.192603  9810 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:20.193747  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:20.196550  9955 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:20.192766  9713 catalog_manager.cc:5697] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b reported cstate change: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:20.195333  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:20.202814  9885 raft_consensus.cc:3055] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:20.205502  9885 raft_consensus.cc:740] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:20.207695  9885 consensus_queue.cc:260] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:20.211094 10532 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 3 LEARNER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:20.216601  9802 tablet_service.cc:1558] Processing DeleteTablet for tablet bcb5052194b44bc49f4db5030ce11988 with delete_type TABLET_DATA_TOMBSTONED (TS 4104e34a61b7448281d6d91ce23ebf71 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:46484
I20260709 12:26:20.214727  9885 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:20.217734  9890 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:20.221030  9955 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:20.223651 11192 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:20.225322  9811 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:20.227257 11316 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:20.229118 11213 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:20.237497  9778 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:20.239241 11327 raft_consensus.cc:2804] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:20.240132 11327 raft_consensus.cc:697] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:20.241098 11327 consensus_queue.cc:237] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:20.242187 11210 raft_consensus.cc:993] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower b011791796d1457284b857d7d3422195 to start an election
I20260709 12:26:20.250385 11210 raft_consensus.cc:1081] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Signalling peer b011791796d1457284b857d7d3422195 to start an election
I20260709 12:26:20.243975 11316 raft_consensus.cc:2955] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:20.254158  9955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7"
dest_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55952
I20260709 12:26:20.254827  9955 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:20.258083  9955 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:20.247617  9811 raft_consensus.cc:2955] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:20.258239 10529 raft_consensus.cc:2955] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:20.257085  9885 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:20.265817  9955 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:20.275126  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:20.276463  9813 raft_consensus.cc:3055] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:20.278079  9813 raft_consensus.cc:740] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:20.278599 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:20.279255 10532 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:20.279553  9813 consensus_queue.cc:260] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:20.280699  9813 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:20.277403  9955 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:20.289153 10532 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:20.290648  9928 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:20.291440 11213 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:20.291967 11213 raft_consensus.cc:697] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 2 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:20.293540 11213 consensus_queue.cc:237] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:20.294384  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 91515.2us
I20260709 12:26:20.304388  9813 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:20.304569  9698 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bcb5052194b44bc49f4db5030ce11988 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:20.312819 11342 tablet_replica.cc:333] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:26:20.352618  9712 catalog_manager.cc:5697] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 2 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:20.361302 11342 raft_consensus.cc:2243] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.362251 11342 raft_consensus.cc:2272] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.366991  9713 catalog_manager.cc:5697] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 2, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:20.365226  9885 raft_consensus.cc:2955] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:20.380957 11342 ts_tablet_manager.cc:1916] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:20.380396  9958 raft_consensus.cc:2955] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:20.368288  9710 catalog_manager.cc:5697] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 1 to 2, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 2 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:20.407356 11342 ts_tablet_manager.cc:1929] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:20.407863 11342 log.cc:1199] T bcb5052194b44bc49f4db5030ce11988 P 4104e34a61b7448281d6d91ce23ebf71: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-0-root/wals/bcb5052194b44bc49f4db5030ce11988
I20260709 12:26:20.409901  9697 catalog_manager.cc:5028] TS 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): tablet bcb5052194b44bc49f4db5030ce11988 (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:20.424701  9958 consensus_queue.cc:237] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:20.429215  9813 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:20.429359 10529 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:20.430680 11213 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:20.431499 11316 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:20.437713 11343 raft_consensus.cc:2955] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:20.439096  9811 raft_consensus.cc:2955] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:20.439869 10527 raft_consensus.cc:2955] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:20.455403  9713 catalog_manager.cc:5697] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 5 to 6, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New cstate: current_term: 3 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:20.455945  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0f77ade6a50544c9a6c3f56b3719a92e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:20.470299  9871 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f77ade6a50544c9a6c3f56b3719a92e with delete_type TABLET_DATA_TOMBSTONED (TS 963185e117384b2085d7cea02a64478b not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:57650
I20260709 12:26:20.472024 11346 tablet_replica.cc:333] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:26:20.472751 11346 raft_consensus.cc:2243] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.473477 11346 raft_consensus.cc:2272] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.478981 11346 ts_tablet_manager.cc:1916] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:20.493084 11346 ts_tablet_manager.cc:1929] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:26:20.493440 11346 log.cc:1199] T 0f77ade6a50544c9a6c3f56b3719a92e P 963185e117384b2085d7cea02a64478b: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-1-root/wals/0f77ade6a50544c9a6c3f56b3719a92e
I20260709 12:26:20.494783  9698 catalog_manager.cc:5028] TS 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): tablet 0f77ade6a50544c9a6c3f56b3719a92e (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:26:20.651435  9956 raft_consensus.cc:1275] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:20.653569 11307 consensus_queue.cc:1048] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:20.670358  9885 raft_consensus.cc:1275] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:20.671767 11307 consensus_queue.cc:1048] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:20.710865  9813 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:20.712486 11316 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:20.722317 10527 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:20.724025 11316 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:21.819200 11362 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:21.819808 11362 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:21.824216 11358 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:21.824777 11358 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:21.821995 11362 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:21.826582 11348 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:21.826893 11358 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:21.827126 11348 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:21.829442 11348 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:21.832170 11348 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:21.832629 11348 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:21.836122 11348 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:21.850317 11360 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:21.850945 11360 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:21.853073 11360 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:21.854326  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:21.859841 11358 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:21.860435 11358 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:21.862452 11358 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:21.885257 11368 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:21.886415 11360 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:21.886955 11360 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:21.883034 11359 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:21.889076 11360 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:21.885800 11368 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:21.889561 11359 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:21.891767 11359 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:21.881698 11358 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:21.892746 11358 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:21.893113 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:21.934003 11359 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:21.942921 11359 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:21.943320 11358 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:21.935931 11348 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:21.943956 11358 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:21.944212 11348 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:21.944526 11358 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:21.945935 11359 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:21.951480 11358 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:21.907574 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:21.940889 11357 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:21.906988 11363 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:21.978791 11374 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:21.907884 11356 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:21.952518 11368 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:21.955188 11365 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:21.961640 11358 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:21.980160 11359 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:21.996660 11359 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:21.997879 11365 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.016940  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:21.985601 11360 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.010514 11356 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.026692 11360 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.027096 11362 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.027696 11362 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.028472 11356 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.028584 11369 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:21.999811 11358 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.029230 11369 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.139456 11376 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:22.140282 11376 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.142817 11358 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.143153 11376 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.143985 11376 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.144613 11376 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.145569 11365 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.108359 11364 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.147264 11376 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.146929 11364 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:21.994227 11357 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:21.985553 11363 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.151557 11357 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.152199 11357 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:22.153648 11368 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.156860 11368 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.159337 11368 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.160912 11368 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.161496 11368 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.164696 11348 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.165853 11362 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:22.168426 11362 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.169092 11362 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.174871 11381 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.044230 11360 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:22.114820 11374 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.249280 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:22.250082 10532 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:22.262893 11371 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.263129  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.152727 11357 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.155514 11363 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.265920  9885 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:22.245230 11369 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.270236  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.253082 11381 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.250972 11360 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:22.334414 11360 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.338035 11363 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.339212 11363 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.264267 11348 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.342388 11348 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.263484 11371 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.351225 11376 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:22.372460  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.375730 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:22.361748 11358 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:22.376442 11358 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.378698 11385 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.374580  9887 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:26:22.383646  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.386670  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.386752 11392 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.387220  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.387292 11390 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.391701 11379 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.374969 11365 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.379369 11385 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.381153 11369 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.430064  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.380609 11376 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.392587 11382 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.442895 11362 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:22.465430  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.427716 11392 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.467734 11362 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.468619 11392 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:22.468487 11362 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.469163 11392 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.469686 11392 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.449898 11360 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.472599  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.450960 11356 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.452318 11348 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:22.474481  9886 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 1.
I20260709 12:26:22.449515 11387 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.443598 11365 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.447690 11369 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.445060 11379 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.478212 11357 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.471205 11358 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.525617 10497 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:22.475024 11363 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.473376 11368 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:22.428790 11390 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.451699 11382 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:22.540182 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 56443.3us
I20260709 12:26:22.524799 11388 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.545159 11389 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:22.476321 11360 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.549300  9890 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:22.474686 11371 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.484745 11374 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.565961  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.566569  9813 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 1.
I20260709 12:26:22.567607  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.568645  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.525818 11356 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.570681  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.572742 11377 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:22.573027 11396 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:22.554983 11391 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.573346 11377 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.583510 11382 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.564332 11380 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:22.586766  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.524801 11387 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.564308 11360 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.594983 11392 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:22.599308 11399 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:22.579456 11373 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:22.603531  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.586452 11362 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.607618 11394 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:22.584352 11384 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.611594 11369 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.611680 11395 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.598305 11386 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:22.600698 11382 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.618507 11383 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:22.569316 11389 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.602873 11380 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.618958 11383 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.581271 11391 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.573511 11396 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.617337 11393 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:22.599941 11399 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.630167 11362 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:22.634095 11374 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.639884 11374 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.639794 11362 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.634012 11369 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.649392 11401 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.618664 11395 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.652246  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:22.631496 11383 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.627326 11390 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:22.654225  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.623479 11382 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.660624  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:22.632781 11385 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:22.570930 11388 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.666033  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:22.650259 11365 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.617658 11373 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.669629 11373 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.663331 11371 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.656351 11404 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.663532 11360 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:22.608134 11394 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.674014 11371 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.654371 11369 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.674484  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:22.692754 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:22.691833  9813 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:22.682353 11387 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:22.693216 10497 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:22.623093 11384 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.697073 11407 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:22.687216  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:22.697556  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:22.684597 11377 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.633092 11386 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.701102  9959 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:22.703569  9963 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:26:22.707494 11374 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.710582  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:22.710749 11399 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.711310 11394 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.694847 11379 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:22.705327 11407 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:22.705438 11362 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.690062 11360 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:22.692976 11389 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.704937  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.663558 11393 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.713330  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.712847  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:22.726464 11396 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.719352  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:22.711344 11385 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:22.727396 11385 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.727795 11385 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.727996 11388 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.727398 11360 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.723479  9890 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 1.
I20260709 12:26:22.721151 11380 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.745115 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:22.743758 10497 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:22.717686 11407 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.690058 11404 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.762548 11376 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.745179 11396 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.664608 11401 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.770725 11289 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.774848  9956 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:26:22.773243 11396 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.780362 11369 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.776150 11398 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.774072 11382 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.781873  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.780521 11396 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:22.788383  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.771953 11402 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:26:22.792130 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 48504.2us
I20260709 12:26:22.790038 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:22.776788 11371 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.795696  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:26:22.798463  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 83561.3us
I20260709 12:26:22.777544 11386 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.783210 11395 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:22.805408  9779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.830s	user 0.000s	sys 0.019s
I20260709 12:26:22.799975  9890 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:22.781473 11398 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:22.806427  9779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.000s	sys 0.019s
I20260709 12:26:22.806578  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.807691 10497 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:22.814028 11359 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.790434 11360 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.787818 11403 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:22.799643 11405 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.805550 11399 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:22.806505 11393 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.880273  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.880893  9811 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:26:22.877660 11377 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.786732 11289 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.881999  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.882120 11377 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.838495 11395 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:22.892236  9778 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:26:22.893632  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 89127.6us
I20260709 12:26:22.895360 11409 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.895936 11409 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.874954 11399 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.898675  9778 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:22.901922  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.792181 11402 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.904844  9810 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:22.905771  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:22.905983 11389 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:22.906267  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:22.906489 10554 debug-util.cc:398] Leaking SignalData structure 0x7b08002893e0 after lost signal to thread 8640
I20260709 12:26:22.911391  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:22.915686 10554 debug-util.cc:398] Leaking SignalData structure 0x7b08001e0500 after lost signal to thread 9747
I20260709 12:26:22.915905  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:22.916854 10554 debug-util.cc:398] Leaking SignalData structure 0x7b08002669e0 after lost signal to thread 9839
I20260709 12:26:22.916997 11404 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:22.917083  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:22.893369 11395 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:22.899252 11393 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:22.923172 10496 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:22.904431 11399 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.925464 11381 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.847517 11405 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.926051 11377 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.926769  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.922397 11395 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.926007 11379 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:22.875254 11383 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.893056 11403 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.929112  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.918655 11389 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:22.919400 11360 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:22.929793  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.931166 11401 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:22.927264  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:22.931691  9810 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 1.
I20260709 12:26:22.932709  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:22.927242 10554 debug-util.cc:398] Leaking SignalData structure 0x7b08002dcea0 after lost signal to thread 9914
I20260709 12:26:22.935554  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.922418 11393 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:22.935444  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.939224  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.941669  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.936535 11389 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.950244  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.943420 10532 raft_consensus.cc:2393] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 2: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:22.943513  9886 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:26:22.944281  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.944571 11405 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.939699 11364 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.945106  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:22.939827 11360 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.957257 11360 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.946635  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.957903  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.936932  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.954473  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.954618  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.947836  9815 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:22.949095 11393 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:22.962909  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:22.963112 10554 debug-util.cc:398] Leaking SignalData structure 0x7b08002ed880 after lost signal to thread 9988
I20260709 12:26:22.963395 11409 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.963140  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.971724  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.971939  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.972591  9808 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:26:22.967221  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.973084  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.973233 11389 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.967824 11403 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:22.969046 10554 debug-util.cc:398] Leaking SignalData structure 0x7b080035e8a0 after lost signal to thread 10557
I20260709 12:26:22.966388  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.973923  9806 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:26:22.965838 11383 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:22.950933 11385 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.975291  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.984655 10529 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 3: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:22.981590 11402 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:22.981666  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.969893 11407 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:22.975785  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.986919 11385 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:22.988543 11407 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.986312  9807 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
W20260709 12:26:22.982128 10554 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4da0 after lost signal to thread 10558
I20260709 12:26:22.990463  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:22.995119  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.996194  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.992615  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.976382 11389 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:22.993323 11393 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:22.999816 11384 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:23.000433 11356 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:22.998107  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.993340  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.997583  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.997267  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:22.996563 11395 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.032323 10526 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:23.033138 11395 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:22.989841  9927 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:23.005223  9713 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56416 (request call id 231) took 1190 ms. Trace:
I20260709 12:26:23.007786  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:23.034449  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 44711.4us
I20260709 12:26:23.035187  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:23.036211  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:23.036082 10497 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:23.037025 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.037300  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:23.037564 10527 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:23.037755  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:23.009198 11391 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:23.038653 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.014390  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.038928  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:23.033838  9713 rpcz_store.cc:276] 0709 12:26:21.814504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:21.814612 (+   108us) service_pool.cc:224] Handling call
0709 12:26:23.005139 (+1190527us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2}
I20260709 12:26:23.040124  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:23.040352 11289 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:26:23.040570  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:23.041177  9959 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:23.041502  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:23.042107  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:23.042544 11395 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:23.042624  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:23.042980 11395 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:23.012567 11399 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.015220  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.043371  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:23.016356  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.044140  9959 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.017050  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.017277  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.018244  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.019011  9928 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.021315 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.018244 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.000946 11393 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:23.025069  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:23.025983  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.048754 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:23.048775 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.049410 11399 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:23.049726 10529 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:26:23.050360  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:23.049789 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.024289  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:23.028566  9811 raft_consensus.cc:1240] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:23.032315  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:23.034029 11360 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:23.054679  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:23.043663  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:23.047410  9928 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.043387 11395 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.047902 11391 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.051640  9854 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:23.026964  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.036382  9927 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:23.052124 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.050654 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.041160  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:23.051167  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:23.054090 10524 raft_consensus.cc:1240] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:23.066908  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:23.031002  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:23.067747 10525 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:23.002373  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:23.068441  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:23.054250  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:23.049437 11398 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:23.071736  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:23.056241  9928 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:23.041229  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:23.056679  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:23.056787 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.054557 11360 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:23.079375 11360 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.080350 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.083690 10528 raft_consensus.cc:2393] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 3: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:23.058100  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:23.084432  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.086526 10496 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:23.087730  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.088382  9890 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:23.089318  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.092023 11289 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.094692  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.095822  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.096079  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.097955  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.099330  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.100541  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.101857 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.102597 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.103302  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.103760  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.104663 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.105573 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.105883 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.058908 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.059805 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.060747 11403 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.063036 11365 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:23.062865 11364 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:23.063522 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.062990 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.111331 11364 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:23.111749 11364 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:23.062014  9854 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.065042 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.065444 10530 raft_consensus.cc:1240] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:23.053792  9778 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:23.113446  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.113615 11394 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:23.113762 11381 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.067210  9927 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:23.114033 11394 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:23.114545 11394 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:23.114625  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 47489.3us
W20260709 12:26:23.114193  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 60461.7us
I20260709 12:26:23.109124  9779 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:26:23.113998  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 52053us
I20260709 12:26:23.093712 11360 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.107496 11365 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:23.078024 11405 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:23.119907  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:23.120076 11405 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:23.120483 11405 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.120968 11393 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:23.116714  9779 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:23.107611 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:23.122738  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:23.118072  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.118955  9927 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:23.112249 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.125954  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:23.121536 11393 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:23.127100 11399 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.127178 11393 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.128561  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.130334 11403 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:23.117686  9778 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:23.124460  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.124562  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:23.119917 11365 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.125466  9927 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:23.125586 10496 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.126003 11391 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:23.132439 11401 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:23.130774 11403 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:23.130465  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:23.138427 11401 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:23.138557 11403 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.133549  9963 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:26:23.132550 11389 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:23.138893 11401 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.139173 11389 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:23.081986 11395 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.135803 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.139812  9963 raft_consensus.cc:606] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.134097 10496 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.140354  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:23.140637 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.139585 11389 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.142925  9927 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:23.144409 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:23.141299  9854 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.143442 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:23.145460 11379 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:23.146708  9813 raft_consensus.cc:1240] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:23.140990 11368 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:23.147294 11368 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:23.147475  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:23.147701 11368 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.132812 11391 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:23.150959 11381 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.150921  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:23.132750 11388 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.152196  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:23.152292  9779 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:23.112233  9959 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:23.155701  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:23.157186  9956 raft_consensus.cc:1240] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:23.156318  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:23.160104  9779 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:23.162132  9854 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.161396  9779 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:23.164408 11378 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.165622  9779 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:23.167291 11382 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.167368 11376 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.168073 11395 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:23.152380 11391 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.168749  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:23.153795 11404 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:23.172843 11404 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:23.173274 11404 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.153949 11379 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:23.174423  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:23.174767 10496 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:23.177103  9779 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:23.178164  9779 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:23.156883 11409 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:23.179898  9779 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:23.179216 11363 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:23.182086 11360 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:23.187639  9779 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:23.145906 11405 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.186362 10496 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.187456  9928 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.190557  9928 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:23.182314  9778 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:23.191104  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:23.191111 10496 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.192414  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:23.193859 10496 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.193859  9853 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.196761  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:23.179615 11376 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.197558 11388 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:23.200326 11397 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.200855 11388 raft_consensus.cc:697] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:23.202121 11388 consensus_queue.cc:237] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.185876 11378 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.179332  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:23.198457  9853 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:23.175881 11379 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:23.205005  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:23.199048 10497 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:23.204999  9928 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.206876  9779 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.189774 11386 raft_consensus.cc:2749] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.204533 11360 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:23.189452 11356 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.212420  9853 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:23.208674 11387 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:23.214843  9928 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.179690 11399 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.195073 11385 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.194869 11402 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.213840 11363 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.210382 11396 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.214555  9779 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.222554 11400 raft_consensus.cc:993] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:26:23.214310 11382 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.231585  9853 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.227411 11360 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:23.244050  9779 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.214455 11379 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.236438 11381 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.235165 11374 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.230899 11387 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:23.221690 11397 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.242704 11316 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.252112 11386 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.244112 11380 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.211501 11365 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.222672 11366 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.220966 11407 consensus_queue.cc:1059] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:26:23.254567  9883 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:23.246397 11360 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:23.237138 11398 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.247431  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:23.241685 11393 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:23.256695 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 57737.1us
I20260709 12:26:23.258073 11393 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:23.247426  9779 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:23.259099 11393 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:23.259167  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:23.259517  9779 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.259570 11393 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:23.260181 11393 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.260344 11380 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.261039  9779 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.260895 11386 consensus_queue.cc:1059] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:23.258306 10497 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.261785 11380 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:23.262452 11386 raft_consensus.cc:3055] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:23.262778 11382 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:23.262935 11386 raft_consensus.cc:740] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:23.262742  9779 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.264536 11380 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.264117 11386 consensus_queue.cc:260] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.264796 11409 consensus_queue.cc:1059] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:23.265601 11356 consensus_queue.cc:1059] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:23.265969 11363 raft_consensus.cc:3055] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.266731 11356 raft_consensus.cc:3055] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.266461 11363 raft_consensus.cc:740] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:23.265851  9779 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.245625 11384 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.270340  9853 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:23.243131 11364 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.271951  9806 raft_consensus.cc:1240] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:23.272908 11364 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:23.275584  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:23.277432 11316 consensus_queue.cc:1059] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.278600 11316 raft_consensus.cc:3055] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.270255  9779 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.281323  9928 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.269081 11356 raft_consensus.cc:740] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:23.282104 11397 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.281759 11363 consensus_queue.cc:260] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.283308 11363 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.283012 11356 consensus_queue.cc:260] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.256044 11387 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.265601 11386 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.286643  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:23.287060  9779 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.293485  9779 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.284763  9928 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.297516 11356 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.269707 11378 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.246615 11394 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.279066 11316 raft_consensus.cc:740] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:23.253006 11371 consensus_queue.cc:1059] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:26:23.279639 11406 raft_consensus.cc:1081] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:26:23.277766 11368 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.307504 10530 raft_consensus.cc:1240] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:23.298379 11376 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:23.326938  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:26:23.327476 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 119584us
I20260709 12:26:23.328419 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:23.329312 11398 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.308089  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:23.330075 10496 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.299261 11381 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.301074 11397 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.300413 11377 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.290967 11380 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.331070 11398 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.332481 10496 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.334007  9813 raft_consensus.cc:1240] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:23.334302  9928 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.338819  9962 consensus_queue.cc:237] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:23.346869 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:23.347962  9928 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.302142 11357 consensus_queue.cc:1059] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:26:23.362172 11389 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.362950 11357 raft_consensus.cc:3055] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:23.363310 11357 raft_consensus.cc:740] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:23.364283 11389 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:23.333389  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:23.342720  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:23.364843 11401 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.351224 11365 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:23.337438 11397 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.353130 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:23.344683 11362 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.367362 11385 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.367722 11394 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:23.368468 11316 consensus_queue.cc:260] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.369701 11316 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.343127 11398 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.374778  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:23.364161 11357 consensus_queue.cc:260] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.382791  9957 raft_consensus.cc:1240] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:23.374698  9928 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.337242 11382 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.372169  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:23.386086  9928 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:26:23.389143  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 102557us
I20260709 12:26:23.389294  9928 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.363261 11368 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:23.374948 11405 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:23.391528  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:23.391332 11412 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.376019 11390 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.387786 11406 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.393242  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.399699  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.393193  9853 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:23.389015 11362 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:23.401098  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 100473us
I20260709 12:26:23.406090  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:23.406847  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.407861 11361 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.392939 11400 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.409045  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:23.409168  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:23.396329  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:23.416149 11415 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.418286 11397 consensus_queue.cc:1059] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:23.419304 11397 raft_consensus.cc:3055] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.419618 11397 raft_consensus.cc:740] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:23.403717 11399 raft_consensus.cc:3055] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:23.422252 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:23.396567 11394 consensus_queue.cc:1059] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:26:23.429407 11403 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.410213 11405 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.422796  9928 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.411878 11364 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.434293 11394 raft_consensus.cc:3055] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:23.434736 11394 raft_consensus.cc:740] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:23.438697 10497 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.439607  9959 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:23.413811 11357 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.442445 10532 raft_consensus.cc:1240] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:23.443670  9853 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:23.444944 11398 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.445681  9887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:57652
I20260709 12:26:23.446214  9887 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:23.446563  9887 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:23.448073 11356 consensus_queue.cc:1059] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:23.448988 11358 raft_consensus.cc:3055] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:23.449172 11366 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.449385 11358 raft_consensus.cc:740] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:23.450207 11358 consensus_queue.cc:260] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.453279  9779 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:23.453284  9928 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.423738 11399 raft_consensus.cc:740] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:23.454437  9779 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:23.454789 11390 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:23.461284  9956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:26:23.461292 11389 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.463493 11394 consensus_queue.cc:260] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.459664 11405 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.454689 11380 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.459030 11404 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.467944 11404 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:23.420341 11397 consensus_queue.cc:260] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.469786 11397 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.469110  9711 catalog_manager.cc:5697] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 2, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:23.470505 11381 raft_consensus.cc:3055] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.470839 11381 raft_consensus.cc:740] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:23.473086 11366 consensus_queue.cc:1059] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:23.473212 11374 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.456032 11399 consensus_queue.cc:260] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.474066 11403 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:23.474498 11399 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.471577 11381 consensus_queue.cc:260] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.475451 11381 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.460507  9779 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:23.449776 11393 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.482239 11393 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:23.482934 11391 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.483903  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:23.484935 11391 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:23.457528 11358 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.472810  9853 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:23.477887  9962 raft_consensus.cc:1240] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:23.479609 11409 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.491323 11417 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.491693  9815 raft_consensus.cc:1240] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:23.487457 11387 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.493125 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:23.493594  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:23.494405  9963 raft_consensus.cc:1240] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:23.494585 11387 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:23.495611  9779 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.491803 11369 raft_consensus.cc:3055] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.496598 11369 raft_consensus.cc:740] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:23.498243  9928 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.499485  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:23.507941  9888 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:23.511180  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:23.489035 11374 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:23.512531 11401 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:23.512387 11374 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.514506 11374 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:23.515471 11378 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.516113  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:23.516819  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:23.517457  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:23.518210  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:23.519282  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:23.519955 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:23.520282  9928 consensus_peers.cc:597] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d1e4bd6e7a424475b1d707bfa268d54e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:23.517901 11369 consensus_queue.cc:260] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.521406 11418 consensus_queue.cc:1059] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:26:23.525106 11392 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.521842  9806 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:23.521845 11369 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.538008 11379 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.547688  9928 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.540263 11371 consensus_queue.cc:1059] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:26:23.533517 11380 consensus_queue.cc:1059] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:26:23.551272 11393 raft_consensus.cc:3055] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.551625 11393 raft_consensus.cc:740] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:23.555511  9887 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.552381 11393 consensus_queue.cc:260] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.561424 11371 raft_consensus.cc:3055] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:23.561667 11393 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.561830 11371 raft_consensus.cc:740] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:23.565017 11379 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:23.565111  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:23.565348  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:23.556994 11405 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.566371 11406 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:26:23.570483  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:23.574096  9962 raft_consensus.cc:1240] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:23.574653 11420 consensus_queue.cc:1059] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:26:23.541121 11384 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.577209  9962 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:23.579008  9962 raft_consensus.cc:1240] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:23.578351 10525 raft_consensus.cc:1240] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:23.584964 11405 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:23.587991  9962 raft_consensus.cc:1240] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:23.590548 11371 consensus_queue.cc:260] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.592000 11371 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.594347  9887 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:23.593019  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:23.599483  9807 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:23.600425 11416 raft_consensus.cc:3055] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.600847 11416 raft_consensus.cc:740] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:23.599844  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:23.558919 11374 consensus_queue.cc:1059] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:26:23.602927  9928 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.567662 11360 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.604382 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:23.601711 11416 consensus_queue.cc:260] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.606963 10530 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:23.592702  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:23.605082  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:23.607960  9957 raft_consensus.cc:3055] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:23.608235  9957 raft_consensus.cc:740] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:23.607642 11416 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.609771  9928 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.611896  9928 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.612645 11406 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.611088  9957 consensus_queue.cc:260] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.613500 11406 raft_consensus.cc:2749] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.614060 11365 raft_consensus.cc:3055] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.614450 11365 raft_consensus.cc:740] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:23.615298 11365 consensus_queue.cc:260] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.615607  9928 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.615777  9956 raft_consensus.cc:606] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:23.616178  9956 raft_consensus.cc:614] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:23.616392 11365 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.616583 11405 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.621110  9955 raft_consensus.cc:1240] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:23.622082 11366 raft_consensus.cc:3055] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:23.623759 11420 consensus_queue.cc:1059] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:23.624028 11366 raft_consensus.cc:740] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:23.624483 11394 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.624928 11420 raft_consensus.cc:3055] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.625303 11420 raft_consensus.cc:740] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:23.630122  9853 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.626852 11374 consensus_queue.cc:1059] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:26:23.631704 11360 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:23.625172 11366 consensus_queue.cc:260] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.632186 11417 raft_consensus.cc:3055] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:23.632582 11417 raft_consensus.cc:740] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:23.632885 11366 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.611806 11316 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.636303  9888 raft_consensus.cc:1240] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:23.633476 11417 consensus_queue.cc:260] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.638738  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:23.639271 11417 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:23.631733 11374 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.646759  9806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:26:23.647523  9806 raft_consensus.cc:606] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.647941  9806 raft_consensus.cc:614] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:23.636276 11384 consensus_queue.cc:1059] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:26:23.652158 11384 raft_consensus.cc:3055] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.652894  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:23.654422  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:23.636490 11397 consensus_queue.cc:1059] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:26:23.656618 11397 raft_consensus.cc:3055] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:23.656965 11397 raft_consensus.cc:740] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:23.652529 11384 raft_consensus.cc:740] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:23.661649 10530 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:23.661854 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:23.662658  9854 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:23.664137 11418 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:23.663865 11384 consensus_queue.cc:260] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.664611 11418 raft_consensus.cc:697] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 4 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:23.671728  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:23.671797 11379 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.679461  9957 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:23.674690  9927 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:23.702732 11360 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:23.670897 11387 consensus_queue.cc:1059] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:26:23.686350  9955 raft_consensus.cc:1275] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.686635 11380 consensus_queue.cc:1059] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:26:23.710230 10530 raft_consensus.cc:1240] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:23.714370 11387 raft_consensus.cc:3055] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:23.714771 11387 raft_consensus.cc:740] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:23.715687 11387 consensus_queue.cc:260] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.716585 11380 raft_consensus.cc:3055] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:23.667210 11420 consensus_queue.cc:260] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.708648 11384 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.701442  9884 raft_consensus.cc:2955] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:23.719687 11419 consensus_queue.cc:1059] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:26:23.716962 11387 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.722199 11378 consensus_queue.cc:1048] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.719180 11380 raft_consensus.cc:740] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:23.723377 11388 raft_consensus.cc:3055] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:23.725728 11388 raft_consensus.cc:740] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:23.726351 11380 consensus_queue.cc:260] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:23.726724 11388 consensus_queue.cc:260] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.728296 11388 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.700997 11397 consensus_queue.cc:260] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.728276 11380 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:23.681212 11406 raft_consensus.cc:2955] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:23.733225 11420 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.691370 11418 consensus_queue.cc:237] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.736096  9808 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:23.751889 11397 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.765647  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:23.765982  9884 raft_consensus.cc:1275] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.767556 11357 consensus_queue.cc:1048] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.802935  9809 raft_consensus.cc:2955] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:23.831171  9957 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:23.888520  9853 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:23.896240 11366 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:23.915315  9710 catalog_manager.cc:5697] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 3 to 4, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 4 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:23.900178 11366 raft_consensus.cc:697] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:23.924258 11366 consensus_queue.cc:237] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:23.932024  9713 catalog_manager.cc:5697] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index -1 to 4, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 3 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
W20260709 12:26:23.942795  9761 auto_rebalancer.cc:629] Failed to schedule move for tablet a47692d74f884d019a3ec583399bdb4c: Illegal state: Replica 963185e117384b2085d7cea02a64478b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:26:23.953084  9884 consensus_queue.cc:237] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:23.999970  9710 catalog_manager.cc:5697] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 2 to 3, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 3 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.018738 11436 ts_tablet_manager.cc:933] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:24.023072  9854 consensus_peers.cc:597] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3e593a3b7d754d449a065a58afdb1b7a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:24.032125  9959 raft_consensus.cc:1275] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:24.033895 11384 consensus_queue.cc:1048] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:24.037025  9809 raft_consensus.cc:1275] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:24.051110 11384 consensus_queue.cc:1048] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:24.058566 11436 tablet_copy_client.cc:323] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.67:42253
I20260709 12:26:24.063431  9974 tablet_copy_service.cc:140] P b011791796d1457284b857d7d3422195: Received BeginTabletCopySession request for tablet d1e4bd6e7a424475b1d707bfa268d54e from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:48438)
I20260709 12:26:24.064066  9974 tablet_copy_service.cc:161] P b011791796d1457284b857d7d3422195: Beginning new tablet copy session on tablet d1e4bd6e7a424475b1d707bfa268d54e from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:48438: session id = f5208640a51f493e930ce4f64ceeed0b-d1e4bd6e7a424475b1d707bfa268d54e
I20260709 12:26:24.074996  9974 tablet_copy_source_session.cc:215] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:24.075563 11366 raft_consensus.cc:2955] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:24.078800 11436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1e4bd6e7a424475b1d707bfa268d54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:24.085336  9957 raft_consensus.cc:2955] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:24.092283  9809 raft_consensus.cc:2955] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:24.113608 11436 tablet_copy_client.cc:806] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:24.127027 11436 tablet_copy_client.cc:670] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:24.133971  9711 catalog_manager.cc:5697] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index -1 to 2, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 1 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:24.135229  9808 consensus_queue.cc:237] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:24.137638 11436 tablet_copy_client.cc:538] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:24.168668 11436 tablet_bootstrap.cc:492] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:24.174877  9957 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:24.177439 11357 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:24.177805  9882 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:26:24.178485  9779 consensus_peers.cc:597] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 -> Peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Couldn't send request to peer f5208640a51f493e930ce4f64ceeed0b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8367fec391344e099ca237f0942e4f6d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:24.179781 11378 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:24.190548 11378 raft_consensus.cc:2955] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:24.203344  9956 raft_consensus.cc:2955] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:24.203518  9882 raft_consensus.cc:2955] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:24.229281  9713 catalog_manager.cc:5697] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index -1 to 3, NON_VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) added. New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:24.263142 11436 tablet_bootstrap.cc:492] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:24.264213 11436 tablet_bootstrap.cc:492] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:24.264935 11436 ts_tablet_manager.cc:1403] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.097s	user 0.029s	sys 0.012s
I20260709 12:26:24.268674 11436 raft_consensus.cc:359] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:24.270776 11436 raft_consensus.cc:740] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:24.271462 11436 consensus_queue.cc:260] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:24.274601 11436 ts_tablet_manager.cc:1434] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:26:24.277153  9974 tablet_copy_service.cc:342] P b011791796d1457284b857d7d3422195: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-d1e4bd6e7a424475b1d707bfa268d54e received from {username='slave'} at 127.0.0.1:48438
I20260709 12:26:24.277626  9974 tablet_copy_service.cc:434] P b011791796d1457284b857d7d3422195: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-d1e4bd6e7a424475b1d707bfa268d54e on tablet d1e4bd6e7a424475b1d707bfa268d54e with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:24.288769 10530 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:24.290350 11384 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:24.311506  9808 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:24.313120 11418 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:24.319213  9957 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:24.327044 11384 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:24.340950 10525 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.390043 10525 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:24.391942 11384 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:24.515954 11397 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.516474 11397 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:24.518529 11397 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:24.521129  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:24.521749  9809 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:24.522188  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:24.522848  9927 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:24.523764 11397 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:24.524124 11397 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.524474 11397 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.536176 10525 raft_consensus.cc:1217] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:26:24.538101 11357 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.538612 11357 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:24.542934 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:24.543565 10525 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:24.544723  9779 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:24.537087 11397 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:24.545490 11378 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:24.545873 11378 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.546243 11378 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:24.547981  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:24.548578  9809 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.550859  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:24.551493  9882 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:24.552315 11357 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:24.556295  9809 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:24.560366  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:24.561332 11397 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:24.563961 11378 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:24.564414  9927 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:24.565745 11397 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:24.566627  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:24.566778 11397 raft_consensus.cc:697] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:24.567224  9882 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:24.568090 11397 consensus_queue.cc:237] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:24.577286 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:24.577883 10525 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:24.589037 10525 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:24.589910 11378 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:24.591320  9882 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:24.592449  9779 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:24.593187 11378 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:24.593899 11378 raft_consensus.cc:697] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:24.594730 11378 consensus_queue.cc:237] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:24.612951 11436 ts_tablet_manager.cc:933] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:24.626083  9710 catalog_manager.cc:5697] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:24.639676 11436 tablet_copy_client.cc:323] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.66:34205
I20260709 12:26:24.641353  9899 tablet_copy_service.cc:140] P 963185e117384b2085d7cea02a64478b: Received BeginTabletCopySession request for tablet 3e593a3b7d754d449a065a58afdb1b7a from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:54428)
I20260709 12:26:24.641923  9899 tablet_copy_service.cc:161] P 963185e117384b2085d7cea02a64478b: Beginning new tablet copy session on tablet 3e593a3b7d754d449a065a58afdb1b7a from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:54428: session id = f5208640a51f493e930ce4f64ceeed0b-3e593a3b7d754d449a065a58afdb1b7a
I20260709 12:26:24.649434  9899 tablet_copy_source_session.cc:215] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:24.654910 11436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e593a3b7d754d449a065a58afdb1b7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:24.659859  9710 catalog_manager.cc:5697] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.675128 11436 tablet_copy_client.cc:806] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:24.675772 11436 tablet_copy_client.cc:670] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:24.681486 11436 tablet_copy_client.cc:538] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:24.693737 11436 tablet_bootstrap.cc:492] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:24.715059 11378 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.715598 11378 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:24.717655 11378 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:24.719754 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:24.720402 10525 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:24.720499 11436 tablet_bootstrap.cc:492] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:24.721383  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:24.721598 11436 tablet_bootstrap.cc:492] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:24.722024  9882 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:24.722503 11436 ts_tablet_manager.cc:1403] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.029s	user 0.027s	sys 0.001s
I20260709 12:26:24.723734  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:24.726351 11378 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:24.726738 11378 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.727074 11378 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:24.725448 11436 raft_consensus.cc:359] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:24.729104 11436 raft_consensus.cc:740] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:24.729898 11436 consensus_queue.cc:260] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:24.735172 11378 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:24.736548 11436 ts_tablet_manager.cc:1434] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:26:24.738039  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:24.738631  9882 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:24.738662 11378 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:24.743816 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:24.744401 10525 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:24.749751  9899 tablet_copy_service.cc:342] P 963185e117384b2085d7cea02a64478b: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-3e593a3b7d754d449a065a58afdb1b7a received from {username='slave'} at 127.0.0.1:54428
I20260709 12:26:24.750211  9899 tablet_copy_service.cc:434] P 963185e117384b2085d7cea02a64478b: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-3e593a3b7d754d449a065a58afdb1b7a on tablet 3e593a3b7d754d449a065a58afdb1b7a with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:24.769301  9882 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:24.770550 10525 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:24.772037  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:24.772933 11378 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:24.773687 11378 raft_consensus.cc:697] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:24.775977 11378 consensus_queue.cc:237] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:24.787420 11417 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.788015 11417 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:24.793632 11366 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.794186 11366 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:24.796615 11366 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:24.799798  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:24.800436  9957 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:24.806334 11378 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.806849 11378 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:24.809623  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:24.810958  9853 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:24.811451 11378 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:24.812214 11418 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:24.812601 11418 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.812947 11418 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.814561 11384 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.815049 11384 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:24.817016 11384 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:24.818655  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:24.819109 11417 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:24.819259  9957 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:24.820951  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:24.821223  9853 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:24.821583  9957 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:24.820964 11398 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.822815 11398 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:24.823354 11418 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:24.824208 11366 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:24.824623 11366 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.824965 11366 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.825372 11418 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:24.827380  9853 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:24.834456  9710 catalog_manager.cc:5697] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:24.830327  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:24.836555  9808 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:24.828271  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:24.837600 10496 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:24.837846  9957 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.838392 11412 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:24.838765 11412 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.839072 11412 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.847187  9957 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:24.848750 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:24.850931 11417 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:24.851171  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:24.863790  9882 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:24.865598 11417 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.866330 11417 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:24.868160 11412 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:24.851503 11398 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:24.852389  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:24.869782  9808 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:24.853389  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:24.854401  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:24.854664  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:24.855629 11436 ts_tablet_manager.cc:933] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:26:24.872745  9815 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.872257 11362 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.874652 11362 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:24.878872  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:24.879652  9809 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.879887 11362 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:24.861780 10525 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:24.881881 11366 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:24.877756  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:24.886515  9806 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:26:24.888167 11412 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:24.888320  9927 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:24.889477 11362 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:24.889891 11362 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.890252 11362 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.895749 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:24.896703 10525 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:24.859395  9853 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:24.909518  9809 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:24.911628  9815 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:24.920243 11384 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:24.921025 11384 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:24.910923 11418 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:24.905818 11360 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:24.923623 10496 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:24.924973 11366 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:24.926249 11398 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:24.926824 11398 raft_consensus.cc:697] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 3 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:24.935853  9779 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:24.936722  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:24.930112  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:24.943007 11457 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.943248 11357 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:24.945643 11436 tablet_copy_client.cc:323] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Beginning tablet copy session from remote peer at address 127.8.111.65:38995
I20260709 12:26:24.925034 11360 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:24.967625  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:24.949035 11418 raft_consensus.cc:697] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:24.947191 11362 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:24.953543 11357 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.928076 11398 consensus_queue.cc:237] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:24.957146  9882 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.978018 11418 consensus_queue.cc:237] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:24.980397 11366 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:24.981382 11461 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.981088 11366 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:24.981850 11461 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:24.982589 11362 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:24.984025 11461 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:24.984218 11360 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:24.956804 11457 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:24.987425 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:24.988062 10529 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:24.984552 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:24.989442  9854 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:24.986323  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:24.986203  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:24.993010  9809 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.995064  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:24.995666 11378 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:24.995942  9806 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:24.996419 11378 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:24.997262  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:24.998682 11366 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:24.999428 11461 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:24.999804 11461 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.000134 11461 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.975204 11357 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:25.007397 11417 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.016412 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:25.017043 10532 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.017923 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:25.018699 10527 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:25.031754  9809 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:25.041776  9928 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:25.011850 11467 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:26:25.084324  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 70098.5us
I20260709 12:26:25.087785 10532 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:25.010145 11417 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:25.090343  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:25.098496  9882 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:25.105103 11465 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.089540 11467 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.102013 10525 raft_consensus.cc:2393] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 3: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:25.110752  9853 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:25.104046 11466 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:25.110877  9959 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.101492 11397 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:25.124890 11471 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.108855 11378 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:25.126235 11384 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:25.104144 11412 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:25.125764 11457 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:25.127965 11458 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:25.160586  9710 catalog_manager.cc:5697] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:25.161965  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 120298us
I20260709 12:26:25.164232  9927 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:25.155543 11418 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:25.153038 11397 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:25.117666 11465 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.174630 11418 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:25.169324 11362 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.152853 11466 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.175393 11463 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:25.176100 11397 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.161082 11412 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.194828 11362 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.176904 11472 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:25.199337 11481 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.210022 11481 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.212126 11481 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:25.206703 11482 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:25.207458 11465 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:25.209339 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 278468us
I20260709 12:26:25.191208 11418 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.218847 11482 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.219621 11460 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.157799 11471 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.231503  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:25.232059  9957 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:25.166914 11458 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.224570 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:25.222110  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:25.234591  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:25.235823  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:25.246325  9882 raft_consensus.cc:2368] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3.
I20260709 12:26:25.246879  9956 raft_consensus.cc:2393] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 2: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:25.246599  9809 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:26:25.253774 11467 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:25.255698  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:25.259637 11471 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:25.261160  9809 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:25.261277 11397 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.280112 11397 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:25.262996 11461 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.220351 11463 raft_consensus.cc:697] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:25.281279 11463 consensus_queue.cc:237] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.214805 11472 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.264367  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:25.229516 11362 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:25.229280 11378 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:25.266656 11458 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:25.251686 11460 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.269469 11482 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:25.203308 11479 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.244436 11457 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.276422 11466 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:25.278216  9959 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:25.306880  9887 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:25.273846  9957 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:25.288748 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:25.289392 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:25.307639  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:25.292500  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:25.294626  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:25.308514  9888 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:25.308667  9882 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:25.300750  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:25.309540  9885 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:25.302096 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:25.302562  9779 leader_election.cc:400] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3.
I20260709 12:26:25.311185  9779 leader_election.cc:403] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:25.304407  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:25.303783  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:25.312687  9928 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:25.308254  9962 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:25.312032  9890 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:25.295994 11469 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.317795  9928 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:25.314795 10529 raft_consensus.cc:2393] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 3: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:25.300503 11467 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.323542 10532 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:25.327191  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:25.329772  9955 raft_consensus.cc:2368] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3.
I20260709 12:26:25.300690  9824 tablet_copy_service.cc:140] P 4104e34a61b7448281d6d91ce23ebf71: Received BeginTabletCopySession request for tablet 8367fec391344e099ca237f0942e4f6d from peer f5208640a51f493e930ce4f64ceeed0b ({username='slave'} at 127.0.0.1:34802)
I20260709 12:26:25.302098 11477 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.307237 11458 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:25.318882  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:25.319125  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:25.306546 11378 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.317361 11479 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.317138 11457 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.324064  9884 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
W20260709 12:26:25.347229 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 128884us
I20260709 12:26:25.428205 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:25.426748 11472 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:25.365808 10530 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:25.488210  9809 raft_consensus.cc:1275] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:25.432168 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:26:25.431842  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 114108us
I20260709 12:26:25.518419 10529 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.504242 11492 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.386513 10525 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:25.432060 11362 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:25.432229 11360 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.393903 11483 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.435777 11418 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.328068 11481 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:26:25.348660  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 61259us
I20260709 12:26:25.516427 10532 raft_consensus.cc:2393] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 2: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:25.525046  9778 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:25.556675  9778 leader_election.cc:400] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3.
I20260709 12:26:25.527812  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:25.558138 11378 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:25.530750  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:25.532052  9882 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.504731 11460 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:25.534561  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:25.442941 11478 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.564327 11478 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.565922  9810 raft_consensus.cc:2393] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 3: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:25.567807 11478 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:25.387408 11484 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.568679 11484 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.481530 11488 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.538499 11397 consensus_queue.cc:1048] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:25.533973  9806 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:25.539372  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:25.570921  9882 raft_consensus.cc:1275] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:25.532543  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:25.539764  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:25.517907  9883 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:25.540913  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:25.541095 10529 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:25.545568 11412 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:25.522249 11492 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.572564  9807 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:26:25.571640  9889 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:25.574034 11488 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.343878 11467 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.574594  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:25.574738 11492 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:25.575026  9854 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:25.575203  9962 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:25.576037 10497 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:25.576812 11467 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:25.574136  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:25.577276 11366 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:25.577605  9959 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:25.577801 11366 raft_consensus.cc:697] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:25.431088 11461 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:25.397230 11462 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:25.558574  9809 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:25.578863 11484 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:25.578717 11366 consensus_queue.cc:237] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.559938 11457 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:25.398183 11357 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.516966 11477 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.580139  9815 raft_consensus.cc:2368] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4.
I20260709 12:26:25.580425  9956 raft_consensus.cc:2393] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 2: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:25.560483 11387 raft_consensus.cc:1064] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:25.576859 11412 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:25.580996 11378 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:25.581275 11412 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.571620 11418 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:25.373270  9824 tablet_copy_service.cc:161] P 4104e34a61b7448281d6d91ce23ebf71: Beginning new tablet copy session on tablet 8367fec391344e099ca237f0942e4f6d from peer f5208640a51f493e930ce4f64ceeed0b at {username='slave'} at 127.0.0.1:34802: session id = f5208640a51f493e930ce4f64ceeed0b-8367fec391344e099ca237f0942e4f6d
I20260709 12:26:25.578910 11462 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.591763 11462 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:25.572590 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:25.555814  9853 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:25.593226 11384 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:25.593699 11384 raft_consensus.cc:697] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:25.594558 11384 consensus_queue.cc:237] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.521080 11472 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:25.581681 11357 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:25.598745 11472 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.600874 11472 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:25.585645  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 49202.8us
I20260709 12:26:25.581671 11412 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:25.532615 11362 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.602567 11362 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.602990 11477 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:25.605471  9778 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:25.606679  9778 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:25.607225 11387 consensus_queue.cc:237] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.609943 11457 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:25.610385 11457 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.610669 11483 raft_consensus.cc:2749] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3.
I20260709 12:26:25.610782 11457 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.612360 11500 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:25.612748 11500 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.613065 11500 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:25.610375  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 54639.7us
I20260709 12:26:25.616256  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:25.616952  9959 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:25.617565  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:25.618109  9962 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:25.619406  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:25.620558  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:25.621174  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:25.621337  9812 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:25.621735  9809 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:25.616196  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:25.623204  9956 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:25.623752  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:25.628717  9853 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:25.632097  9956 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:25.555207 11481 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.628717  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:25.634454  9927 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:25.640597 11464 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.641177 11472 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:25.634824  9711 catalog_manager.cc:5697] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 1 to 3, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 3 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:25.642657 11481 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:25.658614 11464 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.555090 11360 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.659816 11494 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:25.660876 11464 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:25.660970 11360 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:25.643530  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:25.661643  9885 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:26:25.661821 11472 raft_consensus.cc:697] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:25.645570 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:25.329883 11469 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.648808  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:25.649295 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:25.650327 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:25.665169 10527 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:25.665122 10530 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:26:25.645889  9778 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:25.667253  9778 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:25.520998 11458 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.668583 11479 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:25.670609 11458 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:25.671160  9955 raft_consensus.cc:2393] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 3: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:25.651996 11483 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:25.671737  9824 tablet_copy_source_session.cc:215] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:25.662859  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:25.672142 11483 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.672544 11483 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.673041 10525 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:26:25.671782 11499 log.cc:927] Time spent T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:26:25.668494  9809 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:25.646800 11492 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.675997 11470 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:25.676191  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:25.676519 11470 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.676369 11472 consensus_queue.cc:237] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.662988 10529 raft_consensus.cc:2368] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3.
I20260709 12:26:25.676988  9884 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:25.647457 10496 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:25.675941 11492 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.676853  9807 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:26:25.676976 11470 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.694460  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:25.653899  9853 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:25.652890  9779 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:25.696355  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:25.696856 11488 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:25.696966 11501 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:25.680178  9814 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:25.697427 11501 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:25.697832 11501 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.698316  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:25.699299  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:25.672495  9806 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:25.700748  9814 raft_consensus.cc:1275] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:25.701118  9806 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:25.679991 11360 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:25.701843 11360 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.702186 11360 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:25.708451 11457 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.708709 11412 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.709678  9815 raft_consensus.cc:2393] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 3: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
W20260709 12:26:25.725414  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 72604us
I20260709 12:26:25.721793  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:25.693849  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:25.702324  9884 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:25.722182  9812 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:25.693506  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:25.689036  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:25.681845  9927 leader_election.cc:400] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4.
I20260709 12:26:25.726715  9779 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:25.726913  9955 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:25.720728 10527 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:25.729633  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:25.734221 11498 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:25.689399 11475 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:25.734688 11498 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:25.735175 11498 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.735342  9807 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.724418 10526 raft_consensus.cc:1217] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:25.689507 11460 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:25.736347 11460 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.736680 11460 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.734261  9962 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:25.720908 11436 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8367fec391344e099ca237f0942e4f6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:25.737743 11378 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:25.738356 11378 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.740079  9809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:26:25.740621  9809 raft_consensus.cc:606] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:26:25.730847  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:25.741732 11475 raft_consensus.cc:697] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:25.668588 11469 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:25.723392 11492 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:25.742728 10496 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:25.743855  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:25.742091  9882 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:25.745050 11478 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:25.745474 11478 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:25.745311 11480 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:25.745766 11489 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:25.746202 11489 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:25.746580 11489 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.745890 11478 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:25.747830 11494 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:25.731448  9928 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:26:25.733539  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 69197.5us
I20260709 12:26:25.742726 11475 consensus_queue.cc:237] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.753037 11458 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:25.758015  9778 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:25.761212  9778 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:25.766953 11494 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:25.709810 11500 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.773571  9779 leader_election.cc:400] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3.
I20260709 12:26:25.773926  9779 leader_election.cc:403] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:25.774040 10532 raft_consensus.cc:2368] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4.
W20260709 12:26:25.776710  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 45351.9us
I20260709 12:26:25.783145  9927 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:25.783272 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:25.787441  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:25.789122 11462 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:26:25.796406  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:25.793670  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:25.802536 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:25.803066 11457 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:25.803164  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:25.803839  9883 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:25.805014 11362 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.807060 11362 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:25.810592  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:25.773350 11494 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.811218  9959 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.814003  9927 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:25.814862  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:25.815536  9961 raft_consensus.cc:2368] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3.
I20260709 12:26:25.826977  9854 leader_election.cc:400] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4.
I20260709 12:26:25.827395  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:25.827313 11478 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.828833  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:25.828727 11378 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.829413  9813 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:25.829674 11478 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:25.792595 11463 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:25.830601 11463 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:25.831030 11463 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.831699  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:25.832370  9958 raft_consensus.cc:2393] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 4: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:25.834674  9808 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:25.798921 11397 consensus_queue.cc:1048] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:26:25.827332  9854 leader_election.cc:403] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:26:25.798573 11490 consensus_queue.cc:1048] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:26:25.838892 11490 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:25.839455  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:25.842094  9928 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:25.842767 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:25.843317 10530 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:26:25.844127  9963 raft_consensus.cc:1275] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:25.816128 11481 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.816504 11500 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:25.780599 11492 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:25.856267  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:25.857575 11477 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:25.770403 11483 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.818830  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:25.819540 11412 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:25.820209 11418 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:25.820502 11470 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.821419 11503 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:25.894850  9956 raft_consensus.cc:2368] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 3. Current term is 4.
I20260709 12:26:25.848497  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:26:25.895192  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 53186.7us
I20260709 12:26:25.895658  9957 raft_consensus.cc:2368] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3.
I20260709 12:26:25.843039 11494 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:25.851634  9813 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:25.855516  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:25.856415 11492 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.790205 11469 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:26:25.871886 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:25.873718  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:25.914227  9811 raft_consensus.cc:2368] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3.
I20260709 12:26:25.914688  9888 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:25.876266  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:25.883675  9778 leader_election.cc:400] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3.
I20260709 12:26:25.892560 11357 raft_consensus.cc:993] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:26:25.826242 11360 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.850234  9959 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:25.797797  9807 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:25.898022  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:25.899024  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:25.901008  9810 raft_consensus.cc:2368] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 2. Current term is 3.
I20260709 12:26:25.857971 11477 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.895048 11503 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.907270  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:25.916747  9778 leader_election.cc:400] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3.
I20260709 12:26:25.873901 11418 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:25.911116  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:25.931705  9814 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.928606  9778 leader_election.cc:403] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:26:25.897965 11467 raft_consensus.cc:2764] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:26:25.932449  9813 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:25.932884  9778 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:25.935793  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:25.935890 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:25.936204 10496 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:25.938916 10533 raft_consensus.cc:2393] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 3: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:25.940160  9778 leader_election.cc:400] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 3. Current term is 4.
I20260709 12:26:25.940565  9778 leader_election.cc:403] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:25.909111  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:25.914441 11492 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:25.917634  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:25.859120 11501 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:25.922930 11488 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:25.931352 11503 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.925187 11477 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.925506 11457 raft_consensus.cc:1081] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:26:25.989939  9882 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:25.956136 11482 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:25.957640  9963 raft_consensus.cc:2368] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 3. Current term is 4.
I20260709 12:26:25.959616 11417 consensus_queue.cc:1048] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:26:25.920922  9883 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:25.924904 11458 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3.
I20260709 12:26:25.931169 11378 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:25.938702 11418 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.039515 11501 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:25.930338 11491 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:25.978888  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:25.953998 11466 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:25.960914 10496 leader_election.cc:400] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3.
W20260709 12:26:26.043848 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 88265us
I20260709 12:26:25.978168 11460 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:25.969483 11462 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:26:26.035507 11508 log.cc:927] Time spent T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:26:25.964042 11488 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:26:26.172736 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 128272us
I20260709 12:26:26.181882  9888 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:26.184561  9886 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:25.964462 11489 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:26.202003 11436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36676 (request call id 347) took 1342 ms. Trace:
I20260709 12:26:26.179589 11488 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.171032 11466 raft_consensus.cc:697] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 3 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:26.221457  9814 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:26.191443 11462 raft_consensus.cc:697] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:26.230825 10527 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:26.224982  9711 catalog_manager.cc:5697] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.232416  9963 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:26:26.233208  9963 raft_consensus.cc:606] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:26.232609  9711 catalog_manager.cc:5697] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.202679 11436 rpcz_store.cc:276] 0709 12:26:24.854975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.855100 (+   125us) service_pool.cc:224] Handling call
0709 12:26:24.872700 (+ 17600us) ts_tablet_manager.cc:934] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: Initiating tablet copy from peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
0709 12:26:25.690293 (+817593us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:26:25.838181 (+147888us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:25.838331 (+   150us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:26:26.181610 (+343279us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:26:26.181854 (+   244us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:26.196935 (+ 15081us) ts_tablet_manager.cc:989] Replica registered.
0709 12:26:26.197007 (+    72us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":29445,"tablet-copy.queue_time_us":88,"thread_start_us":41084,"threads_started":1}
I20260709 12:26:26.238598 11436 tablet_copy_client.cc:806] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:26.239082 11436 tablet_copy_client.cc:670] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:26.223717 11478 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3.
I20260709 12:26:26.250195 11466 consensus_queue.cc:237] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:26.260823 11470 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:26.273876  9928 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:26.277524 11362 raft_consensus.cc:2764] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:26:26.277858 11509 log.cc:927] Time spent T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:26:26.290220  9889 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:35896
W20260709 12:26:26.299145  9809 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.009s	sys 0.043s
I20260709 12:26:26.299269  9889 raft_consensus.cc:606] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:26.303601  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:26.304584  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:26.305285  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:26.305555  9960 raft_consensus.cc:2368] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 2. Current term is 3.
W20260709 12:26:26.299544  9809 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.009s	sys 0.043s
I20260709 12:26:26.306083  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:26.276790 11494 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:26.331032 11418 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:26.332422 11463 consensus_meta.cc:287] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.000s
I20260709 12:26:26.332818 11463 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:26.333299 11418 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:26.334522  9955 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.318229 11490 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4.
I20260709 12:26:26.284035 11462 consensus_queue.cc:237] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:26.340690 11481 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:26.342986  9887 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:26.343070  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:26.343701  9889 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.307865 11460 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:26.347817  9955 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
W20260709 12:26:26.321295 11498 consensus_meta.cc:287] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.009s
I20260709 12:26:26.361653  9806 raft_consensus.cc:2393] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 4: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:26.361712 11492 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:26.323367 11489 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:26.364370 11492 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:26.353664 11498 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:26.367115  9812 raft_consensus.cc:2393] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 5: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:26.368353 11498 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:26.369421 11362 raft_consensus.cc:993] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:26.369192 11485 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:26.369848 11362 raft_consensus.cc:1081] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:26:26.379048 11494 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:26.383597 11360 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:26.376324  9884 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:26.386253 11488 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:26.388257 11488 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:26.352875 11482 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 3. Current term is 4.
I20260709 12:26:26.389168  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:26.389739 11463 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:26.333904 11503 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:26.391429  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:26.393134  9887 raft_consensus.cc:2368] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4.
I20260709 12:26:26.390297 11360 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:26.399294  9928 leader_election.cc:400] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4.
I20260709 12:26:26.399720  9928 leader_election.cc:403] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:26:26.407627  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 431013us
I20260709 12:26:26.395341 11360 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.406714 11463 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4.
I20260709 12:26:26.423113 11360 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:26.431798 11485 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:26.445194 10529 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:26.437687 10525 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 3 LEARNER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:26:26.442335  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 379043us
I20260709 12:26:26.424153 11477 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:26.467633 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:26.480562 10532 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.431200  9810 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:26.485666  9810 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:26.490067  9779 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:26.492460 10532 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:26.469218  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:26:26.470144 11514 log.cc:927] Time spent T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:26:26.476161 11483 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:26.519616  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:26.466400 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:26.442399  9889 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:26.522315 10532 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:26.501977 10529 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:26.506532  9956 raft_consensus.cc:1275] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:26.527269  9928 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:26.509233  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:26.514940  9853 leader_election.cc:400] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 2. Current term is 3.
I20260709 12:26:26.531684  9853 leader_election.cc:403] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:26.510298 11482 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:26.520716  9955 raft_consensus.cc:2393] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 3: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:26.521138 10533 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.499110  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:26.516170  9927 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
W20260709 12:26:26.468523 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 293764us
I20260709 12:26:26.542083  9779 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:26.534904  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:26.535151  9888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:57658
I20260709 12:26:26.543861  9888 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:26.544215  9888 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.544489  9778 leader_election.cc:400] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 3. Current term is 4.
I20260709 12:26:26.544909  9778 leader_election.cc:403] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:26:26.535148  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:26.545696 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:26.527981  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:26.546051  9811 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.535681  9853 leader_election.cc:400] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 2. Current term is 3.
I20260709 12:26:26.546766 10532 raft_consensus.cc:2393] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 3: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:26.546809  9853 leader_election.cc:403] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:26:26.555763  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:26.556339  9885 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:26.557240  9884 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:26.563076  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:26:26.575397  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 59362.4us
I20260709 12:26:26.580214  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:26.583774  9956 raft_consensus.cc:2368] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3.
I20260709 12:26:26.538455 11473 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.591306  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:26.596623  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:26.554596 11498 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:26.598021  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:26.616178  9959 raft_consensus.cc:2368] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3.
I20260709 12:26:26.598554  9885 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:26.616884  9815 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46504
I20260709 12:26:26.599367  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:26.611701  9961 raft_consensus.cc:2393] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 3: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:26.611800  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:26.617455  9815 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:26.617858  9815 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.577729 11502 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:26.574811 11490 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.577219 11482 raft_consensus.cc:697] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:26:26.645249  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 46562.9us
I20260709 12:26:26.643741  9888 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:26.551601 11464 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:26:26.653927  9955 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:26.656239  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:26.595922 11465 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:26.661768 11503 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:26.662793 11482 consensus_queue.cc:237] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:26.514717 11485 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:26.674801  9779 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:26.678633  9811 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:26.659870 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:26.557891 11483 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:26:26.690192 10527 raft_consensus.cc:2393] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 3: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:26.593014  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:26.690936  9815 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:26.712179  9815 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:26.659660  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 74777us
I20260709 12:26:26.585378 11487 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:26:26.646610 11498 raft_consensus.cc:697] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:26.689404  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:26.577932 11521 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.137s
I20260709 12:26:26.591790 11467 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:26:26.724347  9885 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:26.724365 10533 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:26.717458 11477 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:26.657263 11502 raft_consensus.cc:697] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:26.739634 11502 consensus_queue.cc:237] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:26.629252 11384 consensus_queue.cc:1048] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:26:26.724607 11417 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:26:26.689352 11520 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:26.734427  9811 raft_consensus.cc:3055] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:26.682580 11491 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:26.742625  9928 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:26.751716  9811 raft_consensus.cc:740] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:26.752562 11503 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:26.752511 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:26.753130 11503 raft_consensus.cc:697] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:26.753216 10525 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.754036 11503 consensus_queue.cc:237] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:26.756718 11473 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 2. Current term is 3.
I20260709 12:26:26.689044 11466 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 3. Current term is 4.
I20260709 12:26:26.749539  9884 raft_consensus.cc:1240] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:26.784017  9811 consensus_queue.cc:260] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:26.773036 11520 raft_consensus.cc:697] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:26:26.807227 11534 log.cc:927] Time spent T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
W20260709 12:26:26.809222 11516 log.cc:927] Time spent T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 12:26:26.811157  9811 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.811548  9886 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:26.813635  9809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 217) took 1064 ms. Trace:
I20260709 12:26:26.814044  9809 rpcz_store.cc:276] 0709 12:26:25.749569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.749754 (+   185us) service_pool.cc:224] Handling call
0709 12:26:25.750150 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:25.767627 (+ 17477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:25.767680 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:25.768237 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 12:26:26.309039 (+540802us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:26.309087 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:26.309151 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:26.813377 (+504226us) raft_consensus.cc:1685] finished
0709 12:26:26.813400 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:26.813550 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17050,"raft.queue_time_us":18250,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":25690,"thread_start_us":540440,"threads_started":1,"wal-append.queue_time_us":653268}
I20260709 12:26:26.815972  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:26.816609  9809 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.824183 11484 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.824285 11498 consensus_queue.cc:237] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:26.824827 11484 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:26.802846 11475 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:26.797978 11457 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:26.827919 11475 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:26.774237 11476 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
W20260709 12:26:26.852378  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:26.917579  9927 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:26.779402 11491 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:26.841688 11520 consensus_queue.cc:237] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:26.874336  9811 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:26.921113  9853 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:26.834663 11483 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:26.917587 11517 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.918213 11490 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 2. Current term is 3.
I20260709 12:26:26.938552  9811 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:26.928776 11384 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:26.898530 11457 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:26.955678 11384 raft_consensus.cc:697] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:26.957541 11485 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:26.959717 11384 consensus_queue.cc:237] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:26.962340  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:26.960816 11491 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:26.941722  9807 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:26.930318 11483 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:26.956948 11481 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:26.982743 11425 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.005s	sys 0.059s
W20260709 12:26:26.983256 11425 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.005s	sys 0.059s
I20260709 12:26:26.993429 11484 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:27.072739 11483 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:26.968766 11487 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 12:26:27.076972 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:26.961576 11517 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:27.082381  9888 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:26.935374 11357 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.065s	sys 0.064s
I20260709 12:26:26.923280  9809 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:27.107736  9811 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:27.109316  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:27.119553 11492 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:27.120357 11492 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:27.122419 11484 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:27.123153 11484 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:27.142851 11479 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.013s	sys 0.028s
W20260709 12:26:27.143376 11479 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.013s	sys 0.028s
W20260709 12:26:27.145305 11462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.041s	sys 0.079s
W20260709 12:26:27.145798 11462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.041s	sys 0.079s
W20260709 12:26:27.149600  9814 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.055s	sys 0.065s
W20260709 12:26:27.150557  9814 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.055s	sys 0.065s
W20260709 12:26:27.151604 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 481411us
W20260709 12:26:27.154647 10496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.006s	sys 0.014s
W20260709 12:26:27.155062 10496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.006s	sys 0.014s
I20260709 12:26:27.155954 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:26:27.158674  9963 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.016s	sys 0.041s
W20260709 12:26:27.159017  9963 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.016s	sys 0.041s
W20260709 12:26:27.162439  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 453387us
I20260709 12:26:27.166523 11501 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:27.167800 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:27.167333 11501 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:27.171852 11501 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:27.171603 11543 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:27.172734 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:27.185281 11482 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.013s	sys 0.011s
I20260709 12:26:27.125967 11484 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:27.158535 10526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.028s	sys 0.017s
W20260709 12:26:27.190593 11482 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.013s	sys 0.011s
I20260709 12:26:27.291229  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:27.320853  9814 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
W20260709 12:26:27.138935 11378 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.035s	sys 0.051s
W20260709 12:26:27.114112 11357 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.068s	sys 0.065s
I20260709 12:26:27.383641 11484 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:26:27.328104 10526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.029s	sys 0.017s
W20260709 12:26:27.288617 11460 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.000s	sys 0.022s
I20260709 12:26:27.410462 11547 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:27.411432 11547 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:27.289348 11541 raft_consensus.cc:2764] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:26:27.352932 11360 consensus_meta.cc:287] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.838s	user 0.012s	sys 0.000s
I20260709 12:26:27.290163 11517 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:27.383999 10525 consensus_meta.cc:287] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.630s	user 0.009s	sys 0.000s
W20260709 12:26:27.355320 11378 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.036s	sys 0.051s
W20260709 12:26:27.405097 11460 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.000s	sys 0.024s
I20260709 12:26:27.319695 11458 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:27.385949 11494 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:27.386668 11484 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:27.393846 11532 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:26:27.859561  9809 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.013s	sys 0.017s
I20260709 12:26:27.427536 11360 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:27.841162 11503 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.916s	user 0.003s	sys 0.007s
W20260709 12:26:27.709427  9815 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.009s	sys 0.024s
I20260709 12:26:27.617131 11529 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:27.779361 11547 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:27.810302 10532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.013s	sys 0.023s
I20260709 12:26:27.617779 11521 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:26:27.713910 11554 log.cc:927] Time spent T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
W20260709 12:26:27.652590 11481 consensus_meta.cc:287] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.000s
W20260709 12:26:27.760437  9930 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.072s	sys 0.205s
W20260709 12:26:27.834645  9856 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.006s	sys 0.026s
I20260709 12:26:27.413496  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:26:27.559129 11465 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.018s	sys 0.001s
I20260709 12:26:27.871299  9958 raft_consensus.cc:2368] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 4. Current term is 5.
W20260709 12:26:27.870078  9890 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.001s	sys 0.026s
W20260709 12:26:27.920336  9890 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.744s	user 0.001s	sys 0.026s
W20260709 12:26:27.888624  9930 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.114s	user 0.079s	sys 0.208s
W20260709 12:26:27.864769 11418 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.046s	user 0.008s	sys 0.020s
W20260709 12:26:27.810022 11535 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.007s	sys 0.022s
W20260709 12:26:27.876394 10532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.017s	sys 0.023s
I20260709 12:26:27.900554 10496 leader_election.cc:400] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3.
I20260709 12:26:27.428208 11542 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:27.909667  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:28.071996  9963 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.009045  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:27.887679 10529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 367) took 1083 ms. Trace:
W20260709 12:26:27.871871 11503 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.003s	sys 0.007s
I20260709 12:26:27.607424 11384 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:27.579984 11366 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:27.875612 11529 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.069940 10496 leader_election.cc:403] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:26:27.877573 11479 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:27.426901 10525 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:28.283190 11543 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:26:28.184891  9778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.467s	user 0.013s	sys 0.028s
W20260709 12:26:27.869871  9809 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.014s	sys 0.017s
W20260709 12:26:27.874012  9815 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.106s	user 0.010s	sys 0.030s
I20260709 12:26:27.453832  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:28.050377 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:28.386785 10528 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.102414 11360 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:28.086927 11366 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:28.423329 11461 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.424168  9889 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:28.011435  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:28.012286 11362 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:26:28.062086 11418 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.243s	user 0.009s	sys 0.020s
I20260709 12:26:28.433684 10527 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:27.868876 10526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 360) took 1402 ms. Trace:
I20260709 12:26:28.442970 11366 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:28.072675 10529 rpcz_store.cc:276] 0709 12:26:26.804157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.804336 (+   179us) service_pool.cc:224] Handling call
0709 12:26:26.804734 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:26.805134 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:26.805175 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:26.805689 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 12:26:27.148512 (+342823us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:27.148554 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:27.148644 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:27.887428 (+738784us) raft_consensus.cc:1685] finished
0709 12:26:27.887455 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:27.887609 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3893,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":122,"thread_start_us":277420,"threads_started":1,"wal-append.queue_time_us":564814}
I20260709 12:26:28.089224 11384 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.088798 11462 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:28.457559 11462 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.052412 11397 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:27.871481 11458 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.081373 11460 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:26:28.003041 11465 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.294s	user 0.020s	sys 0.019s
I20260709 12:26:28.465277 11465 raft_consensus.cc:697] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:28.466445 11573 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3.
I20260709 12:26:28.467002 11465 consensus_queue.cc:237] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.467516 11474 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:28.468264  9960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 226) took 1891 ms. Trace:
I20260709 12:26:28.102828 11473 raft_consensus.cc:1064] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:28.468338 11474 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:27.879513 11475 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:27.866225 11472 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:27.888413 11481 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:28.473707 11472 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.054092 11484 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:28.049988 11487 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:28.083035 11492 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:28.477550 11472 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:27.908932 11494 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.481436 11494 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:27.874387 11502 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:27.878727 11521 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:28.067981 11535 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.008s	sys 0.022s
I20260709 12:26:28.097643 11529 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:27.878042 11532 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:28.091331 11542 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.103708 11548 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:27.878830 11551 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:28.485450  9711 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59986 (request call id 329) took 2595 ms. Trace:
W20260709 12:26:27.888846  9856 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.213s	user 0.008s	sys 0.026s
I20260709 12:26:28.343672 11568 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:28.344846 11378 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:28.345597  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:28.350425  9883 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.353051 11485 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:28.468818  9960 rpcz_store.cc:276] 0709 12:26:26.576918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.582177 (+  5259us) service_pool.cc:224] Handling call
0709 12:26:26.645954 (+ 63777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:26.733371 (+ 87417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:26.742682 (+  9311us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:26.745269 (+  2587us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:26.747610 (+  2341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.467704 (+1720094us) spinlock_profiling.cc:243] Waited 62.9 ms on lock 0x7b5400114254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:28.467779 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:28.468068 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":144638720}
I20260709 12:26:28.491436 11378 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.491739 11485 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:28.354017 11515 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:28.380599 11518 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.381070  9963 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:28.494454 11378 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:28.494686 11485 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:28.383720  9809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 1733) took 1296 ms. Trace:
I20260709 12:26:28.385403  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 1890) took 1917 ms. Trace:
W20260709 12:26:28.356766  9778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.639s	user 0.013s	sys 0.029s
I20260709 12:26:27.856750  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:26:28.283190 10525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 366) took 1546 ms (client timeout 1699 ms). Trace:
I20260709 12:26:28.089051 11479 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.424203 11461 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.436262 11567 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.438433 11495 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:28.441252  9890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 286) took 1264 ms. Trace:
I20260709 12:26:28.441046 11362 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.441905 11547 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:26:28.442770 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 542185us
W20260709 12:26:28.451467  9927 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 1.515s (SENT)
I20260709 12:26:28.451823 11476 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:28.452003 11360 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:28.505281 11461 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:28.505826 11360 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.454463 11467 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:28.454627 11574 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:28.456038 11552 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.462960  9885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 287) took 1269 ms. Trace:
I20260709 12:26:28.464031 11397 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:28.463289  9958 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55946 (request call id 1658) took 1955 ms (client timeout 1753 ms). Trace:
I20260709 12:26:28.476248 11487 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.496593  9815 rpcz_store.cc:276] 0709 12:26:26.477665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.712941 (+235276us) service_pool.cc:224] Handling call
0709 12:26:26.713279 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:26.719451 (+  6172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:26.719480 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:26.719920 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 12:26:28.384672 (+1664752us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:28.384742 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.384866 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:28.384971 (+   105us) raft_consensus.cc:1685] finished
0709 12:26:28.384996 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:28.385191 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2524,"raft.queue_time_us":4753,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":18032,"thread_start_us":1616369,"threads_started":1,"wal-append.queue_time_us":1142234}
I20260709 12:26:28.500973  9890 rpcz_store.cc:276] 0709 12:26:27.175739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.175869 (+   130us) service_pool.cc:224] Handling call
0709 12:26:27.176158 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:27.176339 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:26:27.920644 (+744305us) log.cc:844] Serialized 14 byte log entry
0709 12:26:28.438444 (+517800us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:28.438560 (+   116us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:28.438650 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.438799 (+   149us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:28.439700 (+   901us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6982,"prepare.queue_time_us":682618,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":15315,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":38550,"thread_start_us":1211666,"threads_started":2,"wal-append.queue_time_us":161200}
I20260709 12:26:28.514010  9885 rpcz_store.cc:276] 0709 12:26:27.193042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.461377 (+1268335us) service_pool.cc:224] Handling call
0709 12:26:28.461969 (+   592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:28.462424 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:28.462451 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:28.462518 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:28.462553 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.462627 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:28.462738 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:28.465286 11462 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:28.482664 11502 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.237942 10532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 614) took 1086 ms. Trace:
I20260709 12:26:28.488600 11458 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:28.495208 11568 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.495574 11515 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:28.498624 10525 rpcz_store.cc:269] 0709 12:26:26.736374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.737164 (+   790us) service_pool.cc:224] Handling call
0709 12:26:28.282930 (+1545766us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:28.500751  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 1.78258e+06us
I20260709 12:26:28.488375 11532 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:28.500631 11567 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.505075 11362 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:28.336478 11543 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.495445  9809 rpcz_store.cc:276] 0709 12:26:27.087301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.110657 (+ 23356us) service_pool.cc:224] Handling call
0709 12:26:27.111008 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:27.111419 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:27.111459 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:27.115563 (+  4104us) log.cc:844] Serialized 26 byte log entry
0709 12:26:28.382918 (+1267355us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:28.382996 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.383121 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:28.383194 (+    73us) raft_consensus.cc:1685] finished
0709 12:26:28.383212 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:28.383420 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":12716,"thread_start_us":1265020,"threads_started":1,"wal-append.queue_time_us":772313}
I20260709 12:26:28.520915  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:28.517118 11574 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.505337 11479 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:28.500689  9881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1841) took 1101 ms. Trace:
I20260709 12:26:28.500753 11495 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.489524 11460 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.543927 11458 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.544740 11458 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.520237 11467 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:28.514456  9958 rpcz_store.cc:269] 0709 12:26:26.507277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.507883 (+   606us) service_pool.cc:224] Handling call
0709 12:26:26.562910 (+ 55027us) spinlock_profiling.cc:243] Waited 6.21 ms on lock 0x7b5800135f98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:28.462888 (+1899978us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400115b54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:28.463095 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3020872320}
W20260709 12:26:28.527275  9886 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54428 (request call id 283) took 1992 ms (client timeout 2324 ms). Trace:
I20260709 12:26:28.527706 11360 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:28.502511 11547 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.530014 11476 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.518605 11461 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:26:28.538856  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 87592.3us
I20260709 12:26:28.525287 10528 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:28.527655 11473 consensus_queue.cc:237] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:28.547063  9886 rpcz_store.cc:269] 0709 12:26:26.534556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.534677 (+   121us) service_pool.cc:224] Handling call
0709 12:26:28.526870 (+1992193us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54002e7554. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:28.527088 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492381952}
I20260709 12:26:28.531443 11551 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.523309 10532 rpcz_store.cc:276] 0709 12:26:27.151009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.151901 (+   892us) service_pool.cc:224] Handling call
0709 12:26:27.152278 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:27.152678 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:27.152707 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:27.153165 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 12:26:28.068214 (+915049us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:28.068258 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.068327 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:28.237308 (+168981us) raft_consensus.cc:1685] finished
0709 12:26:28.237352 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:28.237679 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3544,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":139,"thread_start_us":914636,"threads_started":1,"wal-append.queue_time_us":923488}
W20260709 12:26:28.550804  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 54052.9us
I20260709 12:26:28.551704 11568 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:28.552042 11515 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:28.553313 11567 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:28.520504 11552 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.443655 10526 rpcz_store.cc:276] 0709 12:26:26.466779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.468419 (+  1640us) service_pool.cc:224] Handling call
0709 12:26:26.475010 (+  6591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:26.475426 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:26.475461 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:26.475984 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 12:26:27.868199 (+1392215us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b5400705920. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e486090 00007f2f8e4936b8 00007f2f8e51c92b 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c
0709 12:26:27.868272 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:27.868333 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:27.868431 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:27.868486 (+    55us) raft_consensus.cc:1685] finished
0709 12:26:27.868506 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:27.868788 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":135,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":117,"spinlock_wait_cycles":56368000,"thread_start_us":917465,"threads_started":1,"wal-append.queue_time_us":681290,"wal-append.run_cpu_time_us":2577,"wal-append.run_wall_time_us":1268866}
I20260709 12:26:28.533134 11457 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:28.540984  9881 rpcz_store.cc:276] 0709 12:26:27.408386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.410313 (+  1927us) service_pool.cc:224] Handling call
0709 12:26:28.500425 (+1090112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:28.494712 11518 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:28.555207 10528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 363) took 2031 ms (client timeout 1814 ms). Trace:
I20260709 12:26:28.581229  9885 raft_consensus.cc:1275] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:28.533995 11548 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.488855  9711 rpcz_store.cc:276] 0709 12:26:25.888854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.888993 (+   139us) service_pool.cc:224] Handling call
0709 12:26:28.484464 (+2595471us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:26.437868 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:26.438575 (+   707us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:26.438627 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:26:26.438664 (+    37us) tablet.cc:662] Decoding operations
0709 12:26:26.439194 (+   530us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:26.439294 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:26.439334 (+    40us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:26:26.439753 (+   419us) tablet.cc:701] Row locks acquired
0709 12:26:26.439779 (+    26us) write_op.cc:260] PREPARE: finished
0709 12:26:26.439952 (+   173us) write_op.cc:270] Start()
0709 12:26:26.440097 (+   145us) write_op.cc:276] Timestamp: P: 1783599986439900 usec, L: 0
0709 12:26:26.440128 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:26:26.441160 (+  1032us) log.cc:844] Serialized 918 byte log entry
0709 12:26:27.150766 (+709606us) op_driver.cc:464] REPLICATION: finished
0709 12:26:27.857426 (+706660us) write_op.cc:301] APPLY: starting
0709 12:26:27.857551 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:27.857722 (+   171us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:27.857891 (+   169us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:27.858343 (+   452us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:27.858563 (+   220us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:26:27.858629 (+    66us) write_op.cc:312] APPLY: finished
0709 12:26:27.858892 (+   263us) log.cc:844] Serialized 29 byte log entry
0709 12:26:27.859113 (+   221us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:27.859224 (+   111us) write_op.cc:454] Released schema lock
0709 12:26:27.859262 (+    38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":59280,"reported_tablets":2,"spinlock_wait_cycles":439168,"child_traces":[["op",{"apply.queue_time_us":706278,"apply.run_cpu_time_us":2227,"apply.run_wall_time_us":2229,"num_ops":2,"prepare.queue_time_us":197705,"prepare.run_cpu_time_us":3722,"prepare.run_wall_time_us":33579,"replication_time_us":710441,"thread_start_us":1514557,"threads_started":2}]]}
I20260709 12:26:28.694566 11360 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.695320 11360 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.696369 11384 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:28.669884 11460 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:28.677505  9883 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:28.697587 11360 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:28.677281  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 123261us
I20260709 12:26:28.700326 11502 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:28.700101 11461 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.702466 11521 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:28.702925 11476 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:28.703121 11521 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:28.704182 11458 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:28.703872 11521 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:28.657841 11578 log.cc:927] Time spent T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
W20260709 12:26:28.658663 11577 log.cc:927] Time spent T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:26:28.676782 11397 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:28.669373 11552 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:28.589866 11542 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:28.628957 11543 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:28.590560 11467 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:28.628096 11515 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:28.716956 11417 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:28.697629  9883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 1838) took 1402 ms. Trace:
I20260709 12:26:28.709619 11472 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:28.728101 11360 consensus_queue.cc:1059] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:26:28.653599 11457 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:28.736637  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:26:28.690318 10528 rpcz_store.cc:269] 0709 12:26:26.524185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.528498 (+  4313us) service_pool.cc:224] Handling call
0709 12:26:28.050127 (+1521629us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b58001f1a98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:28.555076 (+504949us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46957952}
I20260709 12:26:28.739779 11360 raft_consensus.cc:3055] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:28.745321 11360 raft_consensus.cc:740] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:28.747040 11548 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:28.746687 11360 consensus_queue.cc:260] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.748196 11360 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.748706 11461 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:28.740329 11551 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:28.736279 11472 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.740638 11573 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:28.740921 11417 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.731945 11541 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:28.743201  9778 leader_election.cc:400] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3.
I20260709 12:26:28.758219 11458 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.757323  9778 leader_election.cc:403] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:26:28.762827 11469 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:28.763700 11469 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.757181 11384 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:28.771883 11469 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:28.726465  9883 rpcz_store.cc:276] 0709 12:26:27.295324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.322426 (+ 27102us) service_pool.cc:224] Handling call
0709 12:26:28.697522 (+1375096us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:28.770519  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:28.733565 11552 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:28.773674 11487 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:28.772112 11458 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.759646 11547 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:28.780922  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 64651.6us
I20260709 12:26:28.728626 11515 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:28.785218 11458 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:28.786136  9882 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:28.774525 11548 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:28.767802 11573 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.792800 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:28.794878 11573 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:28.799069  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:28.798751 11502 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:28.800369 11465 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:28.800746  9928 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:28.801692 11551 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:28.790830 11532 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:28.802958 11532 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:28.805331 11532 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:28.802264 11551 raft_consensus.cc:697] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:28.808718  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:28.779176 11518 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:28.809087 11551 consensus_queue.cc:237] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.811113 11366 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:28.774022 11541 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.791055 11469 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3.
I20260709 12:26:28.815344 11548 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.821079 11417 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:28.820158 11366 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.812800 11472 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:28.790493 11457 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.890465  9779 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:28.815925 11568 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.813221 11532 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:28.926388  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:28.928568  9958 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:28.823453  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 1727) took 2318 ms. Trace:
W20260709 12:26:28.934049  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 51060.6us
I20260709 12:26:28.823433 11574 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:28.936116  9810 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:28.860185 11552 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.937121  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:28.937417  9961 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:28.892562  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:28.943899  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:28.936998 11515 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:28.821118  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:28.820694 11470 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:28.913908 11473 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:28.933884  9813 rpcz_store.cc:276] 0709 12:26:26.505401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.921089 (+415688us) service_pool.cc:224] Handling call
0709 12:26:26.967953 (+ 46864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:27.084697 (+116744us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:27.084742 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:27.084796 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:27.084840 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.822980 (+1738140us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b540033de54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:28.823067 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:28.823273 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267961088}
I20260709 12:26:28.946961  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:28.816186 11384 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:28.948329 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 59870.9us
W20260709 12:26:28.937165 11582 log.cc:927] Time spent T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:26:28.867725 11583 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:28.944507 11469 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:28.956465 11475 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.957098 11475 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.959316 11475 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:28.958081  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:28.960762  9964 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:28.961421  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:28.947441 11541 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:26:28.967231  9955 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:28.969843 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:28.961993  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:28.950325 11472 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:28.951978  9960 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:28.975693 11532 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.977286 11583 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.981480 11458 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:28.978353 11384 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:28.979281 11472 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.974512  9779 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:28.947825 11568 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.983026  9962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 1663) took 1105 ms. Trace:
I20260709 12:26:28.986145  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:28.989068 11357 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:28.989799 11357 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.975826 11469 raft_consensus.cc:697] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:28.991989 11357 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:28.984901  9962 rpcz_store.cc:276] 0709 12:26:27.877273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.908320 (+ 31047us) service_pool.cc:224] Handling call
0709 12:26:27.908718 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:28.699566 (+790848us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:28.699613 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:28.699674 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:28.699707 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.981624 (+281917us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b540014e6d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:28.981685 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:28.982858 (+  1173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1716727552}
I20260709 12:26:28.992776  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:28.985582 11458 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.995728  9959 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:28.996376  9885 raft_consensus.cc:2393] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 5: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:28.997053  9814 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:28.997555 11458 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:28.992772 11469 consensus_queue.cc:237] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:28.998258  9964 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:28.998641 11478 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:28.998535  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:28.999256 11478 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:28.987304  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:28.966854 11473 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:29.012643  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.013000 11357 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:29.013759 11357 raft_consensus.cc:697] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:29.015017 11357 consensus_queue.cc:237] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:29.020432 11548 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:29.015538 11495 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:29.026865 11478 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:29.011569  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:29.030812  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:29.138660  9890 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:29.139050  9961 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:26:29.139750  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.139884  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.031575 11457 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:29.036381 11573 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:29.140946  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.141079  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.141494 11573 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:29.143231  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:28.976441 11470 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:29.033443 10527 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:29.039448  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.047338  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.037689  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:29.100200  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 127273us
W20260709 12:26:29.034981  9812 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46504 (request call id 1893) took 2454 ms (client timeout 1515 ms). Trace:
I20260709 12:26:29.135233  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:29.176232  9812 rpcz_store.cc:269] 0709 12:26:26.580818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.611481 (+ 30663us) service_pool.cc:224] Handling call
0709 12:26:29.034579 (+2423098us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b540002e4d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:29.034793 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1237501312}
I20260709 12:26:29.143953 11573 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:29.181466 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.133138 11583 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:29.032315  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:29.197779  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:26:29.362928  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 353275us
I20260709 12:26:29.216174  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:29.049985 11480 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.469s
I20260709 12:26:29.214682  9888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1840) took 1824 ms. Trace:
W20260709 12:26:29.361855  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:29.525242  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:29.220002  9711 catalog_manager.cc:5697] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 2 to 4, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 4 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:29.201550 10496 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:29.135025 11544 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:26:29.528355  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 142764us
I20260709 12:26:29.035759 11473 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:29.137236 11472 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:29.032330 11464 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:29.207744  9814 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
W20260709 12:26:29.198936 11585 log.cc:927] Time spent T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.335s	user 0.000s	sys 0.002s
I20260709 12:26:29.217377 11568 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:29.494619 11470 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:29.198518 11588 log.cc:927] Time spent T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 12:26:29.198534  9807 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:29.202953 10525 raft_consensus.cc:1275] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 1 LEARNER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:29.353631 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.362950 11532 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:29.346534 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.211968 11474 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:29.535019 11480 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:29.524510  9888 rpcz_store.cc:276] 0709 12:26:27.390735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.424643 (+ 33908us) service_pool.cc:224] Handling call
0709 12:26:28.784295 (+1359652us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b5800043598. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:28.784580 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:28.975671 (+191091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:28.975704 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:28.977736 (+  2032us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:28.977780 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.214325 (+236545us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54001e3554. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:29.214384 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.214509 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433564288}
W20260709 12:26:29.535774 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 334191us
I20260709 12:26:29.362839 11366 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:29.539749  9808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46504 (request call id 1891) took 3039 ms (client timeout 2736 ms). Trace:
I20260709 12:26:29.223004  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.532176 10497 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:29.209573  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.032797 11552 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:29.520567 11463 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:29.428601 11469 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.553249 11472 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:29.549772  9960 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
W20260709 12:26:29.561508  9808 rpcz_store.cc:269] 0709 12:26:26.500537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.524871 (+ 24334us) service_pool.cc:224] Handling call
0709 12:26:29.539296 (+3014425us) spinlock_profiling.cc:243] Waited 2.55 s on lock 0x7b54002d8554. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:29.539529 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5865446784}
I20260709 12:26:29.583923  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.584932  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.585294  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.586090  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:29.588843 11573 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:26:29.589476  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:29.589910  9927 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:29.588090  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:29.590503 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 58422.1us
I20260709 12:26:29.593613  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:29.595404  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.596553  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.597170  9811 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:29.591686  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:29.578183 11568 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:29.609439  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.611591  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:29.612193  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:29.612980  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.591325 11573 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:29.602229 11551 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:29.619318  9811 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:29.599680 11522 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:29.566893 11544 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:29.605561 11474 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:29.628410  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.618687 11573 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:29.592561 11464 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:29.620041 11551 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:29.605933 11463 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:29.641016  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.625916 11366 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.604609 11469 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:29.630837  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:29.644466  9955 raft_consensus.cc:1275] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:29.623230 11532 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:26:29.643203 11551 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:29.653980  9887 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:29.656066  9962 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:29.657083  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.625268 11472 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:29.661702  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.636729 11568 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:29.653968  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.675468  9807 raft_consensus.cc:2393] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 3: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:29.677335 11463 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:29.658816 11547 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:29.651275 11522 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:29.678093 11547 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:29.680238 11522 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:29.645994 11474 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:29.656508 11552 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:29.642489 11457 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
W20260709 12:26:29.654482 11476 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.010s	sys 0.056s
I20260709 12:26:29.683571  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.711711  9811 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:29.716025 11469 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:29.716277 11436 tablet_copy_client.cc:538] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:26:29.717137 11590 log.cc:927] Time spent T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:26:29.720167 11593 log.cc:927] Time spent T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:26:29.721580  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.682181 11568 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:29.715559  9810 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
W20260709 12:26:29.713040 11476 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.011s	sys 0.057s
I20260709 12:26:29.691474 11552 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:29.737435 11552 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:29.731022  9808 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:26:29.751863 11474 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:29.753238 11472 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:29.675542 11366 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:29.757161 11366 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:29.685689 11464 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:29.733141  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.761076  9811 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:29.732354 11521 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:29.763177  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 173081us
I20260709 12:26:29.749603 11551 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:29.739367  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:29.785233  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.789425  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.792613  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.796697  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.786559 11474 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:29.794713 11457 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:29.793923 11480 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:29.812687 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.799365 11574 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.813820  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:29.815006  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.819902 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.820559 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:29.816480  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 168524us
I20260709 12:26:29.809983 11460 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.807785  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:29.814216 10528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.009s	sys 0.036s
I20260709 12:26:29.805647 11544 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:29.802733 11568 consensus_queue.cc:1048] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:26:29.831480 11488 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:29.815690  9881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 293) took 1137 ms. Trace:
I20260709 12:26:29.819801 11600 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.834714  9812 raft_consensus.cc:2393] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 3: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:29.832170 11488 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:29.840113 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.840714 11488 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:29.832558 11480 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:29.843770 11480 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:29.844673  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.819034 11457 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:29.845882 11476 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:26:29.847071 11596 log.cc:927] Time spent T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 12:26:29.847177 11457 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:29.847708 11598 log.cc:927] Time spent T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.136s	user 0.003s	sys 0.000s
I20260709 12:26:29.850523 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.850767  9806 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:29.851676 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.852531 11551 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:29.836886  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.827140  9853 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:29.857414 11436 tablet_bootstrap.cc:492] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: Bootstrap starting.
I20260709 12:26:29.856166  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.855850 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.861515 10533 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:29.866827  9814 raft_consensus.cc:1275] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:29.856264  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.856608  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.864658 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.897706 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.899472 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:29.833827 10528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.009s	sys 0.036s
I20260709 12:26:29.892889  9887 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
W20260709 12:26:29.900818  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 62670.7us
I20260709 12:26:29.865520  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.902976  9888 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:29.857252  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.856946  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.905511  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:29.860446 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.907320 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.907928 10533 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:26:29.908893  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:29.910580  9885 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
W20260709 12:26:29.838408  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 191800us
I20260709 12:26:29.824550 11573 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:29.865192  9808 raft_consensus.cc:1275] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:29.828603 11460 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:29.926422 10530 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
W20260709 12:26:29.927423 11597 log.cc:927] Time spent T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.252s	user 0.002s	sys 0.000s
I20260709 12:26:29.927794 11460 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:29.928498 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.929597 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.930054  9812 raft_consensus.cc:1275] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:29.930434  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.913551  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.913635  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.834686  9881 rpcz_store.cc:276] 0709 12:26:28.690940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.698094 (+  7154us) service_pool.cc:224] Handling call
0709 12:26:28.729124 (+ 31030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:28.771648 (+ 42524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:28.771696 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:28.771757 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:28.771795 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.804888 (+1033093us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b54003c5854. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:29.808625 (+  3737us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.813996 (+  5371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93441920}
I20260709 12:26:29.914839  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.914719 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.915433  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.941098  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.912204 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.941556 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.864274 11547 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:29.901649 11600 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:29.825999 11574 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:29.918991 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.919498  9927 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:29.919889 11464 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:29.919692  9778 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:29.920822 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.859671 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.909660 11605 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:26:29.827791 11474 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:29.915855  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.955114  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:29.955217  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:29.944839  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 91263.2us
W20260709 12:26:29.951884  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 129990us
I20260709 12:26:29.956110 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.954162  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 1900) took 1073 ms. Trace:
I20260709 12:26:29.914858  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.969751  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.970970 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.969362 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.969998  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.956689  9815 rpcz_store.cc:276] 0709 12:26:28.881396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.885485 (+  4089us) service_pool.cc:224] Handling call
0709 12:26:28.944527 (+ 59042us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:28.974558 (+ 30031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:28.974590 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:29.143753 (+169163us) log.cc:844] Serialized 556 byte log entry
0709 12:26:29.558605 (+414852us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:29.558643 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.560102 (+  1459us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:29.926623 (+366521us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:26:29.931170 (+  4547us) raft_consensus.cc:1685] finished
0709 12:26:29.931189 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.954103 (+ 22914us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38401280,"thread_start_us":414468,"threads_started":1,"wal-append.queue_time_us":501382}
I20260709 12:26:29.977164  9885 raft_consensus.cc:1275] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:29.977837  9886 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:29.978120  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.979825  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.955710  9882 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:29.979455 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.981912 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.982463 10530 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:29.984318  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.985361  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:29.985311  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:29.987179  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.983075 10531 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:26:29.951426 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.991910  9885 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:29.991997 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:29.992776 10532 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:29.993924 10532 raft_consensus.cc:1240] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:29.979460  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:29.995733  9883 raft_consensus.cc:2368] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3.
I20260709 12:26:29.996074  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.996924  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.997259  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:29.969537 10528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36672 (request call id 508) took 1006 ms. Trace:
I20260709 12:26:29.998538 10528 rpcz_store.cc:276] 0709 12:26:28.949387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.952972 (+  3585us) service_pool.cc:224] Handling call
0709 12:26:28.961387 (+  8415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:28.961968 (+   581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:28.962003 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:28.962665 (+   662us) log.cc:844] Serialized 26 byte log entry
0709 12:26:29.669122 (+706457us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b18002334a0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f522 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:26:29.681538 (+ 12416us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8b4120ac 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f8e0b620b
0709 12:26:29.911074 (+229536us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:29.918388 (+  7314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.932159 (+ 13771us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:29.942403 (+ 10244us) raft_consensus.cc:1685] finished
0709 12:26:29.943497 (+  1094us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.954609 (+ 11112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4444,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":3306,"spinlock_wait_cycles":10679296,"thread_start_us":939285,"threads_started":1,"wal-append.queue_time_us":879561}
I20260709 12:26:30.000886  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:29.994887 11474 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:29.953938 11460 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:29.985466  9778 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:30.008756  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:30.009640  9956 raft_consensus.cc:2368] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 4. Current term is 5.
I20260709 12:26:30.000898 11600 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:30.014638 11482 raft_consensus.cc:2804] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:30.015072 11482 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:30.015413 11482 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.015515  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:30.016363 11476 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:30.017475  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.018793 11460 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:29.998157  9883 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:30.022893  9778 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:29.957068 10526 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
W20260709 12:26:30.023800  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 106881us
I20260709 12:26:29.970475 11607 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:30.028034  9853 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:30.024529  9927 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:30.032670  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.032804  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.032716  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:30.034750  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:30.036128  9885 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:30.036578  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.037551 11357 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:30.037973 11357 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.038328 11357 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:30.034219  9886 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:30.044970  9882 raft_consensus.cc:1275] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:29.983455  9884 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:30.052469  9885 raft_consensus.cc:1275] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:26:30.056641  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 74933.8us
I20260709 12:26:30.056728  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:30.057574  9881 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:26:30.057587 11473 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:30.026786 11600 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:30.058341 11473 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:30.058519  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.058753 11600 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:30.058887 11473 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:30.026616 11573 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:30.062485 11574 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:30.063393  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.029054 11607 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:30.046376  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:30.064052 11457 consensus_queue.cc:1048] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:26:30.079587 11473 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:30.069217 11478 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:26:30.087616 11460 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:30.076464  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:30.093506  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:30.100211  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:30.100792  9779 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:30.102658  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:30.103384  9890 raft_consensus.cc:2376] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3. Re-sending same reply.
I20260709 12:26:30.103591 11532 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:30.105556  9779 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:30.098388  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:30.106865  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.107479 11457 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:30.108031 11457 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:30.108469 11457 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:30.112354  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:30.107506  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:30.069684 11607 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:30.117841 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:30.118263 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:30.123616  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.124526  9957 raft_consensus.cc:1275] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:30.124462  9956 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:30.126032  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.125972  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:30.135381  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 64781.1us
I20260709 12:26:30.138720 10529 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:30.140019  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:30.161818 11600 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:30.115655 11544 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:26:30.164762  9853 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:30.172515  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:30.148222 11605 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 12:26:30.174817 11612 log.cc:927] Time spent T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:26:30.182715  9779 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:30.202481 11575 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:30.203037 11575 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:30.203416 11575 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:30.175050 11606 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:26:30.210649  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 120042us
W20260709 12:26:30.207374  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 60369.2us
I20260709 12:26:30.213419  9815 raft_consensus.cc:2393] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 3: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
W20260709 12:26:30.217911  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 53305.3us
I20260709 12:26:30.218906  9853 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:30.222205  9927 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:30.222941  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:30.224645 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:30.226979  9779 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:30.228104 11457 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:30.230454 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:30.231770  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:30.238354  9927 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:30.237183  9854 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:30.244525  9854 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:30.243345 11568 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:30.244236 10497 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:30.225237 11594 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:30.250408  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:30.250521 10496 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:30.252439  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:30.257475  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:30.246481 11606 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:30.246493 11568 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:30.248970 11478 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:30.243924 11552 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:26:30.268297  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.243552 11548 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:26:30.275297  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 48408.4us
W20260709 12:26:30.276521 11611 log.cc:927] Time spent T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:26:30.248943 11600 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:30.277057  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:30.276292 11476 raft_consensus.cc:2955] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:30.277827 11474 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:30.266348 11606 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:30.249150 11473 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:30.292496  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:30.269279 11568 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:30.274812 11552 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:30.286506 11460 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:30.273132  9807 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:30.308894  9814 raft_consensus.cc:1275] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:30.290840 11600 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.293339 11474 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:30.317286  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:30.318437  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:30.319537  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:30.319867  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:30.323055 10496 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:30.323364 11457 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:30.296036  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:30.295629 11473 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:30.334133 10496 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:30.311635 11552 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:30.332183  9779 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:30.339197  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.335798 11473 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.339857 11457 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:30.340636 11488 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:30.316601 11600 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:30.327582 11474 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:30.354687  9959 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:30.355762  9779 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:30.328429 11460 raft_consensus.cc:697] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 3 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:26:30.358844  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 65228.5us
I20260709 12:26:30.343343 11574 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:30.359577  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:30.376631  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.352833 11488 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:30.343221 11607 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:30.358714  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.343144 11357 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:30.385758  9928 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:30.383908 11469 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:30.394058  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.362092 11574 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:30.384088 11488 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:30.400797  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 43778.4us
I20260709 12:26:30.375953 11544 consensus_queue.cc:1059] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:26:30.398720 11574 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:30.414088 11457 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:26:30.426674  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.427910  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.428589  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.428969  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.429639  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.430032  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.430692  9956 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:30.430263 11460 consensus_queue.cc:237] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:30.431088  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.407639 11625 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:30.438406  9927 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:30.412024  9961 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:30.448537  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.439769 11477 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:30.449502  9928 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:26:30.504364  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 54964.7us
I20260709 12:26:30.505358  9928 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:26:30.508394  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 72810.1us
I20260709 12:26:30.441048  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:30.513638  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:30.519301 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:30.527894 11548 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:26:30.535187 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 193016us
W20260709 12:26:30.536069  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 246791us
W20260709 12:26:30.533566  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 192594us
W20260709 12:26:30.539548 11436 log.cc:927] Time spent T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:26:30.497035 11482 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:30.558526 11625 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:30.558626 11469 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:30.573597  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:30.578326  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:30.534621  9960 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:30.577080 11469 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:30.590906  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 235195us
W20260709 12:26:30.581841 11634 log.cc:927] Time spent T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:26:30.597757  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:30.587572  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:30.580510 11464 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.550020 11575 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:30.599673  9779 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:30.596632  9853 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:30.604087 11436 tablet_bootstrap.cc:492] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:30.600605  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:30.603061 11607 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:30.608913  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:30.670639 11532 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:30.675140 11532 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:30.675557 11532 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:30.676934  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 171683us
W20260709 12:26:30.677165  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 88518.8us
W20260709 12:26:30.678148  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 78588.5us
I20260709 12:26:30.678773 11436 tablet_bootstrap.cc:492] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: Bootstrap complete.
I20260709 12:26:30.678990  9928 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:30.679332  9779 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:30.678318  9853 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:30.624310 11630 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:30.683393  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:30.685721  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:30.605050 11488 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:30.649390  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:30.608950 11464 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:30.689296 11436 ts_tablet_manager.cc:1403] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: Time spent bootstrapping tablet: real 0.832s	user 0.038s	sys 0.037s
W20260709 12:26:30.690794  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 181364us
I20260709 12:26:30.677335  9884 raft_consensus.cc:1240] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:30.691370 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 395828us
I20260709 12:26:30.686228  9815 raft_consensus.cc:2955] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:30.696928  9927 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:30.686918  9928 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:30.681665  9889 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:30.715696 10532 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:30.716334  9928 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:30.687780 11628 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:30.717142 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 114891us
I20260709 12:26:30.699292 11626 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:26:30.748086 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 51745us
I20260709 12:26:30.750557 10496 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:26:30.755937  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 157466us
I20260709 12:26:30.693949 11647 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:26:30.756811  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 59176.1us
I20260709 12:26:30.776638 10496 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:30.703534 11640 consensus_queue.cc:1048] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:26:30.752594 11626 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:30.787117  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:30.788515  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 102863us
I20260709 12:26:30.789214  9853 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:30.791340 11460 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:30.801898  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:30.782752 11627 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:30.815869  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:30.818158  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:30.820207  9779 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:30.797150 11626 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:30.782807 11636 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:26:30.826462  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 117592us
I20260709 12:26:30.804332 11647 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:30.818899 11648 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:30.837777  9779 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:30.826921 11575 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:30.830901 11636 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:26:30.854650  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 65507.6us
I20260709 12:26:30.825685 11656 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:30.855458 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:30.835423 11647 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:30.834527  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:30.815765 11607 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:26:30.846920 11648 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:30.858834  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:30.864307 11651 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:30.864743 11651 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:30.865130 11651 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:30.866513 11632 log.cc:927] Time spent T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 12:26:30.866562 11669 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:26:30.868007 11653 log.cc:927] Time spent T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:26:30.867429 11669 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:30.869414 11643 log.cc:927] Time spent T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
W20260709 12:26:30.870908 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 94366.9us
I20260709 12:26:30.891088  9779 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:30.893116 10496 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:30.898875  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:30.858004 11636 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:30.862720 11473 consensus_meta.cc:287] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.000s
W20260709 12:26:30.901762  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 186273us
I20260709 12:26:30.860955 11647 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:30.902890  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 45548.3us
I20260709 12:26:30.883883 11648 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:30.870349 11575 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:30.904044  9928 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:30.861088 11661 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:30.890106 11488 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:30.909350 11575 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:30.913298  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:30.914572 11460 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:30.920138  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:30.896342  9807 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:30.931929  9811 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:30.904279 11464 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:30.917762 11469 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:30.908748 11366 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:26:30.957170 11574 consensus_meta.cc:287] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.517s	user 0.011s	sys 0.002s
I20260709 12:26:30.905665 11662 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:26:30.931252 11436 raft_consensus.cc:359] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:30.911907 11478 raft_consensus.cc:2749] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:30.968514 11436 raft_consensus.cc:740] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Initialized, Role: LEARNER
I20260709 12:26:30.973591 11436 consensus_queue.cc:260] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:30.976099 11436 ts_tablet_manager.cc:1434] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: Time spent starting tablet: real 0.276s	user 0.006s	sys 0.001s
W20260709 12:26:30.926844 11654 log.cc:927] Time spent T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:26:30.910981 11657 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:30.926422 11457 raft_consensus.cc:3055] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:30.982529 11457 raft_consensus.cc:740] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:30.923574 11575 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.930493 11594 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:30.947007 11644 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:30.924430 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:26:30.977720 11616 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.005s	sys 0.016s
W20260709 12:26:30.985148  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 200021us
I20260709 12:26:30.906450 11473 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:30.976975 11643 log.cc:927] Time spent T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:26:30.947266 11666 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:30.961548 11366 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:30.980952 11657 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:30.983361 11457 consensus_queue.cc:260] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:30.988215 11594 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:30.993814 11469 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:30.923102  9928 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:30.973961 11574 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:30.998116 11616 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.005s	sys 0.016s
W20260709 12:26:31.051021  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 143576us
W20260709 12:26:31.053625  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 130626us
I20260709 12:26:31.059213  9928 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:30.999454 11366 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:31.061347  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 50312.5us
I20260709 12:26:31.063133  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:31.031554 11594 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.001696 11657 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.071389 10533 raft_consensus.cc:1240] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:31.075524  9928 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:31.078672  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:26:31.083468 11474 consensus_meta.cc:287] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.705s	user 0.015s	sys 0.008s
I20260709 12:26:31.083901 11474 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:31.085953 11474 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:31.088639 11666 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:31.065317 11628 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:31.091718 11473 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:31.092346  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:31.068774 11670 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:31.094882 11648 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:31.096731 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 87045.1us
W20260709 12:26:31.097383 11552 consensus_meta.cc:287] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.740s	user 0.012s	sys 0.012s
I20260709 12:26:31.070703 11548 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:26:31.101752  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 43745.8us
I20260709 12:26:31.107297  9928 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:31.109411  9811 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:31.105216 11548 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:31.111474  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 212691us
I20260709 12:26:31.117229  9779 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:31.117738  9928 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:31.119836  9928 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:31.123095 11628 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:31.126048 11682 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:31.128803 11679 consensus_queue.cc:1048] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:26:31.127589 11473 consensus_queue.cc:1048] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:26:31.111579 11673 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:31.106184 11552 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:31.144140 11631 consensus_queue.cc:1059] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:26:31.145458 11631 raft_consensus.cc:3055] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:31.145814 11631 raft_consensus.cc:740] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:31.133512 11625 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:31.147598  9928 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:31.111109 11464 consensus_queue.cc:1048] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:26:31.152554 11482 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:31.156291 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:26:31.156571 11476 consensus_meta.cc:287] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.762s	user 0.005s	sys 0.006s
I20260709 12:26:31.157665  9959 raft_consensus.cc:1240] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:31.106356 11460 consensus_queue.cc:1059] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:26:31.161103 10532 raft_consensus.cc:1240] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:31.160789 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:31.163887 11648 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:31.164849 11671 log.cc:927] Time spent T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:26:31.165045 11626 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:31.174523 11631 consensus_queue.cc:260] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:31.176235 11631 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.143587 11575 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:31.150415 11625 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:31.181092 11575 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:31.182960 11657 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:31.198474 11657 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:31.206664 11366 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:31.208467 11677 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:31.208817 11366 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:31.210235 11670 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:31.211721 11670 consensus_queue.cc:1048] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:31.213953  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 152806us
I20260709 12:26:31.191624  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:31.216542  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:31.195888 11625 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.178261 11636 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:31.235562 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 94856.4us
I20260709 12:26:31.236632 10496 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:31.238628 11676 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:31.238226 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:26:31.242584  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.218966 11469 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 12:26:31.271201  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 154061us
I20260709 12:26:31.272305  9779 leader_election.cc:400] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3.
I20260709 12:26:31.216199 11574 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:31.200049 11679 consensus_queue.cc:1059] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:26:31.276327 10496 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:31.241199 11666 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:31.280624 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:31.283100  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:31.284955 10496 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:31.270532 11676 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:31.267463 10532 raft_consensus.cc:2955] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:31.275848 11482 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:31.290190  9779 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:31.287976 11552 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:31.293354 11482 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:31.296499 11482 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:31.279904 11460 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:31.298523 10496 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:31.280565 11666 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:31.294914  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:31.301810  9779 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:31.302232 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:31.292923 11474 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:31.297133 11600 consensus_meta.cc:287] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.920s	user 0.018s	sys 0.016s
W20260709 12:26:31.356913  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 55497.5us
I20260709 12:26:31.299933 11662 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:31.359272  9779 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:31.302623 11676 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:31.363086  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 241071us
I20260709 12:26:31.325958 11626 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:31.352957 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 50790.5us
I20260709 12:26:31.367995 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:31.309861 11690 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:26:31.360888 11606 consensus_meta.cc:287] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 1.051s	user 0.011s	sys 0.015s
I20260709 12:26:31.353780 11666 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.370042 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:31.360566 11544 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:31.358690 11469 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:31.394528 10496 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:26:31.365942  9853 leader_election.cc:336] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.753s (SENT)
I20260709 12:26:31.401567 10496 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:31.401060  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:31.404024 10496 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:31.373636 11460 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:31.415387  9811 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:31.361256 11600 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:31.366074 11478 consensus_queue.cc:1048] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:26:31.455822  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:31.397701 11544 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:31.405606 11661 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:31.399891 11636 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:31.468065  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 102141us
W20260709 12:26:31.450802 11653 log.cc:927] Time spent T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:26:31.467386  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 108161us
I20260709 12:26:31.470100  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:31.470716  9811 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.411877 11676 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:31.413188 11667 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:31.477255  9779 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:31.480785  9959 raft_consensus.cc:1275] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:31.484079  9882 raft_consensus.cc:2368] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 3. Current term is 4.
I20260709 12:26:31.486579  9959 raft_consensus.cc:1240] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:31.411602 11469 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:31.472112 11544 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.470971 11661 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:31.474249 11659 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:31.475065 11676 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:31.499850  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:31.502395  9955 raft_consensus.cc:1240] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:31.473829 11573 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:31.504021  9813 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:31.505393  9853 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:31.503238  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:31.491344 11626 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:31.557109  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:31.495867  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:31.515247 11661 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.599982  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:31.604939  9811 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
W20260709 12:26:31.558768  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 53596.6us
I20260709 12:26:31.521173 11573 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:31.520458  9808 raft_consensus.cc:1240] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:31.555908  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:31.509693 11681 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:31.734805 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 326615us
W20260709 12:26:31.566648 11647 consensus_meta.cc:287] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.003s
W20260709 12:26:31.600410 11686 log.cc:927] Time spent T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 12:26:31.393194 11606 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:31.557441 11473 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:31.679584  9853 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:31.559569 11662 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:31.599517 11568 consensus_meta.cc:287] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 1.284s	user 0.012s	sys 0.032s
W20260709 12:26:31.599517 11651 consensus_meta.cc:287] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.734s	user 0.010s	sys 0.003s
I20260709 12:26:31.517381 11676 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:31.601169 11687 log.cc:927] Time spent T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:26:31.544525  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:26:31.601300 11645 log.cc:927] Time spent T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.820s	user 0.000s	sys 0.004s
I20260709 12:26:31.678223  9928 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:26:31.762732  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 84530us
I20260709 12:26:31.600059 11626 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:31.523391 11631 raft_consensus.cc:2804] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:31.729346 11547 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:31.676167 11668 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:31.730230  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:26:31.608423  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 112636us
I20260709 12:26:31.772485  9779 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:31.735680 10496 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:31.679811 11573 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:31.782109  9779 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:31.674593 11636 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:31.743752 11647 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:31.745303 11600 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:31.750319 11684 log.cc:927] Time spent T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
W20260709 12:26:31.795562  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 116034us
I20260709 12:26:31.752498 11482 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:31.677209 11648 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:31.688865 11469 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:31.755759 11532 consensus_meta.cc:287] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 1.080s	user 0.004s	sys 0.009s
I20260709 12:26:31.758525 11473 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:31.779670 11474 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:31.769641 11551 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:26:31.786171 11691 log.cc:927] Time spent T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.381s	user 0.001s	sys 0.000s
W20260709 12:26:31.786731 11692 log.cc:927] Time spent T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.273s	user 0.000s	sys 0.000s
I20260709 12:26:31.812129  9779 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:31.792598 11357 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:31.791211 10496 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:31.772298 11631 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:31.797312 11681 consensus_queue.cc:1059] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:26:31.780879 11662 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:31.761657 11651 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:31.761405 11568 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
W20260709 12:26:31.809744 11696 log.cc:927] Time spent T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:26:31.807418 11532 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:31.810464 11474 raft_consensus.cc:697] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:31.810333 11648 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:31.830384 11648 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:31.794659 11668 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:31.832037 11575 raft_consensus.cc:3055] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:31.832403 11668 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:31.832446 11575 raft_consensus.cc:740] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:31.811832  9956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 991) took 1377 ms. Trace:
I20260709 12:26:31.787065 11698 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:31.960143 11698 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:31.960978 11532 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:31.967761 11568 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:31.968711 11695 log.cc:927] Time spent T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:26:31.972609 11594 consensus_meta.cc:287] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.883s	user 0.009s	sys 0.000s
I20260709 12:26:31.973098 11594 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:31.975443 11647 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:31.976770 11694 log.cc:927] Time spent T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:26:31.814630 11631 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.815419 11679 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:31.818845  9885 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:31.787931 11480 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:26:31.822474  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:31.826321 11683 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:32.026759 11683 raft_consensus.cc:697] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:32.027719 11683 consensus_queue.cc:237] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:31.827987 11474 consensus_queue.cc:237] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:31.865391  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.827188 11473 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:31.817094 11703 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:31.958868 11706 log.cc:927] Time spent T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:26:31.959256 11482 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:31.817354 11469 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:32.033891 11469 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:32.034308 11469 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.840626  9956 rpcz_store.cc:276] 0709 12:26:30.434205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.434376 (+   171us) service_pool.cc:224] Handling call
0709 12:26:30.821670 (+387294us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b5800135f98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:30.821828 (+   158us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:31.036042 (+214214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:31.036088 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:31.036664 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 12:26:31.359153 (+322489us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:31.359191 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:31.359263 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:31.807052 (+447789us) raft_consensus.cc:1685] finished
0709 12:26:31.807073 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:31.811770 (+  4697us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39950,"raft.queue_time_us":36233,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":2413,"spinlock_wait_cycles":7390976,"thread_start_us":462253,"threads_started":2,"wal-append.queue_time_us":312327}
I20260709 12:26:31.986001  9886 raft_consensus.cc:1240] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:32.000736 11548 consensus_meta.cc:287] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.868s	user 0.011s	sys 0.001s
I20260709 12:26:32.042106 11548 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:32.044332 11548 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:32.005517  9890 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.795333 11709 consensus_queue.cc:1048] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.213s
W20260709 12:26:32.050804 11625 consensus_meta.cc:287] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.807s	user 0.011s	sys 0.001s
I20260709 12:26:32.051342 11625 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:32.026161 11705 log.cc:927] Time spent T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 12:26:32.053779 11625 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:32.055056  9889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1022) took 1012 ms. Trace:
I20260709 12:26:32.055457 11651 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:32.036168  9885 raft_consensus.cc:1240] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:32.068527  9890 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:32.056375 11606 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:32.055428  9889 rpcz_store.cc:276] 0709 12:26:31.042339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.060494 (+ 18155us) service_pool.cc:224] Handling call
0709 12:26:31.110138 (+ 49644us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:31.150142 (+ 40004us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:31.158235 (+  8093us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:31.199114 (+ 40879us) log.cc:844] Serialized 26 byte log entry
0709 12:26:31.682374 (+483260us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:31.701000 (+ 18626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:31.735971 (+ 34971us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:32.054826 (+318855us) raft_consensus.cc:1685] finished
0709 12:26:32.054851 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:32.054989 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5984,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":469963,"threads_started":1,"wal-append.queue_time_us":560117}
I20260709 12:26:32.088665  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:32.089303  9889 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.091312  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:32.092581  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:32.064507 11698 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:32.094621 11627 consensus_queue.cc:1059] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:26:32.139371 11544 consensus_meta.cc:287] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.001s
I20260709 12:26:32.139878 11544 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:32.144294 11544 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:32.142436 11666 consensus_meta.cc:287] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.688s	user 0.004s	sys 0.004s
I20260709 12:26:32.148404 11469 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:32.155699 11661 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:32.166486 11661 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:32.157739 11573 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.152570 11631 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:32.168565 11631 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:32.168586 11573 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:32.140407 11676 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.159677  9928 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:32.170508 11651 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:32.170989 11651 raft_consensus.cc:697] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:32.171195 11676 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:32.171963 11651 consensus_queue.cc:237] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:32.174599 11627 consensus_queue.cc:1059] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:32.175784 11630 raft_consensus.cc:3055] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:32.176112 11630 raft_consensus.cc:740] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:32.176882 11630 consensus_queue.cc:260] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:32.161880 11666 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.184774 11666 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:32.164093 11594 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:32.188032  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 391719us
I20260709 12:26:32.212627  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:32.213336  9890 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:32.213618  9853 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:32.219372  9853 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:32.232277  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:32.232589  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:32.232887  9959 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:32.237274  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:32.237306  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:32.238242  9955 raft_consensus.cc:2393] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 3: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:32.238883  9853 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:32.240073  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:32.240247  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:32.240782  9963 raft_consensus.cc:2393] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 4: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:32.244362  9853 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:32.245422  9853 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:32.245713  9890 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:32.226634 11708 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:32.215153 11679 consensus_queue.cc:1059] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:26:32.241042  9957 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:32.228545 11568 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:32.212575 11710 consensus_queue.cc:1048] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:26:32.233858 11469 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:32.236835  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:32.251363  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:32.258841  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:32.258948  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:32.256062  9959 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:32.227355 11629 consensus_queue.cc:1059] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:26:32.259435  9890 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:32.256327  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:32.262096  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:32.243048 11648 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:32.247908  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:32.248910 11707 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:32.260434 11473 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:32.272606  9853 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:26:32.275851  9882 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1018) took 1697 ms (client timeout 1782 ms). Trace:
I20260709 12:26:32.276219  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:32.278348  9955 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:32.279755  9889 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:32.281047  9889 raft_consensus.cc:1240] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:32.282042  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:32.278223  9960 raft_consensus.cc:2393] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:32.282711  9962 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:32.282174  9889 raft_consensus.cc:1240] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:32.284080 11626 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:32.282215  9928 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:32.288000  9884 raft_consensus.cc:2955] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
W20260709 12:26:32.277320  9882 rpcz_store.cc:269] 0709 12:26:30.578390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.588561 (+ 10171us) service_pool.cc:224] Handling call
0709 12:26:32.275669 (+1687108us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b54002e7554. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:32.275796 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2013005056}
I20260709 12:26:32.293236  9928 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:32.294456  9890 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:32.295867  9853 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:32.301198  9853 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:32.302209 11668 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:32.334160  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:32.336021 11722 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:32.345615  9962 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:32.302687 11626 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:32.329627 11677 consensus_queue.cc:1059] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:26:32.330714 11548 consensus_queue.cc:1059] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:26:32.347837 11669 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:32.351504  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:32.352391  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1020) took 1310 ms. Trace:
I20260709 12:26:32.302337 11605 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:32.359555 11668 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:32.370241  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:32.385980  9961 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.386140  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:32.387486  9959 raft_consensus.cc:1240] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:32.359916 11488 raft_consensus.cc:3055] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:26:32.350198 11704 log.cc:927] Time spent T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.553s	user 0.004s	sys 0.010s
W20260709 12:26:32.363229 11685 log.cc:927] Time spent T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.998s	user 0.008s	sys 0.005s
I20260709 12:26:32.369531  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:32.395977  9962 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:32.302471 11710 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:32.375936  9853 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:32.377781  9955 raft_consensus.cc:1240] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:32.380985  9886 rpcz_store.cc:276] 0709 12:26:31.041792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.046387 (+  4595us) service_pool.cc:224] Handling call
0709 12:26:31.051546 (+  5159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:32.035399 (+983853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:32.352051 (+316652us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b540029aed4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:32.352312 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2148400512}
I20260709 12:26:32.396551 11656 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:32.395859 11488 raft_consensus.cc:740] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:32.399580 11521 raft_consensus.cc:3055] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:32.409406 11521 raft_consensus.cc:740] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:32.410401 11521 consensus_queue.cc:260] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:32.410912 11656 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.411403 11627 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:32.411550 11521 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.411994 11627 raft_consensus.cc:697] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:32.413081 11656 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:32.412855 11627 consensus_queue.cc:237] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.403707 11668 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:32.402323  9853 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:32.406881  9959 raft_consensus.cc:1240] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:32.414942 11488 consensus_queue.cc:260] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.418262 11488 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:32.419235  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:32.408613  9962 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:32.422300  9853 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:32.429348 10524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 640) took 1163 ms. Trace:
I20260709 12:26:32.429870  9853 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:32.430812 11679 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:32.430962  9853 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:32.429828 10524 rpcz_store.cc:276] 0709 12:26:31.265560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.265690 (+   130us) service_pool.cc:224] Handling call
0709 12:26:31.289326 (+ 23636us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:31.317620 (+ 28294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:31.319467 (+  1847us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:31.365974 (+ 46507us) log.cc:844] Serialized 26 byte log entry
0709 12:26:31.678411 (+312437us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:31.684466 (+  6055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:31.732219 (+ 47753us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:32.349430 (+617211us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:26:32.400089 (+ 50659us) raft_consensus.cc:1685] finished
0709 12:26:32.403510 (+  3421us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:32.429279 (+ 25769us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5348,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":7331,"spinlock_wait_cycles":6750592,"thread_start_us":202982,"threads_started":1,"wal-append.queue_time_us":369784}
I20260709 12:26:32.431948 11719 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:32.432317 11710 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:32.431370 11679 raft_consensus.cc:697] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:32.432467  9853 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:32.432936 11710 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:32.433367 11710 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:32.433650 11679 consensus_queue.cc:237] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:32.434269  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:32.397214 11626 raft_consensus.cc:697] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:32.442422  9962 raft_consensus.cc:1240] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:32.443853 11626 consensus_queue.cc:237] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:32.444324  9806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 1935) took 1452 ms. Trace:
I20260709 12:26:32.415267 11478 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:32.444766  9806 rpcz_store.cc:276] 0709 12:26:30.992215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.992388 (+   173us) service_pool.cc:224] Handling call
0709 12:26:30.992773 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:30.993015 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:30.993045 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:30.993523 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 12:26:31.192294 (+198771us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:31.195437 (+  3143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:31.196615 (+  1178us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:32.362658 (+1166043us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:26:32.415194 (+ 52536us) raft_consensus.cc:1685] finished
0709 12:26:32.415214 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:32.441601 (+ 26387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3813120,"thread_start_us":190494,"threads_started":1,"wal-append.queue_time_us":326964}
I20260709 12:26:32.452040  9881 raft_consensus.cc:1240] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:32.452726  9881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 317) took 1411 ms. Trace:
I20260709 12:26:32.453032  9881 rpcz_store.cc:276] 0709 12:26:31.041173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.066168 (+ 24995us) service_pool.cc:224] Handling call
0709 12:26:32.451659 (+1385491us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b5800043598. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:32.451857 (+   198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:32.452464 (+   607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:32.452670 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38239104}
I20260709 12:26:32.435415 11600 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:32.459600  9853 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:32.461522 11722 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:32.474063 10531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 644) took 1205 ms. Trace:
I20260709 12:26:32.475967 10531 rpcz_store.cc:276] 0709 12:26:31.268545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.268705 (+   160us) service_pool.cc:224] Handling call
0709 12:26:32.473381 (+1204676us) spinlock_profiling.cc:243] Waited 992 us on lock 0x7b58001f1a98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:32.473586 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:32.473769 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:32.473794 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:32.473831 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:32.473859 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:32.473913 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:32.474011 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2282368}
I20260709 12:26:32.466703 11719 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:32.480826 11719 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:32.480875  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1876) took 1214 ms. Trace:
I20260709 12:26:32.482471 11719 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:32.487078  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 135642us
I20260709 12:26:32.472889 11722 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:32.466114  9961 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:32.466326 11478 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.475660 10525 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:32.488188  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:32.490453  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:32.491011  9815 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.500092  9809 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:32.499128 11729 log.cc:927] Time spent T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:26:32.503671  9853 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:32.512405  9853 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:32.517282  9815 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:32.514045 11722 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:32.518424 11521 raft_consensus.cc:2804] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:32.523977 11521 raft_consensus.cc:697] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:32.525136 11478 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:32.526011  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:32.529495  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:32.486922 11646 consensus_queue.cc:1059] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:26:32.531117 11646 raft_consensus.cc:3055] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:32.531448 11646 raft_consensus.cc:740] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:32.532187 11710 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:32.524817 11521 consensus_queue.cc:237] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:32.495235 11605 raft_consensus.cc:697] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:32.513254 10525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 394) took 1663 ms. Trace:
I20260709 12:26:32.535966 10525 rpcz_store.cc:276] 0709 12:26:30.850220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.851520 (+  1300us) service_pool.cc:224] Handling call
0709 12:26:32.455431 (+1603911us) spinlock_profiling.cc:243] Waited 6.47 ms on lock 0x7b58001f1a98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7eee 000000000036eb39 00007f2f9346b1e0 00007f2f935340c4 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:32.461392 (+  5961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:32.498054 (+ 36662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:32.510720 (+ 12666us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14881152}
I20260709 12:26:32.540835  9812 raft_consensus.cc:1240] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:32.510855 11720 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:32.509614  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:32.547405  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:32.574505 11644 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:32.578891  9881 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:32.578715 11656 consensus_queue.cc:1059] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:32.579162 11644 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.579861 11656 raft_consensus.cc:3055] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:32.580190 11656 raft_consensus.cc:740] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:32.581210 11644 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:32.581002 11656 consensus_queue.cc:260] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.582023  9962 raft_consensus.cc:1240] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:32.582144 11656 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:32.583154  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:32.584293  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:32.576202  9807 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.586068  9813 raft_consensus.cc:1240] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:32.573931 11720 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.588635 11720 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:32.585265  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:32.592288  9962 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:32.573177 11651 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:32.594955 11651 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.597216 11651 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:32.601568  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.546267 11547 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:32.591524 11657 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:32.611763  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:32.591073 11544 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:32.591313 11728 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:32.614483  9963 raft_consensus.cc:1240] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:32.618069  9853 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:32.618836  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:32.615666 11656 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.619628  9961 raft_consensus.cc:2393] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 4: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:32.619592 11656 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.620759  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:32.621487  9961 raft_consensus.cc:2393] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 6: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:26:32.625746  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.621996 11656 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:32.630028  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:32.630182 11641 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:32.589890 11719 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:32.627074 11728 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.610942 11731 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:26:32.632547  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 63452.6us
I20260709 12:26:32.626943  9806 raft_consensus.cc:1240] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:32.610227 11547 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.647522  9778 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:32.614681 11644 consensus_queue.cc:1059] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:26:32.657857  9927 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:32.644467 11641 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:32.615834 11657 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.617516 11544 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.629525 11720 consensus_queue.cc:1059] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:26:32.655310  9881 raft_consensus.cc:2393] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 3: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:32.635680 11626 consensus_queue.cc:1059] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:26:32.663434  9957 raft_consensus.cc:1240] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:26:32.532199 11646 consensus_queue.cc:260] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.659749 11661 raft_consensus.cc:2804] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:32.649756 11624 consensus_queue.cc:1059] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:26:32.622269  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:32.661644 11641 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:32.667454 11644 consensus_queue.cc:1243] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer b011791796d1457284b857d7d3422195 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:26:32.656229 11698 consensus_queue.cc:1059] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:26:32.665612 11656 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:32.676548 11736 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:32.649922 11731 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.677456 11640 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:32.687472 11731 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:32.699939  9778 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:32.690734 11708 raft_consensus.cc:3055] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:32.691660 11657 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:32.692281 11662 raft_consensus.cc:3055] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:32.718314 11665 raft_consensus.cc:3055] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:32.718498 11662 raft_consensus.cc:740] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:32.718756 11665 raft_consensus.cc:740] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:32.693377 11667 raft_consensus.cc:3055] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:32.693921 11736 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.719426  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:32.720074  9957 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:32.719669 11665 consensus_queue.cc:260] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:32.644874 11605 consensus_queue.cc:237] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.694548 11682 raft_consensus.cc:3055] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:32.693292 11544 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:32.689536 11719 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:32.716985 11640 raft_consensus.cc:697] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:32.731534  9814 raft_consensus.cc:1240] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:32.673125 11733 consensus_queue.cc:1059] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:26:32.712636 11625 consensus_queue.cc:1059] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:26:32.713008 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.713919  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:32.700062 11547 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:32.725224 11682 raft_consensus.cc:740] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:32.682482 11656 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:32.703531 11734 log.cc:927] Time spent T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:26:32.706317 11728 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:32.680896 11646 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:32.709977 11710 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:32.717057 11708 raft_consensus.cc:740] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:32.725786  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:32.776175  9963 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:32.719576 11667 raft_consensus.cc:740] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:32.720870 11665 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:32.702346 11630 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:32.730131 11661 raft_consensus.cc:697] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:32.704815 11477 raft_consensus.cc:3055] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:32.745473  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:32.746634  9824 tablet_copy_service.cc:342] P 4104e34a61b7448281d6d91ce23ebf71: Request end of tablet copy session f5208640a51f493e930ce4f64ceeed0b-8367fec391344e099ca237f0942e4f6d received from {username='slave'} at 127.0.0.1:34802
I20260709 12:26:32.747409  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:32.750499  9887 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1024) took 1686 ms (client timeout 1545 ms). Trace:
I20260709 12:26:32.751958 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:32.787569 10532 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.752882 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:32.768942 11720 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.757068 11574 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:32.757476 11683 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:32.757738 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:32.757794  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:32.759120  9807 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:32.761103 11641 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.766580  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:32.769079  9882 raft_consensus.cc:1240] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:32.769446  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:32.778105  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:32.779721  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:32.779878 11708 consensus_queue.cc:260] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:32.780699 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:32.761726 11747 consensus_queue.cc:1059] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:26:32.737547 11521 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:32.776067 11679 consensus_queue.cc:1059] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:26:32.788970  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:32.719422 11662 consensus_queue.cc:260] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:32.786681  9887 rpcz_store.cc:269] 0709 12:26:31.064378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.064504 (+   126us) service_pool.cc:224] Handling call
0709 12:26:32.713778 (+1649274us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b5800043598. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:32.750432 (+ 36654us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38041344}
I20260709 12:26:32.791527 10531 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:32.793908  9824 tablet_copy_service.cc:434] P 4104e34a61b7448281d6d91ce23ebf71: ending tablet copy session f5208640a51f493e930ce4f64ceeed0b-8367fec391344e099ca237f0942e4f6d on tablet 8367fec391344e099ca237f0942e4f6d with peer f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:32.794205 11739 raft_consensus.cc:3055] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:32.795017 11667 consensus_queue.cc:260] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.796084 11683 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.796890 11457 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:32.833366 11683 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:32.798035  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:32.782872 11736 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:32.798226 11575 consensus_queue.cc:260] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.799206  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:32.802480 11682 consensus_queue.cc:260] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:32.826098 11662 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.809167  9888 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:32.809242  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:32.773643 11547 consensus_queue.cc:1059] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:26:32.810865  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:32.866986 11547 raft_consensus.cc:3055] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:32.867287  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:32.867815  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:32.868279  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:32.784482  9810 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:32.786563 11477 raft_consensus.cc:740] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:32.870249 11741 consensus_queue.cc:1059] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 12:26:32.871177 11741 consensus_queue.cc:1243] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer b011791796d1457284b857d7d3422195 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:26:32.870782 11477 consensus_queue.cc:260] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.777626 11474 consensus_queue.cc:1059] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:26:32.823690  9963 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:32.820477 10526 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:32.872922 11743 log.cc:927] Time spent T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.131s	user 0.004s	sys 0.000s
I20260709 12:26:32.873312 11474 raft_consensus.cc:3055] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:32.873673 11474 raft_consensus.cc:740] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:32.874547 11474 consensus_queue.cc:260] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.874997 10533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36672 (request call id 534) took 2285 ms. Trace:
I20260709 12:26:32.875643 11474 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:32.875344 10533 rpcz_store.cc:276] 0709 12:26:30.589617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.591381 (+  1764us) service_pool.cc:224] Handling call
0709 12:26:30.591759 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:31.077422 (+485663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:32.874765 (+1797343us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54006aa254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:32.874919 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1102387968}
I20260709 12:26:32.876597 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:32.482528  9884 rpcz_store.cc:276] 0709 12:26:31.267169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.269772 (+  2603us) service_pool.cc:224] Handling call
0709 12:26:32.287554 (+1017782us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b5800043598. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:32.287720 (+   166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:32.287896 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:26:32.390672 (+102776us) log.cc:844] Serialized 14 byte log entry
0709 12:26:32.471164 (+ 80492us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:32.473044 (+  1880us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:32.473711 (+   667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:32.479880 (+  6169us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:32.480810 (+   930us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19760,"raft.queue_time_us":24860,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":7410,"spinlock_wait_cycles":15056512,"thread_start_us":44636,"threads_started":1,"wal-append.queue_time_us":45707}
I20260709 12:26:32.830958 11746 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:32.818477  9881 raft_consensus.cc:1240] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:32.878387 11746 raft_consensus.cc:697] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:32.879257  9881 raft_consensus.cc:1240] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:32.880439  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:32.867328 11547 raft_consensus.cc:740] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:32.881860 11473 raft_consensus.cc:3055] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:32.882230 11473 raft_consensus.cc:740] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:32.882117 11547 consensus_queue.cc:260] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:32.882891  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.880478  9881 raft_consensus.cc:1240] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:32.883126 11473 consensus_queue.cc:260] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:32.884074 11698 raft_consensus.cc:3055] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:32.884451 11698 raft_consensus.cc:740] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:32.884729  9881 raft_consensus.cc:1240] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:32.839672  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:32.845170  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:32.777897 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:32.828181 11708 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:32.847100 10532 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:32.804704 11720 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.790170 11640 consensus_queue.cc:237] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:32.857704  9964 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:32.842568 11661 consensus_queue.cc:237] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:32.840742 11544 raft_consensus.cc:3055] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:32.861421 11641 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:32.862637  9814 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:32.865016  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:32.871592 11457 raft_consensus.cc:3055] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:32.811429 11574 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:32.877764 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:32.868860  9882 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:32.840229 11739 raft_consensus.cc:740] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:32.823197 11521 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:32.903302  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 63689.2us
I20260709 12:26:32.938534  9889 raft_consensus.cc:1240] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:32.904269 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 125143us
I20260709 12:26:32.905921 11469 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.940403 10533 raft_consensus.cc:2393] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 5: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:32.940937 10497 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:32.894877 11656 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:32.905428  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:32.858879 11683 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:32.893282 11473 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.938174  9882 raft_consensus.cc:1240] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:26:32.889245 10526 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
W20260709 12:26:32.951848  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.905367 11477 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:32.954674  9779 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:32.956919  9889 raft_consensus.cc:1240] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:32.907250 11457 raft_consensus.cc:740] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:32.905398  9964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55946 (request call id 1695) took 1423 ms. Trace:
I20260709 12:26:32.907368 11657 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:32.904203 11544 raft_consensus.cc:740] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:32.885229 11698 consensus_queue.cc:260] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:32.970752 11457 consensus_queue.cc:260] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:32.958778 11747 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:32.967751 11657 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:32.964092  9964 rpcz_store.cc:276] 0709 12:26:31.480451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.484175 (+  3724us) service_pool.cc:224] Handling call
0709 12:26:32.799128 (+1314953us) spinlock_profiling.cc:243] Waited 6.56 ms on lock 0x7b5800135f98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7f8c 00007f2f8b3f7ef6 000000000036eb39 00007f2f9346b1e0 00007f2f935340c4 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:32.904061 (+104933us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15080320}
I20260709 12:26:32.972281 11544 consensus_queue.cc:260] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:32.980091  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:32.986709 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:32.987948 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:32.988178 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:32.988874 10528 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:32.989785 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:32.990180 11457 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:32.879287 11746 consensus_queue.cc:237] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:32.965554 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:32.986081 11657 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:32.994199 10528 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:32.995090 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:32.947683 11469 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.001258 11574 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:33.002832 11521 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:32.962954 11607 consensus_queue.cc:1059] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:26:32.988301 11720 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:32.983376  9711 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56416 (request call id 246) took 3852 ms. Trace:
I20260709 12:26:32.991770  9710 catalog_manager.cc:5697] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 2 to 4, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 4 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:33.014606  9888 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:33.005110  9711 rpcz_store.cc:276] 0709 12:26:29.131497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.131733 (+   236us) service_pool.cc:224] Handling call
0709 12:26:32.983316 (+3851583us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:29.867408 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:29.897240 (+ 29832us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:29.897310 (+    70us) write_op.cc:435] Acquired schema lock
0709 12:26:29.897334 (+    24us) tablet.cc:662] Decoding operations
0709 12:26:29.897768 (+   434us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:29.897863 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:29.897899 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:29.898225 (+   326us) tablet.cc:701] Row locks acquired
0709 12:26:29.898307 (+    82us) write_op.cc:260] PREPARE: finished
0709 12:26:29.898492 (+   185us) write_op.cc:270] Start()
0709 12:26:29.898643 (+   151us) write_op.cc:276] Timestamp: P: 1783599989898435 usec, L: 0
0709 12:26:29.898680 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:26:29.899393 (+   713us) log.cc:844] Serialized 533 byte log entry
0709 12:26:30.211876 (+312483us) op_driver.cc:464] REPLICATION: finished
0709 12:26:30.818184 (+606308us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8b4120ac 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f91f52ef0
0709 12:26:31.130672 (+312488us) write_op.cc:301] APPLY: starting
0709 12:26:31.130786 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:31.130946 (+   160us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:31.130994 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:31.131386 (+   392us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:31.131673 (+   287us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:26:31.131760 (+    87us) write_op.cc:312] APPLY: finished
0709 12:26:31.132078 (+   318us) log.cc:844] Serialized 23 byte log entry
0709 12:26:31.454139 (+322061us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:31.465023 (+ 10884us) write_op.cc:454] Released schema lock
0709 12:26:31.470715 (+  5692us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:31.599705 (+128990us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:31.599741 (+    36us) write_op.cc:454] Released schema lock
0709 12:26:32.186873 (+587132us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b54001abb54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51932a 00007f2f8e49ef14 00007f2f8e49eec3 00007f2f8e49ee38 00007f2f8e49edf3 00007f2f8e49e0dc 00007f2f8e4c7e16 00007f2f8e4afcbb 00007f2f8e49a39d 00007f2f8e49dd75
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":907983,"apply.run_cpu_time_us":24490,"apply.run_wall_time_us":436121,"num_ops":1,"prepare.queue_time_us":266199,"prepare.run_cpu_time_us":21094,"prepare.run_wall_time_us":159887,"raft.queue_time_us":35663,"raft.run_cpu_time_us":34143,"raft.run_wall_time_us":2064294,"replication_time_us":241879,"spinlock_wait_cycles":35378304,"thread_start_us":1405171,"threads_started":5,"wal-append.queue_time_us":718512,"wal-append.run_cpu_time_us":4688,"wal-append.run_wall_time_us":2103477}]]}
I20260709 12:26:33.017897 11698 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.017992  9884 raft_consensus.cc:1240] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:33.019821 11574 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:33.020010  9710 catalog_manager.cc:5697] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 3, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 3 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:33.015344  9888 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1023) took 1951 ms (client timeout 1924 ms). Trace:
W20260709 12:26:33.021955  9888 rpcz_store.cc:269] 0709 12:26:31.063963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.066048 (+  2085us) service_pool.cc:224] Handling call
0709 12:26:32.779589 (+1713541us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b5800043598. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:33.015273 (+235684us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40916864}
I20260709 12:26:33.024087  9811 raft_consensus.cc:1240] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:32.961925  9779 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:33.025022 11657 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:33.026638 11745 log.cc:927] Time spent T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 12:26:33.027724  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 65883.3us
I20260709 12:26:32.960569 11683 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.028386  9957 raft_consensus.cc:2410] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:26:33.022210  9710 catalog_manager.cc:5697] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:33.030961  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:33.033973  9812 raft_consensus.cc:1240] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:33.038671 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:33.039430 10532 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:33.043757  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:33.032120  9710 catalog_manager.cc:5697] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:33.046651  9710 catalog_manager.cc:5697] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:33.047462 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:33.049853 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:33.050601 10532 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:33.055570 10532 raft_consensus.cc:1240] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:33.056304  9854 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:26:33.057026  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.049350  9710 catalog_manager.cc:5697] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 2 to 4, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 4 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:33.057889  9854 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:33.059078  9710 catalog_manager.cc:5697] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 3 to 4, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 4 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:33.061790 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:33.063706 11472 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:33.064106 10531 raft_consensus.cc:1240] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:33.061228 11711 consensus_queue.cc:1059] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:26:33.064555  9811 raft_consensus.cc:1240] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:33.064661 11737 raft_consensus.cc:3055] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:33.065056 11737 raft_consensus.cc:740] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:33.065094 11711 raft_consensus.cc:3055] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:33.065656 11711 raft_consensus.cc:740] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:33.066066 11737 consensus_queue.cc:260] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:33.066533 11711 consensus_queue.cc:260] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.067183 11737 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.067736 11711 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.065299 10531 raft_consensus.cc:1240] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:33.073917  9813 raft_consensus.cc:1240] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:33.077339 10533 raft_consensus.cc:1240] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:33.049351 11752 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:33.081981  9854 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:26:33.086938 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 315627us
W20260709 12:26:33.089805 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.064138  9881 raft_consensus.cc:1240] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:33.064107  9807 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:33.068856 11473 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:33.061774 11683 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:33.090443 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 149621us
I20260709 12:26:33.090679 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:33.096187  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:33.100730  9813 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:33.102907 10533 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Advancing to term 3
W20260709 12:26:33.096987  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 136913us
I20260709 12:26:33.085850  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:26:33.108985  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.091225 11720 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:33.112386  9885 raft_consensus.cc:1275] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:33.109212 10496 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:33.113183  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:33.110970 10497 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:33.114989  9882 raft_consensus.cc:2393] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 4: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:33.129051  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:33.130555 11750 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:33.122354 11683 consensus_queue.cc:1059] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:26:33.130940 11750 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:33.131384 11750 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.131613 11682 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.128084  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:33.137252  9882 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 2: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:33.133678 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:26:33.139253 11749 log.cc:927] Time spent T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:26:33.140498  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:33.142602  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:33.144102 11657 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:33.145032  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.145933 11656 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:33.146692 11656 consensus_queue.cc:1059] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:33.149178 11656 consensus_queue.cc:1059] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:33.150233 11656 consensus_queue.cc:1059] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:33.150697 11750 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.151270 11669 raft_consensus.cc:3055] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:33.151690 11669 raft_consensus.cc:740] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:33.092716 11722 consensus_queue.cc:1059] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:26:33.152526 11669 consensus_queue.cc:260] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.153292 11722 raft_consensus.cc:3055] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:33.153788 11722 raft_consensus.cc:740] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:33.154426 11683 raft_consensus.cc:3055] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:33.155031 11750 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:33.155160 11754 raft_consensus.cc:3055] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:33.154767 11722 consensus_queue.cc:260] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.155547 11754 raft_consensus.cc:740] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:33.124179  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:33.114929 11720 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:33.159852  9882 raft_consensus.cc:1240] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:33.165880  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:33.167092  9885 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:33.171631 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:33.173012  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:33.174094  9882 raft_consensus.cc:2393] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 3: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:33.175381 11754 consensus_queue.cc:260] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.176654 11574 raft_consensus.cc:3055] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:33.177047 11574 raft_consensus.cc:740] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:33.177639 11731 raft_consensus.cc:3055] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:33.178193 11731 raft_consensus.cc:740] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:33.177870 11574 consensus_queue.cc:260] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.179201 11574 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.153806 11669 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.155982 11722 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:33.147125  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:33.154835 11683 raft_consensus.cc:740] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:26:33.182319  9779 leader_election.cc:336] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.782s (SENT)
I20260709 12:26:33.162744 11720 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:33.191807  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:33.190397  9883 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:33.188151 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:33.196646 11683 consensus_queue.cc:260] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.086550 11739 consensus_queue.cc:260] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:33.223824  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:33.234851  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 52606.9us
W20260709 12:26:33.238224 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:33.241598  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:33.244009  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.247346  9779 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:33.200338 11762 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:26:33.258824 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 113263us
I20260709 12:26:33.260928 10532 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:33.263310 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:33.264840 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:33.266254 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:33.266530 10497 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:33.267715 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:33.269011 11748 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:33.269996 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.270315  9779 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:33.273370 11768 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:33.273787 11768 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.274158 11768 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:33.274680  9811 raft_consensus.cc:1240] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:26:33.179430 11731 consensus_queue.cc:260] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.263700 11683 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.277612 11700 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:33.282344  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:33.285193  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:33.261658 11662 consensus_queue.cc:1059] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:26:33.288813  9885 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:26:33.291021  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.291958  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:33.298918  9889 raft_consensus.cc:2393] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 2: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:33.286522 11731 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.294492 11700 raft_consensus.cc:697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:33.317437  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:33.318324  9958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55946 (request call id 1711) took 1088 ms. Trace:
I20260709 12:26:33.319132  9958 rpcz_store.cc:276] 0709 12:26:32.230348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.230467 (+   119us) service_pool.cc:224] Handling call
0709 12:26:33.317329 (+1086862us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b5800135f98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7eee 000000000036eb39 00007f2f9346b1e0 00007f2f935340c4 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:33.318245 (+   916us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5269248}
I20260709 12:26:33.327570 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:33.329119  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:33.329869  9958 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.331719  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:33.332489  9814 raft_consensus.cc:2393] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 4: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:33.333304  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:33.334677  9779 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:33.344689  9779 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:33.341888 11700 consensus_queue.cc:237] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.347486  9779 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:33.350546 11607 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:33.351243 11607 consensus_queue.cc:1059] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:33.342939 11662 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:33.351519 11762 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:33.355544 10533 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 3 LEARNER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:26:33.356279  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.352201 11607 raft_consensus.cc:3055] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:33.359514 11607 raft_consensus.cc:740] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:33.352521 11750 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:26:33.348421 11488 consensus_queue.cc:1059] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 12:26:33.410928  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 50847.9us
I20260709 12:26:33.414814  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:33.416229  9814 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 2: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:33.423727  9813 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:33.358423 11762 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:33.361117 11472 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:26:33.438874  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:33.440203  9815 raft_consensus.cc:2393] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 4: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:33.441259  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:33.442577  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:33.444192  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:26:33.448216  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.426692 11762 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.449119 10533 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 12:26:33.455694 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 105636us
I20260709 12:26:33.431528 10525 raft_consensus.cc:1240] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:33.457645  9815 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 2: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:33.458596  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:33.426151 11752 raft_consensus.cc:697] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:26:33.450569 11772 log.cc:927] Time spent T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:26:33.463918  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:33.462249  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.467042  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:33.467187 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 51828.4us
I20260709 12:26:33.468422  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:33.468634 10496 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:33.469092  9815 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:33.469188 11766 consensus_queue.cc:1059] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.122s
I20260709 12:26:33.470328  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:33.470911  9815 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:33.471951  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:33.472761  9958 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:33.473483  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:33.473562  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:33.474291  9815 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:33.474436  9958 raft_consensus.cc:2393] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 4: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:33.475275  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:33.475477  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:33.475936  9958 raft_consensus.cc:2393] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 3: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:33.476701  9958 raft_consensus.cc:1240] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:33.477716  9958 raft_consensus.cc:1240] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:33.478184 10531 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:33.478472  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:33.462360  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:33.483408  9807 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:33.483126 11752 consensus_queue.cc:237] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.484717  9958 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:33.449169 11720 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.488646 10527 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:33.438591 11607 consensus_queue.cc:260] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:33.491343  9958 raft_consensus.cc:1240] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 1. Current term is 2. Ops: [1.3-1.3]
W20260709 12:26:33.492208  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:33.490901 11646 consensus_meta.cc:287] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.712s	user 0.003s	sys 0.008s
I20260709 12:26:33.500941  9884 raft_consensus.cc:2393] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 5: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:33.488524 11775 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.501341  9956 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
W20260709 12:26:33.506923  9853 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 1.793s (SENT) [suppressed 26 similar messages]
I20260709 12:26:33.511337  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:33.512552  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:33.513231  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:33.513813  9853 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:33.522903  9853 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:33.524446  9853 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:33.523936 11464 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.523005 11472 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:33.526852  9853 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:33.529978 10496 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:33.531056 11690 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:33.533097 11469 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:33.539633 10530 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:33.522621 11366 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:33.540647  9853 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:33.522912 11766 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:33.527809 11708 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:33.528400 11464 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:33.548259  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:33.553704  9882 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:33.543085 11521 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:33.545001 11472 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:33.547624 11708 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:33.550779 11464 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:33.547818 11766 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:33.558015 11464 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:33.562873 11766 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:33.555860 11472 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:33.568508 11472 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:33.568889 11739 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.567101 11720 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:33.567956 11630 consensus_meta.cc:287] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.781s	user 0.006s	sys 0.004s
W20260709 12:26:33.569732  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.558079 11708 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.576668 11768 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:33.581934 11777 log.cc:927] Time spent T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:26:33.576678 11750 raft_consensus.cc:3055] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:33.583900 11750 raft_consensus.cc:740] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:33.587450  9815 raft_consensus.cc:2393] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 3: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:33.589222 11750 consensus_queue.cc:260] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.590930 11750 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.593902  9888 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:33.598994  9962 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:33.606477  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:33.607869  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:33.608399  9808 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:33.619632 11472 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.621735 11472 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:33.624668 11627 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.625240 11627 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:33.625977 11719 raft_consensus.cc:3055] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:33.613297 11762 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.632826 10496 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:33.637038  9959 raft_consensus.cc:1240] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:33.644487 11627 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:33.644712 11669 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:33.626380 11719 raft_consensus.cc:740] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:33.645924 11719 consensus_queue.cc:260] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:33.647236 11719 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.648967  9955 raft_consensus.cc:1275] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:33.650230 10496 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:33.653995  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:33.642134 11736 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:33.665371  9958 raft_consensus.cc:1240] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:33.641791 11752 consensus_queue.cc:1059] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
W20260709 12:26:33.668363 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:33.670929  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.672253  9955 raft_consensus.cc:1240] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:33.673527  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:33.663645 11750 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.666596 11768 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:33.685456 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.684780  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:33.679575  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:33.687310  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:33.666965 11469 consensus_queue.cc:1048] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:26:33.666451 11736 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:33.689476  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.691035 11754 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.693343  9815 raft_consensus.cc:1240] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:26:33.697739 11746 raft_consensus.cc:3055] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:33.698123 11746 raft_consensus.cc:740] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:33.698778  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:33.699393  9957 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:33.699020 11746 consensus_queue.cc:260] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:33.699776 11628 consensus_queue.cc:1059] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:33.700383 11746 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.700872 11626 raft_consensus.cc:3055] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:33.701257 11626 raft_consensus.cc:740] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:33.702814  9927 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:33.668886 11464 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.690068  9961 raft_consensus.cc:2376] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3. Re-sending same reply.
I20260709 12:26:33.708263 11630 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:26:33.714433  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.709705 11478 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.715281 11478 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.716259 11464 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:33.716552 11547 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.717206 11478 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:33.716269  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:33.722783  9815 raft_consensus.cc:2376] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b011791796d1457284b857d7d3422195 in term 4. Re-sending same reply.
I20260709 12:26:33.705809 11626 consensus_queue.cc:260] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.723809  9956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55946 (request call id 1718) took 1481 ms. Trace:
I20260709 12:26:33.723942 11626 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.724203  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:33.724238  9956 rpcz_store.cc:276] 0709 12:26:32.241923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.246714 (+  4791us) service_pool.cc:224] Handling call
0709 12:26:32.864874 (+618160us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b5800135f98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:33.723668 (+858794us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b5400241b54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:33.723761 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1372040320}
I20260709 12:26:33.727301  9810 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:33.729640  9808 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:26:33.730477 11762 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:33.687867 11708 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:33.731490  9927 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:33.735250  9815 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:33.735996 11731 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:33.736511 11731 raft_consensus.cc:697] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:33.737614 11708 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:33.737386 11731 consensus_queue.cc:237] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:33.739821 11736 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:33.740371  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:33.742749 11457 raft_consensus.cc:3055] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:33.743129 11457 raft_consensus.cc:740] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:33.743883 11457 consensus_queue.cc:260] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.744992 11457 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:33.750577 11607 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.755450 11667 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:33.757690  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.761029 10497 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:33.763875 11655 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:33.765285 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:33.766258 10532 raft_consensus.cc:2368] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
I20260709 12:26:33.769716  9927 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:33.771054 11625 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:33.771523 11625 raft_consensus.cc:697] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:33.772533  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:33.783381 11750 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.785408 11625 consensus_queue.cc:237] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:33.785360 11750 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.787513 11544 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.788563 11750 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:33.790300  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:33.765201 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:33.790489  9854 leader_election.cc:400] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
I20260709 12:26:33.791266  9882 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:33.791294  9854 leader_election.cc:403] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:26:33.796391 10497 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:33.782433 11708 consensus_queue.cc:1059] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 12:26:33.808072 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.792290  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:33.780313 11754 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:26:33.800005 11710 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:33.812212 11669 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:26:33.824506  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.825769  9810 raft_consensus.cc:1240] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:33.827226  9810 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:33.828562  9810 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:33.829727  9810 raft_consensus.cc:1240] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:33.831046 11739 consensus_queue.cc:1059] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:33.831823 11739 raft_consensus.cc:3055] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:33.832126 11739 raft_consensus.cc:740] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:33.832978 11739 consensus_queue.cc:260] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:33.834049 11739 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.837080  9811 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:33.838716  9810 raft_consensus.cc:1275] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:33.841909  9810 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:33.843864  9810 raft_consensus.cc:1240] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:33.827348 11669 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.826288 11708 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:33.848049 11740 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:33.849375 11669 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.858620 10527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 647) took 1105 ms. Trace:
I20260709 12:26:33.878553 11472 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.879251 11472 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.881865 11472 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:33.883679  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.847864 10528 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:33.859164 10527 rpcz_store.cc:276] 0709 12:26:32.752839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.774596 (+ 21757us) service_pool.cc:224] Handling call
0709 12:26:33.327367 (+552771us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b58001f1a98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:33.858465 (+531098us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54005e92d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:33.858568 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315436544}
I20260709 12:26:33.844087 11727 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:26:33.895386 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:33.896026 10526 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:33.905355  9809 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:33.902087 11655 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:33.849656 11731 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
W20260709 12:26:33.893460 11786 log.cc:927] Time spent T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:26:33.852077 11708 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.885615 11740 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.915361 11740 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:33.917762 10524 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
W20260709 12:26:33.918376  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.919137 11708 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:33.920797  9814 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:33.923620 11575 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.925874 10525 raft_consensus.cc:1240] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:33.926303 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:33.927783 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:33.928306  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.936720 10530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 645) took 1184 ms. Trace:
I20260709 12:26:33.937124 10530 rpcz_store.cc:276] 0709 12:26:32.752349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.752599 (+   250us) service_pool.cc:224] Handling call
0709 12:26:33.936571 (+1183972us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b54005938d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:33.936666 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1641264896}
W20260709 12:26:33.940512  9853 leader_election.cc:336] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.718s (SENT)
I20260709 12:26:33.954485  9883 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:33.949939 10526 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:33.956781 11750 consensus_queue.cc:1059] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:33.957581 11750 raft_consensus.cc:3055] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:33.957887 11750 raft_consensus.cc:740] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:33.959990 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:33.960573  9779 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:33.961437 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:33.962350 11737 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:33.962769 11750 consensus_queue.cc:260] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.963704 11750 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:33.963939  9853 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:33.965174 11600 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:33.965965  9779 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:33.962796 11737 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:33.966802 11737 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:33.967216 11544 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:33.967738 11544 raft_consensus.cc:697] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:33.968547 11544 consensus_queue.cc:237] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.970377  9779 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:33.970551 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:33.971189 10530 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 6: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:33.972353  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:33.977530 11675 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:33.979219  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:33.979936  9884 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:26:33.980351 11760 log.cc:927] Time spent T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.699s	user 0.006s	sys 0.000s
I20260709 12:26:33.980974  9884 raft_consensus.cc:3055] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:33.981303  9884 raft_consensus.cc:740] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:33.981779  9887 raft_consensus.cc:1275] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:26:33.982213  9887 pending_rounds.cc:85] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 2
I20260709 12:26:33.982501  9887 pending_rounds.cc:107] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:26:33.982762  9887 raft_consensus.cc:2889] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:33.983781  9806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 256) took 1253 ms. Trace:
I20260709 12:26:33.983930  9886 raft_consensus.cc:1240] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:33.984066 11759 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:33.984788  9962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55952 (request call id 1015) took 1412 ms. Trace:
I20260709 12:26:33.985052  9779 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:33.985152  9962 rpcz_store.cc:276] 0709 12:26:32.572570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.598312 (+ 25742us) service_pool.cc:224] Handling call
0709 12:26:33.984633 (+1386321us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54001527d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:33.984733 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2209769344}
I20260709 12:26:33.985790 11759 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:33.986881  9779 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:26:33.981902  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.988430  9778 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:33.987305 11464 raft_consensus.cc:3055] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:33.993912  9890 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:33.982059  9884 consensus_queue.cc:260] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:33.998566  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:34.002974  9853 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:34.004132 11575 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:34.009230  9884 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.996897 11473 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.027747 10527 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:34.030330 10527 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:34.036353  9779 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:33.987833 11655 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:34.050310  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:34.050390  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:34.052745  9814 raft_consensus.cc:2376] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5. Re-sending same reply.
I20260709 12:26:34.054702  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:34.055222  9813 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:34.051076  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.051424  9888 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:33.997346 11759 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:34.004685 11575 raft_consensus.cc:697] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:33.996138 11464 raft_consensus.cc:740] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
W20260709 12:26:34.057534  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.035533 11700 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:34.073989  9928 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:33.997277 11740 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:26:34.081779  9928 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:26:34.066399  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.078042 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:34.077659  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:34.046239 11719 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:34.048861 11675 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:34.038029  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:34.062721  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:34.041927 11473 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:34.156716 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.165759  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:34.087620  9886 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:26:34.161274  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:26:34.164430  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.172030  9814 raft_consensus.cc:2368] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
I20260709 12:26:34.181545  9853 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:34.073539 11762 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:34.182796  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:34.077301 10526 raft_consensus.cc:1217] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 3 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:26:34.184680 11600 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:34.185652  9883 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:34.187040 11575 consensus_queue.cc:237] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.188134 10525 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:34.189083  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:34.179977 11708 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.059420 11655 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.190778  9779 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:34.213558 11655 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:34.213888 11644 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:34.191303 11607 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:34.214751  9962 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:34.214526 11607 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:34.215008 11644 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:34.209619 10526 raft_consensus.cc:1240] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 3 LEARNER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 12:26:34.195940  9928 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:34.197777  9885 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:34.154783 11472 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.199653  9813 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:34.201066  9853 leader_election.cc:400] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
W20260709 12:26:34.179409 11785 log.cc:927] Time spent T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:26:34.165575 11731 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:34.200850 11675 raft_consensus.cc:697] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:34.226775  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:34.174214 11700 raft_consensus.cc:697] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:34.207589  9814 raft_consensus.cc:2393] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 4: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:34.181360 11733 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:34.189679 11464 consensus_queue.cc:260] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.209370  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:34.204308 11631 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:34.223616 11644 consensus_queue.cc:1059] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:34.219715 11665 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:34.170110 11719 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:34.202582 11762 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.228829  9928 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:34.225227  9779 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:34.230948 11630 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:34.226388 11607 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:34.204476  9807 raft_consensus.cc:1275] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:34.243971  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:34.224432 11472 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:34.245666 10528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 659) took 1285 ms. Trace:
W20260709 12:26:34.247095  9890 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54428 (request call id 320) took 1482 ms (client timeout 1966 ms). Trace:
W20260709 12:26:34.269295  9890 rpcz_store.cc:269] 0709 12:26:32.764283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.767028 (+  2745us) service_pool.cc:224] Handling call
0709 12:26:34.246948 (+1479920us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400216e54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:34.247043 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2690177792}
I20260709 12:26:34.247861 11644 raft_consensus.cc:3055] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:34.250463  9815 raft_consensus.cc:1275] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:34.220326 11708 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.227679  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:34.234668  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:34.262969  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:34.263737  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:34.228473 11731 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:34.265795  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:34.233609 11733 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:34.226804 11544 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:26:34.286250  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:34.274515  9813 raft_consensus.cc:2376] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3. Re-sending same reply.
I20260709 12:26:34.288540  9955 raft_consensus.cc:1275] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:34.290553  9956 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:34.229187 11624 consensus_queue.cc:1048] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
W20260709 12:26:34.292595 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.260025 11773 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:34.296840 10527 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
W20260709 12:26:34.298156 11794 log.cc:927] Time spent T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:26:34.298022  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:34.298765 11607 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:34.299140  9814 raft_consensus.cc:1275] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:34.300884 10526 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.301452  9815 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:33.984206  9806 rpcz_store.cc:276] 0709 12:26:32.730462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.732046 (+  1584us) service_pool.cc:224] Handling call
0709 12:26:32.739292 (+  7246us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:32.818854 (+ 79562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:32.820837 (+  1983us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:32.901879 (+ 81042us) log.cc:844] Serialized 26 byte log entry
0709 12:26:33.182896 (+281017us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:33.191236 (+  8340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:33.197590 (+  6354us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:33.979823 (+782233us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:26:33.983508 (+  3685us) raft_consensus.cc:1685] finished
0709 12:26:33.983534 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:33.983727 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3223,"raft.queue_time_us":26375,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":13720,"spinlock_wait_cycles":5347072,"thread_start_us":183601,"threads_started":1,"wal-append.queue_time_us":310287}
I20260709 12:26:34.304708 11762 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:34.305052  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:34.308583 11675 consensus_queue.cc:237] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.309619 11737 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:34.312798 11719 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:34.312960 11473 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:34.268137 11698 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:34.314234 11472 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:34.268958 10528 rpcz_store.cc:276] 0709 12:26:32.959946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.994805 (+ 34859us) service_pool.cc:224] Handling call
0709 12:26:34.245489 (+1250684us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b540069f854. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:34.245605 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1957896448}
I20260709 12:26:34.315325 11710 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
W20260709 12:26:34.315716  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.315934 10497 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:26:34.385526 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 69671.9us
I20260709 12:26:34.271790 11644 raft_consensus.cc:740] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:26:34.316805 10524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 551) took 1531 ms (client timeout 1803 ms). Trace:
I20260709 12:26:34.318455 11773 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.318840 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:34.271867 11630 raft_consensus.cc:697] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:34.284375 11731 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:34.321370 11700 consensus_queue.cc:237] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:34.271411 11727 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:26:34.323267 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:34.327664  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.396701  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:34.292348 11640 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:26:34.326609 11625 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.291131 11733 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:34.283006 11606 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:26:34.428871  9779 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:34.399281  9890 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:34.400336  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:34.333842 11708 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:34.446147 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.448634  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:34.449828 10531 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:34.455751 10496 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:34.392925 11754 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:34.390290 11472 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.395035 11473 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:34.462850 11655 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:34.462865 11473 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.463661 11655 raft_consensus.cc:697] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:34.464794 11655 consensus_queue.cc:237] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.465746 11473 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:34.382448 11682 consensus_queue.cc:1048] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:26:34.447281 11762 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:34.391361 11736 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:26:34.428871 11624 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:26:34.459575 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:34.390900 10524 rpcz_store.cc:269] 0709 12:26:32.785217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.940986 (+155769us) service_pool.cc:224] Handling call
0709 12:26:34.316645 (+1375659us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b54000c9254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:34.316750 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2039672192}
I20260709 12:26:34.334862 11669 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.472754 11665 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.513918 11600 raft_consensus.cc:697] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:34.512704 11631 raft_consensus.cc:697] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:34.466986 11740 consensus_queue.cc:1048] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:26:34.442605 11625 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:34.561812  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.562335  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:34.563220  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.563351  9962 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:26:34.584045  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 248164us
I20260709 12:26:34.584168 11575 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:34.508531 11472 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:34.595826  9853 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:34.596701  9853 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:34.597694  9853 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:26:34.599387  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 273155us
I20260709 12:26:34.598989 11799 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.600868 11799 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:34.601184 11457 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:34.602672 11600 consensus_queue.cc:237] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:34.604241 11625 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:34.487000 11644 consensus_queue.cc:260] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.607508 11644 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:34.594046 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:34.610814 10524 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
I20260709 12:26:34.588017 11710 consensus_queue.cc:1048] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:26:34.613029 11710 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:34.613493 11710 raft_consensus.cc:697] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:34.613638 11473 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:34.614436 11473 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:34.614835 11631 consensus_queue.cc:237] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:34.560125 11630 consensus_queue.cc:237] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.615693 11472 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:34.632602 11472 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:34.633147 11472 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:34.585871 11665 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:34.674312 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 218649us
W20260709 12:26:34.676390  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 55355.5us
I20260709 12:26:34.598069 11708 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
W20260709 12:26:34.702214  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 102047us
I20260709 12:26:34.703275  9928 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:34.658182  9881 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:26:34.668810 11727 raft_consensus.cc:697] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:34.620467 11575 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.675767 11625 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:34.735940  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.744364  9779 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:34.649807 11710 consensus_queue.cc:237] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.734820 11799 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:34.682047  9814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55720
W20260709 12:26:34.753394  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 155588us
I20260709 12:26:34.754184  9814 raft_consensus.cc:606] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Received request to transfer leadership to TS b011791796d1457284b857d7d3422195
I20260709 12:26:34.734804 11472 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:34.752734  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:34.757045  9959 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:34.752573  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:34.753002  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:34.755946  9809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 1777) took 1660 ms (client timeout 1926 ms). Trace:
W20260709 12:26:34.759990  9809 rpcz_store.cc:269] 0709 12:26:33.089133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.464915 (+375782us) service_pool.cc:224] Handling call
0709 12:26:34.749747 (+1284832us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b540036bd54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:34.749857 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":966635264}
I20260709 12:26:34.735913 11773 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:34.767102  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:34.764493  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:34.764535 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:34.745376 11457 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:34.768774  9962 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:34.758584  9956 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:34.745240 11805 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:34.749439 11746 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:34.745971 11750 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.771798  9963 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:34.802606  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:34.797536 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.785439  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:34.806779  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:34.739953 11625 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:34.778715 11754 raft_consensus.cc:697] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 3 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:34.812548  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:34.813059  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:34.786046 11798 log.cc:927] Time spent T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
W20260709 12:26:34.859252 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.775261 11800 consensus_queue.cc:1048] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.099s
I20260709 12:26:34.786223 11805 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:34.861624 11814 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:34.816980 11472 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:34.873454 11472 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.861878 11754 consensus_queue.cc:237] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.789004 10524 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:26:34.876117 11472 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:34.876871  9928 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:34.879576 11665 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:34.881441 11733 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.882812  9958 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:34.884116 11733 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:34.817508 11669 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:34.892122 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 211007us
I20260709 12:26:34.788746 11457 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.807499 11809 consensus_queue.cc:1059] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 12:26:34.823292 11655 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:26:34.936802 11464 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:34.940981 11801 log.cc:927] Time spent T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
W20260709 12:26:34.923759 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.887518 11755 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:26:34.927469 10526 consensus_meta.cc:287] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.626s	user 0.011s	sys 0.001s
I20260709 12:26:34.920212  9808 raft_consensus.cc:2393] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 4: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:34.888197 11805 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:34.818408 11750 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.950070  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:34.897356 11665 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:26:34.953696  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.955567  9928 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:34.960340  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:34.960824  9928 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:34.964573  9882 raft_consensus.cc:1275] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:34.968122  9889 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:34.968405  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:34.969560 10496 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:34.970952 10496 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:34.973063  9887 raft_consensus.cc:1275] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:34.916147 11810 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:34.923141 11669 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.978864  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:34.982952 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:34.983686 10527 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:34.986465  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.960481 11800 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.959192 11665 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:34.888424 11727 consensus_queue.cc:237] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.963094 11733 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:34.973479 11815 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:34.968286 11624 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.958702 11626 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:26:34.894557 11814 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:34.985858 11544 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.026962 10527 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:34.995802  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:35.005468 11665 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:35.031428  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 61035.2us
I20260709 12:26:34.996516 11809 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:35.014155 11815 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:35.022969 11731 consensus_meta.cc:287] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.602s	user 0.004s	sys 0.007s
I20260709 12:26:34.991024 11669 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.028704 11825 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:35.014501 11630 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:26:34.964282 11755 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.047283 11815 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:35.099121  9812 raft_consensus.cc:1240] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:26:35.093858 11659 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.100709 11675 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.098639 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:35.133486  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:35.021782 11832 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:26:35.032974 11606 consensus_queue.cc:1048] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:26:34.981015 11810 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.022025 11624 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.007392 11800 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.048563  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:35.094174 11825 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:35.145395 10532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 666) took 1115 ms. Trace:
I20260709 12:26:35.155622 10532 rpcz_store.cc:276] 0709 12:26:34.029568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.029722 (+   154us) service_pool.cc:224] Handling call
0709 12:26:35.098435 (+1068713us) spinlock_profiling.cc:243] Waited 952 us on lock 0x7b58001f1a98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:35.145320 (+ 46885us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2189184}
I20260709 12:26:35.034832 11544 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.097510 11834 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.126951 11625 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:35.054059 11806 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.099s
I20260709 12:26:35.051019 11731 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.153241 11809 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.155318 11457 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:35.185652  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.187476 11814 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:35.187855 11821 log.cc:927] Time spent T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:26:35.167519 11834 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:35.188733 11831 log.cc:927] Time spent T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:26:35.147732 11675 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:35.226540 10529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36672 (request call id 564) took 1467 ms. Trace:
W20260709 12:26:35.190918 11833 log.cc:927] Time spent T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:26:35.191447 11827 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:35.192116 11829 log.cc:927] Time spent T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:26:35.193261 11815 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:35.186762  9811 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:35.239523  9811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 1788) took 1194 ms. Trace:
I20260709 12:26:35.157750 11825 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:35.205574 11806 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:35.214941 11773 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.147907 11659 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:35.218930  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:35.223222 10531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 566) took 1463 ms. Trace:
I20260709 12:26:35.223886 11814 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:35.200265 11824 log.cc:927] Time spent T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 12:26:35.197956 11805 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.264724  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:35.266611 11805 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:35.185197 11750 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:35.292750 11710 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:35.293318 11665 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.293407 11710 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.182653 11839 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:35.227007 10529 rpcz_store.cc:276] 0709 12:26:33.759119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.762942 (+  3823us) service_pool.cc:224] Handling call
0709 12:26:34.211369 (+448427us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b58001f1a98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:34.218075 (+  6706us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:34.218658 (+   583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:34.218690 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:34.219307 (+   617us) log.cc:844] Serialized 26 byte log entry
0709 12:26:34.553285 (+333978us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:34.553339 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:34.553429 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:34.942009 (+388580us) raft_consensus.cc:1685] finished
0709 12:26:34.942035 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:35.226366 (+284331us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b5400832050. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:35.226480 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":162,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5807,"spinlock_wait_cycles":19195520,"thread_start_us":282147,"threads_started":1,"wal-append.queue_time_us":510873}
I20260709 12:26:35.239955  9811 rpcz_store.cc:276] 0709 12:26:34.045370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.049111 (+  3741us) service_pool.cc:224] Handling call
0709 12:26:35.184572 (+1135461us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b5800010e98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:35.185214 (+   642us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:35.239272 (+ 54058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.239463 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4679424}
I20260709 12:26:35.206641 11457 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:26:35.229633 11759 consensus_meta.cc:287] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 1.150s	user 0.009s	sys 0.003s
W20260709 12:26:35.228540 11644 consensus_meta.cc:287] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.001s
I20260709 12:26:35.175043 11828 consensus_queue.cc:1048] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 12:26:35.303748 11710 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:35.305485  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:35.252962  9962 raft_consensus.cc:2368] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7.
I20260709 12:26:35.306860 11665 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:35.253459 10531 rpcz_store.cc:276] 0709 12:26:33.759784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.763283 (+  3499us) service_pool.cc:224] Handling call
0709 12:26:34.077859 (+314576us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b58001f1a98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:35.223088 (+1145229us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54006702d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:35.223177 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":548629248}
I20260709 12:26:35.255641 11675 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:35.239768 11841 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:35.257817 11815 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:35.327232  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:35.241273 11827 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.260511  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:35.346211  9885 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:35.250336 11806 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:35.262323 11836 log.cc:927] Time spent T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:26:35.252152 11773 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:35.263056 11835 log.cc:927] Time spent T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:26:35.264328 11659 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:35.201493 11809 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.287441 11810 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:35.288671  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 61204.8us
I20260709 12:26:35.221969 11834 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:35.300742 11800 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:35.300940 11844 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.301302 11624 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:35.293439 11750 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:35.302037 11457 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.303227 11759 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:35.329190 11669 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:35.269083 11814 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.334669 11841 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.308185 11839 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.278600  9806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 1981) took 1035 ms. Trace:
I20260709 12:26:35.251909  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:35.308882  9811 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:35.266170  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:35.900024  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:35.900444  9814 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:35.901291  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:35.901760  9814 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:35.352000 11847 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.905445 11847 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.901921  9927 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:35.907558 11847 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:35.907958  9927 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:35.908327 11848 raft_consensus.cc:993] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower b011791796d1457284b857d7d3422195 to start an election
I20260709 12:26:35.908829 11848 raft_consensus.cc:1081] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Signalling peer b011791796d1457284b857d7d3422195 to start an election
I20260709 12:26:35.909184 11626 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:35.909569 11626 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.909869 11626 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:35.385188 11839 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:35.910543 11839 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:35.910874 11839 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.911196 11839 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:35.912508 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:35.913705  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:35.385198 11841 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:35.416292  9812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 1768) took 2358 ms. Trace:
I20260709 12:26:35.914673  9812 rpcz_store.cc:276] 0709 12:26:33.057401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.057525 (+   124us) service_pool.cc:224] Handling call
0709 12:26:33.078892 (+ 21367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:35.141876 (+2062984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.415901 (+274025us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b54001847d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:35.416200 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4631961472}
I20260709 12:26:35.915925  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:35.916570  9812 raft_consensus.cc:2393] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 3: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:35.917320  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:26:35.418723 11846 log.cc:927] Time spent T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:26:35.448135  9815 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af001ec909824ed199d355fd69f43ede"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:26:35.918747  9815 raft_consensus.cc:606] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:26:35.914269  9963 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:35.919127  9815 raft_consensus.cc:614] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:35.919430 10527 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:35.919709  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:35.475996  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.922739  9854 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:35.923408 11626 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:35.404527  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:35.480629  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.928431 11879 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:26:35.928748  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.928977 11879 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:35.929507  9853 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:35.929407 11879 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:35.381783  9881 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54428 (request call id 346) took 1614 ms (client timeout 1637 ms). Trace:
I20260709 12:26:35.428529  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:35.932557 11710 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:35.932639  9883 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:35.422487  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:35.435254  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:35.451843  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:35.386220  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:35.369647  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:35.940213  9957 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:35.941668  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:35.942353  9959 raft_consensus.cc:2368] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3.
I20260709 12:26:35.942797 10496 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:35.944034 11879 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:35.944941  9959 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:35.367956  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:35.947366  9853 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:35.948272 11879 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:35.948400  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:35.948729 11879 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.433099  9885 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
W20260709 12:26:35.352789 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 47221.6us
I20260709 12:26:35.553074  9958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1036) took 1349 ms. Trace:
I20260709 12:26:35.955806  9958 rpcz_store.cc:276] 0709 12:26:34.203436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.203566 (+   130us) service_pool.cc:224] Handling call
0709 12:26:34.203854 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:34.883266 (+679412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.552800 (+669534us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54001522d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:35.552999 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1560902016}
I20260709 12:26:35.472942 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:35.958168 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:35.958873 10524 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:35.472057 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:35.960819 10529 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:35.961939 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:35.962869 10529 raft_consensus.cc:2393] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 3: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:35.963717 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:35.964864 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:35.473630 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:35.967865 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:35.967557 11839 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:35.968407 10532 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:35.968767  9957 raft_consensus.cc:1240] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:26:35.969308 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:35.473691 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:35.473138 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:35.385315 10525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 574) took 1069 ms. Trace:
I20260709 12:26:35.380440 11457 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:35.444558 11464 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.431373 11575 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:35.484166 11600 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:35.984054 11881 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:35.394656 11719 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:35.985566 11719 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.394951 11731 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:35.403064 11737 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:34.618570 11741 consensus_queue.cc:1175] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f5208640a51f493e930ce4f64ceeed0b" responder_term: 5 status { last_received { term: 4 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:26:35.377738 11750 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.994968 10532 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:26:35.996090 11750 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:35.565790 11755 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:35.386618 11773 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:35.398736 11800 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:36.005780 11719 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:36.005867 11800 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.007431 11719 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.414589 11806 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:35.382468 11809 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:35.381459 11814 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:35.389850 11825 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.016876 11825 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:35.345870 11827 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:35.607227  9810 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:26:35.653443  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.018803  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:36.019403  9810 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:36.020136 11644 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:36.020663 11644 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:35.716056 11640 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:36.022755 11644 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:35.747143  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1912) took 1720 ms. Trace:
I20260709 12:26:35.583323 10530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 662) took 1557 ms. Trace:
I20260709 12:26:36.023248 11773 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.023370 10530 rpcz_store.cc:276] 0709 12:26:34.025989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.026764 (+   775us) service_pool.cc:224] Handling call
0709 12:26:34.027028 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:34.214440 (+187412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:34.214471 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:34.214507 (+    36us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:34.214533 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.583060 (+1368527us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54005ea1d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:35.583113 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:35.583266 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430611840}
I20260709 12:26:36.023768 11773 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.025130 10530 raft_consensus.cc:1240] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:35.760315  9806 rpcz_store.cc:276] 0709 12:26:34.242875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.303404 (+ 60529us) service_pool.cc:224] Handling call
0709 12:26:35.277625 (+974221us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b5800010e98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:35.277877 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:35.278110 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:35.278159 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:35.278221 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:35.278287 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.278373 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:35.278515 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60631808}
W20260709 12:26:35.775748  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 312765us
I20260709 12:26:35.783267 11607 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.806348 11631 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:35.812036 11669 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.812847 11813 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.813341 11834 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:26:35.814731  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.814786 11627 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.814981 11727 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:35.823827 11872 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.828320 11698 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:35.838022 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:35.838140 10526 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:35.844321  9779 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:35.854640 11661 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.856067 11816 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:35.856683 11762 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:35.858827 11754 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:35.859818 11655 raft_consensus.cc:3055] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:35.865674 11478 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.868961 11765 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.870808  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:35.876384 11820 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:35.878556 11544 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:35.883808  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:35.892539  9778 leader_election.cc:400] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7.
I20260709 12:26:35.895318  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:35.897755  9808 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:35.908059 11847 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:35.375221 11844 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.920938 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:35.926249 11626 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:35.931744  9881 rpcz_store.cc:269] 0709 12:26:33.767570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.768136 (+   566us) service_pool.cc:224] Handling call
0709 12:26:35.381568 (+1613432us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54001d74d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:35.381716 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320354048}
I20260709 12:26:35.933167 11710 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:35.934578 11659 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:35.940188  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:35.383332  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:35.949324 11880 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:35.949906  9710 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59972 (request call id 302) took 5837 ms. Trace:
I20260709 12:26:35.951913  9854 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:35.952446  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:35.970808 10531 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:35.973734 10525 rpcz_store.cc:276] 0709 12:26:34.315982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.318508 (+  2526us) service_pool.cc:224] Handling call
0709 12:26:35.385023 (+1066515us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b54005c12d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:35.385232 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1938988928}
I20260709 12:26:35.959734 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:35.978340 11879 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:35.982296 11464 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:35.976300 11839 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:35.981304  9711 catalog_manager.cc:5697] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 2 to 3, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 3 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.984139 11575 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:35.984632 11600 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:35.579816 11624 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:35.993289 11882 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:35.993758 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 51033.7us
I20260709 12:26:35.997448 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:36.008107 11800 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:35.439440 11803 log.cc:927] Time spent T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.653s	user 0.003s	sys 0.003s
I20260709 12:26:36.156028 11478 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.156714  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:36.157325  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:36.157675 11727 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:36.158561 11478 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:36.158672  9963 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:36.157371  9808 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.159567  9928 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:35.713935  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:36.160641  9960 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 268) took 1477 ms (client timeout 1845 ms). Trace:
I20260709 12:26:36.160905  9928 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:26:36.161072  9960 rpcz_store.cc:269] 0709 12:26:34.684177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.713645 (+1029468us) service_pool.cc:224] Handling call
0709 12:26:36.160584 (+446939us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:36.162149 11733 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:36.162576 11810 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:36.162549 11733 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:36.163105 11810 raft_consensus.cc:697] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:36.163239 11733 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:36.164287  9778 leader_election.cc:403] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:26:36.164009 11810 consensus_queue.cc:237] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:36.164803  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 272388us
I20260709 12:26:36.022531 11640 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:36.156031 11882 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.167815 11640 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:35.732394  9961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55946 (request call id 1740) took 1446 ms. Trace:
I20260709 12:26:36.168582 11825 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.168964 11814 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.169098 11825 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.169588 11814 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.170647 11754 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.171715 11814 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:36.172084 11825 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:36.168619  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:36.173331 11754 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:36.173924 11655 raft_consensus.cc:740] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:36.173424 10496 leader_election.cc:400] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3.
I20260709 12:26:36.174762 10496 leader_election.cc:403] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:36.174860 11655 consensus_queue.cc:260] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.175933 11655 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.168371  9961 rpcz_store.cc:276] 0709 12:26:34.285676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.291300 (+  5624us) service_pool.cc:224] Handling call
0709 12:26:35.732141 (+1440841us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b5400114254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:35.732321 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1612479744}
I20260709 12:26:36.177492  9808 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:36.180485 11659 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.181006 11659 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.177978 11882 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:36.025795 11773 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:36.181756 11816 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.182459 11813 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.183662 10529 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:36.178421 11754 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.178941 11631 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:36.137678 11881 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.184784 11881 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.185374  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.186064  9815 raft_consensus.cc:2393] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 2: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:36.186796 10532 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:36.116173 11457 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.187774 11457 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.188022 11575 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:36.192502 11773 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:36.193209 11773 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:36.181293  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.194252  9808 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:36.195479 11878 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.196552 10526 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:36.196070 11878 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.199379  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.199527 11627 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:36.200412  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.201336  9813 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:26:36.023262  9886 rpcz_store.cc:276] 0709 12:26:34.026574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.171471 (+144897us) service_pool.cc:224] Handling call
0709 12:26:34.197757 (+ 26286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:34.273119 (+ 75362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:34.273160 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:34.273258 (+    98us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:34.273300 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.746888 (+1473588us) spinlock_profiling.cc:243] Waited 75 ms on lock 0x7b540013c4d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:35.746937 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:35.747072 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172569472}
I20260709 12:26:36.203663 11765 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:36.205139  9811 raft_consensus.cc:2393] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 3: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:36.205578 11847 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.112452 11827 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:36.208101 11874 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:36.170262 11762 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:36.209748  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 257879us
I20260709 12:26:36.210443 11880 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:36.210861 11880 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.212088 11762 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:36.010159  9713 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59992 (request call id 297) took 4718 ms. Trace:
I20260709 12:26:36.212177 11607 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.212882  9713 rpcz_store.cc:276] 0709 12:26:31.291308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.292210 (+   902us) service_pool.cc:224] Handling call
0709 12:26:36.009999 (+4717789us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1999395,"reported_tablets":4}
I20260709 12:26:36.159359 11624 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.218556  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.219022 11872 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.219460  9808 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:36.220835 11698 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:36.223280  9808 raft_consensus.cc:1240] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:36.062369 11737 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:36.026221 10530 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:36.224550 11834 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.234364 10524 raft_consensus.cc:2393] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 5: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:36.234869 11669 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.235859 11640 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.263801 11640 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:36.210875  9807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 1982) took 1965 ms. Trace:
I20260709 12:26:36.265777  9807 rpcz_store.cc:276] 0709 12:26:34.245311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.312028 (+ 66717us) service_pool.cc:224] Handling call
0709 12:26:35.896550 (+1584522us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b5800010e98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:35.896798 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:36.209854 (+313056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:36.209889 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:36.209936 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:36.209968 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.210658 (+   690us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b540002dfd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:36.210703 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.210820 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754887296}
I20260709 12:26:36.238498 10527 raft_consensus.cc:2393] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 4: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:26:36.239686  9809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46504 (request call id 1985) took 1553 ms (client timeout 2055 ms). Trace:
W20260709 12:26:36.269049  9809 rpcz_store.cc:269] 0709 12:26:34.686548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.883545 (+1196997us) service_pool.cc:224] Handling call
0709 12:26:36.239622 (+356077us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:36.244900 11848 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.271667 11848 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.247129  9927 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:36.274739 11625 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:36.275326 11625 raft_consensus.cc:697] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:36.240921  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:36.249882 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.264163 10533 raft_consensus.cc:2393] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:36.276475 11625 consensus_queue.cc:237] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:36.276201  9961 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:36.280056  9927 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:36.283123 11841 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.283349 10532 raft_consensus.cc:1275] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:36.179682 11820 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.244295  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:36.285382  9963 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:36.259232 11737 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:36.303562 11883 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:36.304128 11883 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.304536 11883 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.305823  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:36.175945 10496 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:36.307432 11882 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:36.202045  9813 raft_consensus.cc:606] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:36.310118  9813 raft_consensus.cc:614] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:26:36.331073  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 51102.2us
W20260709 12:26:36.331022  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 491040us
I20260709 12:26:36.333302  9810 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
W20260709 12:26:36.334169  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 83299.2us
W20260709 12:26:36.335002 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 159109us
I20260709 12:26:36.337428 10496 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:26:36.339512 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.343297  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.346947 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:36.349378  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.350142  9810 raft_consensus.cc:2393] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 3: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:36.350841  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:36.354691  9815 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:36.355599  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.356096  9815 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:36.360396  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.360946  9815 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:36.361690  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.344240 10527 pending_rounds.cc:85] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: Aborting all ops after (but not including) 2
I20260709 12:26:36.362564 10527 pending_rounds.cc:107] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:26:36.362811 10527 raft_consensus.cc:2917] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:26:36.362914  9854 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:36.362201  9815 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:36.363204 10527 raft_consensus.cc:2889] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:36.368122  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:36.369572  9963 raft_consensus.cc:1240] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:36.367749  9928 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:36.370868  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.372117  9779 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:36.372937  9779 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:36.373306 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:36.376693  9814 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:26:36.378604  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.385120  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:36.391322  9961 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:36.190500  9710 rpcz_store.cc:276] 0709 12:26:30.112951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.113192 (+   241us) service_pool.cc:224] Handling call
0709 12:26:35.949820 (+5836628us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:33.255997 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:33.256769 (+   772us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:33.256816 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:26:33.256845 (+    29us) tablet.cc:662] Decoding operations
0709 12:26:33.257998 (+  1153us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:33.258102 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:33.258151 (+    49us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:26:33.259435 (+  1284us) tablet.cc:701] Row locks acquired
0709 12:26:33.259455 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:26:33.259592 (+   137us) write_op.cc:270] Start()
0709 12:26:33.259693 (+   101us) write_op.cc:276] Timestamp: P: 1783599993259546 usec, L: 0
0709 12:26:33.259713 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:26:33.260374 (+   661us) log.cc:844] Serialized 2829 byte log entry
0709 12:26:33.456405 (+196031us) op_driver.cc:464] REPLICATION: finished
0709 12:26:33.554135 (+ 97730us) write_op.cc:301] APPLY: starting
0709 12:26:33.555010 (+   875us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:33.566198 (+ 11188us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:33.579042 (+ 12844us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:33.695828 (+116786us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:33.696044 (+   216us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:26:33.696106 (+    62us) write_op.cc:312] APPLY: finished
0709 12:26:33.696372 (+   266us) log.cc:844] Serialized 59 byte log entry
0709 12:26:33.696533 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:33.696657 (+   124us) write_op.cc:454] Released schema lock
0709 12:26:33.696703 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:33.697065 (+   362us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:33.697096 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":114941,"reported_tablets":14,"spinlock_wait_cycles":1073152,"child_traces":[["op",{"apply.queue_time_us":84062,"apply.run_cpu_time_us":4729,"apply.run_wall_time_us":145893,"num_ops":7,"prepare.queue_time_us":108003,"prepare.run_cpu_time_us":4704,"prepare.run_wall_time_us":13046,"raft.queue_time_us":94251,"raft.run_cpu_time_us":10772,"raft.run_wall_time_us":76894,"replication_time_us":178027,"thread_start_us":228164,"threads_started":4,"wal-append.queue_time_us":6913,"wal-append.run_cpu_time_us":35393,"wal-append.run_wall_time_us":1425905}]]}
I20260709 12:26:36.395907 10532 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:36.399091  9854 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:36.399739  9955 raft_consensus.cc:1275] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:36.372812 11759 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:36.208518 11827 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.392323  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:36.354135 11825 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:36.160087 11661 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:36.358654 11874 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:36.354591 11807 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.373462 11884 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:36.392817 11814 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:36.411610  9928 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:36.423902 10496 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:36.372807 11624 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:36.421566 11828 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:36.394351 11464 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:36.393317 11746 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7.
I20260709 12:26:36.392793  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:36.437917  9955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94"
dest_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55952
I20260709 12:26:36.481212  9955 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:36.481621  9955 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:36.422842 11759 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.423324  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:36.414609 11675 consensus_queue.cc:1059] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:26:36.415483  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.447937 11698 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:36.468736 11885 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:36.469751 11887 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.421020 11755 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:36.473836  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:36.482146 11607 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:36.441303 11874 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:36.355968 11719 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:36.444594 11884 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.404408 11876 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:26:36.440269  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.489476  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:36.425527 11700 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:26:36.489650  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:36.462185 11814 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.407055 11762 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:36.437403 11750 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:26:36.498503  9778 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:36.498725 11887 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:36.482771 11828 raft_consensus.cc:697] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:36.486984 11759 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:36.501554  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:36.503182 11820 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:36.522575 11669 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:36.446621 11807 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:36.432754 11877 consensus_queue.cc:1059] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:26:36.489840 11457 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:36.491127 11736 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.487251 11765 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:36.492184 11627 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:36.488925  9856 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.010s	sys 0.018s
W20260709 12:26:36.548399  9856 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.010s	sys 0.018s
I20260709 12:26:36.491840 11881 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:36.510053 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 86219.1us
I20260709 12:26:36.494531 11872 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:36.490437  9964 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:36.494683 11885 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.505909 11884 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.515518  9807 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:36.516032 11631 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:36.517704 11814 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:26:36.502655 11755 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.520356 11661 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:36.505779 11874 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.520570  9960 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:36.521165 11848 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:36.521317 11727 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:36.522119 11827 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:36.522447 11813 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:36.496222 11878 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:36.484043  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:36.503475 11882 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:26:36.509848  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 135417us
I20260709 12:26:36.510571 11675 consensus_queue.cc:1059] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:26:36.513661 11844 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:36.533223  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 121703us
I20260709 12:26:36.536394  9813 raft_consensus.cc:1275] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:36.523319 11762 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:36.548873  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 149865us
W20260709 12:26:36.550012  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 137250us
I20260709 12:26:36.552280 10496 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:36.553217  9853 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:26:36.605921  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 52768.5us
I20260709 12:26:36.606307  9854 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:36.529309 11754 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3.
I20260709 12:26:36.528311 11887 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:36.555130  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 56696us
I20260709 12:26:36.537859 11820 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:36.614826 11820 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.615566 11800 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:36.616849 11820 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:36.546759 11809 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:36.548269 11773 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:36.559026 11881 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:36.617985 11881 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:36.619839 11881 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:36.554431 11834 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:36.576596 11876 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:36.558815 11710 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:36.573699 11885 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:36.622653  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:36.624642  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.545735 11828 consensus_queue.cc:237] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.603379  9928 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:36.625631 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:36.606583  9853 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:26:36.607009  9836 debug-util.cc:398] Leaking SignalData structure 0x7b08000c0180 after lost signal to thread 8640
I20260709 12:26:36.607005 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:36.607844 11901 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:36.553050 11904 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:36.608201 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:36.598917 11882 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.626683  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.627163  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:26:36.627556 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 75412.3us
I20260709 12:26:36.660914  9886 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:36.661104 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:36.630599 10532 raft_consensus.cc:2410] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:26:36.634948 10530 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:36.613692 11884 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.626926 11762 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.669342  9890 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:26:36.627482 11878 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.631174 11710 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:36.690240  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 55259.8us
W20260709 12:26:36.735919  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 132604us
I20260709 12:26:36.719995  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.690781  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:36.728188  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.739580  9928 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:36.664348 11882 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:36.730993 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:36.635965 11841 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.741268  9889 raft_consensus.cc:2376] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6. Re-sending same reply.
W20260709 12:26:36.741106  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 134569us
I20260709 12:26:36.749243  9853 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:36.743145  9928 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:36.744277  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:36.751541  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:26:36.752609 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 91585.3us
W20260709 12:26:36.756547 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 94667.3us
I20260709 12:26:36.757803  9889 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:36.757706  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:36.743228  9927 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:36.759800  9853 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:36.757416 10496 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:36.752388  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.663115 11896 consensus_queue.cc:1048] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.133s
I20260709 12:26:36.663144 11904 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.766412  9887 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.767230  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.767870 11881 consensus_queue.cc:1059] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:36.768922 11881 raft_consensus.cc:3055] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:36.769209 11881 raft_consensus.cc:740] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:36.769508  9853 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:36.770025 11881 consensus_queue.cc:260] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:36.770488  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.770648  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:36.771095  9890 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:36.771178 11881 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:36.771721 11904 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:36.771956 11736 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:36.708186 11740 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:36.764693 11902 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:26:36.749202 11888 log.cc:927] Time spent T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 12:26:36.747522 11627 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.764843 10496 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:36.659178 11661 consensus_queue.cc:1059] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:26:36.775902  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.772447 11736 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:26:36.758939 11733 consensus_meta.cc:287] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.000s
I20260709 12:26:36.774989 11897 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:26:36.780505  9836 debug-util.cc:398] Leaking SignalData structure 0x7b080011c620 after lost signal to thread 9747
I20260709 12:26:36.748255 11878 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.781116 10496 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:36.803474 10496 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:36.763134 11710 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:36.772926 11901 raft_consensus.cc:2749] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:36.752790 11754 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:36.774959 11834 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:36.772300 11904 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:36.786517 10497 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:36.778512  9887 raft_consensus.cc:2410] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:26:36.777990 11905 log.cc:927] Time spent T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 12:26:36.778644 11631 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:36.781772 11841 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:36.804384  9955 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.806663  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.807230  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:36.781960 11740 raft_consensus.cc:697] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:36.782244  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.826766  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:36.824324  9889 raft_consensus.cc:2368] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7.
W20260709 12:26:36.828106  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 57611.6us
I20260709 12:26:36.830839  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.819268 11631 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.800994 11627 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:26:36.828641  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.814733 11750 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:36.835325  9884 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:36.836230  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.785676 11736 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:36.814254 11755 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:36.812667 11754 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:36.823429  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 62405.3us
I20260709 12:26:36.813057 11669 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:36.812530 11897 raft_consensus.cc:697] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:36.833182 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:36.823976  9890 raft_consensus.cc:2393] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 3: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:36.812227 11834 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.833961  9955 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:36.800765 11872 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:26:36.800097 11733 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.837189  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.785535 11820 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:36.838233  9889 raft_consensus.cc:2393] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 4: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:36.856053  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.856148 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:36.833685 11879 consensus_meta.cc:287] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.616s	user 0.011s	sys 0.000s
I20260709 12:26:36.834985 11631 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.822149 11814 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:36.822057 11841 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:36.853590  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:36.856916  9809 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:36.830967 11807 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:36.858683  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:36.841640  9836 debug-util.cc:398] Leaking SignalData structure 0x7b0800269780 after lost signal to thread 9839
I20260709 12:26:36.859668  9889 pending_rounds.cc:85] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 2
I20260709 12:26:36.856959 10529 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
W20260709 12:26:36.849807 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 46408us
I20260709 12:26:36.881285  9889 pending_rounds.cc:107] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:26:36.861613 11816 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:36.882380 10496 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:36.881681  9889 raft_consensus.cc:2917] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:26:36.856271 11820 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:36.863240 11883 consensus_meta.cc:287] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.558s	user 0.006s	sys 0.004s
I20260709 12:26:36.863173  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.863869  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.839548 11750 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.877125  9810 raft_consensus.cc:3055] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:36.877528  9956 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:36.848873 11669 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.852034 11754 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.854596 11834 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.827699 11727 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:26:36.854089 11904 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:26:36.903601 11886 log.cc:927] Time spent T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.338s	user 0.000s	sys 0.002s
I20260709 12:26:36.903510 11904 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:36.905629 11904 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:36.883404  9889 raft_consensus.cc:2889] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:36.862629  9807 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:36.907696 10526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 432) took 1061 ms. Trace:
I20260709 12:26:36.908334 11885 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.909611 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:36.894826 11814 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:26:36.910733 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:36.911082 11575 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:36.913090  9882 raft_consensus.cc:2393] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 6: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:36.898181  9808 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:36.914978 11918 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:36.886897 11820 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.892050 10496 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:36.915675  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.864279 11759 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:36.914124 11880 consensus_meta.cc:287] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.703s	user 0.011s	sys 0.000s
W20260709 12:26:36.881155  9836 debug-util.cc:398] Leaking SignalData structure 0x7b08001910e0 after lost signal to thread 9840
I20260709 12:26:36.880031 11841 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:36.902875 11878 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:36.886381 11655 consensus_meta.cc:287] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.710s	user 0.009s	sys 0.001s
I20260709 12:26:36.949810  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.899919  9853 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:26:36.951893  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 52005.3us
I20260709 12:26:36.866386 11879 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.892942  9810 raft_consensus.cc:740] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:36.921995  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.955433  9813 raft_consensus.cc:2393] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:36.922745 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:36.924692  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.957162  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.958551  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.959259  9815 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:36.894600 11669 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:36.894497 11750 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:36.895069 11884 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:36.945269  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.955725  9882 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:36.966413  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.967737  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.896689  9806 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:36.890892 11883 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.963043 10533 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
W20260709 12:26:36.979645  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 145627us
I20260709 12:26:36.864224 11897 consensus_queue.cc:237] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:36.932145 11918 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:36.882862 11740 consensus_queue.cc:237] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.955379  9810 consensus_queue.cc:260] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:36.982972  9810 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:36.982877  9853 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:36.983006  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.977229 10531 raft_consensus.cc:1240] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:36.968395  9882 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:36.918205 11902 consensus_queue.cc:1059] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:26:36.986698  9886 raft_consensus.cc:1240] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:36.946964 11814 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:36.988821  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:36.989061  9882 raft_consensus.cc:1275] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:36.955312 11915 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:36.991729  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:36.990587  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:36.989988  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:36.994436  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:36.993024  9963 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:36.991039  9811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2002) took 1274 ms. Trace:
I20260709 12:26:36.975850 11827 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:36.999046  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.999333  9885 raft_consensus.cc:1240] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:37.000537  9810 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:36.978331  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:37.001818  9957 raft_consensus.cc:1275] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:37.002848  9882 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
W20260709 12:26:36.988525  9836 debug-util.cc:398] Leaking SignalData structure 0x7b0800404040 after lost signal to thread 9914
I20260709 12:26:36.997738  9811 rpcz_store.cc:276] 0709 12:26:35.716567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.207407 (+490840us) service_pool.cc:224] Handling call
0709 12:26:36.207944 (+   537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:36.291311 (+ 83367us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:26:36.291642 (+   331us) log.cc:844] Serialized 14 byte log entry
0709 12:26:36.513712 (+222070us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:36.513780 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:36.513833 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.990842 (+477009us) spinlock_profiling.cc:243] Waited 83.1 ms on lock 0x7b540033d454. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:36.990885 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.990991 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25920,"prepare.queue_time_us":166,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":31,"raft.queue_time_us":55427,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":6738,"spinlock_wait_cycles":195786496,"thread_start_us":184060,"threads_started":2,"wal-append.queue_time_us":131097}
I20260709 12:26:36.986956 11710 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:37.007824  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:37.007404  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:36.908147 10526 rpcz_store.cc:276] 0709 12:26:35.846649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.197679 (+351030us) service_pool.cc:224] Handling call
0709 12:26:36.197988 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:36.413798 (+215810us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:36.419336 (+  5538us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:36.430131 (+ 10795us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:36.434822 (+  4691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.907451 (+472629us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b540052c954. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:36.907497 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.907626 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390533888}
I20260709 12:26:37.010991  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.991250  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:36.997221 11918 raft_consensus.cc:697] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:26:37.006544  9836 debug-util.cc:398] Leaking SignalData structure 0x7b0800404000 after lost signal to thread 9915
I20260709 12:26:36.999717 11885 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:36.935010 11880 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:37.006951  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:26:37.016811 11892 log.cc:927] Time spent T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.131s	user 0.003s	sys 0.003s
I20260709 12:26:37.041775  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:37.011724  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:37.044663 11759 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:37.012503 11881 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:37.015257 11899 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:37.048050 11698 raft_consensus.cc:3055] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:37.050937  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:36.998412 11814 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.064724  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:37.066166  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:37.034967 11800 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:37.071471  9854 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:37.074115  9854 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:37.075103  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:37.054654 11698 raft_consensus.cc:740] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:37.076655  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:37.076931  9806 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:26:37.077366  9812 raft_consensus.cc:2393] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 3: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:37.077880  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:37.078070  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:37.079012  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:37.079274 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:37.080152 10526 raft_consensus.cc:2393] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 4: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:37.081008 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:37.081528 10526 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:37.082533 11901 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:37.084276 11659 consensus_meta.cc:287] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.903s	user 0.007s	sys 0.003s
I20260709 12:26:37.054679 11881 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.084796 11881 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.084667 11659 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.084976  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:37.085175 11901 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:37.085656  9889 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:37.087105  9888 raft_consensus.cc:2368] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3.
I20260709 12:26:37.087687  9779 leader_election.cc:400] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7.
I20260709 12:26:37.088517  9779 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:37.017987 11904 consensus_queue.cc:1048] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:26:37.090682  9890 raft_consensus.cc:1275] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:37.090977  9779 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:37.093082  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:37.089956  9853 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:37.096683  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:37.096788  9779 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:37.097211  9957 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.098824 11675 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.099354 11883 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:37.099686 11659 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:37.100005 11914 consensus_queue.cc:1059] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:37.098214  9779 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:37.102445  9779 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:37.103403  9779 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:37.104420  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:37.104749  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:37.105289  9958 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.047276 11887 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:37.162843  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 55286.7us
I20260709 12:26:37.163359  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:37.164729  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:37.052209  9881 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:37.126941  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:37.168536  9812 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:37.089525 11902 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:37.175458  9957 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:37.176908  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:37.102308  9836 debug-util.cc:398] Leaking SignalData structure 0x7b08003949a0 after lost signal to thread 9988
I20260709 12:26:37.100332 11918 consensus_queue.cc:237] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.113647 11661 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:37.169127  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:37.098845  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:37.186007  9809 raft_consensus.cc:1240] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:26:37.193234  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:37.162942 11765 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:37.113442  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:37.188601  9958 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:37.197538  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:37.168061 11800 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:37.169252 11925 log.cc:927] Time spent T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:26:37.100777 11759 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:37.106631 11885 consensus_queue.cc:1048] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 12:26:37.214594 11759 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:37.215107 11759 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.215294 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:37.216640 11765 consensus_queue.cc:1048] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:37.101743 11816 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:37.106490 11896 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:37.192512  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:37.194036  9962 raft_consensus.cc:2410] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:26:37.199452  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:37.179817  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:37.197495  9853 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:37.190081 11661 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.200519 11737 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:37.185534 11881 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:37.238508  9927 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:37.217089 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:37.226439  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:37.187065 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:37.231531  9958 raft_consensus.cc:2393] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 3: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:37.241837 10527 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.193135 11901 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:37.067041 11874 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.213681  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:37.178789 11902 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.201042 11879 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:37.221051 11883 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:37.115731 11899 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:37.267758  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:37.218981  9808 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:37.230623  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:37.237703 11661 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:37.251778  9927 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:37.254520 11600 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:37.256254 10528 consensus_meta.cc:287] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.000s
I20260709 12:26:37.257067 11880 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:37.258208 10526 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:26:37.273454 10496 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:37.185505 11762 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:37.258867  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 91221.5us
I20260709 12:26:37.204753  9883 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:37.184496 11736 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.249281 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:37.269472  9958 raft_consensus.cc:1240] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:26:37.275771  9779 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:37.280877 10527 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:37.261418 11628 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:37.286706  9854 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:37.274530 10528 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:37.282763 11806 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:37.288892 11762 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:37.262089  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:37.290706  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:37.291378  9779 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:37.291886 11896 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:26:37.296034  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 128675us
I20260709 12:26:37.296095  9882 raft_consensus.cc:1240] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:37.269361 11902 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:37.299185  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 101742us
I20260709 12:26:37.301877  9854 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:37.261756 11901 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:37.294108 11825 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:37.294087 11628 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.263675 11894 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:26:37.277762 11914 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:37.313100  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:37.299001 11710 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:37.262888 11820 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.316308 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:37.277459 11883 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.333680 11814 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:37.346490  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 55169.5us
I20260709 12:26:37.347071 11931 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:37.349110 11841 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.358431 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:37.352871 11834 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.295284 11655 consensus_queue.cc:1059] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 12:26:37.356015  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 54251.2us
I20260709 12:26:37.365236 11631 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:37.315629  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:37.365999 11655 raft_consensus.cc:3055] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:37.366403 11655 raft_consensus.cc:740] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:37.366479  9884 raft_consensus.cc:2393] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 4: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:37.366986 11881 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:37.367233 11655 consensus_queue.cc:260] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.368403  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:37.369132 11874 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:37.369483  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:26:37.369751  9836 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6620 after lost signal to thread 10557
I20260709 12:26:37.370252  9887 raft_consensus.cc:2410] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:26:37.370970  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:37.368409 11655 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.373111 11914 raft_consensus.cc:697] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:37.374034 11914 consensus_queue.cc:237] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.376752 11884 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:37.376919 11887 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:37.377278 11884 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:37.353093 11882 consensus_meta.cc:287] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.000s
I20260709 12:26:37.361333  9779 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:37.378670 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:37.378543 11882 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.379873 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:37.380378 10527 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.380471 11736 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:37.381136 11882 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:37.382149 11874 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:37.382593 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:37.382638 11874 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:37.383316 10532 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:37.383390 11874 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.385715 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:37.362497  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:37.362782 11825 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.363647 11600 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:37.364857 11931 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.390892  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:37.298462 11806 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:37.309531 11896 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:37.398082  9779 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:37.399721 10496 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:37.399037 11806 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.401124 11814 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:37.401495 11762 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:37.399878 11931 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.406724 10529 raft_consensus.cc:2368] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4.
I20260709 12:26:37.339620 11628 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.424016 10496 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:37.425240  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:37.429780  9958 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:37.427429 10532 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:37.434532  9887 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:37.435966 10497 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:37.455710  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:37.458400  9779 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:37.464732 10527 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:37.432931 11896 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.433640 11710 raft_consensus.cc:697] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 4 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:37.433444 11655 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:37.442735 11882 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:37.466858  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:37.489579  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:37.458156 11600 raft_consensus.cc:697] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 6 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:37.453861 11631 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:37.454213 11932 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:37.472223 11816 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:37.472261 11809 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:37.454068  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:37.473090 10497 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:37.473879 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:37.443990 11759 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.481077 11464 raft_consensus.cc:1064] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
W20260709 12:26:37.482511 11890 log.cc:927] Time spent T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.968s	user 0.003s	sys 0.000s
I20260709 12:26:37.435246 11930 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:37.435501 11814 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:37.466025  9928 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:37.488097 11880 raft_consensus.cc:3055] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:37.490883  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:37.436501 11898 raft_consensus.cc:3055] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:37.456125 11733 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:37.510592 10530 raft_consensus.cc:2368] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5.
W20260709 12:26:37.488602 11754 consensus_meta.cc:287] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.003s
I20260709 12:26:37.509629 11932 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.513224 10497 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:37.487643  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:26:37.517616  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 51684.6us
I20260709 12:26:37.520843 11898 raft_consensus.cc:740] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:37.516765 11600 consensus_queue.cc:237] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.515866  9808 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.509680 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:37.519899  9958 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
W20260709 12:26:37.521347  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 63058.5us
I20260709 12:26:37.548267  9779 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:37.521648 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:37.549371 10530 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.514915 11655 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:37.490113  9778 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:37.519682 11880 raft_consensus.cc:740] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:37.535588 11898 consensus_queue.cc:260] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.552629  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:37.515413 11675 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:37.519284 11814 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.524531 11897 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:37.553299  9958 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:37.556107  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:37.529716  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:37.524716 11719 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:37.530251 11918 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:37.561045  9958 raft_consensus.cc:2393] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 3: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:37.531257 11932 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.548550  9883 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.562259  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:37.553687 11750 consensus_meta.cc:287] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.004s
I20260709 12:26:37.565095  9958 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:37.565747 11700 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:37.570263 11841 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:37.572824  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 82843.8us
I20260709 12:26:37.571357 11640 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:37.575418  9778 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:37.576273  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:37.576874  9813 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.576581 11806 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:37.579228 11759 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:37.579594  9885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 1947) took 1244 ms. Trace:
I20260709 12:26:37.579949  9885 rpcz_store.cc:276] 0709 12:26:36.335575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.335711 (+   136us) service_pool.cc:224] Handling call
0709 12:26:36.336072 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.002847 (+666775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:37.579380 (+576533us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b54001e2b54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:37.579542 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1524916608}
I20260709 12:26:37.581153  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:37.582388 11880 consensus_queue.cc:260] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:37.557031 11884 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:37.558588 11898 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.587146  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:37.561062 11883 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:37.538906 11902 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.574232 10530 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:37.584627  9927 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:37.537883 11754 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.566004  9964 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:37.586231  9779 leader_election.cc:400] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5.
I20260709 12:26:37.630609  9813 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:37.631233  9779 leader_election.cc:403] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:26:37.558579 11661 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.560586 11897 raft_consensus.cc:697] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:26:37.566918 11669 consensus_meta.cc:287] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.587s	user 0.009s	sys 0.005s
W20260709 12:26:37.585565 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.622095 11675 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:37.590651  9778 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:37.597457  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:26:37.591600  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.641055 11669 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.626950 11841 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:37.646575 10531 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: []
W20260709 12:26:37.646773  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 56191.3us
I20260709 12:26:37.647642 10496 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:37.648547 11655 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:37.649156 11655 raft_consensus.cc:697] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:26:37.649850 11939 log.cc:927] Time spent T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:26:37.650142 11655 consensus_queue.cc:237] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.645973 11841 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.651012 11876 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.655606 11841 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.655961 11876 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.659766 11897 consensus_queue.cc:237] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.663910  9853 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:37.665803  9810 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:37.667337  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:37.667359 11661 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:37.623433 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:37.587147 11820 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:37.570827 11628 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:37.571808 11750 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.627939 11754 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:37.628372 11902 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:37.628554  9889 raft_consensus.cc:2393] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 5: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:37.583271 11901 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:37.570794 11710 consensus_queue.cc:237] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.683089 11883 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:37.686558 11669 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:37.587092 11943 raft_consensus.cc:2749] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:37.636535  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:37.636897 11874 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:37.626133  9927 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:37.589635  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:26:37.640677  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 54562.5us
I20260709 12:26:37.695663  9885 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:37.696691  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 70633us
I20260709 12:26:37.621526 11806 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:37.625468 11848 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:37.625298 11880 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.673197 11914 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.646138 11675 raft_consensus.cc:697] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:37.710438  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:37.678560  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:37.709069 11913 consensus_queue.cc:1059] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:26:37.718792 11675 consensus_queue.cc:237] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.721254 11841 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:37.723824  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 45372.8us
I20260709 12:26:37.724896  9885 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:37.713068 10525 raft_consensus.cc:2393] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 6: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:37.706001 11848 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.646487 11478 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.705379  9881 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.690920 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:37.729202  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:37.728631  9853 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:37.705204 11883 raft_consensus.cc:697] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 4 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:37.732790 11825 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:37.717254 11628 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:37.722873 11640 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:26:37.723392  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:37.755684 10530 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.738904 11848 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.713995 11914 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:37.759775  9853 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:37.731010 11901 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:26:37.704066  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.758821 11575 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:37.772854  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:37.773635  9809 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:37.768927  9853 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:37.775245  9853 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:37.771559  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:37.776072  9885 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:37.780030 11600 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:37.769057 11750 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:37.767227 11902 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:37.786379  9853 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:37.787505 11935 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:37.788060 11935 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:37.788532 11935 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.791499  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:37.797183 10533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 584) took 1024 ms. Trace:
I20260709 12:26:37.797621 10533 rpcz_store.cc:276] 0709 12:26:36.772897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.910524 (+137627us) service_pool.cc:224] Handling call
0709 12:26:37.796959 (+886435us) spinlock_profiling.cc:243] Waited 51.8 ms on lock 0x7b5400556254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:37.797081 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119068544}
I20260709 12:26:37.799377  9854 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:37.801539  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:37.793794 11600 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:37.802722 11600 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:37.803433  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:37.838951  9885 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:37.848732  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:37.803174 11600 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.850020  9779 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:37.850217  9885 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:37.833019  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:37.781001 11931 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:37.853966  9887 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:37.854911  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:37.768790 11883 consensus_queue.cc:237] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.806805 11902 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:37.832986 11841 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:37.860035  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:37.860714 11945 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:37.803757 11661 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:37.863871  9815 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.869625  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:37.866807  9928 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:37.873827 10530 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:37.875139  9854 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:37.876407 10530 raft_consensus.cc:1240] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:26:37.876327  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:37.862798 11902 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:37.877888 11841 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:37.884248 11814 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.879056  9806 raft_consensus.cc:2368] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 4. Current term is 5.
I20260709 12:26:37.895205 10529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 581) took 1123 ms. Trace:
I20260709 12:26:37.906311 10529 rpcz_store.cc:276] 0709 12:26:36.772098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.894742 (+122644us) service_pool.cc:224] Handling call
0709 12:26:37.894965 (+1000223us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54000c9254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:37.895125 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021691776}
I20260709 12:26:37.898619  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:37.879529 10530 raft_consensus.cc:1240] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:26:37.907953  9887 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.862470 11669 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:37.881325 11945 raft_consensus.cc:697] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:37.878523 11719 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:26:37.911868 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 186608us
I20260709 12:26:37.897109 10524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 434) took 1540 ms. Trace:
I20260709 12:26:37.902956 11902 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.904536 11841 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.903805 11640 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:37.922761  9815 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:37.923242  9854 leader_election.cc:400] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4.
I20260709 12:26:37.941866  9854 leader_election.cc:403] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:26:37.927376 10497 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:37.925376 10524 rpcz_store.cc:276] 0709 12:26:36.346244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.356509 (+ 10265us) service_pool.cc:224] Handling call
0709 12:26:36.421284 (+ 64775us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:36.471730 (+ 50446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:36.471779 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:36.471842 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:36.471890 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:37.875029 (+1403139us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b54002ed454. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:37.878403 (+  3374us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:37.886657 (+  8254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41027456}
I20260709 12:26:37.935868 11710 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:37.933698 11719 raft_consensus.cc:697] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:37.875700 11661 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:37.948086 10497 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:37.954519  9887 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:37.956969  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:37.957803  9887 raft_consensus.cc:2393] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 5: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:37.958305  9779 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:37.958732  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:37.959431  9887 raft_consensus.cc:2393] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 6: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:37.960068  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:37.957165 10529 raft_consensus.cc:1240] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:37.915156 11896 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:37.964306  9815 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:26:37.938894 11841 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.969205  9853 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:37.970726  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:37.972522  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:37.973392  9815 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.948839 10524 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:37.940299 11901 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:37.922777 11669 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.961227 11820 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:37.956578 11575 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4.
I20260709 12:26:37.940446 11931 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:37.966027 11891 log.cc:927] Time spent T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 1.369s	user 0.003s	sys 0.000s
I20260709 12:26:37.980729 11805 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:37.942773 11914 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:37.966651 11759 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:37.998441 10529 raft_consensus.cc:1240] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:37.961169 11918 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:37.961580 11631 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:37.956048 11640 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.004640  9958 raft_consensus.cc:1240] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:37.965935 11934 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:37.945868 11710 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.969766 11736 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:37.982815  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:38.032123  9887 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:38.011179 11746 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.014351 11478 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.016391 11575 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:37.998042 11820 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:38.002182 11847 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:37.979801 11935 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:37.999610 11901 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.108160  9815 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:38.120887 11913 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:38.107893 11736 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:38.133654  9883 consensus_meta.cc:287] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.000s
I20260709 12:26:38.134056  9883 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
W20260709 12:26:38.125840  9808 consensus_meta.cc:287] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.000s
W20260709 12:26:38.126219 11949 log.cc:927] Time spent T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 12:26:38.028721 11631 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:38.021759 11805 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:38.123931 11820 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:38.126355 11698 consensus_queue.cc:260] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.120558 11575 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:38.131680  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 162540us
I20260709 12:26:38.026911 11759 raft_consensus.cc:697] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:38.032027  9964 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:38.134963  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:38.136364 10497 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:38.137575  9887 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:38.149245 11575 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:38.163501 11805 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:38.163854 11948 log.cc:927] Time spent T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:26:38.139997  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:38.168083  9815 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:38.142539 11877 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.997961 11945 consensus_queue.cc:237] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.003301 11719 consensus_queue.cc:237] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.161149 11631 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:38.131770 11746 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.130250 11841 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:38.138428  9808 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:38.154394 11698 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:38.137439 11913 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.179623  9815 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:38.154839 11839 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:38.169652 11741 raft_consensus.cc:3055] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:38.168277 11847 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:38.168414 11640 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:38.036018 11934 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:38.216158  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:38.192616  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 56758.2us
W20260709 12:26:38.210536 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.224578 10532 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:26:38.244495  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 208865us
I20260709 12:26:38.187994 11661 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:38.189754 11762 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5.
I20260709 12:26:38.188235 11814 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:38.252786  9779 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
W20260709 12:26:38.254834 11898 consensus_meta.cc:287] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.665s	user 0.015s	sys 0.006s
W20260709 12:26:38.257805 11880 consensus_meta.cc:287] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.548s	user 0.007s	sys 0.010s
I20260709 12:26:38.191792 11741 raft_consensus.cc:740] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:38.206645  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:38.261560 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:38.249801 11847 raft_consensus.cc:697] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:38.250746 11896 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:38.190109 11877 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:38.253953 11914 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:26:38.253948 11901 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:38.250162 11640 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:38.262450 11698 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:38.279037 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:38.280241  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:38.207898 11759 consensus_queue.cc:237] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:38.284087 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:38.273408 11669 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:38.288790  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:38.291023  9883 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 1.
I20260709 12:26:38.287197  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
W20260709 12:26:38.275959 10528 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 679) took 2458 ms (client timeout 1583 ms). Trace:
I20260709 12:26:38.278198 11710 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:38.292855 10497 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:38.294473  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:26:38.285808 11932 consensus_meta.cc:287] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.715s	user 0.011s	sys 0.000s
I20260709 12:26:38.294766  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:38.295300  9815 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:38.268538 11902 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.299270  9883 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:38.285082 11935 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:38.286381 11698 raft_consensus.cc:697] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 5 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:38.273000 11600 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:38.288064 11736 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:38.301972 11746 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:38.305627 11841 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:38.302064 11963 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:26:38.294392 10528 rpcz_store.cc:269] 0709 12:26:35.817126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.837674 (+ 20548us) service_pool.cc:224] Handling call
0709 12:26:38.275757 (+2438083us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b54002ee0d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:38.275856 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986576128}
I20260709 12:26:38.307144 11934 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:38.312367 11631 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:38.312904 11631 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:38.313591 11698 consensus_queue.cc:237] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:38.314901 11631 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:38.315479  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.319154 10532 raft_consensus.cc:3055] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:38.319464 10532 raft_consensus.cc:740] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:38.320011 10532 consensus_queue.cc:260] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.321419 10532 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:38.300361 11669 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:38.285969 11640 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:38.323766  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:38.303776 11847 consensus_queue.cc:237] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.305670 11913 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:38.332731 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:38.334149  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1062) took 1525 ms. Trace:
I20260709 12:26:38.338202  9884 rpcz_store.cc:276] 0709 12:26:36.808904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.836964 (+ 28060us) service_pool.cc:224] Handling call
0709 12:26:38.333856 (+1496892us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b540043b7d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:38.334062 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1177121152}
I20260709 12:26:38.339493  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:38.339977 11915 raft_consensus.cc:3055] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:38.340031  9884 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:38.340567 11915 raft_consensus.cc:740] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:38.341086  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:38.341619  9884 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:38.343626 10532 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:26:38.344014  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:38.344035 10532 pending_rounds.cc:85] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: Aborting all ops after (but not including) 4
I20260709 12:26:38.344753  9884 raft_consensus.cc:2393] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 4: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:38.344785 10532 pending_rounds.cc:107] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:26:38.345331 10532 raft_consensus.cc:2889] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:38.346518  9779 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:38.346984  9883 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:38.347191  9815 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:38.347334  9779 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:38.348805  9779 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:38.341486 11915 consensus_queue.cc:260] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.286772 11741 consensus_queue.cc:260] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.320514 11963 raft_consensus.cc:697] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:38.350448  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:38.321700 11746 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.351426  9853 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:38.301298 11932 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.354868 11661 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:38.355275  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:38.359211 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.303263 11575 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:38.325958 11669 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:38.362242  9883 raft_consensus.cc:2410] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:26:38.349684 11896 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:38.353152 11898 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:38.360533 10528 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:38.374181  9813 raft_consensus.cc:2393] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 4: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:38.366163 11915 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:38.369930 11669 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:38.383836  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.352922 11710 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:26:38.369689 11741 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:38.387195 11698 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:38.389570 11698 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.379300 11913 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:38.371742 11898 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.377882  9883 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:38.370597 11896 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:38.367714 11640 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:38.387766 11719 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.390631 11575 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:38.392015 11600 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:38.369766 11934 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:38.371289 11661 raft_consensus.cc:697] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:38.368229 11746 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:38.410473 11834 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:38.411928  9881 consensus_meta.cc:287] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.645s	user 0.009s	sys 0.003s
I20260709 12:26:38.420897  9881 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:38.422865 11746 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:38.423321  9881 raft_consensus.cc:1240] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:38.423501 11934 raft_consensus.cc:697] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:38.424467 11934 consensus_queue.cc:237] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.412223 11698 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:38.426249 11963 consensus_queue.cc:237] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:38.427871 10497 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:38.427738 11661 consensus_queue.cc:237] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:38.430464 11834 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:38.426957 11719 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:38.430981 11834 raft_consensus.cc:697] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:38.396520  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:38.397418 11898 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:38.414026 11896 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:38.435178 11719 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:38.433125 11834 consensus_queue.cc:237] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:38.436764  9956 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 275) took 2497 ms (client timeout 1806 ms). Trace:
I20260709 12:26:38.398000 11877 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:38.435787  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 360) took 1747 ms. Trace:
W20260709 12:26:38.441278  9956 rpcz_store.cc:269] 0709 12:26:35.939298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.939950 (+   652us) service_pool.cc:224] Handling call
0709 12:26:38.436572 (+2496622us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b54001513d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:38.436669 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1502244224}
I20260709 12:26:38.442901  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:38.443765  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:38.444286  9956 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 3: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:38.441483  9886 rpcz_store.cc:276] 0709 12:26:36.688552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.689308 (+   756us) service_pool.cc:224] Handling call
0709 12:26:36.689618 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:36.995367 (+305749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:38.435565 (+1440198us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b5400216e54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:38.435727 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":682771712}
I20260709 12:26:38.447338  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:38.447885  9956 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:38.450017 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:38.412925 11913 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.439177  9807 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:38.461910 10531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36672 (request call id 588) took 1398 ms. Trace:
I20260709 12:26:38.464627 10531 rpcz_store.cc:276] 0709 12:26:37.063489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.063703 (+   214us) service_pool.cc:224] Handling call
0709 12:26:37.064068 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.646992 (+582924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:38.461668 (+814676us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54006702d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:38.461844 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1339159424}
I20260709 12:26:38.450376 11902 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:38.476724 11876 consensus_meta.cc:287] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.820s	user 0.007s	sys 0.014s
I20260709 12:26:38.484767  9881 raft_consensus.cc:1275] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:38.487787  9956 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:38.488508 11669 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.491184  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:38.491881  9956 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:38.477200 11876 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:38.471863 11719 consensus_queue.cc:1059] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:26:38.501560 11876 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:38.494011 11848 consensus_meta.cc:287] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.732s	user 0.012s	sys 0.000s
I20260709 12:26:38.502427  9809 raft_consensus.cc:2393] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 4: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:38.502602 11848 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:38.503183 11913 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:38.493785  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:38.507362 10532 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:38.508816  9854 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:38.489423 11932 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:38.504733 11848 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:38.517664  9808 raft_consensus.cc:1240] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:26:38.520540  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:38.521376  9885 raft_consensus.cc:2410] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:26:38.521718  9928 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:38.522217 11876 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.522804 11913 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:38.522895 11876 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.516319 11710 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:38.536384 11896 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:38.539386 11847 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:38.540270  9815 raft_consensus.cc:2393] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 6: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:38.496099 11820 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.543079 11820 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:38.543844  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:38.544405  9815 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:38.546806 10530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 691) took 1154 ms. Trace:
I20260709 12:26:38.530510 11710 raft_consensus.cc:697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:38.547241 10530 rpcz_store.cc:276] 0709 12:26:37.392243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.909981 (+517738us) service_pool.cc:224] Handling call
0709 12:26:37.910394 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:38.018308 (+107914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:38.018357 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:38.018415 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:38.018467 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:38.546597 (+528130us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54005ea1d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:38.546639 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:38.546748 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247471360}
I20260709 12:26:38.549003  9958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1069) took 1235 ms. Trace:
I20260709 12:26:38.548512 11710 consensus_queue.cc:237] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.549350  9958 rpcz_store.cc:276] 0709 12:26:37.313946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.642686 (+328740us) service_pool.cc:224] Handling call
0709 12:26:37.642982 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:38.026876 (+383894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:38.548792 (+521916us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54003bae54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:38.548936 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":826128768}
I20260709 12:26:38.551321  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:38.552052  9881 raft_consensus.cc:2393] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 4: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:38.552006 11881 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:38.552630 11881 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.635443  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:38.637087  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:26:38.570953  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:38.638236  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 116571us
I20260709 12:26:38.635643 11876 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:38.612200  9888 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54428 (request call id 364) took 1868 ms (client timeout 1704 ms). Trace:
W20260709 12:26:38.529994 11464 raft_consensus.cc:1068] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b: Unable to promote non-voter f5208640a51f493e930ce4f64ceeed0b: Illegal state: Replica 963185e117384b2085d7cea02a64478b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
W20260709 12:26:38.643481  9888 rpcz_store.cc:269] 0709 12:26:36.743617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.743949 (+   332us) service_pool.cc:224] Handling call
0709 12:26:38.612006 (+1868057us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54003c6254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:38.612130 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":772138880}
I20260709 12:26:38.646101  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:38.647414  9888 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:38.585245 11813 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:38.638237  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:38.613121  9886 raft_consensus.cc:1240] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:38.640453  9815 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:26:38.651048 11813 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.653101 11813 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:38.653146 11898 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.654196 11625 consensus_queue.cc:1059] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:38.655467 11625 raft_consensus.cc:3055] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:38.655900 11625 raft_consensus.cc:740] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:38.656908 11898 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:38.634382 11896 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:38.664577  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:38.668056 11899 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:38.666985  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:38.656754 11625 consensus_queue.cc:260] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:38.675531 10530 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:26:38.713248 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:38.679790 10531 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:26:38.714197 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:38.714488 10531 pending_rounds.cc:85] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: Aborting all ops after (but not including) 5
I20260709 12:26:38.714736 10531 pending_rounds.cc:107] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:26:38.714951 10531 raft_consensus.cc:2889] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:38.715229 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:38.715772 10530 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:38.715934 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:38.716482 10531 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:26:38.681193 10532 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:38.683472  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:38.635491  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:38.689013  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:38.689188 11640 consensus_queue.cc:1059] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:38.692812  9928 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:26:38.697059 11926 log.cc:927] Time spent T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195: Append to log took a long time: real 1.529s	user 0.006s	sys 0.000s
I20260709 12:26:38.722528 11881 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:38.698410  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 1762) took 1710 ms. Trace:
I20260709 12:26:38.724941 10531 raft_consensus.cc:1240] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:26:38.694096  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:38.702943 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:26:38.726486 10527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 596) took 1288 ms (client timeout 1612 ms). Trace:
W20260709 12:26:38.727082 10527 rpcz_store.cc:269] 0709 12:26:37.438525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.465654 (+ 27129us) service_pool.cc:224] Handling call
0709 12:26:38.702752 (+1237098us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b58001f1a98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:38.726377 (+ 23625us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2617088}
I20260709 12:26:38.710506 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:38.719368  9958 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 1.
I20260709 12:26:38.719442  9962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 286) took 1519 ms. Trace:
I20260709 12:26:38.728634 10529 raft_consensus.cc:2368] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5.
I20260709 12:26:38.728740  9962 rpcz_store.cc:276] 0709 12:26:37.199420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.229538 (+ 30118us) service_pool.cc:224] Handling call
0709 12:26:38.688882 (+1459344us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b5800135f98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:38.719153 (+ 30271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2746240}
I20260709 12:26:38.723654  9959 rpcz_store.cc:276] 0709 12:26:36.987645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.987775 (+   130us) service_pool.cc:224] Handling call
0709 12:26:36.988045 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.291960 (+303915us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:26:37.292224 (+   264us) log.cc:844] Serialized 14 byte log entry
0709 12:26:37.448615 (+156391us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:37.448684 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:37.448740 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:38.698064 (+1249324us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b5400115654. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:38.698134 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:38.698326 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":596,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":331,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"spinlock_wait_cycles":698493312,"thread_start_us":155702,"threads_started":1,"wal-append.queue_time_us":217472,"wal-append.run_cpu_time_us":1223,"wal-append.run_wall_time_us":1072482}
I20260709 12:26:38.732220 11640 raft_consensus.cc:3055] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:38.731977 11913 consensus_queue.cc:1059] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:38.732709 11640 raft_consensus.cc:740] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:38.733686 11828 raft_consensus.cc:3055] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:38.734721  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:38.731745  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:38.735612  9961 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 285) took 1540 ms (client timeout 1542 ms). Trace:
W20260709 12:26:38.736101  9961 rpcz_store.cc:269] 0709 12:26:37.195143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.196146 (+  1003us) service_pool.cc:224] Handling call
0709 12:26:38.734576 (+1538430us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b5800135f98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:38.735551 (+   975us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11282304}
I20260709 12:26:38.736370  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:38.740417  9963 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 289) took 1522 ms (client timeout 1920 ms). Trace:
W20260709 12:26:38.741096  9963 rpcz_store.cc:269] 0709 12:26:37.218114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.229382 (+ 11268us) service_pool.cc:224] Handling call
0709 12:26:38.683336 (+1453954us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b5800135f98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:38.740314 (+ 56978us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2740992}
I20260709 12:26:38.731774 11899 consensus_queue.cc:1059] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:26:38.734146 11828 raft_consensus.cc:740] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:38.745223 11700 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:38.734153 11839 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.746023 11625 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:38.748210 11669 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:38.754829 11700 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:38.771623 11874 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:38.777168 11959 log.cc:927] Time spent T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259: Append to log took a long time: real 0.635s	user 0.002s	sys 0.000s
W20260709 12:26:38.779600 11970 log.cc:927] Time spent T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
W20260709 12:26:38.791205 11954 log.cc:927] Time spent T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.661s	user 0.000s	sys 0.002s
W20260709 12:26:38.793138 11972 log.cc:927] Time spent T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.281s	user 0.010s	sys 0.006s
I20260709 12:26:38.766875 11828 consensus_queue.cc:260] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.802690 11914 raft_consensus.cc:3055] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:38.803392 11914 raft_consensus.cc:740] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:38.804778 11914 consensus_queue.cc:260] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:38.806900 11914 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:38.849300  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:38.869056  9711 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59986 (request call id 330) took 4686 ms. Trace:
W20260709 12:26:38.871979  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 320710us
W20260709 12:26:38.888034  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:38.888576  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:38.889490  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:38.891638  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.890235  9779 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:38.612327  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:38.893700  9810 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:26:38.893592  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:38.895685  9806 raft_consensus.cc:2368] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4.
W20260709 12:26:38.904533  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:38.911578  9853 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.868s (SENT) [suppressed 12 similar messages]
W20260709 12:26:38.913671  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.900569  9807 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:38.906679  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 302) took 1248 ms. Trace:
I20260709 12:26:38.914538  9813 rpcz_store.cc:276] 0709 12:26:37.658001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.667103 (+  9102us) service_pool.cc:224] Handling call
0709 12:26:38.906158 (+1239055us) spinlock_profiling.cc:243] Waited 706 ms on lock 0x7b54001f5754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:38.906471 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1623914368}
I20260709 12:26:38.552989  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:38.869654  9711 rpcz_store.cc:276] 0709 12:26:34.182542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.182770 (+   228us) service_pool.cc:224] Handling call
0709 12:26:38.868756 (+4685986us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:36.523011 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:36.591466 (+ 68455us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:36.593466 (+  2000us) write_op.cc:435] Acquired schema lock
0709 12:26:36.595169 (+  1703us) tablet.cc:662] Decoding operations
0709 12:26:36.663707 (+ 68538us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:36.707179 (+ 43472us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:36.722496 (+ 15317us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:36.747925 (+ 25429us) tablet.cc:701] Row locks acquired
0709 12:26:36.747958 (+    33us) write_op.cc:260] PREPARE: finished
0709 12:26:36.776031 (+ 28073us) write_op.cc:270] Start()
0709 12:26:36.779711 (+  3680us) write_op.cc:276] Timestamp: P: 1783599996773719 usec, L: 0
0709 12:26:36.781118 (+  1407us) op_driver.cc:348] REPLICATION: starting
0709 12:26:37.926053 (+1144935us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b54001ac0a0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e493ec4 00007f2f8e5178d7 00007f2f8e517e09 00007f2f91f52581 00007f2f91f51d58 00007f2f91f569f1 00007f2f91f569a9 00007f2f91f56939 00007f2f91f56901 00007f2f91f55b2d
0709 12:26:38.009454 (+ 83401us) log.cc:844] Serialized 538 byte log entry
0709 12:26:38.775442 (+765988us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b1800040660. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b3fd2a6 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db
0709 12:26:38.776310 (+   868us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:26:38.806384 (+ 30074us) op_driver.cc:464] REPLICATION: finished
0709 12:26:38.807684 (+  1300us) write_op.cc:301] APPLY: starting
0709 12:26:38.807792 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:38.807919 (+   127us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:38.807949 (+    30us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:38.808396 (+   447us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:38.808611 (+   215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:26:38.808679 (+    68us) write_op.cc:312] APPLY: finished
0709 12:26:38.808910 (+   231us) log.cc:844] Serialized 23 byte log entry
0709 12:26:38.809861 (+   951us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:38.809971 (+   110us) write_op.cc:454] Released schema lock
0709 12:26:38.810032 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:38.810499 (+   467us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:38.810540 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":265155,"reported_tablets":12,"spinlock_wait_cycles":12544,"child_traces":[["op",{"apply.queue_time_us":1025,"apply.run_cpu_time_us":1867,"apply.run_wall_time_us":2774,"num_ops":1,"prepare.queue_time_us":318102,"prepare.run_cpu_time_us":24517,"prepare.run_wall_time_us":1642640,"raft.queue_time_us":7341,"raft.run_cpu_time_us":898,"raft.run_wall_time_us":2300,"replication_time_us":2023372,"spinlock_wait_cycles":43151488,"thread_start_us":377639,"threads_started":4,"wal-append.queue_time_us":129587}]]}
I20260709 12:26:38.699671  9882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1080) took 1609 ms. Trace:
I20260709 12:26:38.918716  9882 rpcz_store.cc:276] 0709 12:26:37.090334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.090512 (+   178us) service_pool.cc:224] Handling call
0709 12:26:37.293026 (+202514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.310688 (+ 17662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:38.699411 (+1388723us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400217d50. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:38.699576 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464853376}
I20260709 12:26:38.920341  9884 raft_consensus.cc:1240] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:38.920478  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:38.908355  9883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1084) took 1205 ms. Trace:
I20260709 12:26:38.922537  9883 rpcz_store.cc:276] 0709 12:26:37.703066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.411412 (+708346us) service_pool.cc:224] Handling call
0709 12:26:38.411710 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:38.412051 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:38.412080 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:38.412508 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 12:26:38.636179 (+223671us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:38.636225 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:38.636303 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:38.907740 (+271437us) raft_consensus.cc:1685] finished
0709 12:26:38.907782 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:38.908101 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":975,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":8826,"thread_start_us":176434,"threads_started":1,"wal-append.queue_time_us":308319}
I20260709 12:26:38.917946  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:38.925350  9881 raft_consensus.cc:2393] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 4: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:38.925454  9809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 1831) took 1228 ms. Trace:
I20260709 12:26:38.925848  9809 rpcz_store.cc:276] 0709 12:26:37.697192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.783874 (+ 86682us) service_pool.cc:224] Handling call
0709 12:26:38.925072 (+1141198us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b54001f5254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:38.925295 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1630068096}
I20260709 12:26:38.922127  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:38.926946  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:38.933929  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:38.935423  9812 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:38.936942  9854 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:38.937780  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:38.938868  9814 raft_consensus.cc:2368] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4.
I20260709 12:26:38.940410  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:38.941354  9811 raft_consensus.cc:2393] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 5: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:38.941712  9807 raft_consensus.cc:1240] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:26:38.941780  9814 raft_consensus.cc:1240] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:38.942662  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:38.942684  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:38.700212  9888 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:38.690122  9890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1059) took 1882 ms. Trace:
I20260709 12:26:38.951573  9890 rpcz_store.cc:276] 0709 12:26:36.807732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.851079 (+ 43347us) service_pool.cc:224] Handling call
0709 12:26:36.851385 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.091033 (+239648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:38.689886 (+1598853us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54003f98d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:38.690059 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549658368}
I20260709 12:26:38.952275  9889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54428 (request call id 372) took 1727 ms. Trace:
I20260709 12:26:38.952394  9808 raft_consensus.cc:1240] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:38.952890  9889 rpcz_store.cc:276] 0709 12:26:37.224426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.226085 (+  1659us) service_pool.cc:224] Handling call
0709 12:26:38.951762 (+1725677us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b540043bcd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:38.952045 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889590656}
I20260709 12:26:38.956099  9806 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:38.957659  9808 raft_consensus.cc:1240] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:38.959266  9810 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:26:38.967725  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 77732.7us
I20260709 12:26:38.975214  9807 raft_consensus.cc:1240] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:38.977666  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:38.979151  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 256849us
I20260709 12:26:38.985507  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:38.988095  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:38.988516  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:38.989115  9959 raft_consensus.cc:2393] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:38.989740  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55946 (request call id 1778) took 1313 ms. Trace:
W20260709 12:26:38.989951  9955 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55946 (request call id 1770) took 1985 ms (client timeout 1868 ms). Trace:
W20260709 12:26:38.993256  9955 rpcz_store.cc:269] 0709 12:26:37.004566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.005142 (+   576us) service_pool.cc:224] Handling call
0709 12:26:38.988118 (+1982976us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b5800135f98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:38.989792 (+  1674us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10766208}
I20260709 12:26:38.994302  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:38.994841  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:38.995169  9961 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:38.992424  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:38.991735  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:38.998706  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:38.999377  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:38.999621  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:39.000125  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:39.000840  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:39.001221  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:39.001575  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:39.004298  9962 raft_consensus.cc:1240] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:39.005384  9962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1074) took 1690 ms. Trace:
I20260709 12:26:39.005507  9955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1073) took 1690 ms. Trace:
W20260709 12:26:39.007689 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.008069  9963 raft_consensus.cc:2393] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:39.010306 10533 raft_consensus.cc:1240] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:26:39.010522 11464 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:38.990192  9959 rpcz_store.cc:276] 0709 12:26:37.676130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.987315 (+1311185us) service_pool.cc:224] Handling call
0709 12:26:38.989640 (+  2325us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:39.012120 10528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.019s	sys 0.015s
I20260709 12:26:39.011583 11464 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.012413  9959 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 3. Current term is 4. Ops: []
W20260709 12:26:39.012688 10528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.019s	sys 0.015s
I20260709 12:26:39.012991 10533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36672 (request call id 599) took 1372 ms. Trace:
I20260709 12:26:39.014884 11464 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:39.017168 11464 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.988777  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:39.013127  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1079) took 1343 ms. Trace:
I20260709 12:26:39.030311  9959 rpcz_store.cc:276] 0709 12:26:37.669987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.011715 (+1341728us) service_pool.cc:224] Handling call
0709 12:26:39.012137 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.012860 (+   723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.013044 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:39.005950  9962 rpcz_store.cc:276] 0709 12:26:37.315196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.002870 (+1687674us) service_pool.cc:224] Handling call
0709 12:26:39.003513 (+   643us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:39.004932 (+  1419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.005257 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:39.013618 10533 rpcz_store.cc:276] 0709 12:26:37.640566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.028418 (+387852us) service_pool.cc:224] Handling call
0709 12:26:38.028740 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:39.010961 (+982221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.012675 (+  1714us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b540031b0d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:39.012925 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2255575424}
I20260709 12:26:39.017906  9956 raft_consensus.cc:1240] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:39.017954 11464 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:39.006039  9955 rpcz_store.cc:276] 0709 12:26:37.314922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.002012 (+1687090us) service_pool.cc:224] Handling call
0709 12:26:39.004564 (+  2552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.005031 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:39.005068 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:39.005133 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:39.005205 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.005272 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:39.005438 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:39.040477  9956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1080) took 1365 ms. Trace:
I20260709 12:26:39.047087  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 1777) took 1371 ms. Trace:
I20260709 12:26:39.047469  9959 rpcz_store.cc:276] 0709 12:26:37.675756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.045600 (+1369844us) service_pool.cc:224] Handling call
0709 12:26:39.046223 (+   623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.046672 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:39.046696 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:39.046764 (+    68us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:39.046844 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.046901 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:39.047010 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:39.048004  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:39.049816  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:39.052824  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:39.054402  9807 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:39.053977  9955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 1783) took 1359 ms. Trace:
I20260709 12:26:39.049816  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1081) took 1284 ms. Trace:
W20260709 12:26:39.010588 10525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 436) took 2662 ms (client timeout 1735 ms). Trace:
I20260709 12:26:39.044334  9956 rpcz_store.cc:276] 0709 12:26:37.670232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.016684 (+1346452us) service_pool.cc:224] Handling call
0709 12:26:39.017362 (+   678us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.034473 (+ 17111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.035771 (+  1298us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:39.025961 11624 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.024791 11719 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.058669  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:39.055851  9955 rpcz_store.cc:276] 0709 12:26:37.694796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.048388 (+1353592us) service_pool.cc:224] Handling call
0709 12:26:39.049056 (+   668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.053036 (+  3980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:39.053094 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:39.053186 (+    92us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:39.053252 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.053434 (+   182us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:39.053785 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50816}
W20260709 12:26:39.068773  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.069209 11929 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.024286 11879 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:26:39.105558 10531 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:39.072299 11813 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:39.072508  9927 leader_election.cc:400] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4.
I20260709 12:26:39.107002  9927 leader_election.cc:403] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:26:39.106906 11813 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.025765 11640 consensus_queue.cc:260] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:39.056952  9959 rpcz_store.cc:276] 0709 12:26:37.765869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.048538 (+1282669us) service_pool.cc:224] Handling call
0709 12:26:39.049008 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.049441 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:39.049472 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:39.049540 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:39.049578 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.049636 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:39.049756 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:39.133634 11897 consensus_queue.cc:1059] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:39.135285 11733 raft_consensus.cc:3055] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:39.135722 11733 raft_consensus.cc:740] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:39.136811 11733 consensus_queue.cc:260] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.137995 11733 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:39.091413 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 50429.8us
I20260709 12:26:39.094460  9958 raft_consensus.cc:2393] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 4: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:39.141727 10497 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:39.142163  9958 raft_consensus.cc:1240] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:39.142658 11825 consensus_queue.cc:1059] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:39.142959 11834 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:39.094892 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:39.096963  9963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1076) took 1764 ms. Trace:
I20260709 12:26:39.098006 11762 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:39.143528 11825 consensus_queue.cc:1243] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer 963185e117384b2085d7cea02a64478b log is divergent from this leader: its last log entry 5.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:26:39.144409 11762 raft_consensus.cc:697] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:39.145406 11731 consensus_queue.cc:1059] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:39.145790 11762 consensus_queue.cc:237] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.146756 11731 raft_consensus.cc:3055] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:39.147192 11731 raft_consensus.cc:740] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:39.094728  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:39.143951  9963 rpcz_store.cc:276] 0709 12:26:37.332712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.009082 (+1676370us) service_pool.cc:224] Handling call
0709 12:26:39.096276 (+ 87194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.096621 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:39.096647 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:39.096706 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:39.096736 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.096789 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:39.096882 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:39.102336 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:39.143622 11834 raft_consensus.cc:697] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:39.099661 11765 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.103360 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:39.149394 10527 raft_consensus.cc:2393] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 4: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:39.149753 10529 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:39.150538 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:39.151434 10527 raft_consensus.cc:2368] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6.
I20260709 12:26:39.102923 11874 raft_consensus.cc:1064] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:39.103742 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:39.155099 11731 consensus_queue.cc:260] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:39.113166 11921 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:39.114116 11899 consensus_queue.cc:1059] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:39.115896  9884 raft_consensus.cc:1240] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:39.116212  9890 raft_consensus.cc:1240] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:39.116657 11719 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.116868  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:39.117918  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:39.118805  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:39.119128  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:39.170094  9885 raft_consensus.cc:2393] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 5: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:39.170949 11834 consensus_queue.cc:237] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.120121  9883 raft_consensus.cc:1240] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:39.174358  9882 raft_consensus.cc:2368] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4.
I20260709 12:26:39.119880 11736 consensus_queue.cc:1059] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:39.175113 11746 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:39.023727 11881 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:26:39.126207 11882 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.127435 10496 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:39.128630  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:26:39.075979 10525 rpcz_store.cc:269] 0709 12:26:36.347561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.354398 (+  6837us) service_pool.cc:224] Handling call
0709 12:26:37.215085 (+860687us) spinlock_profiling.cc:243] Waited 7.39 ms on lock 0x7b58001f1a98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7e9c 00007f2f8b3f7a5b 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:39.010004 (+1794919us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54004a2c54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:39.010255 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1101250048}
W20260709 12:26:39.090632  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 120417us
I20260709 12:26:39.139175 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:39.142851  9958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 1785) took 1285 ms. Trace:
I20260709 12:26:39.143565 11682 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4.
I20260709 12:26:39.179351  9958 rpcz_store.cc:276] 0709 12:26:37.857792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.141479 (+1283687us) service_pool.cc:224] Handling call
0709 12:26:39.141873 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.142592 (+   719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.142792 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:39.147831 11945 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:39.103969 11929 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.149407 11765 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.106832 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:39.143079 10497 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:39.156445 11828 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:39.156925 11874 consensus_queue.cc:237] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.161450 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:39.163004 11839 consensus_queue.cc:1059] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:39.164002 11813 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:39.164213 11903 raft_consensus.cc:3055] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:39.037122  9778 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:39.089146  9961 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
W20260709 12:26:39.084326  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 172962us
W20260709 12:26:39.168574  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 50341.2us
I20260709 12:26:39.175777  9963 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:39.175720 11736 raft_consensus.cc:3055] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:39.175803 11746 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:39.194669 11464 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:39.194933 11736 raft_consensus.cc:740] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:39.202436 11719 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.204190 11736 consensus_queue.cc:260] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.205324 11719 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:39.206187 11882 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.208673 11882 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:39.211841 11945 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.215085  9955 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:26:39.220444  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 183524us
I20260709 12:26:39.222496  9958 raft_consensus.cc:1240] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:26:39.220571 11661 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:39.223232 11848 consensus_queue.cc:1059] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:39.223577 11919 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:39.224242 11848 raft_consensus.cc:3055] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:39.224633 11848 raft_consensus.cc:740] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:39.224915 11930 consensus_queue.cc:1059] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:39.225769 11626 raft_consensus.cc:3055] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:39.226056 11644 raft_consensus.cc:3055] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:39.226135 11626 raft_consensus.cc:740] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:39.226567 11644 raft_consensus.cc:740] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:39.227326 11626 consensus_queue.cc:260] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:39.227543 11644 consensus_queue.cc:260] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.228581 11626 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:39.228868 11644 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:39.230497 11731 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:39.235829 11640 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:39.236074 11746 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:39.238402 11736 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:39.205370  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.225570 11848 consensus_queue.cc:260] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:39.192076 11899 consensus_queue.cc:1243] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Peer 4104e34a61b7448281d6d91ce23ebf71 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:26:39.250373  9956 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:39.247849 10529 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
W20260709 12:26:39.257190  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 71720.7us
I20260709 12:26:39.192682 11903 raft_consensus.cc:740] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:39.258101 11809 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:39.186383 11624 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.246853 11746 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:39.247313 11945 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:39.271469 11813 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:39.288138  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:26:39.304347 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 177215us
I20260709 12:26:39.303323 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:39.307508 10532 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:39.314832  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 1784) took 1524 ms. Trace:
I20260709 12:26:39.315236  9959 rpcz_store.cc:276] 0709 12:26:37.790511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.131017 (+1340506us) service_pool.cc:224] Handling call
0709 12:26:39.131470 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.131914 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:26:39.266526 (+134612us) log.cc:844] Serialized 14 byte log entry
0709 12:26:39.314463 (+ 47937us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:39.314515 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:39.314569 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.314631 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:39.314747 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":182,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":149973,"threads_started":2}
I20260709 12:26:39.317997 11624 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:39.318569 11878 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.319216 11878 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.324224 11878 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:39.333248 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 190343us
W20260709 12:26:39.334005  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 65931.8us
I20260709 12:26:39.310950 11848 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:39.335273  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 56380.7us
W20260709 12:26:39.335642  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.335830 11914 raft_consensus.cc:2764] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:26:39.334890 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:39.313349 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:39.345397  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.345981  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:39.347604 10529 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:39.358161 11813 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:39.367594  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:39.369405  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:39.370255  9887 raft_consensus.cc:1217] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 4 LEADER]: Deduplicated request from leader. Original: 2.5->[3.6-3.6]   Dedup: 3.6->[]
I20260709 12:26:39.370814  9807 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:39.371189  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:39.372326  9815 raft_consensus.cc:1275] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:39.372522  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:39.370836  9887 raft_consensus.cc:1240] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 4 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:26:39.373307 11903 consensus_queue.cc:260] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.374408 11903 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:39.374648 11765 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:39.374439 11813 raft_consensus.cc:697] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:39.376016  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:39.376271 11813 consensus_queue.cc:237] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.344465 11644 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.378206 11644 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.380242 11913 raft_consensus.cc:3055] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:39.380789 11913 raft_consensus.cc:740] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:39.351281 11731 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:26:39.386346 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:39.386472  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:39.388144  9886 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:39.388718  9779 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:39.389858 10530 raft_consensus.cc:1240] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:39.397428  9778 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:26:39.387625  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.381651 11913 consensus_queue.cc:260] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:39.405849  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:39.402228  9962 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:26:39.335889 11700 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.311800 11746 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:39.412608 11746 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:39.419027  9887 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:26:39.419412  9887 pending_rounds.cc:85] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 3
I20260709 12:26:39.419647  9887 pending_rounds.cc:107] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 12:26:39.419919  9887 raft_consensus.cc:2889] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:39.420991  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:39.421738 11626 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:39.422197  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:39.380302 11644 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:39.406584  9962 pending_rounds.cc:85] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 5
W20260709 12:26:39.431787  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.431979  9962 pending_rounds.cc:107] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:26:39.432255  9962 raft_consensus.cc:2889] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:39.410743 11700 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:39.410815  9853 leader_election.cc:400] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 4. Current term is 5.
I20260709 12:26:39.405700  9956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 1792) took 1110 ms. Trace:
I20260709 12:26:39.437592  9956 rpcz_store.cc:276] 0709 12:26:38.295407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.165873 (+870466us) service_pool.cc:224] Handling call
0709 12:26:39.187378 (+ 21505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.250840 (+ 63462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.398766 (+147926us) spinlock_profiling.cc:243] Waited 55.9 ms on lock 0x7b5400089dd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:39.405640 (+  6874us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128511744}
I20260709 12:26:39.422564 11750 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:39.438951  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 50331.3us
W20260709 12:26:39.440886  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 43540.7us
I20260709 12:26:39.447975 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:39.441532 11624 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:39.464442  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:39.442806  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:39.414108  9960 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:39.436550  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:39.465281 10532 raft_consensus.cc:2393] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 4: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:26:39.469048  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 58359.1us
I20260709 12:26:39.472518  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:39.476696  9955 raft_consensus.cc:1275] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:39.477137 11750 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.478583 10529 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:39.479375 11750 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:26:39.479482  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:39.480192  9958 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:39.480540 11624 raft_consensus.cc:697] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:39.481153  9887 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:39.481719 11624 consensus_queue.cc:237] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:39.483379  9882 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:39.476637  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:39.486747 11929 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:39.487219 11750 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:39.487582  9884 raft_consensus.cc:1240] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:39.486625 11834 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:39.488473  9778 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:26:39.519065  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.516731 11878 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:39.517675 11644 consensus_queue.cc:1048] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:26:39.523252 11878 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.438354 11913 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:39.548470  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.548717  9963 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:39.488400 11879 consensus_queue.cc:1059] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:26:39.550446  9962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 1787) took 1252 ms. Trace:
W20260709 12:26:39.531261 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 98662.9us
I20260709 12:26:39.551036  9962 rpcz_store.cc:276] 0709 12:26:38.280083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.147145 (+867062us) service_pool.cc:224] Handling call
0709 12:26:39.147521 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.438451 (+290930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.532042 (+ 93591us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b5400114254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:39.532218 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":584707968}
I20260709 12:26:39.552651  9963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 1791) took 1255 ms. Trace:
I20260709 12:26:39.553136  9963 rpcz_store.cc:276] 0709 12:26:38.293744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.165864 (+872120us) service_pool.cc:224] Handling call
0709 12:26:39.175588 (+  9724us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.549035 (+373447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.549214 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:39.438956 11698 raft_consensus.cc:2804] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:39.488729 10524 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 12:26:39.560390  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.563006  9853 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:39.565843  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:39.532377 11644 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:26:39.574815  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.550530 11881 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.518546 11800 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:26:39.556288 11698 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:39.584642  9955 raft_consensus.cc:1275] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:39.584729  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:39.568231 11878 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:39.571504 11644 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:39.592680  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 62876.4us
W20260709 12:26:39.593823 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.594357 11464 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:39.594905 11464 raft_consensus.cc:697] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:39.595882  9853 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:39.596797 11719 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:39.602550  9810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:26:39.603806  9853 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:39.604733 11914 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.595917 11464 consensus_queue.cc:237] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:39.605310 11914 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.607474 11914 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:39.609099 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:39.609844 10533 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:39.611027  9854 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:39.614579  9962 raft_consensus.cc:3055] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:39.614960  9962 raft_consensus.cc:740] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:39.615767  9962 consensus_queue.cc:260] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.616935  9962 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:39.624158  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.627485 11914 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.634518 11719 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:26:39.635776  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:39.636667  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.646109  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:39.646493  9962 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:26:39.646938  9962 pending_rounds.cc:85] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 5
I20260709 12:26:39.647168  9962 pending_rounds.cc:107] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:26:39.647425  9962 raft_consensus.cc:2889] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:39.601418  9710 catalog_manager.cc:5697] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 4 to 5, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 5 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:39.586851 11698 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:39.652688  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.653934  9810 raft_consensus.cc:606] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Received request to transfer leadership to TS b011791796d1457284b857d7d3422195
I20260709 12:26:39.654379  9810 raft_consensus.cc:614] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:39.656200 11903 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.656744 11903 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.662508 11881 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.665225 11881 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:39.612849 11644 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:39.673609 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 104044us
I20260709 12:26:39.652700  9710 catalog_manager.cc:5697] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 4 to 6, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 6 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.685038  9888 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:26:39.685467  9888 pending_rounds.cc:85] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 3
I20260709 12:26:39.685683 10533 raft_consensus.cc:1240] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:39.686533  9779 leader_election.cc:400] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5.
I20260709 12:26:39.686853  9779 leader_election.cc:403] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:26:39.688380 11942 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5.
I20260709 12:26:39.688750  9779 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:39.689328 10533 raft_consensus.cc:1217] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[3.6-3.6]   Dedup: 3.6->[]
I20260709 12:26:39.689217 11942 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:39.689867 10533 raft_consensus.cc:1240] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:26:39.690721  9853 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:39.684487 10526 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 3 LEARNER]: Advancing to term 4
I20260709 12:26:39.691506 10530 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:39.692901 11848 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:39.693555 11848 raft_consensus.cc:697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:39.694684 11848 consensus_queue.cc:237] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.695936 10496 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:39.697045 11813 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:39.697347 10496 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:39.635076 11719 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.685721  9888 pending_rounds.cc:107] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:26:39.702165  9888 raft_consensus.cc:2889] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:39.699937  9779 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:39.711938  9964 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:39.713415  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:39.705854 11746 consensus_queue.cc:1048] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:26:39.714231  9886 raft_consensus.cc:2410] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:26:39.706764  9710 catalog_manager.cc:5697] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 1 to 2, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:39.715420 10533 raft_consensus.cc:1240] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:39.716364 10530 raft_consensus.cc:1240] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:39.720369 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:39.701275 11809 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:39.703830 11719 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:39.725023  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:39.707510 11624 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:39.736073  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:39.732693  9710 catalog_manager.cc:5697] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 3 to 4, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 4 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:39.741978 11575 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:39.744460 11710 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:39.745280 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 48031us
I20260709 12:26:39.746151 10496 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:39.747534 10496 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:39.731418 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:39.753625  9710 catalog_manager.cc:5697] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 2 to 3, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 3 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:39.756961 10496 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
W20260709 12:26:39.763127  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 49361.2us
I20260709 12:26:39.744808 11669 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:39.751569 11809 raft_consensus.cc:2764] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:26:39.755158 11640 consensus_meta.cc:287] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.518s	user 0.008s	sys 0.002s
I20260709 12:26:39.753633 11834 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:39.759039 11945 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:39.754496 11644 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.776444 11813 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:39.773056 11834 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:39.775141 10525 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:26:39.795672  9779 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:39.790337  9710 catalog_manager.cc:5697] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 3 to 4, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 4 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:39.799386  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:39.790634 11813 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:26:39.805785 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 57037.1us
I20260709 12:26:39.793116 11834 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:39.800490  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:39.811597  9955 raft_consensus.cc:1275] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:39.803330  9853 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:39.814154  9710 catalog_manager.cc:5697] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 2 to 3, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 3 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.818547  9959 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:39.818377  9710 catalog_manager.cc:5697] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:39.827224  9928 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:39.826889  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:39.813303 11828 consensus_meta.cc:287] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.001s
W20260709 12:26:39.842114  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 49861.6us
I20260709 12:26:39.836604  9710 catalog_manager.cc:5697] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 4 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:39.816908 11813 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.849495  9854 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:39.851215 10496 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:39.817772 11746 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:39.854806  9957 raft_consensus.cc:2410] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:26:39.850759  9710 catalog_manager.cc:5697] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 3 to 4, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 4 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.844811 11669 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.845247 11809 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:39.862138  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 61852.9us
I20260709 12:26:39.857998  9710 catalog_manager.cc:5697] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 2 to 3, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 3 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:39.864886  9928 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:39.859615 11899 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:39.861346 11575 raft_consensus.cc:697] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 4 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:39.863930 11881 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.883551  9853 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:39.894327 11600 raft_consensus.cc:3055] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:39.894908 11600 raft_consensus.cc:740] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:39.896036 11600 consensus_queue.cc:260] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.872697 11731 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:39.904209 11575 consensus_queue.cc:237] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:39.906876 11644 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:39.909435 11903 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:39.897639 11600 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:39.887779  9779 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:39.876235 11464 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:26:39.886968 12010 log.cc:927] Time spent T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:26:39.918637  9928 leader_election.cc:400] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4.
I20260709 12:26:39.918144 11464 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.919385 11844 consensus_queue.cc:1059] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:26:39.919962 11464 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:39.920553 11844 raft_consensus.cc:3055] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:39.920936 11844 raft_consensus.cc:740] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:39.920964 10526 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 4 LEARNER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:26:39.921468 10526 pending_rounds.cc:85] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: Aborting all ops after (but not including) 3
I20260709 12:26:39.921716 10526 pending_rounds.cc:107] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 12:26:39.921983 10526 raft_consensus.cc:2889] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 4 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:39.866585 11669 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.867110 11809 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:39.932065 11669 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:39.933717 11809 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:39.935267 11746 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:39.939420 11881 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:39.921864 11844 consensus_queue.cc:260] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:39.942876  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 55208.1us
I20260709 12:26:39.909998 11903 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:39.946862 11844 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:39.963797  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 95691us
W20260709 12:26:39.975546  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.967628 11710 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:39.987380  9928 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:39.959173 11746 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:26:40.004498 11914 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:40.004891 12013 log.cc:927] Time spent T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.145s	user 0.000s	sys 0.003s
I20260709 12:26:40.006585 11710 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:40.008213 11834 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.008797 11710 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:40.011377  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.014227  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:40.014794  9956 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:40.023100  9853 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:39.971695 11698 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.029815  9928 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:40.030485  9956 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:40.021340 11640 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.024355 10525 raft_consensus.cc:1240] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:40.045612  9928 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:26:40.053223  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.033154 11942 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:40.035188 11874 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:40.049686 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 209856us
I20260709 12:26:40.061594 10529 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:26:40.035308 11624 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.058470 11640 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:40.060882 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:40.083546  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:40.100777  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 66485.2us
I20260709 12:26:40.058352  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:26:40.106194 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 45424.4us
I20260709 12:26:40.043819 11736 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:40.037346 11895 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:26:40.058691 12020 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:26:40.125408  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 67174.5us
I20260709 12:26:40.126801  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:26:40.128365  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:40.133870 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.057461 12019 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.163s
I20260709 12:26:40.120945  9806 raft_consensus.cc:1240] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:40.099480 11942 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:40.116971 11640 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:40.164980 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:40.165912 11719 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.167250 11631 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.099710 11874 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.132591 11913 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:26:40.174104  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 72456.2us
I20260709 12:26:40.176486  9778 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:40.177850 11464 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.178364 11762 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:40.179870 11464 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:40.182650 12016 log.cc:927] Time spent T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.382s	user 0.002s	sys 0.000s
I20260709 12:26:40.183553 11874 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:40.186580 10496 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:40.187598 11762 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:40.187700 10496 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
W20260709 12:26:40.188988  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.105819 11624 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:40.209475  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 177541us
I20260709 12:26:40.211333 11874 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:40.213225  9778 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:40.132201 12020 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:40.219362  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 220960us
I20260709 12:26:40.220041 10496 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:40.188467 11750 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:40.198395 11882 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:40.225075 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:40.225270 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:40.225667 10529 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:40.225838 10530 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:40.190074 11913 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:40.220975  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:40.223479 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:40.192924 12028 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:40.208835 11834 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:40.232609  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:26:40.236673  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.235280  9887 raft_consensus.cc:1275] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:40.240911 10527 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:40.242838  9890 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:40.238888  9814 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:40.221144 11874 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:26:40.244715  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 116035us
I20260709 12:26:40.221443 11669 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:40.207935 11736 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:26:40.251542  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:40.245555  9928 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:40.247747  9853 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:40.264400  9810 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:26:40.229502 11913 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:40.221330 11945 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:26:40.231966 11698 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:40.251443 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:40.236155 11809 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:40.272765 11809 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.274075  9882 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:40.274572 11809 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:40.275645  9888 raft_consensus.cc:1275] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:40.242064 11903 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.270044  9886 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:40.270342  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:40.268388  9813 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:26:40.276750  9890 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:40.220997 11813 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.282678  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:40.287859  9814 raft_consensus.cc:1275] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:40.295542 10531 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:40.295789  9809 raft_consensus.cc:1240] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: []
W20260709 12:26:40.297266 12027 log.cc:927] Time spent T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:26:40.298121 12036 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:40.298300 12022 log.cc:927] Time spent T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 12:26:40.300150 12008 log.cc:927] Time spent T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.562s	user 0.001s	sys 0.001s
I20260709 12:26:40.280046 11464 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:40.292898  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:40.303419 10533 raft_consensus.cc:1240] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:40.291045  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:40.268784 11669 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.338845  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:40.292879 11942 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:40.345541  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 64483.7us
I20260709 12:26:40.327466 12037 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.348815  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:26:40.349758  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.351349 11719 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:40.354144 12020 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:40.351711 12037 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:40.355839 11669 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:40.356539 12037 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:40.352757 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:40.357903 10532 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:40.370402  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:40.372727  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:40.352032 11874 raft_consensus.cc:697] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:40.366472 11719 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.376912 11813 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:40.383803  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:26:40.384469 12039 log.cc:927] Time spent T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:26:40.385859 11675 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.386511 11675 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.388646 11675 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:40.363339 11669 consensus_queue.cc:1048] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:26:40.394415 11719 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:40.396600 11719 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:40.398499 12024 log.cc:927] Time spent T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:26:40.410770  9886 raft_consensus.cc:1275] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:26:40.420778  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 175320us
I20260709 12:26:40.421291  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:40.423226 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:40.432367 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:40.438421 12031 consensus_queue.cc:1059] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:26:40.439252 11800 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:40.439711 12031 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:40.440649 11800 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:40.441295 12031 raft_consensus.cc:3055] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:40.441599 11813 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:40.441687 11669 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.442229 11813 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.442297 11669 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.438560 12021 consensus_queue.cc:1059] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:40.443961 11575 raft_consensus.cc:3055] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:40.444324 11575 raft_consensus.cc:740] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:40.444766 11813 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:40.445238 11575 consensus_queue.cc:260] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:40.446671 11874 consensus_queue.cc:237] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:40.431563 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 211586us
I20260709 12:26:40.457923  9815 raft_consensus.cc:1240] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:40.422829 11675 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:40.460660  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:40.464316 10532 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:40.464429  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:40.464679  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 216803us
I20260709 12:26:40.469556  9928 leader_election.cc:400] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6.
I20260709 12:26:40.469949  9928 leader_election.cc:403] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:26:40.429893 11914 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:40.482914  9814 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:40.484421  9810 raft_consensus.cc:1240] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:40.441684 12031 raft_consensus.cc:740] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:40.426745 11710 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:26:40.492208 10530 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:26:40.427604 12019 consensus_queue.cc:1059] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:26:40.430909 11731 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:26:40.470613 11844 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6.
I20260709 12:26:40.496742  9815 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
W20260709 12:26:40.500613  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:40.513592  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 57070.5us
I20260709 12:26:40.607074  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:40.607208 12034 consensus_queue.cc:1059] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 12:26:40.607956  9960 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:40.605124  9928 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:40.610392 10527 raft_consensus.cc:1275] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 2 LEARNER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:26:40.612303  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:40.614384 12049 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:40.615090 12049 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:40.619843  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 157340us
W20260709 12:26:40.620390  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.621203 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:40.621932 10529 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:40.498756 11575 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:40.475418 11675 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.634481 10530 raft_consensus.cc:1275] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:40.493747 11914 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:40.643285  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:40.644667  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:40.638962  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:40.641080 12021 raft_consensus.cc:3055] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:40.648134  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:40.649088  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:40.653497  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:40.639041 12049 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:40.639393 11669 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:40.643270 11731 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:40.649915 11879 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:40.714936  9955 raft_consensus.cc:1275] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:40.714748 11879 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:40.716063  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:40.698033 11669 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:40.666721 11600 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:40.649698 11719 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.690058  9963 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
W20260709 12:26:40.690238  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 51378.9us
I20260709 12:26:40.722838  9928 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:26:40.691293  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 48077.9us
I20260709 12:26:40.659561  9806 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:40.692965  9961 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:40.724845  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:40.725405  9961 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:40.656147 12021 raft_consensus.cc:740] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
W20260709 12:26:40.699932 12055 log.cc:927] Time spent T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:26:40.718664 11600 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.730715 11600 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:40.699946  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:40.700542 11675 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:40.733613  9853 leader_election.cc:400] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4.
I20260709 12:26:40.734571 12021 consensus_queue.cc:260] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.735950 12021 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.737334 11828 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:40.700992 10496 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:40.734611  9853 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:40.738293  9955 raft_consensus.cc:2393] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:40.688521 12034 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.668541 11913 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.703152  9960 raft_consensus.cc:2393] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 4: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
W20260709 12:26:40.704581  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.666496  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:40.686930  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:40.717049 11879 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:40.727733 10529 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
W20260709 12:26:40.701051 12047 log.cc:927] Time spent T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:26:40.731065  9928 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:40.730029  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:40.760856  9961 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:40.731451  9958 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.739990  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:40.635695 12031 consensus_queue.cc:260] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.742715 10496 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:40.717079 11669 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.751171  9853 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:40.751464 11464 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:40.754500 12054 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:26:40.754745  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.737746 11828 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:40.761986  9963 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.766979  9956 raft_consensus.cc:2410] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:26:40.763588 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:40.767727 11809 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:40.768110 11809 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.768227 12031 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.768472 11809 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:40.769044 11914 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:40.769627 11914 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:40.769563 11600 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:40.756716 11800 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:40.770406 11914 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:40.770849 11800 raft_consensus.cc:697] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:40.771857 11800 consensus_queue.cc:237] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:40.772795 11669 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:40.766544 11879 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:26:40.774706 11600 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:40.775388  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 44421.5us
I20260709 12:26:40.776703 12037 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:40.777253 11913 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:40.777320 12037 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:40.778443 12038 consensus_queue.cc:1059] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:40.778829  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:40.779495 12037 raft_consensus.cc:3055] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:40.779589 12038 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:40.779907 12037 raft_consensus.cc:740] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:40.780314 12038 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:40.780776 12037 consensus_queue.cc:260] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.782078 12037 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:40.782006 11878 consensus_queue.cc:1048] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:40.786351 10529 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:40.764129 12054 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:40.787140 12054 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:40.787142 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:40.731738 11719 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.790491 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:40.791337 10533 raft_consensus.cc:2393] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 4: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:40.792073 11719 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:40.794559  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:40.796484 12037 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.797119 12037 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.799650 12037 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:40.800277  9963 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:40.801091  9959 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:26:40.801522  9959 pending_rounds.cc:85] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 4
I20260709 12:26:40.801827  9959 pending_rounds.cc:107] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:26:40.802124  9959 raft_consensus.cc:2889] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:40.803303 12049 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.803982 12049 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.765823 11813 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:40.807318 11828 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:40.808372 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:40.809165 10526 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:40.811059 11945 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.811529 11945 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.813737 11945 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:40.816346 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:40.821638  9958 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:40.822669 10496 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:40.824060 11878 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:40.824790  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:40.826910 10496 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:40.831156  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:40.828717  9779 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:40.837682 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:40.838397  9962 raft_consensus.cc:1275] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:40.839697 10527 raft_consensus.cc:2393] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 6: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:40.814195 11945 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.832540 11669 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.842705  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:40.843534  9885 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:26:40.840054 12034 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.843789  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:40.845428  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:40.874562  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:40.803314 11624 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:40.836915 12036 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.874115  9814 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:26:40.876778  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:40.840835 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:40.882833  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:40.833153 11878 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:40.833235 11813 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:40.881204  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:40.892591  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:40.847637 11848 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:40.888548  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:40.832942 12051 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:26:40.879703 12020 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.877381  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:40.904996  9811 raft_consensus.cc:1275] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:40.895255 11624 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:26:40.912248  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:40.912987  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:40.913542 11733 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.914021 11733 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:40.915566 12044 consensus_queue.cc:1059] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:40.916219 11733 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:40.891845 11813 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:40.916591 12044 consensus_queue.cc:1048] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:40.917201 11813 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:40.881608  9807 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
W20260709 12:26:40.919062  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.920456  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:40.918083 12044 raft_consensus.cc:3055] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:40.851065 11698 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:26:40.925640  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:40.926859  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:40.927481  9812 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:40.934646  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:40.901620 12058 log.cc:927] Time spent T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.209s	user 0.003s	sys 0.001s
I20260709 12:26:40.924823  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:40.924984  9888 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:57650
I20260709 12:26:40.937106  9779 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:40.925379 12048 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:40.942629 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:40.890070 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:40.943145  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:40.871527 11945 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:40.943203 10533 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:26:40.899819 11848 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:40.898682 11878 raft_consensus.cc:697] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:40.877182 12034 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:40.949146  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:40.941300  9854 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:26:40.949580  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.950127  9887 raft_consensus.cc:2393] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 5: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:40.950796  9779 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:40.952014  9779 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:40.973150  9814 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:40.973938  9854 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:40.924283 12044 raft_consensus.cc:740] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:40.945091 11874 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:40.996210  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:41.003134  9811 raft_consensus.cc:2410] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:26:40.947458 11675 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:40.893530 12036 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.951131 11848 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:41.005209  9854 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:41.005479  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:40.938409  9881 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:40.974372 11624 raft_consensus.cc:2749] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:41.008888 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:41.007231 11698 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.010568 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:41.016636  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:40.967670 10525 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:40.973501 12031 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:41.020371  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:40.942026 12020 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:41.009838 10531 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:26:40.968544 12051 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:26:41.028833 10533 raft_consensus.cc:2393] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 5: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:41.005263 11874 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:41.014675 11719 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:41.045589 12063 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:41.032258 11698 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:40.991963 11746 consensus_queue.cc:1048] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:26:41.021078 12021 consensus_queue.cc:1059] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:26:41.006211 12054 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:41.026731 11881 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:26:41.042697  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 277749us
I20260709 12:26:41.004654 11464 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:41.134421 10496 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
W20260709 12:26:41.084734 12060 log.cc:927] Time spent T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 12:26:41.032119 11731 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.195122 11731 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:41.197590 11731 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:41.198963 12019 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:41.134407 11675 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.161870 12067 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.074661 11878 consensus_queue.cc:237] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:41.075485 12044 consensus_queue.cc:260] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:41.147569 11921 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.157631 11874 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:41.156967 12031 raft_consensus.cc:697] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:41.187646 11733 consensus_queue.cc:1059] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:41.188254 12034 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:41.189518 12020 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:41.190325  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:41.190984 11698 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:41.191686 11945 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:41.307091  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 156676us
I20260709 12:26:41.190356 11464 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:41.170763 11719 raft_consensus.cc:697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:41.320569  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:41.218330 11644 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:41.194299 12021 consensus_queue.cc:1048] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:41.194135  9853 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:26:41.215764 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 141089us
I20260709 12:26:41.232537  9778 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:41.183844 11881 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.197402 11828 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:41.198216 11731 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.354635  9883 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:41.306085  9927 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:41.199575 12075 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.219769 11675 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:41.310316  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:41.194103 12036 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:41.216944  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:41.321328  9928 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:41.199565 12019 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:41.326867 12069 log.cc:927] Time spent T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
W20260709 12:26:41.326953 12066 log.cc:927] Time spent T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.190s	user 0.000s	sys 0.000s
I20260709 12:26:41.238734 12049 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:41.299069 11669 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:41.170190 12063 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:41.238029 11809 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:41.307657 10525 raft_consensus.cc:1240] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:41.310524  9813 raft_consensus.cc:606] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:41.299568 11921 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:41.238794 12067 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:41.563472  9888 raft_consensus.cc:606] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Received request to transfer leadership
W20260709 12:26:41.563735  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 257766us
I20260709 12:26:41.563921  9888 raft_consensus.cc:614] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:41.564751  9813 raft_consensus.cc:614] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:26:41.565281  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 196192us
W20260709 12:26:41.563051  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 330602us
I20260709 12:26:41.566509 11746 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:41.567186  9779 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:41.568004 12078 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:41.568507 12078 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:41.568337 12075 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:41.567842 12079 consensus_queue.cc:1048] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:41.570547 12075 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:41.568934 12078 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:41.571713 11828 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:41.468245 12073 log.cc:927] Time spent T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:26:41.468082 12076 log.cc:927] Time spent T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:26:41.575135 11921 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:41.575273  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:41.575583 12019 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:41.336215 11813 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:41.337489 11945 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:26:41.462435 12056 log.cc:927] Time spent T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.674s	user 0.006s	sys 0.005s
I20260709 12:26:41.528865 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:41.617683 10533 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
W20260709 12:26:41.588482  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 394375us
I20260709 12:26:41.573136  9779 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:26:41.552570 12074 log.cc:927] Time spent T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 12:26:41.337914 11881 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:41.588124  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55720 (request call id 14) took 1315 ms. Trace:
W20260709 12:26:41.607465  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 286176us
I20260709 12:26:41.578089 12067 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:41.555253 12054 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:41.407934 12044 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:41.367715 11698 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.600811 12021 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:41.621834  9813 rpcz_store.cc:276] 0709 12:26:40.249696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.249885 (+   189us) service_pool.cc:224] Handling call
0709 12:26:41.310359 (+1060474us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b5800010e98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f8c40 00007f2f934e4bb9 00007f2f934e447c 00007f2f8ca6a7d4
0709 12:26:41.565194 (+254835us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4386176}
I20260709 12:26:41.634488 11698 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:41.622820  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 49755.5us
I20260709 12:26:41.626825 12072 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:41.637287 12072 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.636703 11698 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:41.637960 12072 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:41.642666 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:41.643668 11809 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:41.644047 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:41.644989 12089 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:41.651769 12034 raft_consensus.cc:3055] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:41.652292 12034 raft_consensus.cc:740] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:41.367516 11731 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:41.653265 12034 consensus_queue.cc:260] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:41.655640 11731 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:41.630554 12051 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:41.534261 11719 consensus_queue.cc:237] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:41.632786 12067 consensus_queue.cc:1048] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:41.662534 12052 raft_consensus.cc:3055] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:41.662931 12052 raft_consensus.cc:740] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:41.637423  9779 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:41.663780 12052 consensus_queue.cc:260] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:41.665480 11631 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:26:41.615379 12020 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:41.667080 12020 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:41.668052 11698 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:41.672397 11903 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:41.672911 11903 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:41.676121  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:41.677079  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:41.678224  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:41.678530  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:41.679195  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:41.679757  9885 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:26:41.680526  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:41.681134  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:41.681488  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:41.682173  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:41.683252  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:41.683753  9809 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:41.685454  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:41.631835  9884 raft_consensus.cc:1275] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:26:41.687547  9884 pending_rounds.cc:85] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 2
I20260709 12:26:41.687880  9884 pending_rounds.cc:107] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:26:41.679208  9810 raft_consensus.cc:2393] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 4: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:41.688198  9884 raft_consensus.cc:2889] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:41.614851 12036 raft_consensus.cc:2764] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:26:41.645563 12089 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:41.701318  9885 raft_consensus.cc:1275] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:26:41.701799  9885 pending_rounds.cc:85] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 5
I20260709 12:26:41.702080  9885 pending_rounds.cc:107] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:26:41.702378  9885 raft_consensus.cc:2889] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:41.706470  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 137071us
I20260709 12:26:41.615090 12075 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:41.708039 12075 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:41.710906 12075 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:41.697139  9928 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:41.717917  9778 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:41.720481 11945 raft_consensus.cc:2804] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:41.721069 11945 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:41.721590 11945 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:41.727097 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:41.501396 12031 consensus_queue.cc:237] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:41.627665 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:41.734220 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:41.734746  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:41.735289 10496 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:41.729152  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:41.731506  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:41.741632 10496 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:41.743534 10496 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:41.752075  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:41.723763 11913 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:26:41.757695  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:41.737516 11626 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:41.732771 12063 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:41.740005 10528 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:41.782204  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:41.758373 12034 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:41.736613 12054 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:26:41.699442 12081 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:26:41.774523 11626 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.797019  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:41.776893 11913 raft_consensus.cc:697] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:26:41.788075 11848 consensus_meta.cc:287] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.760s	user 0.011s	sys 0.000s
I20260709 12:26:41.754676 11878 consensus_queue.cc:1059] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:26:41.841380  9890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1115) took 1465 ms. Trace:
I20260709 12:26:41.793447 11903 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:41.813143  9853 connection.cc:256] RPC call timeout handler was delayed by -1.0491086090000863s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
I20260709 12:26:41.812789 11626 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:41.841899  9890 rpcz_store.cc:276] 0709 12:26:40.353862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.363299 (+  9437us) service_pool.cc:224] Handling call
0709 12:26:40.379230 (+ 15931us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:40.382689 (+  3459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:40.382735 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:40.398747 (+ 16012us) log.cc:844] Serialized 26 byte log entry
0709 12:26:40.464416 (+ 65669us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:40.489123 (+ 24707us) log.cc:844] Serialized 14 byte log entry
0709 12:26:40.489338 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:40.489418 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:41.327316 (+837898us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:26:41.814725 (+487409us) raft_consensus.cc:1685] finished
0709 12:26:41.819078 (+  4353us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:41.819221 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135535,"prepare.queue_time_us":25372,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":1893,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":39851,"spinlock_wait_cycles":55065472,"thread_start_us":65173,"threads_started":1,"wal-append.queue_time_us":241704}
I20260709 12:26:41.814255 11669 raft_consensus.cc:697] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 3 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:41.871140  9853 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:26:41.875172 12084 log.cc:927] Time spent T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 12:26:41.876116 12085 log.cc:927] Time spent T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:26:41.877053 12087 log.cc:927] Time spent T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:26:41.877432 12090 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:26:41.878223 12082 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:41.879742 12089 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:41.816738 12091 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:41.825428 12063 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.840516 11719 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:26:41.887935 10497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.000s	sys 0.062s
W20260709 12:26:41.934580 10497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.000s	sys 0.063s
I20260709 12:26:41.896517  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:41.867980 11903 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:41.818521 11848 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:41.844370 11624 consensus_queue.cc:1048] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:26:41.859432 11881 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:41.982088  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 223580us
W20260709 12:26:41.985322  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 114271us
I20260709 12:26:41.897630 11675 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:41.899448 11813 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:41.985348  9778 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:41.986073  9853 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:41.927970 12054 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:41.930071 11809 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:41.994943 11675 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:26:41.995478 11879 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.000s	sys 0.013s
W20260709 12:26:41.995985 11879 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.000s	sys 0.013s
I20260709 12:26:41.998222 11879 consensus_queue.cc:1048] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:42.000090 11879 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:26:41.992929 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 249465us
I20260709 12:26:41.935276 12089 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:42.038424 12071 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.039017 12071 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:42.044379 11903 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:42.033273 11669 consensus_queue.cc:237] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:42.046909 12093 log.cc:927] Time spent T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 12:26:42.050935 11848 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:42.052994 11874 consensus_meta.cc:287] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.731s	user 0.005s	sys 0.005s
W20260709 12:26:42.053169 12103 log.cc:927] Time spent T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:26:42.053690 12094 raft_consensus.cc:3055] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:42.054184 12094 raft_consensus.cc:740] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:42.055215 12094 consensus_queue.cc:260] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:42.055716 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:42.056439 10527 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:41.925670 12091 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:42.064654 10527 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:42.078670 10530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 484) took 1070 ms. Trace:
I20260709 12:26:42.079205 10530 rpcz_store.cc:276] 0709 12:26:41.008422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.011626 (+  3204us) service_pool.cc:224] Handling call
0709 12:26:41.028574 (+ 16948us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:41.028906 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:41.028934 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:41.159965 (+131031us) log.cc:844] Serialized 26 byte log entry
0709 12:26:41.600402 (+440437us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:41.600456 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:41.600542 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:42.078351 (+477809us) raft_consensus.cc:1685] finished
0709 12:26:42.078377 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:42.078561 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2138,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":17397,"thread_start_us":402124,"threads_started":1,"wal-append.queue_time_us":556132}
I20260709 12:26:42.087268  9887 raft_consensus.cc:2368] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7.
I20260709 12:26:41.927379 12082 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:42.127084  9955 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 314) took 1426 ms (client timeout 1785 ms). Trace:
I20260709 12:26:42.020377 11879 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:42.068468 12051 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:41.983594 12063 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:42.123450 11624 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.067602 11874 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:41.987845 11913 consensus_queue.cc:237] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:42.122998 12072 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:42.177346  9955 rpcz_store.cc:269] 0709 12:26:40.700448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.715838 (+ 15390us) service_pool.cc:224] Handling call
0709 12:26:42.126866 (+1411028us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b54000b45d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:42.127024 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35664128}
W20260709 12:26:42.172770 12092 log.cc:927] Time spent T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.371s	user 0.000s	sys 0.006s
I20260709 12:26:42.167449 11881 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:41.988636 11719 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:42.166118 11809 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:42.173352 12094 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:26:42.176347  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 190334us
I20260709 12:26:42.195871 10529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 717) took 1376 ms. Trace:
I20260709 12:26:42.196762  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:42.222080 10529 rpcz_store.cc:276] 0709 12:26:40.819713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.819903 (+   190us) service_pool.cc:224] Handling call
0709 12:26:40.837619 (+ 17716us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:41.133437 (+295818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:41.133465 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:41.669299 (+535834us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b2c0010bbf8. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8ce15a11 00007f2f8ce25372 00007f2f8e557a01 00007f2f8e51c43a 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2
0709 12:26:41.669850 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 12:26:41.788714 (+118864us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:42.169572 (+380858us) log.cc:844] Serialized 14 byte log entry
0709 12:26:42.185066 (+ 15494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:42.185139 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:42.185193 (+    54us) raft_consensus.cc:1685] finished
0709 12:26:42.187841 (+  2648us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:42.195820 (+  7979us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27670,"prepare.queue_time_us":93886,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":1867,"raft.queue_time_us":24190,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":9158,"spinlock_wait_cycles":41443584,"thread_start_us":504853,"threads_started":3,"wal-append.queue_time_us":198127}
I20260709 12:26:42.186213 11848 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.186183 11746 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.199649  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:26:42.200053 12106 log.cc:927] Time spent T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:26:42.183754 11675 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.234997 11675 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:42.220009  9811 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:42.232645  9853 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:42.226454 11921 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:42.237087  9961 raft_consensus.cc:1240] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:42.238600  9955 raft_consensus.cc:2410] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:26:42.245054  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:42.245922  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 60185.6us
I20260709 12:26:42.247339  9853 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:42.187701 11624 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:42.219327 12071 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:42.249117  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:42.250564 11921 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:42.260540 11800 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:26:42.262571 12053 log.cc:927] Time spent T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 1.658s	user 0.013s	sys 0.000s
I20260709 12:26:42.229359 11809 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:42.246217 11879 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:42.264247  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:42.250675 11881 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:42.276716 12063 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:42.278326 12032 raft_consensus.cc:3055] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:42.278825 12032 raft_consensus.cc:740] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:42.279824 12032 consensus_queue.cc:260] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:42.281208 12032 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:42.250183  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:42.266228  9961 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:42.284238  9961 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:42.285624  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:42.251797 11945 consensus_meta.cc:287] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.000s
I20260709 12:26:42.271510  9963 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:42.243825 12034 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:26:42.276407 12109 log.cc:927] Time spent T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 12:26:42.269122 12101 log.cc:927] Time spent T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:26:42.240309 11746 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:42.290385  9853 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:42.241030 11848 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:42.294648  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:42.292797 11945 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:42.296873 12072 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:42.297295 11719 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:42.267187 12079 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.319355 12079 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:42.320122 11874 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:42.320377 11746 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:42.321452 12079 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:42.321843 11624 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:42.322510 12068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.003s	sys 0.011s
W20260709 12:26:42.322888 12068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.003s	sys 0.011s
I20260709 12:26:42.324854  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1124) took 1295 ms. Trace:
I20260709 12:26:42.325260  9884 rpcz_store.cc:276] 0709 12:26:41.029482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.695258 (+665776us) service_pool.cc:224] Handling call
0709 12:26:41.695640 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:41.733499 (+ 37859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:41.733528 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:41.745463 (+ 11935us) log.cc:844] Serialized 26 byte log entry
0709 12:26:41.904834 (+159371us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:41.904892 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:41.904987 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:42.324618 (+419631us) raft_consensus.cc:1685] finished
0709 12:26:42.324639 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:42.324794 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55250,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":7060,"spinlock_wait_cycles":38656,"thread_start_us":100345,"threads_started":1,"wal-append.queue_time_us":366973}
I20260709 12:26:42.326596 11675 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:42.292694 12071 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:42.315328 12078 consensus_meta.cc:287] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.708s	user 0.012s	sys 0.000s
I20260709 12:26:42.293205 11881 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:42.265568 11626 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:42.315532  9963 raft_consensus.cc:1275] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:42.335170  9807 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:42.347122 11800 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:42.347811 11800 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:42.350816 11809 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:42.287345 12091 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:42.351331  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:42.352186  9960 raft_consensus.cc:2410] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:26:42.352735 11848 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:42.354331 10528 consensus_meta.cc:287] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.565s	user 0.009s	sys 0.001s
I20260709 12:26:42.354815 10528 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:42.297714 12034 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:42.327771  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:42.358176 12129 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.335853 11921 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:42.358780 12082 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:42.336125 11719 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:42.359413 12082 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:42.318248 12119 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:42.365530  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:42.366045  9963 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:42.359769 11719 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:42.358788 11945 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:42.358721 12129 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:42.338755 12071 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:42.340680 12078 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:42.360041 12082 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:42.371217 11800 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:42.470438 11848 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:42.536787 11848 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:42.537747 12078 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:42.538959 11848 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:42.539155  9778 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:42.393067 12034 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:42.540858 12034 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:42.540930  9778 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:42.542484 12124 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:42.544644 12124 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:42.545123 12124 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.545526 12124 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:42.448010 11675 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:42.549304 11675 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:42.544649 12129 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:42.551667 11675 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:42.554839  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:42.555650  9963 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
W20260709 12:26:42.368772 12044 consensus_meta.cc:287] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.677s	user 0.011s	sys 0.000s
W20260709 12:26:42.374933 12112 log.cc:927] Time spent T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:26:42.568849  9807 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:42.570811  9778 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:42.381353 11626 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:42.541756 12034 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:42.568275 11669 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.581913 11698 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:42.586930 11698 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.588799  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:42.598451 12133 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:42.599176 12133 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:42.584520 11669 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:42.602792  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:42.604409  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:42.587471 11626 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:42.610617 11626 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:42.615717  9881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1125) took 1577 ms. Trace:
I20260709 12:26:42.616513  9881 rpcz_store.cc:276] 0709 12:26:41.038719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.700864 (+662145us) service_pool.cc:224] Handling call
0709 12:26:41.732302 (+ 31438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:41.818429 (+ 86127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:41.825052 (+  6623us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:41.849439 (+ 24387us) log.cc:844] Serialized 26 byte log entry
0709 12:26:42.122536 (+273097us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:42.186685 (+ 64149us) log.cc:844] Serialized 14 byte log entry
0709 12:26:42.231896 (+ 45211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:42.240594 (+  8698us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:42.374222 (+133628us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:26:42.615324 (+241102us) raft_consensus.cc:1685] finished
0709 12:26:42.615474 (+   150us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:42.615624 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21849,"prepare.queue_time_us":89144,"raft.queue_time_us":101236,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":11563,"spinlock_wait_cycles":51614720,"thread_start_us":262133,"threads_started":3,"wal-append.queue_time_us":375867}
I20260709 12:26:42.619493 11669 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:42.620329 11719 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:42.632681  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:42.642988  9963 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:42.643551  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:42.593011 11698 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:42.655797  9778 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:26:42.657608 12134 log.cc:927] Time spent T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:26:42.657482  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:26:42.658748 12128 log.cc:927] Time spent T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.089s	user 0.002s	sys 0.000s
I20260709 12:26:42.658840  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:42.659400 12034 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:42.660324  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:42.660919  9963 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:42.662592  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:42.663162  9959 raft_consensus.cc:2410] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:26:42.663348 11945 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:42.622908 12124 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:42.670725 11945 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.670737  9963 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:42.671283 11945 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:26:42.673265  9956 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 306) took 2032 ms (client timeout 1871 ms). Trace:
W20260709 12:26:42.673666  9956 rpcz_store.cc:269] 0709 12:26:40.640819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.640931 (+   112us) service_pool.cc:224] Handling call
0709 12:26:42.673072 (+2032141us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400114754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:42.673200 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248975104}
I20260709 12:26:42.674604  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55946 (request call id 1807) took 1857 ms. Trace:
I20260709 12:26:42.674981  9959 rpcz_store.cc:276] 0709 12:26:40.817694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.817826 (+   132us) service_pool.cc:224] Handling call
0709 12:26:42.662453 (+1844627us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b5800135f98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:42.674542 (+ 12089us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11938560}
I20260709 12:26:42.682433  9811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 325) took 1714 ms. Trace:
I20260709 12:26:42.684391  9927 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:42.682935  9811 rpcz_store.cc:276] 0709 12:26:40.967911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.027760 (+ 59849us) service_pool.cc:224] Handling call
0709 12:26:41.145182 (+117422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:42.236152 (+1090970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:42.682133 (+445981us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002d6754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:42.682349 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2468082560}
I20260709 12:26:42.654892 12138 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:42.662611 12071 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:42.782881  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:42.835778  9963 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:26:42.694614 11913 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:42.707180 12138 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:42.800606 11698 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:42.800056  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:42.801757  9958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 317) took 1932 ms. Trace:
I20260709 12:26:42.845218  9958 rpcz_store.cc:276] 0709 12:26:40.869140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.869257 (+   117us) service_pool.cc:224] Handling call
0709 12:26:40.869552 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:41.132844 (+263292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:41.132874 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:41.136644 (+  3770us) log.cc:844] Serialized 26 byte log entry
0709 12:26:41.582353 (+445709us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:41.582388 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:42.801235 (+1218847us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54001de054. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:42.801301 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:42.801365 (+    64us) raft_consensus.cc:1685] finished
0709 12:26:42.801385 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:42.801660 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":206,"raft.queue_time_us":336,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":373062400,"thread_start_us":381823,"threads_started":1,"wal-append.queue_time_us":496359,"wal-append.run_cpu_time_us":1749,"wal-append.run_wall_time_us":1005854}
W20260709 12:26:42.782265 12137 log.cc:927] Time spent T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 12:26:42.853222  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:42.857188  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:42.860232  9928 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:42.842198 12133 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:42.865303  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:42.868017  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:42.869028  9956 raft_consensus.cc:2393] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 2: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:42.872822  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:42.874369  9928 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:42.876008  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:42.876629  9814 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:42.877890  9813 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:42.879016  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:42.879760  9963 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:42.881026 10527 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:42.878068 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:42.854449 12048 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:42.885155 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:42.884390 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:42.884903 10533 raft_consensus.cc:1240] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:42.887109  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:42.859424  9806 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:26:42.871143 11899 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:42.889461 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:42.890950  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:42.894961  9813 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:26:42.891520  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:42.887920  9956 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:42.870215 11644 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:42.891748  9853 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:42.897396  9814 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 4: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:42.878631 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:42.882344 12133 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:42.907030  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:42.907892  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:42.911001  9956 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:26:42.912026  9963 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:42.889056 12091 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:42.915068  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:42.920740  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:42.921885  9956 raft_consensus.cc:2393] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:42.928473  9710 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56416 (request call id 247) took 4084 ms. Trace:
I20260709 12:26:42.931524 11698 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:42.933503  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:42.968182  9814 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:42.904397 11575 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:42.937131 12138 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:42.937580  9778 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:42.904485 11644 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:42.938827 10525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36672 (request call id 646) took 1779 ms. Trace:
I20260709 12:26:42.940079  9888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57650 (request call id 91) took 2025 ms. Trace:
I20260709 12:26:42.903934 12048 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:42.951128  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1127) took 1388 ms. Trace:
W20260709 12:26:42.901892  9806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46504 (request call id 2065) took 1977 ms (client timeout 2207 ms). Trace:
W20260709 12:26:42.959028 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 158823us
I20260709 12:26:42.969599 11575 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:42.999097 11575 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:42.906356 12124 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:42.958503 12133 raft_consensus.cc:697] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:42.964818  9813 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:26:42.972695  9814 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:26:42.982558  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 167165us
I20260709 12:26:42.974891  9888 rpcz_store.cc:276] 0709 12:26:40.915309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.924821 (+  9512us) service_pool.cc:224] Handling call
0709 12:26:42.939887 (+2015066us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b540029aed4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e516853 00007f2f934e460a 00007f2f8ca6a7d4 00007f2f8ca6a762 00007f2f8ca6a691 00007f2f8ca6a60c 00007f2f8ca698c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:42.939994 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1441757440}
I20260709 12:26:42.995524  9886 rpcz_store.cc:276] 0709 12:26:41.563140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.887242 (+324102us) service_pool.cc:224] Handling call
0709 12:26:41.933307 (+ 46065us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:42.236329 (+303022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:42.236355 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:42.248200 (+ 11845us) log.cc:844] Serialized 556 byte log entry
0709 12:26:42.284514 (+ 36314us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:42.284551 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:42.658076 (+373525us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:26:42.950848 (+292772us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54001333d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:42.950894 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:42.950937 (+    43us) raft_consensus.cc:1685] finished
0709 12:26:42.950949 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:42.951073 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":701033216,"thread_start_us":36037,"threads_started":1,"wal-append.queue_time_us":116811}
I20260709 12:26:43.030730  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 1873) took 1301 ms. Trace:
I20260709 12:26:42.966749  9710 rpcz_store.cc:276] 0709 12:26:38.844019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.844622 (+   603us) service_pool.cc:224] Handling call
0709 12:26:42.928408 (+4083786us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:40.194121 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:40.194876 (+   755us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:40.194942 (+    66us) write_op.cc:435] Acquired schema lock
0709 12:26:40.194967 (+    25us) tablet.cc:662] Decoding operations
0709 12:26:40.196204 (+  1237us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:40.196280 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:40.196317 (+    37us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:26:40.211286 (+ 14969us) tablet.cc:701] Row locks acquired
0709 12:26:40.211341 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:26:40.211518 (+   177us) write_op.cc:270] Start()
0709 12:26:40.211665 (+   147us) write_op.cc:276] Timestamp: P: 1783600000211452 usec, L: 0
0709 12:26:40.211687 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:26:40.212418 (+   731us) log.cc:844] Serialized 4520 byte log entry
0709 12:26:40.614084 (+401666us) op_driver.cc:464] REPLICATION: finished
0709 12:26:40.730401 (+116317us) write_op.cc:301] APPLY: starting
0709 12:26:40.730501 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:40.730742 (+   241us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:40.730854 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:40.733848 (+  2994us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:40.734186 (+   338us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:26:40.734245 (+    59us) write_op.cc:312] APPLY: finished
0709 12:26:40.734625 (+   380us) log.cc:844] Serialized 83 byte log entry
0709 12:26:40.734799 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:40.734928 (+   129us) write_op.cc:454] Released schema lock
0709 12:26:40.735007 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:40.735447 (+   440us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:40.735476 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11300,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":107534,"apply.run_cpu_time_us":3857,"apply.run_wall_time_us":5070,"num_ops":11,"prepare.queue_time_us":149048,"prepare.run_cpu_time_us":32648,"prepare.run_wall_time_us":85246,"raft.queue_time_us":235497,"raft.run_cpu_time_us":22044,"raft.run_wall_time_us":51247,"replication_time_us":402198,"thread_start_us":276646,"threads_started":4,"wal-append.queue_time_us":63118,"wal-append.run_cpu_time_us":44194,"wal-append.run_wall_time_us":1473742}]]}
I20260709 12:26:43.003717 11698 raft_consensus.cc:2955] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:43.049867  9810 rpcz_store.cc:276] 0709 12:26:41.729121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.743248 (+ 14127us) service_pool.cc:224] Handling call
0709 12:26:41.759364 (+ 16116us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:41.775767 (+ 16403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:41.775811 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:41.780849 (+  5038us) log.cc:844] Serialized 26 byte log entry
0709 12:26:42.563195 (+782346us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b180041c140. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b411e07 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f8e0b620b 00007f2f8e0bbd23 00007f2f8e0bc0d1 00007f2f8e4d7a0f
0709 12:26:42.883196 (+320001us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:42.883234 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:42.883303 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:43.005584 (+122281us) raft_consensus.cc:1685] finished
0709 12:26:43.005627 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:43.030627 (+ 25000us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27852,"raft.queue_time_us":671,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":8772,"spinlock_wait_cycles":3777280,"thread_start_us":319814,"threads_started":1,"wal-append.queue_time_us":1172055}
I20260709 12:26:43.085235 12070 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.088820 12070 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.091470 12070 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:43.139295  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 246683us
I20260709 12:26:43.139317 12138 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:42.974826 10525 rpcz_store.cc:276] 0709 12:26:41.143824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.147157 (+  3333us) service_pool.cc:224] Handling call
0709 12:26:41.193303 (+ 46146us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:41.584439 (+391136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:42.908716 (+1324277us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b54005c12d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:42.923488 (+ 14772us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57535872}
W20260709 12:26:43.141201  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 266949us
I20260709 12:26:43.161226  9779 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:26:43.040848  9806 rpcz_store.cc:269] 0709 12:26:40.920271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.923980 (+  3709us) service_pool.cc:224] Handling call
0709 12:26:42.799864 (+1875884us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b5800010e98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:42.897801 (+ 97937us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6943104}
I20260709 12:26:43.151708 12124 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:26:43.180179  9887 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1121) took 2241 ms (client timeout 1879 ms). Trace:
W20260709 12:26:43.180754  9887 rpcz_store.cc:269] 0709 12:26:40.938969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.992206 (+ 53237us) service_pool.cc:224] Handling call
0709 12:26:43.179886 (+2187680us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b540027a954. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:43.180065 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2262334848}
I20260709 12:26:43.183672 12030 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.184347 12030 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:43.185982 12075 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.186503 12075 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.187302 12144 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.187685  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:43.187837 12144 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.187314 12030 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:43.189080 12030 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:43.189616 12030 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.191651 12030 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:43.189911 12144 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:43.192313 12144 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:43.192830 12144 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:43.193668  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:43.193922 12146 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:43.194435  9812 raft_consensus.cc:2368] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6.
W20260709 12:26:43.194888  9812 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 323) took 2249 ms (client timeout 1785 ms). Trace:
I20260709 12:26:43.195086 12048 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:43.194970 12144 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:43.152078 11669 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:43.195263  9812 rpcz_store.cc:269] 0709 12:26:40.945408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.952966 (+  7558us) service_pool.cc:224] Handling call
0709 12:26:43.193510 (+2240544us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b5800010e98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:43.194799 (+  1289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7901056}
I20260709 12:26:43.195960 11669 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.197973 11669 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:43.200374  9778 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:43.217929  9778 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:43.203521 12070 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:43.218050  9853 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:43.203730  9961 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:43.206651 12127 raft_consensus.cc:1064] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195: attempting to promote NON_VOTER f5208640a51f493e930ce4f64ceeed0b to VOTER
I20260709 12:26:43.162885 12138 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.208382 11644 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:43.208884 11945 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:43.211580  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:43.215819 12091 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:43.216323 12146 raft_consensus.cc:697] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:43.229640  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:43.227531 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:43.227933  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 58668.2us
I20260709 12:26:43.228284  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:43.223351  9853 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:43.231652 10529 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:43.236501  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:43.237207  9814 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:26:43.171980 12124 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:43.188506 12075 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:43.224275 11675 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:43.256983 11675 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.257396 11675 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:43.259109 11945 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:43.167032 12133 consensus_queue.cc:237] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.224552 11669 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:43.464934 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:43.318847  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 86969.3us
I20260709 12:26:43.237094 12091 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:43.262511  9809 raft_consensus.cc:1240] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:43.228166 12067 raft_consensus.cc:2749] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:43.482990  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:43.355007 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:43.481376  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:43.492174  9810 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:43.491379 10529 raft_consensus.cc:2410] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:26:43.240864 11914 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:43.469252  9853 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:26:43.417893 12099 log.cc:927] Time spent T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 1.425s	user 0.022s	sys 0.041s
I20260709 12:26:43.499469  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 1867) took 1821 ms. Trace:
I20260709 12:26:43.499547 12155 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:43.250205 12124 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:43.374053 10525 raft_consensus.cc:1240] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:26:43.428496 12048 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.260339 12138 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:43.291558 12075 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:43.257006 12030 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:43.460589 11626 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:43.494021 11929 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:26:43.551915 10496 connection.cc:256] RPC call timeout handler was delayed by -1.4795389160003651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
I20260709 12:26:43.553893  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:43.495613  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:43.556025 12067 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:43.556530 11575 consensus_meta.cc:287] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.557s	user 0.011s	sys 0.000s
I20260709 12:26:43.557107  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:26:43.557593 12148 log.cc:927] Time spent T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.210s	user 0.000s	sys 0.000s
I20260709 12:26:43.557847  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:43.558188  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:43.558557  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:43.611258  9886 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:43.559243  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:43.562846 12161 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:43.564054  9961 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:43.612337  9889 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:26:43.564715 12158 log.cc:927] Time spent T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:26:43.565769 12156 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.566412 12075 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.491331 11669 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.570973 10533 raft_consensus.cc:1240] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:43.571786 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:43.494563 12019 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:26:43.621235 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 78816.1us
I20260709 12:26:43.589972  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:43.413010 12146 consensus_queue.cc:237] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.592083  9964 raft_consensus.cc:2393] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:43.500274 12155 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.592845 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:43.594535  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 345940us
I20260709 12:26:43.627859  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:26:43.597105  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 127958us
I20260709 12:26:43.597559  9882 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:43.628444  9887 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:43.598165  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:43.627875 10527 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:26:43.629391  9962 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:43.607137  9888 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:43.607360  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:43.565135 10526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 716) took 2749 ms. Trace:
I20260709 12:26:43.583879 11914 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:43.617628  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:43.634407  9889 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:26:43.574188 12048 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.620973  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:26:43.591533 10496 connection.cc:256] RPC call timeout handler was delayed by -1.4795389160003651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
W20260709 12:26:43.624812  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 151025us
I20260709 12:26:43.611050 11626 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.557121  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:43.635926  9853 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:26:43.637566 10496 connection.cc:256] RPC call timeout handler was delayed by -1.40213891600024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18710000000000002s for a response
I20260709 12:26:43.660866 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:43.668277 10533 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:43.660945  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:43.665709  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:43.593571 12030 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:43.637954  9779 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:43.600994 11929 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.617044  9881 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:43.670444  9928 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:43.683458  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:43.683898  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:43.671419  9889 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:43.610677 12067 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.612221 11575 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.637163 12145 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:43.725342  9927 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:26:43.727099  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 94378us
I20260709 12:26:43.634903 12019 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.729215  9884 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
W20260709 12:26:43.734488  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 98634.1us
I20260709 12:26:43.735733  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:43.711074 11899 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:43.721997 11464 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:43.616942 12161 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.673069 11626 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.764462  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:43.713688 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:43.620544 12156 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:43.757445  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 119556us
I20260709 12:26:43.766390  9883 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:43.623507 12127 consensus_queue.cc:237] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.711340 12159 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:43.730088  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:43.740900 11600 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:43.689814 12107 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:26:43.712011 12163 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:26:43.811225  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:43.811964  9810 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:43.808420 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:43.774981 11464 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:43.806656  9854 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:43.715864 12167 consensus_queue.cc:1048] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.099s
I20260709 12:26:43.745731 11899 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:43.835464 11899 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:43.835603 12161 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:43.836141 12161 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.836592 12161 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.838893 12155 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:43.794128 12160 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:43.842949 12179 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:43.794195  9779 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:43.843581 12179 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:26:43.843981  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 49886.3us
I20260709 12:26:43.844096 12179 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:43.844488 10525 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:26:43.794656 11631 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:26:43.845717 12160 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:43.630954 10526 rpcz_store.cc:276] 0709 12:26:40.815390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.834393 (+ 19003us) service_pool.cc:224] Handling call
0709 12:26:42.843302 (+2008909us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b58001f1a98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:42.859295 (+ 15993us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:42.893052 (+ 33757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:42.893125 (+    73us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:42.934748 (+ 41623us) log.cc:844] Serialized 26 byte log entry
0709 12:26:43.164087 (+229339us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:43.541053 (+376966us) log.cc:844] Serialized 14 byte log entry
0709 12:26:43.564534 (+ 23481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:43.564655 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:43.564735 (+    80us) raft_consensus.cc:1685] finished
0709 12:26:43.564863 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:43.565039 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":385088,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":10087,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":8150,"spinlock_wait_cycles":9801088,"thread_start_us":470117,"threads_started":2,"wal-append.queue_time_us":279555}
I20260709 12:26:43.849828 11899 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:43.804927 11600 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.852509 12155 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:43.852662 11600 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.853164 12155 raft_consensus.cc:697] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:43.853385 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:43.854543 12176 consensus_queue.cc:1059] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 12:26:43.851954 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 43601.1us
I20260709 12:26:43.855777 10496 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:43.854215 12155 consensus_queue.cc:237] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.832610 12174 consensus_queue.cc:1059] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:43.859088 12177 raft_consensus.cc:3055] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:43.859562 12177 raft_consensus.cc:740] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:43.860563 11600 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:43.860576 12177 consensus_queue.cc:260] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.809060 12159 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:43.821949  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 138588us
W20260709 12:26:43.875715  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:43.940999  9928 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:26:43.936635 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 80969.7us
W20260709 12:26:43.942116  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:43.932178  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 125629us
I20260709 12:26:43.942091  9928 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:43.943879  9854 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:43.945152 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:43.499866  9808 rpcz_store.cc:276] 0709 12:26:41.679373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.679511 (+   138us) service_pool.cc:224] Handling call
0709 12:26:41.679919 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:41.680366 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:41.680409 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:41.681031 (+   622us) log.cc:844] Serialized 26 byte log entry
0709 12:26:41.795477 (+114446us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:41.795900 (+   423us) log.cc:844] Serialized 14 byte log entry
0709 12:26:41.868016 (+ 72116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:41.880789 (+ 12773us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:43.417083 (+1536294us) spinlock_profiling.cc:243] Waited 9.09 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:26:43.499193 (+ 82110us) raft_consensus.cc:1685] finished
0709 12:26:43.499286 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:43.499412 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28894,"prepare.queue_time_us":207,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":70681,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":6138,"spinlock_wait_cycles":20901248,"thread_start_us":105865,"threads_started":1,"wal-append.queue_time_us":204221}
I20260709 12:26:43.887420 12030 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:43.947499 10496 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:43.949565 10533 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:26:43.867540  9886 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:26:43.952052  9810 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
W20260709 12:26:43.959976  9779 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.879s (SENT) [suppressed 8 similar messages]
I20260709 12:26:43.918435 11731 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:43.937839 12177 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:43.964514  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 226729us
I20260709 12:26:43.965554  9854 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:43.878522 12019 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:43.862931 12075 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:43.890187 11626 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:43.888927  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:43.863638 12180 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:43.871114 11575 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:43.943918 12165 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:26:43.985044  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 247734us
I20260709 12:26:43.964499 12167 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:43.982105  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:43.961210 12178 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:43.882063 12124 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:43.865427 11464 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:43.986884 12192 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:43.973466 12030 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:43.987336 12190 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:43.993062 12190 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:43.993511 12190 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:43.993861 11899 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:43.993866 11669 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:43.981750 12147 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.994886 12147 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.996104 12188 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:43.991323 12161 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:43.986091 12156 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:43.982563 12160 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:43.964112 12179 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:43.988104 12075 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
W20260709 12:26:43.998163 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 50756.4us
I20260709 12:26:43.991678 11600 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:44.154645  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:44.347102 12188 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:44.347352 12179 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:44.085331 12178 raft_consensus.cc:697] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:44.347908  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:44.348393 12160 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:43.992270 12030 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:44.124761 12124 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:44.369598  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:44.370333  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:44.383988  9957 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:44.384315  9962 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:44.089330  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:44.125661  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 86319.1us
I20260709 12:26:44.347630 12188 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:44.386163 10496 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:44.390610 12030 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:43.998864 12048 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:44.391005  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:43.999053 11575 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.393s
I20260709 12:26:44.084224 12185 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:43.992517 11675 consensus_meta.cc:287] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.735s	user 0.011s	sys 0.000s
I20260709 12:26:43.991919 10525 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:44.402187 12184 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:44.406634 11675 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:44.406945 12184 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.408749 12070 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:44.409083  9813 raft_consensus.cc:2393] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 5: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:44.409289 12070 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.409785 12082 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:44.349275 12178 consensus_queue.cc:237] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.411420 12070 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:44.408771 11675 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:44.366871  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:44.413517 12070 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:44.413817 12185 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.414018 12070 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:44.360906  9890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2009) took 2635 ms. Trace:
W20260709 12:26:44.351555 12091 consensus_meta.cc:287] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.854s	user 0.010s	sys 0.000s
I20260709 12:26:44.415169 12091 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:44.416158 12185 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:44.416219 12070 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:44.416698 11631 raft_consensus.cc:3055] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:44.417102 12091 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:44.370676  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:44.417830  9964 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:44.417898  9890 rpcz_store.cc:276] 0709 12:26:41.725871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.174332 (+448461us) service_pool.cc:224] Handling call
0709 12:26:42.187192 (+ 12860us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:42.197325 (+ 10133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:42.197354 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:42.197400 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:42.197428 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:44.360547 (+2163119us) spinlock_profiling.cc:243] Waited 9.93 ms on lock 0x7b54001e3554. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:44.360611 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:44.360814 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22845312}
I20260709 12:26:44.419500  9806 raft_consensus.cc:2393] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
W20260709 12:26:44.420361 12154 log.cc:927] Time spent T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.993s	user 0.006s	sys 0.004s
I20260709 12:26:44.421103  9806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46504 (request call id 2083) took 1126 ms. Trace:
I20260709 12:26:44.421479  9806 rpcz_store.cc:276] 0709 12:26:43.294931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.390575 (+1095644us) service_pool.cc:224] Handling call
0709 12:26:44.420919 (+ 30344us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b5400140354. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:44.421047 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35783936}
I20260709 12:26:44.398960 11600 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:26:44.403498 12190 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:44.423014 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:44.423653 10527 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:44.424527 12190 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:44.414065  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:44.426225  9964 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:44.427470  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:44.427574  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:44.428069  9808 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:44.430064  9956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1150) took 1861 ms. Trace:
I20260709 12:26:44.430512  9956 rpcz_store.cc:276] 0709 12:26:42.568355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.973827 (+405472us) service_pool.cc:224] Handling call
0709 12:26:43.005809 (+ 31982us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:43.055209 (+ 49400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:43.055239 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:43.087580 (+ 32341us) log.cc:844] Serialized 26 byte log entry
0709 12:26:43.234387 (+146807us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:43.234444 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:43.234542 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:44.419786 (+1185244us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:26:44.429653 (+  9867us) raft_consensus.cc:1685] finished
0709 12:26:44.429676 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:44.430006 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19497,"raft.queue_time_us":56227,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":20267,"spinlock_wait_cycles":76061056,"thread_start_us":85951,"threads_started":1,"wal-append.queue_time_us":193876}
I20260709 12:26:44.433146  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:44.431087  9814 raft_consensus.cc:2393] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 5: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:44.083380 11464 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:43.999732 12067 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:44.440150 12030 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:43.997843 11929 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:44.441685 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:44.442696 10528 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:44.361636 12020 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:44.448630 12160 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:44.367317  9960 raft_consensus.cc:1240] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:44.409081 12184 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:44.403498 12075 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:44.450405  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:44.417158 11631 raft_consensus.cc:740] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:43.992201 12192 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.451303  9960 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:44.451447 12192 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:44.451835 11631 consensus_queue.cc:260] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.453140 11631 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:44.433454  9778 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:44.460821 12175 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:44.461366 12175 raft_consensus.cc:697] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:26:44.325639 11698 consensus_meta.cc:287] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 1.109s	user 0.009s	sys 0.003s
I20260709 12:26:44.350257 12147 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:44.466686 11848 consensus_queue.cc:1059] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:44.400210 10496 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:26:44.470582 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 70521.8us
I20260709 12:26:44.463183  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:44.468295  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 484086us
I20260709 12:26:44.473369  9962 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:44.473892  9814 raft_consensus.cc:2393] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:44.475958  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46504 (request call id 2089) took 1014 ms. Trace:
I20260709 12:26:44.473790  9854 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:44.476591  9778 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:44.474094  9957 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:44.477985 10496 leader_election.cc:400] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6.
I20260709 12:26:44.478238 10496 leader_election.cc:403] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:44.476337  9814 rpcz_store.cc:276] 0709 12:26:43.461544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.435186 (+973642us) service_pool.cc:224] Handling call
0709 12:26:44.475904 (+ 40718us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:44.480159  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:44.481199  9812 raft_consensus.cc:1240] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:44.481967  9778 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:44.482736  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2080) took 1240 ms. Trace:
I20260709 12:26:44.482669  9889 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
new_leader_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:35896
I20260709 12:26:44.483534  9889 raft_consensus.cc:606] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Received request to transfer leadership to TS b011791796d1457284b857d7d3422195
I20260709 12:26:44.483197  9814 rpcz_store.cc:276] 0709 12:26:43.242548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.481987 (+1239439us) service_pool.cc:224] Handling call
0709 12:26:44.482249 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:44.482452 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:44.482477 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:44.482515 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:44.482544 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:44.482591 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:44.482688 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:44.484011  9889 raft_consensus.cc:614] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:44.485512  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:44.486114  9962 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:44.486649 12165 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:26:44.486303  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2082) took 1238 ms. Trace:
I20260709 12:26:44.493932  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:44.494568  9810 rpcz_store.cc:276] 0709 12:26:43.248468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.485608 (+1237140us) service_pool.cc:224] Handling call
0709 12:26:44.485842 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:44.485993 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:44.486014 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:44.486049 (+    35us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:44.486088 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:44.486142 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:44.486232 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:44.487373  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2081) took 1242 ms. Trace:
I20260709 12:26:44.487295 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:44.474829 12075 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:44.493832 11575 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:44.501681  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:44.487838 12146 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:44.507050  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:44.495620  9814 rpcz_store.cc:276] 0709 12:26:43.244703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.484236 (+1239533us) service_pool.cc:224] Handling call
0709 12:26:44.484472 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:44.487087 (+  2615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:44.487114 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:44.487151 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:44.487180 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:44.487228 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:44.487323 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:44.507985  9962 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:44.508935  9956 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:26:44.509646  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2096) took 1019 ms. Trace:
I20260709 12:26:44.510167  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:44.504894  9957 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:44.510233  9814 rpcz_store.cc:276] 0709 12:26:43.490347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.508577 (+1018230us) service_pool.cc:224] Handling call
0709 12:26:44.509022 (+   445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:44.509226 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:44.509263 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:44.509318 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:44.509362 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:44.509432 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:44.509575 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:44.513640  9853 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:44.462237 12175 consensus_queue.cc:237] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:44.516234  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:44.517423  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:44.518117  9889 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:44.513660  9814 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:44.521129  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:44.514575 11575 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.522012  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:44.522789  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:44.523065  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:44.523689 11575 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:44.516882 12146 raft_consensus.cc:697] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:44.524117  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:44.525173  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:44.524884 12146 consensus_queue.cc:237] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.526742  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:44.528103  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:44.529795  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:44.520260 12181 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:44.521821  9889 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:44.532593  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:44.534576  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:44.532845 10528 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:44.534307  9889 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:44.498071 12067 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:44.487877 12173 consensus_queue.cc:1059] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:26:44.506618 12019 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:44.506397 12160 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:44.516053 12020 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:26:44.550397  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46504 (request call id 2075) took 1322 ms. Trace:
I20260709 12:26:44.550750  9813 rpcz_store.cc:276] 0709 12:26:43.227726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:43.228068 (+   342us) service_pool.cc:224] Handling call
0709 12:26:44.550205 (+1322137us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54001f5254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:44.550345 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2707014528}
I20260709 12:26:44.551534  9811 raft_consensus.cc:1240] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:26:44.547482  9808 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:44.525190  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:44.553107  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46504 (request call id 2085) took 1198 ms. Trace:
I20260709 12:26:44.553416  9962 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:44.553565  9808 rpcz_store.cc:276] 0709 12:26:43.354316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.427364 (+1073048us) service_pool.cc:224] Handling call
0709 12:26:44.553046 (+125682us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:44.520788 12169 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.555619  9961 raft_consensus.cc:1240] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:44.557088  9853 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:44.563732  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:44.564433  9885 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 4: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:44.507164 12192 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.554045 10528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 727) took 1329 ms. Trace:
I20260709 12:26:44.555055 12067 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.560107 12169 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.559603 12160 raft_consensus.cc:697] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:44.570036 10528 rpcz_store.cc:276] 0709 12:26:43.217870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:43.220090 (+  2220us) service_pool.cc:224] Handling call
0709 12:26:44.441470 (+1221380us) spinlock_profiling.cc:243] Waited 7.87 ms on lock 0x7b58001f1a98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:44.547174 (+105704us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18099072}
I20260709 12:26:44.560329  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:44.581769  9809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 1880) took 1723 ms. Trace:
I20260709 12:26:44.684871  9883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 2024) took 1052 ms. Trace:
I20260709 12:26:44.708092  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:44.708815  9883 rpcz_store.cc:276] 0709 12:26:43.632024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:43.632769 (+   745us) service_pool.cc:224] Handling call
0709 12:26:44.684704 (+1051935us) spinlock_profiling.cc:243] Waited 95.3 ms on lock 0x7b54001bc454. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:44.684815 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219082624}
W20260709 12:26:44.704622 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 217352us
I20260709 12:26:44.683679 10532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36672 (request call id 650) took 1187 ms. Trace:
W20260709 12:26:44.710810  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:44.711624  9927 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:44.712361  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:44.704643  9890 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:44.584160  9928 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:26:44.578670  9761 auto_rebalancer.cc:893] Removing replace marker failed: Replica 963185e117384b2085d7cea02a64478b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } } }
I20260709 12:26:44.584627  9807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 1876) took 1727 ms. Trace:
I20260709 12:26:44.705792  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:44.591269  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:44.592540  9812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2073) took 1369 ms. Trace:
I20260709 12:26:44.717363  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:44.716032  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 159000us
W20260709 12:26:44.714998  9761 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:26:44.711056 10532 rpcz_store.cc:276] 0709 12:26:43.496047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:43.496382 (+   335us) service_pool.cc:224] Handling call
0709 12:26:43.545282 (+ 48900us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:43.647814 (+102532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:43.647862 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:43.647922 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:43.647973 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:44.683414 (+1035441us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54002ec554. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:44.683473 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:44.683617 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235215744}
I20260709 12:26:44.722966  9958 raft_consensus.cc:2393] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:44.717146  9812 rpcz_store.cc:276] 0709 12:26:43.223100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:43.223259 (+   159us) service_pool.cc:224] Handling call
0709 12:26:43.240148 (+ 16889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:44.484635 (+1244487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:44.592233 (+107598us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400183dd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:44.592462 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2848201984}
I20260709 12:26:44.708243  9809 rpcz_store.cc:276] 0709 12:26:42.864813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.926541 (+ 61728us) service_pool.cc:224] Handling call
0709 12:26:42.926840 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:43.489579 (+562739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:44.581534 (+1091955us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b54002d7154. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:44.581705 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742599040}
I20260709 12:26:44.724756  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:44.570406 12019 raft_consensus.cc:697] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:44.725935  9958 raft_consensus.cc:2410] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:26:44.722637  9853 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:26:44.726161  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 142099us
I20260709 12:26:44.728400  9927 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:26:44.583180 12151 log.cc:927] Time spent T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 1.210s	user 0.006s	sys 0.010s
I20260709 12:26:44.729108  9808 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 3. Current term is 4. Ops: []
W20260709 12:26:44.722962  9761 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:26:44.595595 12030 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:44.560010  9806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2079) took 1330 ms. Trace:
I20260709 12:26:44.709065 12067 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:44.730160 12133 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:44.571235 11600 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:44.728083 12191 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.726819 11736 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.735119 12075 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:44.735754  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:44.747161  9885 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:44.583825 12192 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:44.580938 12194 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:44.736603  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:44.714501 11669 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:44.752295 11736 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.752861 11669 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.754454 11736 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:44.737155 12190 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:44.730559 12193 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:44.730206 12021 raft_consensus.cc:2804] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:44.743204  9853 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:44.744441  9962 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:44.748606  9808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46484
I20260709 12:26:44.730434 12127 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:44.727777  9881 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:44.751799  9958 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 4: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:44.755110  9811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 1875) took 1898 ms. Trace:
I20260709 12:26:44.717933  9807 rpcz_store.cc:276] 0709 12:26:42.857151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.857267 (+   116us) service_pool.cc:224] Handling call
0709 12:26:42.892530 (+ 35263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:43.150566 (+258036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:43.150611 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:43.219063 (+ 68452us) log.cc:844] Serialized 26 byte log entry
0709 12:26:43.633654 (+414591us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:43.633710 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:43.634976 (+  1266us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:43.848136 (+213160us) raft_consensus.cc:1685] finished
0709 12:26:43.848163 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:44.584397 (+736234us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b54001f5c50. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:44.584572 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97460,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":5605,"spinlock_wait_cycles":80338688,"thread_start_us":394010,"threads_started":2,"wal-append.queue_time_us":484884}
I20260709 12:26:44.767566  9811 rpcz_store.cc:276] 0709 12:26:42.856317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.856868 (+   551us) service_pool.cc:224] Handling call
0709 12:26:43.912953 (+1056085us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b5800010e98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:44.551341 (+638388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:44.551808 (+   467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:44.754929 (+203121us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b54001f5250. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:44.755057 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1472328832}
I20260709 12:26:44.756913  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:44.738768 12178 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.760382 11669 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:44.736794 11464 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:26:44.771494  9963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 1823) took 2413 ms. Trace:
I20260709 12:26:44.771983  9963 rpcz_store.cc:276] 0709 12:26:42.358181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.962324 (+604143us) service_pool.cc:224] Handling call
0709 12:26:42.970002 (+  7678us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:42.970498 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:26:43.025406 (+ 54908us) log.cc:844] Serialized 14 byte log entry
0709 12:26:43.220610 (+195204us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:43.221239 (+   629us) log.cc:844] Serialized 26 byte log entry
0709 12:26:43.221422 (+   183us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:43.221466 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:43.221551 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:44.582558 (+1361007us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:26:44.760997 (+178439us) raft_consensus.cc:1685] finished
0709 12:26:44.771207 (+ 10210us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:44.771389 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":91308,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":1313,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":30109,"spinlock_wait_cycles":59868672,"thread_start_us":154619,"threads_started":1,"wal-append.queue_time_us":292342}
I20260709 12:26:44.763134  9853 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:44.764858  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:44.776047  9890 raft_consensus.cc:2393] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:44.776077  9853 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:44.740103 12133 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:44.735715 11929 consensus_queue.cc:1059] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
W20260709 12:26:44.766654 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 1.02755e+06us
I20260709 12:26:44.594048 12160 consensus_queue.cc:237] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:44.755913  9778 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:44.770171  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:44.761127 11736 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:44.778157  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:44.782087  9962 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:44.778856  9853 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:44.761411 12169 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:44.765285 12021 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:44.789678 12021 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:44.767544 12193 raft_consensus.cc:697] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:44.791112 12193 consensus_queue.cc:237] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:44.768712 11600 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:44.794524 11600 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.779255 12178 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.795063 11600 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:44.786538  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:44.779691 12189 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:44.783344  9778 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:44.757323 12075 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.798983  9890 raft_consensus.cc:2393] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 5: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:44.803674  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:44.774871 12181 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:44.768847  9960 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:44.750056 12191 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.810575  9963 raft_consensus.cc:1240] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:44.780503 12133 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:44.816609 12207 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.817162 12207 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.819406 12207 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:26:44.820377 10496 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:44.813827  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:44.822307  9962 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:44.823678 10496 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:44.824457 12207 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:44.825083 12207 consensus_queue.cc:1059] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:44.825989 12207 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:44.826346 12207 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:44.826743 12207 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:44.815816  9963 raft_consensus.cc:2955] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:44.828164  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:44.833875 12207 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.836992 12207 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:44.837213  9962 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:44.838399 10496 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:44.838346 12133 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.839679  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:44.840749 12133 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:44.840919  9962 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:44.842222 12208 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:44.844163  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:44.767659 12127 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:44.737010  9806 rpcz_store.cc:276] 0709 12:26:43.229972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.479256 (+1249284us) service_pool.cc:224] Handling call
0709 12:26:44.512779 (+ 33523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:44.520755 (+  7976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:44.535580 (+ 14825us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:44.539419 (+  3839us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:44.546769 (+  7350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:44.549660 (+  2891us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:44.558704 (+  9044us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:44.786885 12113 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:44.849004  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:44.803141 11921 raft_consensus.cc:3055] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:44.850602 12194 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:44.806640 12067 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:44.840232 12207 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:44.805397 12189 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.852805  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:44.861326  9807 raft_consensus.cc:2393] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 2: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:44.852996  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:44.853785  9778 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:44.858760  9958 raft_consensus.cc:1240] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:26:44.843149 12206 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:44.847144 12144 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:44.843037 12208 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.848258 12181 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:44.874642  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:44.889439  9812 raft_consensus.cc:2410] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:26:44.798177 11736 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:44.853724 11921 raft_consensus.cc:740] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:44.891690  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:44.892441  9883 raft_consensus.cc:2393] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 7: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:44.893311  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:44.878870 12207 raft_consensus.cc:697] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:44.893973  9888 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:26:44.862286 12113 raft_consensus.cc:697] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:44.894430 12207 consensus_queue.cc:237] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.894909 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:44.895218  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:44.890924 12144 raft_consensus.cc:697] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:44.895864  9884 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 4: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:44.894909  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:44.895694 12113 consensus_queue.cc:237] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:44.896569  9887 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:26:44.896535 12144 consensus_queue.cc:237] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:44.892467 11921 consensus_queue.cc:260] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.787300 12019 consensus_queue.cc:237] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:44.871503 12153 consensus_queue.cc:1059] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:26:44.870693  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:44.886749  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:44.894965  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:45.357887 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:45.373898  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.373783 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:45.040968 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 45627.8us
I20260709 12:26:45.200821  9955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1138) took 2665 ms. Trace:
I20260709 12:26:44.992182  9885 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:45.210479 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:45.087184  9962 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:45.062309 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:45.054405 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:45.382649  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:45.383424  9884 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:44.871552 12189 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:45.384410  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:45.385114  9883 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
W20260709 12:26:45.387266  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 262475us
W20260709 12:26:45.390952  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:45.394100 10497 leader_election.cc:336] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 2.026s (SENT)
I20260709 12:26:45.381965 10529 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 1.
W20260709 12:26:45.258905 12165 consensus_meta.cc:287] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.761s	user 0.007s	sys 0.003s
W20260709 12:26:45.265640 11698 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.012s	sys 0.021s
I20260709 12:26:45.080452 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:45.128695 12201 log.cc:927] Time spent T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.394s	user 0.000s	sys 0.001s
I20260709 12:26:45.375936  9955 rpcz_store.cc:276] 0709 12:26:42.535942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:42.949750 (+413808us) service_pool.cc:224] Handling call
0709 12:26:42.950074 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:43.204316 (+254242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:43.204363 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:43.204978 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 12:26:43.243195 (+ 38217us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:43.243241 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.200424 (+1957183us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54001d2754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:45.200468 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:45.200511 (+    43us) raft_consensus.cc:1685] finished
0709 12:26:45.200522 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:45.200741 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7281,"raft.queue_time_us":7294,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":120,"spinlock_wait_cycles":569952128,"thread_start_us":37782,"threads_started":1,"wal-append.queue_time_us":142987,"wal-append.run_cpu_time_us":3029,"wal-append.run_wall_time_us":1395895}
I20260709 12:26:45.419677 10496 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:45.418601  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:45.417706  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:45.417863  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:45.414557  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:45.199205 12155 raft_consensus.cc:3055] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:45.476734  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:44.877801 12175 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:45.063083 12145 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:26:45.053952 12162 log.cc:927] Time spent T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 1.380s	user 0.006s	sys 0.008s
I20260709 12:26:44.899901  9960 raft_consensus.cc:1240] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
W20260709 12:26:45.396905 12146 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.002s	sys 0.015s
I20260709 12:26:45.420264 11848 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:45.416687 11921 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:45.493005 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:45.493696 10532 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:45.421185 11644 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.418728 12159 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:45.487555  9961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1157) took 1120 ms. Trace:
I20260709 12:26:45.379069 12173 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:45.496356 12146 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.003s	sys 0.015s
I20260709 12:26:45.479141  9963 raft_consensus.cc:1240] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: []
W20260709 12:26:45.467152 11698 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.025s	sys 0.026s
I20260709 12:26:45.478433 12155 raft_consensus.cc:740] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:26:45.484946  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 91563.7us
I20260709 12:26:45.418238 12127 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:45.468696 12165 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6.
I20260709 12:26:45.391675 11736 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:45.501183  9961 rpcz_store.cc:276] 0709 12:26:44.367543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.370841 (+  3298us) service_pool.cc:224] Handling call
0709 12:26:44.371145 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:44.556073 (+184928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.487328 (+931255us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5400413054. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:45.487500 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423712512}
I20260709 12:26:45.516721  9808 raft_consensus.cc:606] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:26:44.888049 12188 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:44.879535 12206 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:45.482142 12147 raft_consensus.cc:3055] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:44.910853 12178 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:45.495772  9853 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.014s	sys 0.035s
W20260709 12:26:45.544183  9853 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.015s	sys 0.035s
I20260709 12:26:45.490418 12145 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:45.509583  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:45.512133 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:44.921054 12181 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:45.518680 12021 consensus_meta.cc:287] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.000s
I20260709 12:26:45.521196  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 331) took 1545 ms. Trace:
I20260709 12:26:45.499035 11848 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:45.523765 11669 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:45.527004  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:45.500182 11914 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.559259 10532 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:26:45.502661  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:45.503254 11644 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:45.534623 11600 consensus_meta.cc:287] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.739s	user 0.009s	sys 0.002s
I20260709 12:26:45.536211  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2095) took 2046 ms. Trace:
I20260709 12:26:45.536437  9961 raft_consensus.cc:1240] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:45.508142  9963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 1835) took 1017 ms. Trace:
I20260709 12:26:45.592393  9963 rpcz_store.cc:276] 0709 12:26:44.491036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.389510 (+898474us) service_pool.cc:224] Handling call
0709 12:26:45.478965 (+ 89455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:45.507839 (+ 28874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.508086 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.592975 10533 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
W20260709 12:26:45.547709  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 584989us
I20260709 12:26:45.510109 12173 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:45.509955 12075 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:45.549968  9958 raft_consensus.cc:1240] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:45.543005 12147 raft_consensus.cc:740] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:45.514045  9960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1165) took 1144 ms. Trace:
I20260709 12:26:45.557754 12159 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:45.548627  9814 rpcz_store.cc:276] 0709 12:26:43.975607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.535732 (+560125us) service_pool.cc:224] Handling call
0709 12:26:44.542389 (+  6657us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:44.549471 (+  7082us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:44.550199 (+   728us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:44.550652 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 12:26:44.872320 (+321668us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:44.890781 (+ 18461us) log.cc:844] Serialized 14 byte log entry
0709 12:26:45.386881 (+496100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.386986 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:45.520988 (+134002us) raft_consensus.cc:1685] finished
0709 12:26:45.521007 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:45.521134 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67,"prepare.queue_time_us":19756,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":400,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":10079,"thread_start_us":304115,"threads_started":1,"wal-append.queue_time_us":959192}
I20260709 12:26:45.563037  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:45.565080  9810 rpcz_store.cc:276] 0709 12:26:43.489615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.502705 (+1013090us) service_pool.cc:224] Handling call
0709 12:26:45.535368 (+1032663us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b5800010e98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:45.535612 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:45.535816 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:45.535851 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:45.535903 (+    52us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:45.535947 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.536025 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:45.536145 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6740736}
I20260709 12:26:45.598153  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 1869) took 3912 ms. Trace:
I20260709 12:26:45.547160 12191 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:45.649291  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:45.650161  9812 raft_consensus.cc:2376] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b011791796d1457284b857d7d3422195 in term 5. Re-sending same reply.
I20260709 12:26:45.557479 10527 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:45.557930 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:45.653820  9814 raft_consensus.cc:1240] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:45.647989  9813 raft_consensus.cc:2393] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 4: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:45.606439  9957 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:45.554767 12143 consensus_queue.cc:1059] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:26:45.647284  9815 rpcz_store.cc:276] 0709 12:26:41.680061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:43.176722 (+1496661us) service_pool.cc:224] Handling call
0709 12:26:43.177170 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:43.227673 (+ 50503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:43.227705 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:43.247239 (+ 19534us) log.cc:844] Serialized 26 byte log entry
0709 12:26:43.516069 (+268830us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:43.632720 (+116651us) log.cc:844] Serialized 14 byte log entry
0709 12:26:43.672675 (+ 39955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:43.673279 (+   604us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:44.925707 (+1252428us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:26:45.120178 (+194471us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b180022fa80. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f3f3 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:26:45.585686 (+465508us) raft_consensus.cc:1685] finished
0709 12:26:45.585725 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:45.592121 (+  6396us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110795,"prepare.queue_time_us":197851,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":181882,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":50360,"spinlock_wait_cycles":17586304,"thread_start_us":285074,"threads_started":3,"wal-append.queue_time_us":289930}
I20260709 12:26:45.685245  9812 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:45.594405 11848 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:45.564546 11914 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:45.604461 11644 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:45.601846  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:45.599836 11669 raft_consensus.cc:697] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:45.558414 12021 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:45.591984 11600 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:45.673632 10528 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:26:45.694135 11921 raft_consensus.cc:3055] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:26:45.721895 12215 log.cc:927] Time spent T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:26:45.651563  9960 rpcz_store.cc:276] 0709 12:26:44.369702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.860559 (+490857us) service_pool.cc:224] Handling call
0709 12:26:44.899653 (+ 39094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:45.497790 (+598137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.509666 (+ 11876us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:45.659427 12159 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:45.736501 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 316890us
I20260709 12:26:45.727903 11921 raft_consensus.cc:740] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:45.737918 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:45.756697 11669 consensus_queue.cc:237] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:45.759066 12214 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.759788 12214 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:45.753973 10496 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:45.723317 12147 consensus_queue.cc:260] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:45.785176  9957 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:45.761572 12207 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:45.761313 12165 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:26:45.775799 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:45.780720 12157 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:45.782815 12188 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:45.798069  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:45.800750 10528 raft_consensus.cc:2393] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 5: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:45.800613  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:45.802239  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:45.804152  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:45.804816  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:45.805613  9888 raft_consensus.cc:2393] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 5: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:45.811316 11644 raft_consensus.cc:993] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower b011791796d1457284b857d7d3422195 to start an election
I20260709 12:26:45.812036 11644 raft_consensus.cc:1081] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Signalling peer b011791796d1457284b857d7d3422195 to start an election
I20260709 12:26:45.812150 11600 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:45.812702 12021 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:45.813244  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:45.814199  9882 raft_consensus.cc:2393] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 4: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:45.814100  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:45.816000 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:45.817157 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:45.817806 12208 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:45.789059 11921 consensus_queue.cc:260] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:45.801826 12147 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:45.820035 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:45.836730 10528 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:45.838860 11921 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:45.842504 12052 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:45.844700 10528 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 4 LEARNER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:45.851238 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:45.852825 12177 raft_consensus.cc:3055] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:45.853268 12177 raft_consensus.cc:740] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:45.854048 12177 consensus_queue.cc:260] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:45.855237 12177 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:45.857558 12157 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:45.859063 12194 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:45.859498 12194 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:45.862831  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:45.863839  9927 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:45.864396  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:45.865418  9927 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:45.865955  9958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1167) took 1464 ms. Trace:
I20260709 12:26:45.868626  9958 rpcz_store.cc:276] 0709 12:26:44.401971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.873476 (+471505us) service_pool.cc:224] Handling call
0709 12:26:44.873818 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:45.598831 (+725013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.865730 (+266899us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b5400412b54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:45.865903 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1554520448}
I20260709 12:26:45.820294 12221 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:45.786212 12145 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:45.800863 12226 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:26:45.821838 12159 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:45.822499 11914 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:45.790578 12189 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:45.822872  9963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1175) took 1009 ms. Trace:
I20260709 12:26:45.823071 12021 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.823539 12181 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:45.823457  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:45.874246  9963 rpcz_store.cc:276] 0709 12:26:44.813354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.593442 (+780088us) service_pool.cc:224] Handling call
0709 12:26:45.822203 (+228761us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b5800135f98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7eee 000000000036eb39 00007f2f9346b1e0 00007f2f935340c4 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:45.822373 (+   170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:45.822554 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:45.822580 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:45.822622 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:45.822659 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.822717 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:45.822818 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5229824}
I20260709 12:26:45.825733 12214 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:45.793994 12127 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:45.883038  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 69249us
W20260709 12:26:45.827611  9928 connection.cc:256] RPC call timeout handler was delayed by -1.0002162450000469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
I20260709 12:26:45.795621 12178 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:26:45.798014 12206 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:45.795962  9960 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:45.829761 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:45.831020  9779 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.846s	user 0.015s	sys 0.024s
I20260709 12:26:45.832695 12173 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:45.833295  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:45.813282 12160 consensus_queue.cc:1059] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
W20260709 12:26:45.834950 12218 log.cc:927] Time spent T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:26:45.867192 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:45.794848 12175 raft_consensus.cc:697] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:45.820199 12180 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:45.818176 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:45.871846  9927 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:45.925010 10529 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:45.877063  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:45.925738  9889 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 1.
I20260709 12:26:45.926692  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:26:45.928633  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 56845.1us
I20260709 12:26:45.929838  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:26:45.932459  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.877686  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:45.885677  9957 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:45.927253  9889 raft_consensus.cc:2376] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5. Re-sending same reply.
I20260709 12:26:45.886132  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:45.890216  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.891098  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:45.892349  9888 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:45.901118  9928 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:45.901692  9890 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:45.914083  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:45.897321 12127 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:45.882644 12221 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:45.890908 12021 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:45.916136 12159 consensus_queue.cc:1059] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:45.955731  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:45.902132 11921 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:26:45.900563 12091 consensus_queue.cc:1059] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:26:45.873337 12188 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:26:45.923290  9779 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.938s	user 0.015s	sys 0.024s
W20260709 12:26:45.962725  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 2.00256e+06us
I20260709 12:26:45.963927  9958 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:45.933075 12130 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:45.934938  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:45.959537 10524 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:45.990471  9889 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:45.991430  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:45.991995  9889 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:45.947070 12153 raft_consensus.cc:3055] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:45.937338 10531 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
I20260709 12:26:45.943315  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:45.945787  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:45.939707  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:45.993906  9885 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:45.994638  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:45.949168  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:45.956377  9887 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:45.960136  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:45.924037  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:45.977218  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:45.979378  9814 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:45.998800  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:45.999848  9889 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:45.980072  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:45.981801  9815 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:45.983160  9813 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:45.984182  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:45.986564  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.987186  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:46.002871  9882 raft_consensus.cc:2368] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3.
I20260709 12:26:46.003209  9809 raft_consensus.cc:2410] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:26:46.004415  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:46.005035  9888 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:46.005584  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:46.017345  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:46.019507  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:46.020268  9884 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:46.022740  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:45.961830  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:46.023867  9884 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:46.029843  9885 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:26:46.032630  9889 raft_consensus.cc:1240] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:46.033254  9884 raft_consensus.cc:1275] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:46.032508  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:46.035727  9888 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:26:46.042618  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:46.042922  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:45.989449  9961 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a"
dest_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55952
I20260709 12:26:46.043660  9961 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:46.044006  9961 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:45.933252 12180 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:46.044759  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:46.042551 12178 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.047812  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:46.048329 12227 consensus_queue.cc:1059] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:46.048710  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:46.051208 12189 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:46.051604 12091 consensus_queue.cc:1059] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:46.053170 12230 log.cc:927] Time spent T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:26:46.054253  9964 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:46.054900 12221 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:46.055423 12021 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:46.005396 12188 raft_consensus.cc:697] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:46.056501 12127 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:45.994554 12153 raft_consensus.cc:740] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:45.953501 12233 consensus_queue.cc:1059] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:26:46.043491  9890 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:46.059677  9812 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:46.066951  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:46.099942  9810 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
W20260709 12:26:46.099424  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 198411us
I20260709 12:26:46.044137 12228 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:46.031546 11698 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:26:46.046299 12107 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:46.061162 12235 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:46.031412 12113 consensus_queue.cc:1048] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:26:46.092417 12038 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.103542  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:46.091341 12019 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.119478  9962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 331) took 1382 ms. Trace:
I20260709 12:26:46.127890  9962 rpcz_store.cc:276] 0709 12:26:44.740086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.840143 (+1100057us) service_pool.cc:224] Handling call
0709 12:26:45.840422 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:45.840606 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:26:45.963891 (+123285us) log.cc:844] Serialized 14 byte log entry
0709 12:26:46.119123 (+155232us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:46.119190 (+    67us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:46.119234 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:46.119301 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:46.119419 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":215032,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"thread_start_us":277865,"threads_started":2}
W20260709 12:26:46.128135  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 128445us
I20260709 12:26:46.055442 12175 consensus_queue.cc:237] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:46.119189 12227 raft_consensus.cc:3055] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:46.069444 12178 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:46.137082  9962 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:46.131484  9961 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:46.124168 12071 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:46.140793 12145 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:46.132037 12019 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:46.142218 12180 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:46.132191 12038 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:46.143325 12019 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:46.142794 12153 consensus_queue.cc:260] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:46.144181 12153 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:46.143872 12188 consensus_queue.cc:237] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:46.136961 12227 raft_consensus.cc:740] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:26:46.146782 12234 log.cc:927] Time spent T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:26:46.147200 12227 consensus_queue.cc:260] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:46.127413 12107 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:46.132053 12166 raft_consensus.cc:3055] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:46.142706 12178 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:46.148416 12227 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:46.166100  9888 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:46.168450  9955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 332) took 1428 ms. Trace:
W20260709 12:26:46.169021  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 65580.9us
I20260709 12:26:46.168840  9955 rpcz_store.cc:276] 0709 12:26:44.740390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.476365 (+735975us) service_pool.cc:224] Handling call
0709 12:26:45.503180 (+ 26815us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:45.503523 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:45.503549 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:45.505258 (+  1709us) log.cc:844] Serialized 26 byte log entry
0709 12:26:45.795329 (+290071us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:45.795456 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:45.795929 (+   473us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:46.168251 (+372322us) raft_consensus.cc:1685] finished
0709 12:26:46.168272 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:46.168395 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":3694,"thread_start_us":276464,"threads_started":1,"wal-append.queue_time_us":385618}
I20260709 12:26:46.171968  9961 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:46.128191 12228 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:46.176375 12228 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:46.177073 12228 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:46.158809 12107 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:46.158257 12166 raft_consensus.cc:740] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:46.181461 12166 consensus_queue.cc:260] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:46.185932  9956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 329) took 1449 ms. Trace:
I20260709 12:26:46.187282  9956 rpcz_store.cc:276] 0709 12:26:44.736279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.867369 (+1131090us) service_pool.cc:224] Handling call
0709 12:26:45.867701 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:45.867944 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:26:45.927273 (+ 59329us) log.cc:844] Serialized 14 byte log entry
0709 12:26:46.184989 (+257716us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:46.185116 (+   127us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:46.185218 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:46.185728 (+   510us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:46.185865 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20968,"prepare.queue_time_us":187920,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":69226,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":7352,"spinlock_wait_cycles":596864,"thread_start_us":315617,"threads_started":3,"wal-append.queue_time_us":205361}
I20260709 12:26:46.168392 12127 raft_consensus.cc:2764] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:26:46.196019  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.208971  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:46.132267 12235 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:46.216312  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.218740  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:26:46.302431  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 83812.3us
W20260709 12:26:46.223337  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 156315us
I20260709 12:26:46.268375 12107 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:46.263556  9959 raft_consensus.cc:1240] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:26:46.192091 12143 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.342809  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46484 (request call id 85) took 1604 ms. Trace:
I20260709 12:26:46.304025  9928 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:46.310478 12107 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:46.365691 10497 leader_election.cc:336] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.583s (SENT)
I20260709 12:26:46.371642 10497 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:46.371716 12107 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:26:46.371815  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 67861.7us
I20260709 12:26:46.372694 12208 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:46.371039 12143 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:46.341720 11669 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:46.375469 12143 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:46.378407  9928 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:46.379763 12081 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:46.379993  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:46.375151 11669 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:46.208572 12189 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:46.304885 11731 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:26:46.304818  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 80550.5us
I20260709 12:26:46.319815  9886 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:46.344221 12159 raft_consensus.cc:3055] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:46.324815 12214 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:26:46.316309  9927 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:46.370936  9808 rpcz_store.cc:276] 0709 12:26:44.738378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.739022 (+   644us) service_pool.cc:224] Handling call
0709 12:26:46.342645 (+1603623us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54001847d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e516853 00007f2f934e460a 00007f2f8ca6a7d4 00007f2f8ca6a762 00007f2f8ca6a691 00007f2f8ca6a60c 00007f2f8ca698c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:46.342733 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1731465088}
I20260709 12:26:46.380977 12107 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:46.272320 12155 consensus_queue.cc:260] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:46.422040  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 115975us
I20260709 12:26:46.381681  9928 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:26:46.406798 10527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 497) took 1198 ms (client timeout 1510 ms). Trace:
I20260709 12:26:46.422823  9927 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:46.423724  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 1836) took 1689 ms. Trace:
I20260709 12:26:46.370052 12235 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:46.426216  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:46.429966 10527 rpcz_store.cc:269] 0709 12:26:45.208694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.210129 (+  1435us) service_pool.cc:224] Handling call
0709 12:26:46.406569 (+1196440us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b540002fdd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:46.406719 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388602624}
I20260709 12:26:46.218197 12251 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:26:46.429064  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.430706  9963 raft_consensus.cc:1240] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:46.451464  9886 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
W20260709 12:26:46.431013  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 49263.6us
I20260709 12:26:46.452471  9928 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:46.431433  9927 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:46.430321  9959 rpcz_store.cc:276] 0709 12:26:44.734702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.262661 (+1527959us) service_pool.cc:224] Handling call
0709 12:26:46.263171 (+   510us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:46.423370 (+160199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:46.423657 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:46.244709 12019 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:46.436744 11733 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:46.437206 12184 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:46.464102  9963 raft_consensus.cc:1240] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:46.438669 12208 consensus_queue.cc:1059] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:46.430997 12143 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:46.438699  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:46.431210 12178 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:26:46.419143 12038 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:46.440008  9956 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:46.386935 12052 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.426962 11731 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:46.441643 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:46.442270 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:46.519060 10530 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:46.442440 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:46.442771 11669 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:46.216630 12194 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:46.442888 12206 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:46.312290 12232 raft_consensus.cc:3055] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:46.627514 12232 raft_consensus.cc:740] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:46.628443 12232 consensus_queue.cc:260] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:46.629503 12232 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:46.470425 12019 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:46.444383 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:46.429443 12189 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:46.631075 10524 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:46.314361 12166 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:46.445986 12081 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:46.517647  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:46.422689 12159 raft_consensus.cc:740] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:46.353590 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:46.430197  9962 raft_consensus.cc:1275] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:46.433384 10496 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:26:46.643625 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 210332us
I20260709 12:26:46.645078 10496 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:46.457808 10527 raft_consensus.cc:1240] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:46.465684  9813 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:46484
I20260709 12:26:46.467576  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:46.468901  9815 raft_consensus.cc:1275] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:46.469734  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:46.511909  9961 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:46.451215 12251 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:46.509328  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 47304.1us
W20260709 12:26:46.521138  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 68769.1us
I20260709 12:26:46.577593  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:46.463367 12072 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:26:46.582473  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 87245.9us
I20260709 12:26:46.576807 11731 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:46.459057 11733 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:46.639849 10532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 740) took 1223 ms. Trace:
W20260709 12:26:46.640687  9811 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.000s	sys 0.020s
I20260709 12:26:46.646230 10496 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:46.670189  9963 raft_consensus.cc:2410] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:26:46.676631 10532 rpcz_store.cc:276] 0709 12:26:45.415961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.499785 (+ 83824us) service_pool.cc:224] Handling call
0709 12:26:46.639603 (+1139818us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b54006801d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:46.639770 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32657152}
I20260709 12:26:46.670751  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:46.671864  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:46.458993 12226 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.651916  9962 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:26:46.665400  9964 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55952 (request call id 1166) took 2241 ms (client timeout 1793 ms). Trace:
I20260709 12:26:46.670044  9928 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:46.679739 11733 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:46.682401 11669 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:46.677712 12178 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:46.678958  9812 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:46.685324 12159 consensus_queue.cc:260] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:46.676749  9811 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.000s	sys 0.021s
I20260709 12:26:46.686380 10526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 729) took 1321 ms. Trace:
W20260709 12:26:46.686854 12262 log.cc:927] Time spent T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:26:46.687917 12194 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:46.642678  9806 raft_consensus.cc:3055] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:46.576541 12052 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:46.579140 12188 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:46.690860 12189 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:46.692163  9960 raft_consensus.cc:1240] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:46.692917 11731 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:46.693253 12019 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:46.694432  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.695950  9961 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:26:46.677263 12251 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:46.700906 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 54768.4us
I20260709 12:26:46.758976  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:46.710979 12227 consensus_queue.cc:1059] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 12:26:46.710803 12208 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:46.711961 12165 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.811777  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:46.811220  9964 rpcz_store.cc:269] 0709 12:26:44.397504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.426955 (+ 29451us) service_pool.cc:224] Handling call
0709 12:26:46.638807 (+2211852us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54000b36d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:46.638958 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3739865472}
W20260709 12:26:46.815131  9779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.041s	sys 0.099s
W20260709 12:26:46.830053  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:46.860777  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.817191 12226 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:46.879791  9806 raft_consensus.cc:740] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:26:46.982411  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:47.128984  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:47.364089  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:47.364482  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:47.048609  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 378605us
W20260709 12:26:47.103858  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 203641us
W20260709 12:26:47.369577 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:47.272672  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.988004 12188 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:47.372241 12188 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:47.374576  9779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.244s	user 0.041s	sys 0.115s
W20260709 12:26:47.375166  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 1.24436e+06us
W20260709 12:26:47.212155 12267 log.cc:927] Time spent T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:26:46.861472 10526 rpcz_store.cc:276] 0709 12:26:45.365367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.365678 (+   311us) service_pool.cc:224] Handling call
0709 12:26:46.308387 (+942709us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b58001f1a98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:46.686290 (+377903us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16820480}
I20260709 12:26:47.370927  9963 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:46.986370 12146 raft_consensus.cc:3055] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:47.427958 12146 raft_consensus.cc:740] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:26:47.429193  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 53248.7us
I20260709 12:26:47.428964 12146 consensus_queue.cc:260] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:47.434154 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:47.383857  9927 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:47.434777 10527 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:47.377797  9811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 351) took 1352 ms. Trace:
I20260709 12:26:47.363857 12072 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:47.212741 11731 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:47.204526 12143 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.454357 10527 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:47.425064  9806 consensus_queue.cc:260] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:47.214957 12166 consensus_meta.cc:287] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.005s
W20260709 12:26:47.213269 12232 consensus_meta.cc:287] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.583s	user 0.012s	sys 0.002s
I20260709 12:26:47.071241 12178 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:47.426470 12226 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:47.427059 12271 log.cc:927] Time spent T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:26:47.427305 11736 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:47.472219  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 345) took 1012 ms. Trace:
I20260709 12:26:47.439033 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:47.440412 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:47.440837 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:47.441481 12072 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:47.025579 12159 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:47.048866 12147 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:47.356345 12052 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:47.454435  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 70642.2us
I20260709 12:26:47.484685  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:47.104421 12081 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:47.377617 12038 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.382139 11669 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.457005 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:47.383571 12165 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:47.365352 12155 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:47.413062 12183 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.435520  9811 rpcz_store.cc:276] 0709 12:26:46.025104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.030386 (+  5282us) service_pool.cc:224] Handling call
0709 12:26:46.030736 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:46.030970 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:26:46.134602 (+103632us) log.cc:844] Serialized 14 byte log entry
0709 12:26:47.377428 (+1242826us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:47.377487 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:47.377534 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:47.377600 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:47.377732 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":169653,"prepare.queue_time_us":27043,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":397,"raft.queue_time_us":546382,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"thread_start_us":771404,"threads_started":2,"wal-append.queue_time_us":866283}
I20260709 12:26:47.380379 12208 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.232465 12206 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.464350  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:47.430181 12146 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:47.297747  9881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2029) took 1495 ms. Trace:
I20260709 12:26:47.381963 12189 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:47.460350 11921 raft_consensus.cc:2804] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:47.467334 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:47.467410 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:47.468036 12232 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:47.620134 12232 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:47.612293 12166 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:26:47.628275 12268 log.cc:927] Time spent T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.396s	user 0.001s	sys 0.001s
I20260709 12:26:47.468628 12178 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:47.413909 12019 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:47.472671  9959 rpcz_store.cc:276] 0709 12:26:46.459744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.459893 (+   149us) service_pool.cc:224] Handling call
0709 12:26:46.517714 (+ 57821us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:46.582527 (+ 64813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:46.582566 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:46.626773 (+ 44207us) log.cc:844] Serialized 26 byte log entry
0709 12:26:46.794889 (+168116us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:46.794953 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:46.795060 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:47.471966 (+676906us) raft_consensus.cc:1685] finished
0709 12:26:47.471991 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:47.472144 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5775,"raft.queue_time_us":6500,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":54889,"thread_start_us":160204,"threads_started":1,"wal-append.queue_time_us":728007}
I20260709 12:26:47.480782 10529 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:26:47.485265  9809 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:47.466799 12188 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:47.486728  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:47.443035 12260 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:26:47.555457  9812 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:26:47.558449  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 68354.5us
W20260709 12:26:47.611048  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 146771us
I20260709 12:26:47.612403  9955 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:47.637122  9779 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:47.462949 12143 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:47.486093 12081 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:47.619432 10524 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:47.559008 12227 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:47.608691 12208 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:47.638581  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:47.637792  9927 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:47.618880 11921 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:47.630934 11733 consensus_meta.cc:287] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.791s	user 0.008s	sys 0.004s
I20260709 12:26:47.485913 12147 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:47.490731 12038 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:47.557669 11669 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:47.651679  9779 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:47.609926 12183 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:47.657631 11848 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:47.658066 11848 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:47.658444 11848 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:47.659646 12038 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:47.649127 12227 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:47.661932 12227 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:47.657644 10498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.039s	sys 0.062s
W20260709 12:26:47.662721 10498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.039s	sys 0.062s
I20260709 12:26:47.663578 12147 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:47.665472 11848 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:47.653983 11733 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:47.667383 11848 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:47.668470 11733 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:47.669302  9962 raft_consensus.cc:1240] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:47.671835  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:47.615512 12206 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:47.645042 12081 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:47.674492  9779 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:47.650640 12248 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:47.673415 11644 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.065s	sys 0.104s
I20260709 12:26:47.631739 12189 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:47.651998 11921 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:47.635861 12019 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:47.682653  9779 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:26:47.680740 11644 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.065s	sys 0.104s
I20260709 12:26:47.686470  9778 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:47.679324 12232 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:47.682118 12147 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:47.698241 12269 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:47.688464 12227 consensus_queue.cc:1059] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:26:47.699209 10529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 674) took 1258 ms. Trace:
I20260709 12:26:47.710363 10529 rpcz_store.cc:276] 0709 12:26:46.441141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.441418 (+   277us) service_pool.cc:224] Handling call
0709 12:26:47.699010 (+1257592us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b5400705154. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:47.699140 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2098251136}
I20260709 12:26:47.695612 12178 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:47.700875 12269 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:47.699244 12147 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:47.715727 12165 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:47.717767 12019 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:47.717845 12206 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:47.700738 12232 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:47.716912 12227 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:47.681036 11848 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:26:47.765407  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 391931us
I20260709 12:26:47.765601  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2120) took 1309 ms. Trace:
I20260709 12:26:47.779930  9808 rpcz_store.cc:276] 0709 12:26:46.455890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.456040 (+   150us) service_pool.cc:224] Handling call
0709 12:26:47.764852 (+1308812us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b5800010e98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:47.765068 (+   216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:47.765271 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:47.765304 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:47.765346 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:47.765373 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:47.765432 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:47.765548 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3664640}
I20260709 12:26:47.744808 12147 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:47.743227 12269 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:47.764106 11914 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.044s	sys 0.103s
W20260709 12:26:47.785950  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.763652 12227 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:47.796479  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 382963us
W20260709 12:26:47.786378 11914 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.044s	sys 0.103s
W20260709 12:26:47.799490  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:47.801101 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 387612us
I20260709 12:26:47.797828  9928 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:47.785862 11848 raft_consensus.cc:697] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:26:47.803247  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 116867us
I20260709 12:26:47.806702 12183 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:47.807677 10525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 498) took 2587 ms. Trace:
W20260709 12:26:47.808871  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:47.809006  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 126765us
I20260709 12:26:47.818130 10525 rpcz_store.cc:276] 0709 12:26:45.220211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.257879 (+ 37668us) service_pool.cc:224] Handling call
0709 12:26:45.846742 (+588863us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x7b58001f1a98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7eee 000000000036eb39 00007f2f9346b1e0 00007f2f935340c4 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:46.644164 (+797422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:46.679806 (+ 35642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:46.679848 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:46.679907 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:46.679945 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:46.680015 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:47.807463 (+1127448us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b54006801d0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:47.807604 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1992602112}
I20260709 12:26:47.818882 12206 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:47.764885 12232 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:47.819917 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 394860us
I20260709 12:26:47.819051  9779 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:47.790827 12188 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:47.820858 10497 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:47.794940 12227 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:47.824404  9928 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:47.825409 10496 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:47.820590  9778 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:47.827138  9808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:26:47.833132 10497 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:47.796497 12019 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:47.808606 11644 raft_consensus.cc:3055] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:47.798431 12166 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:47.843041  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:47.801476 12143 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:47.822144 11669 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:47.861289  9808 raft_consensus.cc:606] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:26:47.861735  9808 raft_consensus.cc:614] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:47.840344 12183 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:47.862671  9928 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:47.864521  9779 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:47.866545  9928 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:26:47.867102  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 67301.8us
W20260709 12:26:47.861749  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.851182 12246 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:47.849325 11644 raft_consensus.cc:740] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:47.872303  9928 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:26:47.873072  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.869444 11914 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:47.851715 12188 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 12:26:47.887248  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.616284  9881 rpcz_store.cc:276] 0709 12:26:45.794974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.795657 (+   683us) service_pool.cc:224] Handling call
0709 12:26:45.814007 (+ 18350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:45.823734 (+  9727us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:26:45.956304 (+132570us) log.cc:844] Serialized 14 byte log entry
0709 12:26:46.128776 (+172472us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:46.334478 (+205702us) log.cc:844] Serialized 26 byte log entry
0709 12:26:46.452080 (+117602us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:46.459059 (+  6979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:46.483669 (+ 24610us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:47.289127 (+805458us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b540003c120. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e491dbe 00007f2f8e49c930 00007f2f8e49c8d8 00007f2f8e49c858 00007f2f8e49c813 00007f2f8e49ba9c 00007f2f943872f6 00007f2f94381aa8 00007f2f8e4d87cb 00007f2f8e4db2c0
0709 12:26:47.289487 (+   360us) raft_consensus.cc:1685] finished
0709 12:26:47.289621 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:47.289848 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9273,"prepare.queue_time_us":232993,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":10100,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":104,"spinlock_wait_cycles":33595648,"thread_start_us":187881,"threads_started":2,"wal-append.queue_time_us":223538}
W20260709 12:26:47.883442  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.861078 12284 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.868083 12037 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:47.855089 12019 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:48.346547  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:48.004467  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 140041us
W20260709 12:26:48.357497  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:47.966578  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 72408.8us
I20260709 12:26:48.358454  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:47.985988  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 117938us
I20260709 12:26:48.359184  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.359920  9811 raft_consensus.cc:2393] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 2: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:48.359993  9854 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:48.088862  9958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 346) took 1628 ms. Trace:
I20260709 12:26:48.362135  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:48.362042  9958 rpcz_store.cc:276] 0709 12:26:46.460237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.647035 (+186798us) service_pool.cc:224] Handling call
0709 12:26:46.648173 (+  1138us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:46.679636 (+ 31463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:46.679677 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:46.696785 (+ 17108us) log.cc:844] Serialized 26 byte log entry
0709 12:26:47.363689 (+666904us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:47.363735 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:48.064632 (+700897us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b54000b40d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:48.064727 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:48.064787 (+    60us) raft_consensus.cc:1685] finished
0709 12:26:48.064807 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:48.088772 (+ 23965us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8567,"raft.queue_time_us":22982,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":28013440,"thread_start_us":480987,"threads_started":1,"wal-append.queue_time_us":919756}
I20260709 12:26:48.332993  9962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1193) took 1662 ms. Trace:
I20260709 12:26:48.363876  9962 rpcz_store.cc:276] 0709 12:26:46.670898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.817872 (+146974us) service_pool.cc:224] Handling call
0709 12:26:46.986647 (+168775us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:47.669759 (+683112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:48.332665 (+662906us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400088ed4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:48.332912 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1569365248}
I20260709 12:26:48.364805  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:47.987932  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:47.972350 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 139330us
I20260709 12:26:48.366393 10497 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:48.370798  9854 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:26:48.374513  9853 leader_election.cc:336] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 1.744s (SENT)
I20260709 12:26:48.375154  9854 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:48.373088 10497 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:48.376511  9928 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:48.378634  9853 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:47.889902 12071 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:48.215862 12248 consensus_meta.cc:287] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.002s
I20260709 12:26:47.886101 12283 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:48.367913 12178 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:26:48.286859 12290 log.cc:927] Time spent T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:26:48.384397  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:47.871218 12183 raft_consensus.cc:697] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:48.385931 10497 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:26:48.288209 12208 consensus_meta.cc:287] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.632s	user 0.009s	sys 0.003s
I20260709 12:26:48.460495 12183 consensus_queue.cc:237] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:48.134868 12155 consensus_meta.cc:287] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.577s	user 0.006s	sys 0.004s
I20260709 12:26:47.957403 11921 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:48.461689 12214 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.387970  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.184594 12295 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:48.463227  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:48.464438  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.465070  9810 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:47.869204 12143 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:48.389585  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:48.466187  9958 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:48.392567  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:48.280381  9806 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:47.941231 12272 log.cc:927] Time spent T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.229s	user 0.001s	sys 0.001s
I20260709 12:26:48.392575  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:48.202737 12306 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.253388 12052 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:47.966584 12279 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:48.462198 12214 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:48.367812 12303 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.376381 12274 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:26:48.392578 12297 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.368710 11736 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.253041 12281 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.185806 12287 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:48.327086 12232 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:48.312959 12292 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.977016 12189 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:48.382877  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:48.426451  9778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.017s	sys 0.064s
W20260709 12:26:48.410702  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.149211  9960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1184) took 1712 ms. Trace:
I20260709 12:26:48.392813  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.376338 12284 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:48.437681 12260 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:26:48.439006 12081 consensus_meta.cc:287] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.757s	user 0.011s	sys 0.000s
I20260709 12:26:48.374782 12037 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:48.541469 12037 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:48.541369 12081 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:48.542835  9963 raft_consensus.cc:1240] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:48.386600 12159 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:47.970494 12107 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:48.444711 12146 consensus_meta.cc:287] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.828s	user 0.011s	sys 0.000s
I20260709 12:26:48.448233  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:48.449043 12251 consensus_meta.cc:287] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 1.017s	user 0.013s	sys 0.000s
I20260709 12:26:48.454082  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.544114 12107 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:48.455026 12304 log.cc:927] Time spent T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:26:48.458534 12280 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:48.459479 12308 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:48.468127  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:48.062732 12298 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:48.087330 12302 raft_consensus.cc:2804] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:48.472288  9809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:55720
W20260709 12:26:48.473934  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.138716 10524 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:47.891127 11669 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.516s
I20260709 12:26:48.475479  9955 raft_consensus.cc:2393] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:48.384804 12165 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:48.380280 12307 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:47.966867 12038 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.466s
I20260709 12:26:47.892758 12246 raft_consensus.cc:697] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 2 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:48.481485 12301 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:48.486845 11921 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:48.514721 11733 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:48.489661  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.102044 12294 consensus_queue.cc:1048] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.401s
W20260709 12:26:48.473394 12072 consensus_meta.cc:287] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.986s	user 0.010s	sys 0.003s
I20260709 12:26:48.394332 12248 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:48.549288 10524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 681) took 1098 ms. Trace:
I20260709 12:26:47.946007 12300 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:48.460966 12208 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:47.945922 11914 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:26:48.287827 12269 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:48.512624 12309 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:48.471513 12143 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:48.518906  9807 raft_consensus.cc:1240] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:48.544149 12081 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:48.514451  9778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.018s	sys 0.069s
I20260709 12:26:48.485760 12295 raft_consensus.cc:697] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:47.946587 11848 consensus_queue.cc:237] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:48.502128 11736 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:48.521726  9960 rpcz_store.cc:276] 0709 12:26:46.424995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.426525 (+  1530us) service_pool.cc:224] Handling call
0709 12:26:46.438903 (+ 12378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:47.023900 (+584997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:48.072504 (+1048604us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54001de554. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:48.137141 (+ 64637us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543117696}
I20260709 12:26:48.530442  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:48.500947 12303 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:48.531778 12019 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:48.062999 11644 consensus_queue.cc:260] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:48.533829 12284 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:48.501986 12281 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:48.500355 12147 consensus_meta.cc:287] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.003s
I20260709 12:26:48.539835 12260 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:48.528412 12292 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:48.545614  9811 raft_consensus.cc:1240] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:48.589412 11733 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:48.547780  9810 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:48.548326  9809 raft_consensus.cc:606] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:48.595589 11914 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:48.547214  9961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 351) took 1058 ms. Trace:
I20260709 12:26:48.544934  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.486661 12188 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:48.551434 10531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36672 (request call id 673) took 2110 ms. Trace:
I20260709 12:26:48.500473 12297 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:48.544600 12251 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:48.590221 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 206290us
I20260709 12:26:48.592000 12309 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:48.633097 10497 leader_election.cc:400] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3.
I20260709 12:26:48.598445  9814 raft_consensus.cc:1240] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:48.548027 12302 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:48.599164 12246 consensus_queue.cc:237] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:48.564142 12165 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:48.546360 12107 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:48.560913 12189 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:48.593140  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 775524us
I20260709 12:26:48.547847 12298 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:48.560128 12310 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:48.546835 12280 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:48.608507  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 219411us
I20260709 12:26:48.610522  9808 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:48.552616 12307 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:48.657514 12307 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:48.658444 12295 consensus_queue.cc:237] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:48.634686 12309 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:26:48.613201  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 236734us
I20260709 12:26:48.597489 12269 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:48.559490  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 184986us
I20260709 12:26:48.623163  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.561069 12232 consensus_queue.cc:1059] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:26:48.625001  9961 rpcz_store.cc:276] 0709 12:26:47.488404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:47.488521 (+   117us) service_pool.cc:224] Handling call
0709 12:26:47.609787 (+121266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:47.790742 (+180955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:47.790787 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:47.800606 (+  9819us) log.cc:844] Serialized 26 byte log entry
0709 12:26:48.236605 (+435999us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:48.236662 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:48.236765 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:48.546893 (+310128us) raft_consensus.cc:1685] finished
0709 12:26:48.546923 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:48.547141 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10883,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":554507,"threads_started":2,"wal-append.queue_time_us":453345}
I20260709 12:26:48.627411 12147 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:48.488668 12306 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:48.575323  9711 catalog_manager.cc:5697] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 3 to 4, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 4 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:26:48.629614  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:48.702899  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.709896  9928 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:48.713706 10530 raft_consensus.cc:1240] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:48.627122 10531 rpcz_store.cc:276] 0709 12:26:46.440868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.444940 (+  4072us) service_pool.cc:224] Handling call
0709 12:26:46.445238 (+   298us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:46.456948 (+ 11710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:46.456976 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:46.512483 (+ 55507us) log.cc:844] Serialized 52 byte log entry
0709 12:26:47.363441 (+850958us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:47.363503 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:47.363602 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:48.551155 (+1187553us) raft_consensus.cc:1685] finished
0709 12:26:48.551185 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:48.551361 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11580,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":55206,"thread_start_us":469360,"threads_started":1,"wal-append.queue_time_us":1134991}
I20260709 12:26:48.631187  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.713848  9711 catalog_manager.cc:5697] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 3 to 4, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 4 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:48.714782  9809 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:48.716074  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:48.715793  9711 catalog_manager.cc:5697] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.716689 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:48.588559 12072 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:48.598129 12143 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:48.591398 12283 raft_consensus.cc:697] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:48.633464 10497 leader_election.cc:403] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:48.717670  9810 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:26:48.718580  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:48.718742 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 85773.2us
I20260709 12:26:48.719251  9711 catalog_manager.cc:5697] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 2 to 3, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 3 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:26:48.719924 10497 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:48.590523 10524 rpcz_store.cc:276] 0709 12:26:47.451417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:47.453956 (+  2539us) service_pool.cc:224] Handling call
0709 12:26:48.549200 (+1095244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:48.636139  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.643757  9778 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:48.650518 11736 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:48.734463  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 90780.2us
I20260709 12:26:48.735893  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.736967  9810 raft_consensus.cc:2393] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:48.650662 12297 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:26:48.647004 12298 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:48.745473  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.752414  9928 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:48.648232 12165 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:48.628479 12260 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:48.646749 12189 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:48.656941  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:48.612742  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 215813us
I20260709 12:26:48.762105  9814 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:48.666714  9812 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:48.675799 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:48.676420 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:48.635715 12302 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.680553 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:48.767248 10527 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:26:48.766050  9956 raft_consensus.cc:1240] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:48.698662 12071 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:48.770908 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:48.771361 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:48.699997 11733 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:48.645072 12316 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:48.743480 12226 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3.
I20260709 12:26:48.743917 10497 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:48.744477  9807 raft_consensus.cc:2393] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 2: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:48.743503  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.748018 12232 consensus_queue.cc:1243] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [LEADER]: Peer f5208640a51f493e930ce4f64ceeed0b log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:26:48.748371 12206 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:48.652626 12155 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.650614 12303 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:48.701005 12227 consensus_meta.cc:287] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.849s	user 0.010s	sys 0.001s
W20260709 12:26:48.759517  9779 connection.cc:256] RPC call timeout handler was delayed by -3.4650607630001105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
I20260709 12:26:48.760659  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:48.682552 12166 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.667625  9808 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
W20260709 12:26:48.764580  9853 leader_election.cc:336] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 2.217s (SENT)
I20260709 12:26:48.766155  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.717378 10530 raft_consensus.cc:2393] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:48.763149 10525 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:48.768435  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:48.720911  9711 catalog_manager.cc:5697] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 4 to 5, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 5 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:48.748862 12107 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:26:48.702971 12052 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:48.695364 12292 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:48.683569  9811 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:26:48.697500 12251 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:48.696385 12208 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:48.774482  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:48.776355  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:48.777999 10531 raft_consensus.cc:2393] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 4: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
W20260709 12:26:48.819409  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.813130  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:48.812747  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:48.781069  9959 raft_consensus.cc:1240] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:48.749115 12146 raft_consensus.cc:2804] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:48.796851 12300 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:48.783836  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.698925 12280 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:48.827253  9814 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:48.827777  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.829268  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:48.829396  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.830324  9961 raft_consensus.cc:2393] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 3: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:48.830638  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.831081  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:48.832968  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:48.787714  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.834517  9807 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:48.835487 12281 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:48.835783  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:48.759280 12269 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.837438  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:48.761656 11736 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:48.840791 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:48.787123  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.762287 12279 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:26:48.791786 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 47945.4us
I20260709 12:26:48.841653  9815 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:26:48.842203 10497 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:48.786726  9927 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:48.842553  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:48.843032  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 56392.5us
I20260709 12:26:48.843446  9815 raft_consensus.cc:2410] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 8 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:26:48.844272  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.844990  9815 raft_consensus.cc:2410] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:26:48.845758  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.693305 12037 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:48.796103  9779 connection.cc:256] RPC call timeout handler was delayed by -2.9169607630001337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
W20260709 12:26:48.847290  9779 connection.cc:256] RPC call timeout handler was delayed by -2.2302607629999329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2882s for a response
I20260709 12:26:48.847914 12037 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:48.848016  9779 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:48.796506  9958 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:48.848666 12037 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:48.849095 12037 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.794368  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.849501 12037 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:48.849506  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:48.804778  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.850585  9808 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:48.851455  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.852017  9808 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:26:48.852852  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.804415  9711 catalog_manager.cc:5697] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 4, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 4 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:26:48.853924  9711 catalog_manager.cc:5697] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.855515  9711 catalog_manager.cc:5697] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 2 to 3, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 3 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:48.856851  9711 catalog_manager.cc:5697] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 4, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 4 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.859238  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.859356 12071 consensus_queue.cc:1059] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:48.860276  9812 raft_consensus.cc:2393] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 4: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:48.860613 12071 consensus_queue.cc:1059] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:48.861104  9812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:26:48.861653 12251 raft_consensus.cc:3055] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:48.781613 11921 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:48.805454  9853 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:48.822764 12146 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.862195 12251 raft_consensus.cc:740] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:26:48.862815  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 98254.8us
I20260709 12:26:48.863457 12251 consensus_queue.cc:260] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:48.864584 12251 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:48.864658  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:48.865464  9961 raft_consensus.cc:2410] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:26:48.865412 12303 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:48.749698 12288 consensus_queue.cc:1059] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:26:48.803134 12155 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:48.866515 12303 consensus_queue.cc:1059] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:48.866792 12288 raft_consensus.cc:3055] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:48.867328 12288 raft_consensus.cc:740] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:48.868062 12155 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:48.868304 12312 raft_consensus.cc:3055] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:48.868147 12288 consensus_queue.cc:260] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:48.863477  9779 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:48.868767 12312 raft_consensus.cc:740] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:48.869374 12288 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:48.869590 12312 consensus_queue.cc:260] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:48.870774 12312 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:48.806907 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:48.871394 12295 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:48.808787  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:48.695178  9854 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:26:48.873152  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 178042us
W20260709 12:26:48.873461 12320 log.cc:927] Time spent T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 12:26:48.873674  9955 raft_consensus.cc:1240] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:48.874917  9883 raft_consensus.cc:3055] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:48.875263  9883 raft_consensus.cc:740] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:48.794920 12311 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.819676 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:48.748548 12283 consensus_queue.cc:237] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:48.782509 10529 raft_consensus.cc:2955] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:48.824574  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:48.780433 12315 consensus_queue.cc:1059] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:26:48.769431  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:48.878227 12310 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:48.885737  9956 raft_consensus.cc:1240] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:48.879616 10525 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:48.884481 12315 raft_consensus.cc:3055] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:48.888101 12315 raft_consensus.cc:740] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:48.888964  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:48.888906 12315 consensus_queue.cc:260] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:48.889605  9889 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 1.
I20260709 12:26:48.862564 12146 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:48.890892  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:48.891587  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:48.808917 12166 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:48.893278 12309 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:48.894253 12166 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:48.895859  9886 raft_consensus.cc:1240] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:26:48.884073  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:48.819824 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:48.876312 12311 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:48.897399 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:48.898312 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:48.878580 11921 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:48.898991 11921 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:48.899109 12311 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:48.833649 12306 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:48.866752 12145 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:48.872614 12295 raft_consensus.cc:993] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:48.900915 12295 raft_consensus.cc:1081] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Signalling peer f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:26:48.887712 11644 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:48.897126 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:48.806752 12227 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:48.901489  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:48.861737 12071 raft_consensus.cc:3055] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:26:48.902781 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 60665.3us
I20260709 12:26:48.901939 10525 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:48.837538 12269 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:48.861677  9812 raft_consensus.cc:606] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Received request to transfer leadership to TS b011791796d1457284b857d7d3422195
I20260709 12:26:48.904013  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:48.850214  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:48.850603  9958 raft_consensus.cc:2393] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 3: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:48.905515  9955 raft_consensus.cc:1240] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:48.908142  9808 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:48.910622  9711 catalog_manager.cc:5697] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 2 to 6, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 6 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:26:48.811650 12052 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:48.912521 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 71837us
W20260709 12:26:48.912209  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.912567  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:48.927186  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:48.890144 12315 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:48.823575  9960 raft_consensus.cc:1275] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:48.912608 10497 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:48.902426  9883 consensus_queue.cc:260] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:48.915570  9853 leader_election.cc:336] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 2.101s (SENT)
I20260709 12:26:48.918329  9812 raft_consensus.cc:614] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:48.920506  9711 catalog_manager.cc:5697] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 5, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 5 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.922125  9884 raft_consensus.cc:2393] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 7: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:48.945432  9883 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:48.946033  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:48.943854  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:48.946939  9884 raft_consensus.cc:2393] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 4: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
W20260709 12:26:48.927893  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.922506  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.914595 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:48.947086  9889 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:26:48.948853  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:26:48.949267  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 44687.9us
I20260709 12:26:48.948669  9811 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:26:48.950217  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:48.951007  9885 raft_consensus.cc:2410] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:26:48.951531  9958 raft_consensus.cc:1240] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:48.885490 12310 raft_consensus.cc:697] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:48.873143 12165 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:48.948635  9711 catalog_manager.cc:5697] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 3 to 4, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 4 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:48.954820  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:48.952224 10496 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:48.959312  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.959810  9884 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:48.955112  9853 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:48.958199  9810 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
W20260709 12:26:48.957145 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 44623.4us
I20260709 12:26:48.960976 12317 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:48.961473  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:48.961918  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 46371us
I20260709 12:26:48.962457 10497 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:48.962741  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:48.961006  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:48.963505  9956 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 3: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:48.963089 12317 consensus_queue.cc:1059] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:48.964329 12282 raft_consensus.cc:3055] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:48.960016  9811 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:26:48.982818  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.964903  9853 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:48.983546 10497 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:48.964269  9927 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:48.964879 12282 raft_consensus.cc:740] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:48.966329 12274 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:48.967424 12226 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:26:48.969257 12318 log.cc:927] Time spent T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.286s	user 0.000s	sys 0.003s
I20260709 12:26:48.935822  9806 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:48.970731  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:48.972870 12072 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:48.974313 10533 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:26:48.974462 12269 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:48.955936 12306 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.010883 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:48.964228  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:48.978247 10496 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:48.979769  9779 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:48.965013  9711 catalog_manager.cc:5697] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 2 to 3, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 3 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:48.912093 12071 raft_consensus.cc:740] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:48.917433 12280 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:49.012676  9883 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:49.013223 12280 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:48.922940 12155 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:49.013240  9711 catalog_manager.cc:5697] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.014065 12155 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.014467 12155 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:49.015122  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:49.015357  9711 catalog_manager.cc:5697] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:26:49.016289  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:49.016858  9883 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:49.017063  9711 catalog_manager.cc:5697] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 2 to 4, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 4 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.018734 12071 consensus_queue.cc:260] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:49.019910 12071 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:48.977802 11921 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:48.990866  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.991941  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:48.788906 12316 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:48.995335  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:49.030464  9887 raft_consensus.cc:2393] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 4: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:49.001434  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 12:26:49.003144 10497 connection.cc:256] RPC call timeout handler was delayed by -1.2328383590001977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
I20260709 12:26:49.008700  9813 raft_consensus.cc:606] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Received request to transfer leadership
I20260709 12:26:49.031181  9813 raft_consensus.cc:614] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:49.009819  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:49.031919  9812 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:49.032377  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:49.024662  9883 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:49.029542  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:49.033253  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:49.033103  9810 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:49.030136  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:48.983482  9815 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:26:48.992908 12246 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:26:49.023353  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 43668.5us
I20260709 12:26:48.996629 12274 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.001447 12301 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:48.955686 12300 consensus_queue.cc:1059] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:26:48.992990 12284 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:49.004433 12206 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:49.041860  9779 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:49.050642 10497 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:49.004078 12309 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:49.045857  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:49.005782 12226 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:49.046730  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:49.039968  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:48.988879 12302 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:49.027141  9806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46504 (request call id 2122) took 2566 ms (client timeout 1973 ms). Trace:
I20260709 12:26:49.055058  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:49.047715  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:49.034960 11914 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:26:49.047482  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:49.050977  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:49.051839  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:49.053187  9811 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 3: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:49.060806  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:49.062372  9959 raft_consensus.cc:2393] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 3: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:49.040194 12189 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:49.046093 12274 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:49.026829 12275 consensus_queue.cc:1059] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:26:49.058840  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:49.059337  9779 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:49.068034  9885 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:49.068521  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:49.069018  9779 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:49.048662 12301 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:49.026985 12306 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:49.053481  9812 raft_consensus.cc:2393] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 5: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:48.984886  9853 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:49.040390 12246 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.066125  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:49.027314 12269 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:49.045388 12260 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:49.097297  9959 raft_consensus.cc:1240] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:49.054733 12145 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:49.056054 12226 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:49.075585  9887 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
W20260709 12:26:49.074081  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 89243.4us
I20260709 12:26:49.050233  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.112083  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.113535  9853 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:49.115132  9853 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:49.116174  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:49.116452  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:49.117156  9887 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:49.073511 12248 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:49.076746 12301 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:49.118877  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:49.132453  9887 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:49.117830  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:49.120811  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:49.075671 12309 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:49.077832 12246 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:49.076969 12294 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:49.118566 12303 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:26:49.150040 10497 leader_election.cc:336] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.543s (SENT)
I20260709 12:26:49.066638 12206 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:26:49.029230 12282 consensus_queue.cc:260] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:49.167125 10497 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:49.161753  9885 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
W20260709 12:26:49.167780  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 49998.8us
I20260709 12:26:49.174734  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:49.176301  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:49.176826  9853 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 2.504s (SENT) [suppressed 44 similar messages]
I20260709 12:26:49.104250 12145 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:49.179219  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:49.171281 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.131897 12232 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:26:49.059333  9806 rpcz_store.cc:269] 0709 12:26:46.456581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.459239 (+  2658us) service_pool.cc:224] Handling call
0709 12:26:48.253521 (+1794282us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b54003de120. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e491a1d 00007f2f8e4781a4 00007f2f8e4fa447 00007f2f8e512fe7 00007f2f8e5147de 00007f2f8e52027c 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591
0709 12:26:49.010677 (+757156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7873920}
I20260709 12:26:49.120761 12280 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:49.187909  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.192945  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.176345 12317 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:49.193585  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:49.196594  9815 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:49.194296  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.118194 12298 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:49.178025 12227 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:49.181855 12145 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:49.183293 12336 raft_consensus.cc:3055] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:49.182080 12232 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:49.200286 12316 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:49.121276 12307 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:49.182750 12294 raft_consensus.cc:697] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:49.204362  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:26:49.204594 12322 log.cc:927] Time spent T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:26:49.063585 12310 consensus_queue.cc:237] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:49.213300 12146 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:49.214110 11921 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:49.217516 12145 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:49.219095 12298 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:49.163837 12143 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:49.228461 12334 log.cc:927] Time spent T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:26:49.214880 12052 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:49.246795 10526 raft_consensus.cc:1240] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:49.206387 12336 raft_consensus.cc:740] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:49.250342 12146 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:49.250546 12052 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:49.198676 12317 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:49.251300 12317 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:49.202687 12282 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:49.209403 12232 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:49.251207 12336 consensus_queue.cc:260] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:49.254096 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 275656us
I20260709 12:26:49.257972 12145 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:49.260160 12037 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:49.262509 12037 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:49.265338 12143 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:49.274708 12336 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:49.275228 12294 consensus_queue.cc:237] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:49.278136 12317 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:49.264391 12330 log.cc:927] Time spent T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.214s	user 0.002s	sys 0.000s
I20260709 12:26:49.285723 12214 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:49.279163 12306 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:49.281543 12302 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:49.321363  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:49.325070  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:49.327102  9814 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:49.327915  9806 raft_consensus.cc:1240] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:49.328856  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:49.331648  9809 raft_consensus.cc:2393] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 3: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
W20260709 12:26:49.351625  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.353477  9854 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:49.354053  9853 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:49.357087  9854 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:26:49.361831  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:49.362548  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.205498  9889 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
W20260709 12:26:49.242074  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.377854  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.388360  9955 raft_consensus.cc:1240] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:49.227793  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.220302  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.392028  9960 raft_consensus.cc:2393] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:49.393167  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.377841  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:49.405638  9889 raft_consensus.cc:2393] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 6: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:49.405748 12147 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:49.430620  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.406950  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:49.453785  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.455644  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.456645  9958 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:49.457857  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.460443  9881 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:49.415413  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:49.469642  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.474574 12159 raft_consensus.cc:2764] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:26:49.476457 12019 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:49.477286 12019 raft_consensus.cc:697] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:49.477536 12282 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:49.478812 12292 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:49.479792 12246 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:49.481077 12292 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:49.482923  9956 raft_consensus.cc:2368] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 6. Current term is 7.
I20260709 12:26:49.443529 12307 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:49.478024 12282 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:49.486301 12282 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:49.486370 12317 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:49.491079  9881 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:26:49.491628  9881 pending_rounds.cc:85] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 3
I20260709 12:26:49.492002  9881 pending_rounds.cc:107] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:26:49.492405  9881 raft_consensus.cc:2889] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:49.493917 12232 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:49.498754  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:49.499997 12206 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:49.481890 12292 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:49.504060 12019 consensus_queue.cc:237] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:49.504948  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:49.505681  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:46484 (request call id 86) took 3040 ms. Trace:
W20260709 12:26:49.506494 12251 consensus_meta.cc:287] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.641s	user 0.008s	sys 0.005s
I20260709 12:26:49.513288  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.515138  9962 raft_consensus.cc:1240] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:26:49.516471  9812 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:49.511087  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.512008 12206 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:49.511221  9813 rpcz_store.cc:276] 0709 12:26:46.465309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:46.465529 (+   220us) service_pool.cc:224] Handling call
0709 12:26:49.505184 (+3039655us) spinlock_profiling.cc:243] Waited 2.33 s on lock 0x7b54001847d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e516853 00007f2f934e460a 00007f2f8ca6a7d4 00007f2f8ca6a762 00007f2f8ca6a691 00007f2f8ca6a60c 00007f2f8ca698c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:49.505385 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5365907328}
I20260709 12:26:49.536470  9815 raft_consensus.cc:1240] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:49.537977  9889 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:49.539505  9889 raft_consensus.cc:1240] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:49.540771  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.541476  9956 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:26:49.542693  9882 raft_consensus.cc:1240] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:49.542543  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:49.553776  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 1896) took 1056 ms. Trace:
I20260709 12:26:49.542798  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:49.542431  9810 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:49.542771  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:49.554195  9815 rpcz_store.cc:276] 0709 12:26:48.490310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.330446 (+840136us) service_pool.cc:224] Handling call
0709 12:26:49.516140 (+185694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:49.545982 (+ 29842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:49.546216 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:49.543821 12071 consensus_meta.cc:287] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.523s	user 0.005s	sys 0.014s
I20260709 12:26:49.541810 12232 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:49.544459  9881 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:49.566156  9961 raft_consensus.cc:2393] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 3: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:49.545574 12206 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:49.570250  9812 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:49.572667  9958 raft_consensus.cc:2393] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:49.576054  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:26:49.580127  9884 consensus_meta.cc:287] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.603s	user 0.017s	sys 0.014s
I20260709 12:26:49.584543  9853 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
W20260709 12:26:49.587198  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.588335 11914 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:49.588788 11914 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:49.589238 11914 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:49.590436  9884 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:49.592736  9809 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:26:49.593317  9808 raft_consensus.cc:1240] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:26:49.594988  9814 raft_consensus.cc:1240] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:49.595367  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:49.596478  9957 raft_consensus.cc:2410] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:26:49.581832  9885 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.599148 12275 raft_consensus.cc:3055] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:49.599639 12275 raft_consensus.cc:740] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:49.601158 12275 consensus_queue.cc:260] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:49.603539  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:49.604471  9963 raft_consensus.cc:2393] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 3: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:49.604692  9959 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:49.604988  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:49.605576  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:49.606498 12155 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:49.607595 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 351483us
I20260709 12:26:49.611024  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.612112  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:26:49.614104  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 49507.3us
I20260709 12:26:49.576313 12246 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:49.615695  9881 raft_consensus.cc:1240] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:49.621970  9807 raft_consensus.cc:1275] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:49.622241  9890 raft_consensus.cc:1240] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:49.588685  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.624009  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:49.624825  9886 raft_consensus.cc:2393] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 3: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:49.622259  9883 raft_consensus.cc:1240] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:49.627208  9806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 1895) took 1153 ms. Trace:
I20260709 12:26:49.627380  9927 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:49.627660  9883 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:49.627748  9806 rpcz_store.cc:276] 0709 12:26:48.480077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.330037 (+849960us) service_pool.cc:224] Handling call
0709 12:26:49.330769 (+   732us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:49.331687 (+   918us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:49.331746 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:49.332614 (+   868us) log.cc:844] Serialized 26 byte log entry
0709 12:26:49.447956 (+115342us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:49.451694 (+  3738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:49.462834 (+ 11140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:49.626909 (+164075us) raft_consensus.cc:1685] finished
0709 12:26:49.626932 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:49.627111 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":67038,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":334,"thread_start_us":17797,"threads_started":1,"wal-append.queue_time_us":228285}
W20260709 12:26:49.620288  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.590142  9815 raft_consensus.cc:1240] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:49.629822  9927 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:49.629710 12071 raft_consensus.cc:2804] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:49.631217  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:49.633978  9882 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:49.634609  9881 raft_consensus.cc:1240] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:49.635300  9812 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:26:49.635705  9812 pending_rounds.cc:85] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71: Aborting all ops after (but not including) 6
I20260709 12:26:49.635951  9812 pending_rounds.cc:107] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:26:49.635990  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:49.637638  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:49.626134  9778 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:49.636338  9812 raft_consensus.cc:2889] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:49.641093  9810 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:26:49.634152  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:49.631492 12292 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:49.650606  9883 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:26:49.633049 12071 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:49.662119  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.662475  9812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 1897) took 1167 ms. Trace:
I20260709 12:26:49.662949  9812 rpcz_store.cc:276] 0709 12:26:48.495595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.577244 (+1081649us) service_pool.cc:224] Handling call
0709 12:26:49.634725 (+ 57481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:49.662149 (+ 27424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:49.662397 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:49.663571  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.665359 10496 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:26:49.672289  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 46321.6us
I20260709 12:26:49.671036  9811 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:49.630581 12246 consensus_queue.cc:1059] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:26:49.682093  9961 raft_consensus.cc:2393] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 3: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:49.683830 12251 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:49.684815  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:49.685586  9882 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:49.627250 12226 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:49.666790 12071 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:49.692309  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:49.674943 12292 raft_consensus.cc:2764] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:26:49.692898  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:49.706308  9883 raft_consensus.cc:2410] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:26:49.704957 12206 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:49.708443 10497 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:49.708781  9927 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:49.709719 12206 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:49.694983 12251 raft_consensus.cc:697] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:49.715382  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:49.692348 12072 raft_consensus.cc:3055] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:49.719964  9885 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:49.707386 12155 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:49.726454  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:49.727886 12294 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:49.727289  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:49.728320  9853 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:49.729440 12019 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:49.735891 12188 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:49.736510 12188 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.736584 12147 consensus_queue.cc:1048] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:49.737035 12188 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:26:49.738500  9761 auto_rebalancer.cc:893] Removing replace marker failed: Replica 4104e34a61b7448281d6d91ce23ebf71 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
W20260709 12:26:49.739032  9761 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:26:49.739413  9761 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 12:26:49.741761 12301 consensus_meta.cc:287] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.558s	user 0.000s	sys 0.017s
I20260709 12:26:49.738894 12147 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.743312 12147 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:49.721468 12359 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:49.890962 10530 raft_consensus.cc:1240] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:49.896888  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:49.878906 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 213703us
I20260709 12:26:49.745052  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.718937 12072 raft_consensus.cc:740] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:49.744590  9961 raft_consensus.cc:1240] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
W20260709 12:26:49.764994  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.752568  9815 raft_consensus.cc:1275] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:49.899649  9811 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:26:49.840302  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:49.902415 12275 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.853650 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:26:49.888007  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 159780us
I20260709 12:26:49.872483  9960 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: []
W20260709 12:26:49.911751  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:49.912191  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.819154 12226 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:49.728318 12294 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:49.747175 12147 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:49.915452  9927 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:49.926261 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:49.927160  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:49.927668 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.928776 12206 consensus_queue.cc:1059] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:49.928311  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:49.929991 12359 raft_consensus.cc:3055] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:49.930591  9962 raft_consensus.cc:2393] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:49.918419  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:26:49.919397 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.918627 11733 consensus_queue.cc:1048] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:49.921149  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:49.921294 12155 consensus_queue.cc:1059] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:26:49.863022 12274 consensus_meta.cc:287] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.788s	user 0.010s	sys 0.005s
I20260709 12:26:49.742343 12301 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:49.923805  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:49.913636 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:49.750674 12356 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:49.924866 12294 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:49.930398 12359 raft_consensus.cc:740] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:49.920161  9807 raft_consensus.cc:1240] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:49.930965 10496 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:49.941180  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.930325 12246 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:49.942598 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:49.944249 10532 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.924971  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:49.948395  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:49.948328 10530 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:26:49.955515  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:49.951299  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.955536  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:49.958252  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 252856us
I20260709 12:26:49.959965  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:49.960022 12359 consensus_queue.cc:260] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:49.960904 12147 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:49.961337 12147 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.961637 12359 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:49.961699 12147 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:49.945273 12356 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:49.963979  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:49.968760  9813 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:26:49.965714  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:49.969502  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 1904) took 1370 ms. Trace:
I20260709 12:26:49.974629  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:49.930833 12306 consensus_queue.cc:1048] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:26:49.975690  9807 raft_consensus.cc:2393] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 6: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:49.971695  9813 rpcz_store.cc:276] 0709 12:26:48.599109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.616259 (+1017150us) service_pool.cc:224] Handling call
0709 12:26:49.923816 (+307557us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5800010e98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:49.949074 (+ 25258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:49.969189 (+ 20115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:49.969433 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24652672}
I20260709 12:26:49.979363  9779 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:49.962164 11914 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:49.989758  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:49.946803 12336 consensus_queue.cc:1059] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:26:49.969224 12356 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:49.951395 12274 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:49.995769 10533 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:49.994686  9956 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:49.989349 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:50.001837  9886 raft_consensus.cc:1240] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:50.004735  9963 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:50.005085 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:50.006702 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 76847.8us
I20260709 12:26:50.014786  9809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2146) took 1168 ms. Trace:
I20260709 12:26:50.014897 11914 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:50.015293  9809 rpcz_store.cc:276] 0709 12:26:48.846777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.593598 (+746821us) service_pool.cc:224] Handling call
0709 12:26:49.594025 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:49.656661 (+ 62636us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:26:49.656706 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:49.683140 (+ 26434us) log.cc:844] Serialized 26 byte log entry
0709 12:26:49.697489 (+ 14349us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:49.697539 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:49.697670 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:50.014565 (+316895us) raft_consensus.cc:1685] finished
0709 12:26:50.014590 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:50.014723 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11081,"raft.queue_time_us":5498,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":7763,"thread_start_us":13835,"threads_started":1,"wal-append.queue_time_us":291236}
I20260709 12:26:50.018136  9808 raft_consensus.cc:1240] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:50.018847  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2148) took 1114 ms. Trace:
I20260709 12:26:50.019254  9808 rpcz_store.cc:276] 0709 12:26:48.904771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.594130 (+689359us) service_pool.cc:224] Handling call
0709 12:26:50.017777 (+423647us) spinlock_profiling.cc:243] Waited 6.22 ms on lock 0x7b5800010e98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7eee 000000000036eb39 00007f2f9346b1e0 00007f2f935340c4 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:50.017941 (+   164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:50.018600 (+   659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:50.018782 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14311680}
I20260709 12:26:50.020545 12351 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:50.021646  9888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 464) took 1024 ms. Trace:
I20260709 12:26:50.026381 12072 consensus_queue.cc:260] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:50.033804 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:50.034679 12072 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:50.034848 10526 raft_consensus.cc:2393] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:50.039661  9959 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:50.045838 10496 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:50.026729 12206 raft_consensus.cc:3055] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:50.053450  9962 raft_consensus.cc:2393] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 3: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:49.965065 12251 consensus_queue.cc:237] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:50.024111  9888 rpcz_store.cc:276] 0709 12:26:48.997374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.589052 (+591678us) service_pool.cc:224] Handling call
0709 12:26:49.589729 (+   677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:49.604832 (+ 15103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:49.604870 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:49.605384 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 12:26:49.672331 (+ 66947us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:49.699027 (+ 26696us) log.cc:844] Serialized 14 byte log entry
0709 12:26:49.703322 (+  4295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:49.703391 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:50.021289 (+317898us) raft_consensus.cc:1685] finished
0709 12:26:50.021315 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:50.021461 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4718,"prepare.queue_time_us":137855,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":39949,"raft.queue_time_us":14988,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":6642,"thread_start_us":71598,"threads_started":2,"wal-append.queue_time_us":356806}
W20260709 12:26:50.067065  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:50.080045  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 110003us
W20260709 12:26:50.049280 12282 consensus_meta.cc:287] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.562s	user 0.012s	sys 0.002s
I20260709 12:26:50.084012  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:26:50.074740  9853 leader_election.cc:336] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.531s (SENT)
I20260709 12:26:50.087473  9961 raft_consensus.cc:1275] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:50.089612  9964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 356) took 1698 ms. Trace:
I20260709 12:26:50.099093  9853 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:26:50.103986  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.095292  9959 raft_consensus.cc:1275] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:50.109961 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:50.057230 12206 raft_consensus.cc:740] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:26:50.113376 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 76787us
I20260709 12:26:50.084798 12336 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:50.090142  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:50.128309  9962 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:50.133755  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:50.136808  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:26:50.138774  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 50799.2us
I20260709 12:26:50.140003  9883 raft_consensus.cc:1240] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
W20260709 12:26:50.143056  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.089990  9964 rpcz_store.cc:276] 0709 12:26:48.391075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.391208 (+   133us) service_pool.cc:224] Handling call
0709 12:26:48.391508 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:48.766053 (+374545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:48.766097 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:49.605631 (+839534us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b2c0013c378. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8ce15a11 00007f2f8ce25372 00007f2f8e557a01 00007f2f8e51c43a 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2
0709 12:26:49.606177 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 12:26:49.686076 (+ 79899us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:49.686103 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:50.067969 (+381866us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b5400242054. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:50.068019 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:50.068059 (+    40us) raft_consensus.cc:1685] finished
0709 12:26:50.068072 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:50.089434 (+ 21362us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9991,"raft.queue_time_us":29456,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":10283,"spinlock_wait_cycles":826592256,"thread_start_us":28195,"threads_started":1,"wal-append.queue_time_us":321986}
I20260709 12:26:50.148000 10533 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.150207  9958 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:26:50.152069  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 77433.2us
I20260709 12:26:50.152505 12336 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:26:50.154553 12366 log.cc:927] Time spent T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:26:50.158445 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:50.128433 11914 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:50.102028 12282 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:50.164793  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:50.177198  9779 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:50.178172 12145 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:50.173763  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:50.173722  9888 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:26:50.182629  9883 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:50.183977  9886 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:50.127390 12351 consensus_queue.cc:1059] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:26:50.187932  9890 raft_consensus.cc:1240] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:50.167317 12246 raft_consensus.cc:697] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:50.179595 12301 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:50.184283 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:50.192090 12336 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:26:50.204921 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 66286.4us
I20260709 12:26:50.208832  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:50.214929 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:50.215377 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:50.215678 12288 consensus_queue.cc:1059] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:26:50.216988 12288 raft_consensus.cc:3055] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:50.217314 12288 raft_consensus.cc:740] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:50.210325  9778 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:50.218595  9886 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:50.219249 11848 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:50.219769 11848 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.219678 12351 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:50.220284 11848 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:50.221201  9881 raft_consensus.cc:3055] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:50.221587  9881 raft_consensus.cc:740] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:50.229718 10533 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:50.231527  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:50.237136 10528 raft_consensus.cc:1240] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 4. Current term is 5. Ops: [3.6-4.7]
I20260709 12:26:50.238848 12274 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:50.243345  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:50.244385  9883 raft_consensus.cc:2410] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:26:50.245270  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:50.245882  9883 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:26:50.256361 12248 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:26:50.275410  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.276971  9888 raft_consensus.cc:1275] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:26:50.285087  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:50.287400  9885 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:50.290390  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:50.232218 12292 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.299765  9886 raft_consensus.cc:1275] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:26:50.300695  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.277422  9888 pending_rounds.cc:85] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 2
I20260709 12:26:50.302405 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:26:50.303009  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.304658  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:26:50.310694 12371 log.cc:927] Time spent T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:26:50.222461  9881 consensus_queue.cc:260] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:50.312197  9888 pending_rounds.cc:107] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:26:50.312539 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:50.317709  9888 raft_consensus.cc:2889] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:50.319746  9881 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:50.319862 10528 raft_consensus.cc:2393] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 3: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:50.320079 12292 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:50.208336 12206 consensus_queue.cc:260] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:50.325970 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:50.281167 12147 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:50.255535 12188 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:50.322966 12292 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:50.341768  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 188284us
I20260709 12:26:50.218226 12288 consensus_queue.cc:260] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:50.297806 12351 consensus_queue.cc:1048] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
W20260709 12:26:50.344521  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 165939us
I20260709 12:26:50.345973  9955 raft_consensus.cc:2393] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 6: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:50.337796 12301 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:50.344131 10497 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:50.351958 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:50.356953  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:50.353257 12206 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.368113 10527 raft_consensus.cc:1240] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:26:50.355822 12145 raft_consensus.cc:3055] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:50.372813 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:50.358887 12226 raft_consensus.cc:3055] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:26:50.383594  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.366607 12301 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:26:50.372004 12071 consensus_meta.cc:287] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.653s	user 0.011s	sys 0.000s
I20260709 12:26:50.391532  9927 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:50.358480 12274 consensus_queue.cc:1059] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:26:50.381283 12282 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:50.351588 12246 consensus_queue.cc:237] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:50.371853 12145 raft_consensus.cc:740] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:50.402618 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:50.385260 12226 raft_consensus.cc:740] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:50.408910  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:26:50.418682  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 46204.8us
I20260709 12:26:50.397436 12301 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:50.424784  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 81613.8us
I20260709 12:26:50.434365 10527 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:50.400828 12071 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:50.424077  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 122692us
I20260709 12:26:50.425458  9854 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:50.411902 12306 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:26:50.444727  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.466677  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:50.425402 12301 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.488134 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:50.494786  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 52993us
W20260709 12:26:50.499140  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 135309us
W20260709 12:26:50.526580 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 105984us
I20260709 12:26:50.466497 12147 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:50.433346 12274 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:26:50.542927  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:26:50.543977 10532 consensus_meta.cc:287] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.000s
I20260709 12:26:50.439343 11733 consensus_queue.cc:1059] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 12:26:50.544380 10532 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:50.429207 10528 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:26:50.546550  9957 raft_consensus.cc:1240] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: []
W20260709 12:26:50.545245 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 120691us
I20260709 12:26:50.501870 12188 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:50.442512 12294 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:50.552666  9884 raft_consensus.cc:1275] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:50.558780 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:50.541079 12282 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:50.431710 12145 consensus_queue.cc:260] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:50.570950  9779 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
W20260709 12:26:50.559681  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 116003us
I20260709 12:26:50.545908 12155 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:50.587677  9815 raft_consensus.cc:1240] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:50.587826  9812 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:50.556743 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:50.593523 10497 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:50.588260 12282 raft_consensus.cc:697] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:50.592176 12251 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.582202 12351 consensus_queue.cc:1048] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
W20260709 12:26:50.616986  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.600688 10524 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:50.561323 12226 consensus_queue.cc:260] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:50.596845 12306 raft_consensus.cc:697] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:50.591313 12301 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:50.630311 12373 consensus_queue.cc:1059] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 12:26:50.632706 12373 raft_consensus.cc:3055] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:50.633071 12373 raft_consensus.cc:740] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:50.634058 10527 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:26:50.634591 12145 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.634723 10528 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:26:50.635038 12378 log.cc:927] Time spent T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:26:50.635288 10528 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:50.638392 12390 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.639089 12390 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:50.640281 12377 log.cc:927] Time spent T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:26:50.641290 12390 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:50.638411 12383 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:26:50.642072 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:50.642866 10526 raft_consensus.cc:2393] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:50.643819 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:50.644258 10528 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:50.646194 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:50.647636 10527 raft_consensus.cc:1240] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8. Ops: []
W20260709 12:26:50.649356 12356 consensus_meta.cc:287] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.622s	user 0.006s	sys 0.001s
I20260709 12:26:50.591719 12284 consensus_queue.cc:1059] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 12:26:50.651307 12284 raft_consensus.cc:3055] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:50.651676 12284 raft_consensus.cc:740] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:50.652580 12284 consensus_queue.cc:260] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:50.654819 12282 consensus_queue.cc:237] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:50.659823  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 46478.5us
W20260709 12:26:50.619127 12072 consensus_meta.cc:287] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.567s	user 0.011s	sys 0.000s
I20260709 12:26:50.654034 12284 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:50.619781 12374 log.cc:927] Time spent T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:26:50.666492 10532 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 8. Ops: []
I20260709 12:26:50.649797 12356 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:50.678023  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 70160.9us
I20260709 12:26:50.678388 10496 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:50.678620  9955 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:50.678682  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:26:50.679301  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:50.662987 12275 consensus_meta.cc:287] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.754s	user 0.007s	sys 0.004s
I20260709 12:26:50.687912  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:50.659282 12147 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:50.698951  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:50.699720  9811 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 8: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:50.681638  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:50.663455  9881 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:26:50.690223 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:50.697424 12355 raft_consensus.cc:3055] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:26:50.707320 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 114562us
W20260709 12:26:50.708266  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.614688 12251 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:50.698446 12071 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:50.715891 10525 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:50.724669  9962 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:50.727978  9853 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:50.731637  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:50.706039 12147 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:50.706547 12355 raft_consensus.cc:740] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:50.735191  9884 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:50.663416 12292 consensus_queue.cc:1059] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:26:50.736124  9813 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.736491  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:26:50.740157  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.735673 12232 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:50.744477  9812 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:26:50.748067  9927 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:50.634014 12373 consensus_queue.cc:260] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:50.723774 12336 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:26:50.737347 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 59052.4us
I20260709 12:26:50.738116 12226 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.738458 12147 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:50.764465 10496 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:50.720108 12072 consensus_queue.cc:1059] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:26:50.748992 12275 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:50.762007 12359 consensus_meta.cc:287] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.800s	user 0.012s	sys 0.001s
I20260709 12:26:50.783742 10496 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:50.734112 12306 consensus_queue.cc:237] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:50.787325 12336 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:50.789706 12396 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:50.789776 12399 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:50.791965  9778 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:50.812076 12356 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:50.785378 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:50.804001 12394 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:26:50.831008 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 47350us
I20260709 12:26:50.822180 12373 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.840865  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:50.822665 12359 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:50.827229 12394 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.841557  9928 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:26:50.853595  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 45455.5us
I20260709 12:26:50.805338 12275 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:50.841915 11848 consensus_meta.cc:287] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.621s	user 0.014s	sys 0.000s
I20260709 12:26:50.833528 12301 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:50.854538 10526 raft_consensus.cc:2393] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:26:50.871158  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:50.876581  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.880563 10496 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:50.850032 12072 raft_consensus.cc:3055] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:50.855679 12394 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:50.856659 12282 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:50.887844  9884 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
W20260709 12:26:50.897126  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 163685us
I20260709 12:26:50.886133 12072 raft_consensus.cc:740] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:50.912278 10524 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:50.913072 12288 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:50.900843 12251 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:50.909144  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 364102us
I20260709 12:26:50.917186  9928 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:50.825898 12355 consensus_queue.cc:260] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:50.926077  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.875149 11848 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:50.926795  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:50.899125 12301 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:26:50.951126 12396 raft_consensus.cc:697] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:50.881168 12399 consensus_queue.cc:1059] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:26:50.956984  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:50.957471 10524 raft_consensus.cc:1240] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:50.958138 12410 log.cc:927] Time spent T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:26:50.958460 12178 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:26:50.958918 12072 consensus_queue.cc:260] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:50.962482 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:50.970815 10530 raft_consensus.cc:1240] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:50.975330 12275 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:50.977173  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:50.979063  9811 raft_consensus.cc:2368] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6.
W20260709 12:26:50.978886  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 84559.8us
W20260709 12:26:50.979316  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 81309.4us
W20260709 12:26:50.981230 12380 log.cc:927] Time spent T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.427s	user 0.001s	sys 0.001s
I20260709 12:26:50.954694 12246 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:50.985337 10528 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:50.987649  9813 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:50.991827 10533 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:50.992237 10531 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:50.990689  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:51.026261  9815 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:50.974001 11848 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:50.998395 10529 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:51.024381  9853 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:51.026583  9928 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:51.029219  9812 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:51.035638 12072 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:51.042400 12415 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:51.052479 12288 consensus_queue.cc:1059] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:51.052891 12391 raft_consensus.cc:3055] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:51.053432 12391 raft_consensus.cc:740] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:51.053442 12288 raft_consensus.cc:3055] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:51.054029 12288 raft_consensus.cc:740] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:51.054590 12391 consensus_queue.cc:260] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:51.054944 12288 consensus_queue.cc:260] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.056077 12391 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:51.056468 12401 log.cc:927] Time spent T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:26:51.059664 12418 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:51.060122 12418 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:51.060470 12418 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:51.054616 12294 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:51.080542  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 60474.4us
I20260709 12:26:51.080451  9779 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:51.087662 10496 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:51.090545  9815 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:26:51.090817  9928 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:51.090477  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:26:51.100437  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 76175.1us
I20260709 12:26:51.090394  9779 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:51.107264  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:51.108166  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:51.109300  9958 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:51.117619  9779 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:51.118858 12408 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:51.119272  9779 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:51.119540 12408 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:51.120198 12408 raft_consensus.cc:2764] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:26:51.122650 12381 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:51.122831  9962 raft_consensus.cc:2393] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:51.124269  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:51.125015  9957 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:51.126422 12275 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.126945 12275 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:51.128619 12423 log.cc:927] Time spent T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:26:51.130903  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.131832 10496 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:51.129226 12275 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:51.161513  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:51.162220  9956 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:51.163987 10496 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:51.164796 12275 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:51.165159 12275 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:51.165484 12275 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:51.130199 12155 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:51.150352 12288 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:26:51.176749  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 95317.1us
W20260709 12:26:51.179234  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.159373 12359 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:51.173985 12155 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:51.217698  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.222522  9928 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:51.130618 12284 consensus_queue.cc:1059] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:26:51.220132  9779 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:51.226889 12403 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:51.227252 12019 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.227519 12405 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:51.227749 12019 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:51.228116 12405 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:51.229930 12019 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:51.238005 10497 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:26:51.238636  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.242870  9957 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:51.246815  9958 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:26:51.249634  9778 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:51.251032  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:51.239389 12395 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.225764 12155 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:51.220839 12383 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:26:51.259598 12274 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:51.220973 12418 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.250375 12405 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:51.293313 10527 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:51.299065 10531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 757) took 1122 ms. Trace:
I20260709 12:26:51.300546 10531 rpcz_store.cc:276] 0709 12:26:50.172493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:50.200475 (+ 27982us) service_pool.cc:224] Handling call
0709 12:26:51.294214 (+1093739us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b5400514ad4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:51.294337 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124271872}
I20260709 12:26:51.288475 12381 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:51.297029 12251 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:51.296303 12421 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:26:51.314245 12419 log.cc:927] Time spent T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:26:51.314685 10524 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:26:51.279856 12147 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.315099  9806 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:26:51.240023 12396 consensus_queue.cc:237] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:51.321256  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 143810us
I20260709 12:26:51.322099 12381 raft_consensus.cc:697] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:51.279672 12394 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:51.305320 12274 raft_consensus.cc:697] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:26:51.334333 12412 log.cc:927] Time spent T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:26:51.334818 12274 consensus_queue.cc:237] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.330780 12413 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.337131 12418 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:51.336894 12413 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:51.339030 12413 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:51.315548 12430 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:51.340215 12430 raft_consensus.cc:697] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:51.340288 12301 raft_consensus.cc:3055] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:51.340807 12301 raft_consensus.cc:740] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:51.341223 12430 consensus_queue.cc:237] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.343741 12147 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:51.331337 12421 raft_consensus.cc:697] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:51.272114 12395 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:51.347524  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.347070 12421 consensus_queue.cc:237] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:51.333138 12394 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:51.350152  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.348050 12395 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:51.351850 10525 raft_consensus.cc:1275] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:26:51.355089  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 74959.8us
W20260709 12:26:51.380563 12422 log.cc:927] Time spent T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:26:51.381340 12275 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:51.384706 10529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 752) took 1430 ms (client timeout 1700 ms). Trace:
W20260709 12:26:51.385176 10529 rpcz_store.cc:269] 0709 12:26:49.956872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.962838 (+  5966us) service_pool.cc:224] Handling call
0709 12:26:51.384563 (+1421725us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b54005ea1d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:51.384651 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1804482432}
I20260709 12:26:51.358825 12391 consensus_queue.cc:1059] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:26:51.391789 12391 raft_consensus.cc:3055] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:51.392154 12391 raft_consensus.cc:740] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:51.392964 12391 consensus_queue.cc:260] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:51.412150 11914 raft_consensus.cc:3055] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:51.412645 11914 raft_consensus.cc:740] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:51.413089 12206 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.324291 12386 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.171s
W20260709 12:26:51.416630  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 47462.5us
W20260709 12:26:51.428941 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 189550us
I20260709 12:26:51.341897 12301 consensus_queue.cc:260] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.413645 12206 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.427248 12359 raft_consensus.cc:697] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:51.416445 12284 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.413548 11914 consensus_queue.cc:260] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.444164 12381 consensus_queue.cc:237] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:51.456327 12232 raft_consensus.cc:3055] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:51.449702 12301 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:26:51.458941 12425 log.cc:927] Time spent T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:26:51.431500 12391 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:51.456735 12232 raft_consensus.cc:740] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
W20260709 12:26:51.482942  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 262890us
W20260709 12:26:51.484002  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 244607us
I20260709 12:26:51.486968 12275 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:51.487114  9779 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:51.450426 12284 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:51.491766  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 247552us
I20260709 12:26:51.499600  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:51.500629  9928 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:51.497089  9779 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:51.490927 11914 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:51.504601  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:51.504993 12288 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:51.505098  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:51.505825  9885 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:51.505870  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:51.506126  9888 raft_consensus.cc:1240] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:51.492337 12408 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:51.509829  9887 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:51.497670 12394 consensus_queue.cc:1048] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:26:51.506631  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:51.511097  9889 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:51.512818 12408 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:51.495527 12292 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:26:51.506733 12444 consensus_queue.cc:1048] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:51.503825 12396 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:51.508169 12355 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:51.494900 12390 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:26:51.508556 12206 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:51.510048 10533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 764) took 1150 ms. Trace:
I20260709 12:26:51.503093 12421 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:26:51.519034  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.504354 12359 consensus_queue.cc:237] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.523681 10525 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:51.524068  9928 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:51.530431 10533 rpcz_store.cc:276] 0709 12:26:50.359703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:50.359944 (+   241us) service_pool.cc:224] Handling call
0709 12:26:51.509903 (+1149959us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b54002ee0d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:51.509998 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":968247040}
I20260709 12:26:51.518014 12396 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:51.532783 12396 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:51.533175 10529 raft_consensus.cc:1240] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:26:51.527915  9812 raft_consensus.cc:1240] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:51.528339  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:51.534385  9888 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:51.528517  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:51.528959  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:51.540889  9887 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:51.541992 10497 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:51.543403 12301 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:51.544014 12301 raft_consensus.cc:697] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:51.545187 12301 consensus_queue.cc:237] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.550359  9889 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:51.555672 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:51.556377  9884 raft_consensus.cc:1275] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:51.557485 12155 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.559808 12155 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:51.570493  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 46561.3us
I20260709 12:26:51.571597 12306 consensus_queue.cc:1059] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:51.572077  9928 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:51.572674 12306 raft_consensus.cc:3055] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:51.572933 12414 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:51.573479 12072 consensus_queue.cc:1048] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:51.573050 12306 raft_consensus.cc:740] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:51.575474 12306 consensus_queue.cc:260] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.576596 12306 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:51.550352 12421 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:51.587143 12421 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:51.587556 12421 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:51.590394 12442 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:51.591002 12442 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.593264 12442 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:51.593854 12446 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:26:51.539151 12206 consensus_queue.cc:1059] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:26:51.599097 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:51.600184 10529 raft_consensus.cc:2393] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:51.599135 12284 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:51.604698  9889 raft_consensus.cc:1275] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:51.604954  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:51.605587  9890 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:51.605670  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:51.611529  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:51.615752  9888 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
W20260709 12:26:51.617937 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.620055  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:51.620854  9889 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:26:51.618784 10497 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:51.623543 12390 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.624187  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:51.624804  9883 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:51.624051 12390 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:51.626174 12448 log.cc:927] Time spent T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:26:51.626636 12390 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:51.525034 12232 consensus_queue.cc:260] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.627308  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:51.627673 12232 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:51.627895  9882 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:51.628695 12394 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.629151 12394 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:51.629918  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:51.630541 12435 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:51.630442 12382 consensus_queue.cc:1175] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f5208640a51f493e930ce4f64ceeed0b" responder_term: 8 status { last_received { term: 6 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8. Ops: [7.8-7.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:26:51.631264 12435 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.630491  9812 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:51.633741  9889 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:51.634768  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:51.635842  9890 raft_consensus.cc:2376] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6. Re-sending same reply.
I20260709 12:26:51.651067 12445 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.651590 12445 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.653709 12445 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:51.655627 12394 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:51.657150 12435 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:51.658535  9960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 369) took 1729 ms. Trace:
I20260709 12:26:51.659065  9960 rpcz_store.cc:276] 0709 12:26:49.929422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.959703 (+ 30281us) service_pool.cc:224] Handling call
0709 12:26:51.658234 (+1698531us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b54001522d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:51.658432 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2055143168}
I20260709 12:26:51.606421  9806 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:51.664808  9882 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:26:51.672333  9889 raft_consensus.cc:1240] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:51.646176 12359 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:51.676437 10497 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:51.678558 10496 leader_election.cc:400] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6.
I20260709 12:26:51.678870 10496 leader_election.cc:403] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:26:51.681656  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:51.663614 12444 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.682480  9811 raft_consensus.cc:2368] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
I20260709 12:26:51.647768 12442 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:51.683522  9779 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:51.683941  9812 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:26:51.685350  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:51.685467  9883 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:26:51.686065  9813 raft_consensus.cc:1240] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:51.690407  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:51.691136  9885 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:26:51.692509 12274 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:51.698447  9885 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:26:51.698629  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:51.699887  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:51.700181  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:51.700536  9885 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:51.700995  9808 raft_consensus.cc:2393] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:51.681630 12390 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:51.702836 12390 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:51.703914  9815 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:51.705147 12390 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:51.677052 12408 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:51.706033 12408 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.708242 12408 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:51.675930 12292 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.708868 12292 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.687779 12356 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:51.711484  9815 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:51.711937  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:51.715772  9885 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:51.699762  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:51.711524 12442 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:51.717940  9814 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:51.686821 12359 raft_consensus.cc:697] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:51.719465 12442 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:51.719586 12359 consensus_queue.cc:237] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.720257  9889 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
W20260709 12:26:51.724341 12400 log.cc:927] Time spent T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.885s	user 0.005s	sys 0.000s
I20260709 12:26:51.725793 12403 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:51.726446 12403 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:51.728672 10496 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:51.737601  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:51.733453 12155 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:51.713418 12445 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.738873 12155 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.737387 12206 raft_consensus.cc:2804] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:51.739567 12445 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.740165 12206 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:51.740561 12206 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:51.741647 12445 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:51.741824 12155 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:51.743218  9885 raft_consensus.cc:1240] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:51.744714 12275 raft_consensus.cc:3055] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:51.745153 12275 raft_consensus.cc:740] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:51.745733  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:51.747859  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:51.738389 12435 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:51.744776 12438 consensus_queue.cc:1059] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:26:51.748361 12396 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.736402 12356 raft_consensus.cc:697] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:26:51.750931  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 67470.8us
W20260709 12:26:51.755203  9853 leader_election.cc:336] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.700s (SENT)
I20260709 12:26:51.759136  9853 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:26:51.760349  9853 leader_election.cc:336] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.702s (SENT)
W20260709 12:26:51.762182 12397 log.cc:927] Time spent T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.972s	user 0.000s	sys 0.003s
I20260709 12:26:51.762094 12442 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:51.762933 12206 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.763689  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2165) took 1403 ms. Trace:
I20260709 12:26:51.764212 12396 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:51.764061  9810 rpcz_store.cc:276] 0709 12:26:50.359762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:50.362410 (+  2648us) service_pool.cc:224] Handling call
0709 12:26:50.384980 (+ 22570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:50.558604 (+173624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:50.558632 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:50.590320 (+ 31688us) log.cc:844] Serialized 26 byte log entry
0709 12:26:50.681092 (+ 90772us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:50.681127 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:50.681192 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:51.761492 (+1080300us) spinlock_profiling.cc:243] Waited 59.6 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:26:51.763367 (+  1875us) raft_consensus.cc:1685] finished
0709 12:26:51.763389 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:51.763606 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3699,"raft.queue_time_us":167849,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":30286,"spinlock_wait_cycles":137005952,"thread_start_us":220324,"threads_started":2,"wal-append.queue_time_us":154268}
I20260709 12:26:51.764940 12356 consensus_queue.cc:237] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.765607 12206 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:51.755349 12415 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:51.766840  9882 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:26:51.766629 12415 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:51.689976 12444 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.768517 12415 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:51.758623 12413 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.757982  9814 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 5: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
W20260709 12:26:51.764034  9853 leader_election.cc:336] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 1.920s (SENT)
I20260709 12:26:51.782871  9779 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:51.755667  9883 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:51.784493  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:51.785200  9883 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:51.786175  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:51.786710  9885 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 5: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:51.787092  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:51.787919  9808 raft_consensus.cc:2368] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 6. Current term is 7.
I20260709 12:26:51.786742  9883 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:26:51.750396 12421 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:51.783236  9853 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:51.800020  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:51.802261  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:51.803020  9885 raft_consensus.cc:2393] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 5: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:51.802604  9883 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:51.804725  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:51.805281  9810 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:51.755746 12306 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:51.814216  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:51.814481  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:51.819972 10527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 766) took 1146 ms. Trace:
I20260709 12:26:51.821861  9928 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:26:51.823585  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.823217  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:51.823982 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.820487 10527 rpcz_store.cc:276] 0709 12:26:50.673637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:50.673782 (+   145us) service_pool.cc:224] Handling call
0709 12:26:51.819763 (+1145981us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b54005555d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:51.819898 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292670336}
I20260709 12:26:51.801038 12390 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:51.782393 12435 consensus_queue.cc:1048] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
W20260709 12:26:51.828599 12392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.965s	user 0.003s	sys 0.009s
I20260709 12:26:51.821471  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:51.857076  9885 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:51.858552  9779 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:51.832913  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:51.836716  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 72751.5us
I20260709 12:26:51.832643  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:51.838259 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:51.839752  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:51.840615  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:51.861425  9964 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:51.842017 12421 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:51.843313 12444 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:51.845566 12456 log.cc:927] Time spent T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:26:51.817906 12282 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:26:51.846323 12454 log.cc:927] Time spent T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
W20260709 12:26:51.862828 12392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.003s	sys 0.010s
I20260709 12:26:51.801234 12408 consensus_queue.cc:1059] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:26:51.850098  9810 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:51.799903 12445 consensus_queue.cc:1048] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:26:51.863781  9779 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:51.870102  9963 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:26:51.870929  9809 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
I20260709 12:26:51.871170  9887 raft_consensus.cc:2410] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:26:51.887953  9885 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:51.874668  9927 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:51.833802 12415 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:51.851770  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:51.878677  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:51.883263  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:51.891095  9956 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:51.819142 12306 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.862548 12390 raft_consensus.cc:697] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:26:51.912793  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 97674us
I20260709 12:26:51.893188  9814 raft_consensus.cc:2393] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 2: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:51.889951  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:51.890002  9959 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
W20260709 12:26:51.910463  9853 leader_election.cc:336] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.937s (SENT)
I20260709 12:26:51.875735 12356 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:51.872473 12351 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:51.922597  9853 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:51.831645 12413 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:51.957448 10496 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:51.927912 12306 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:51.928503 12292 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:51.929491  9927 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:51.931064 12403 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:51.921401 12351 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:51.921530 12421 raft_consensus.cc:2804] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:26:51.937321  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 114104us
I20260709 12:26:51.965477 10497 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:26:51.938987  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 47868.8us
I20260709 12:26:51.940807 12232 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:51.940905  9814 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:26:51.942903  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.954455 12072 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:51.955098 12444 raft_consensus.cc:3055] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:51.959263  9964 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:51.892679 12394 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:51.913472 12274 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6.
I20260709 12:26:51.892565 12415 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:51.975692 10496 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
W20260709 12:26:51.981715  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.987193  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:51.985366  9957 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 7. Current term is 8. Ops: []
W20260709 12:26:51.987190  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 73724.3us
I20260709 12:26:51.993007  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:51.993758  9813 raft_consensus.cc:2393] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:51.995618  9815 raft_consensus.cc:1275] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:51.996913  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:51.962039 12226 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:52.000120  9955 raft_consensus.cc:1240] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:51.978080 12356 raft_consensus.cc:2804] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:26:52.003675  9853 leader_election.cc:336] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.989s (SENT)
I20260709 12:26:52.006821  9853 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:51.988601  9808 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:52.004324 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:52.007892  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:52.008226 10533 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:51.968204 12351 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:51.980515 12394 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:51.982795 12392 raft_consensus.cc:2804] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:52.013239  9956 raft_consensus.cc:3055] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:51.987952 12415 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:51.986099 12396 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.981362 12444 raft_consensus.cc:740] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:52.018801  9956 raft_consensus.cc:740] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:52.016613  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:51.991969 12421 raft_consensus.cc:697] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:52.002229 12355 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:52.024468  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:52.025990  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:52.026743  9958 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
W20260709 12:26:52.032840 12393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.232s	user 0.010s	sys 0.025s
W20260709 12:26:52.033620 12393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.242s	user 0.010s	sys 0.025s
W20260709 12:26:52.037302  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.037223  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:52.018164 12394 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:52.046248  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:52.053153  9955 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:52.049683  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:52.019016 12418 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:52.018183 12392 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.020908 12356 raft_consensus.cc:697] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:52.011904 12274 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:26:52.032369 12355 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:52.074326  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:52.076818 12435 consensus_queue.cc:1059] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:26:52.081228  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 86162.2us
I20260709 12:26:52.074671  9956 consensus_queue.cc:260] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:52.082350  9886 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:52.082813  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:52.077886 12071 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:52.050645 12155 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:52.030805 12396 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:52.086506  9778 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
W20260709 12:26:52.088711  9853 leader_election.cc:336] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 2.116s (SENT)
I20260709 12:26:52.090152  9853 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:52.073611 12392 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:52.099743 12155 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:52.102545 12356 consensus_queue.cc:237] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:52.106407 12396 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:52.106949 12403 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:52.050590 12390 consensus_queue.cc:237] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:52.117147 12386 raft_consensus.cc:2764] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:26:52.121424  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:26:52.122958 12462 log.cc:927] Time spent T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 12:26:52.053553 12301 consensus_queue.cc:1059] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:26:52.125571 12421 consensus_queue.cc:237] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:52.128201  9711 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59972 (request call id 303) took 11942 ms (client timeout 15000 ms). Trace:
W20260709 12:26:52.158771  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 76032.5us
I20260709 12:26:52.159945  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:52.161020  9956 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:51.375833  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:52.085991 12435 raft_consensus.cc:3055] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:52.081573 12413 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:52.122185  9961 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:52.078639 12355 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:52.190577  9778 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:52.199225  9928 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:52.206737  9955 raft_consensus.cc:1275] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:52.163895 12072 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:52.100871 12387 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 12:26:52.205160 12403 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:52.100880 12251 consensus_queue.cc:1059] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:26:52.166186 12435 raft_consensus.cc:740] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:52.219010  9928 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:52.222678  9713 catalog_manager.cc:5697] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 3 to 5, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 5 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:52.226002 12467 log.cc:927] Time spent T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 12:26:52.239648 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.240757 12443 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:52.241478 12443 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:52.215035 12396 consensus_queue.cc:1059] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:26:52.243657 12155 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:52.162633 12444 consensus_queue.cc:260] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:52.128630  9711 rpcz_store.cc:269] 0709 12:26:40.185670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.185953 (+   283us) service_pool.cc:224] Handling call
0709 12:26:52.127988 (+11942035us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:49.210400 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:49.210960 (+   560us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:49.210997 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:26:49.211015 (+    18us) tablet.cc:662] Decoding operations
0709 12:26:49.212320 (+  1305us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:49.212395 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:49.212421 (+    26us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:26:49.213609 (+  1188us) tablet.cc:701] Row locks acquired
0709 12:26:49.213625 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:26:49.213782 (+   157us) write_op.cc:270] Start()
0709 12:26:49.213889 (+   107us) write_op.cc:276] Timestamp: P: 1783600009213734 usec, L: 0
0709 12:26:49.213907 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:26:49.282399 (+ 68492us) log.cc:844] Serialized 6274 byte log entry
0709 12:26:49.560204 (+277805us) op_driver.cc:464] REPLICATION: finished
0709 12:26:49.684265 (+124061us) write_op.cc:301] APPLY: starting
0709 12:26:49.684409 (+   144us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:49.684831 (+   422us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:49.691740 (+  6909us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:49.733030 (+ 41290us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:49.745051 (+ 12021us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:26:49.745451 (+   400us) write_op.cc:312] APPLY: finished
0709 12:26:49.749972 (+  4521us) log.cc:844] Serialized 113 byte log entry
0709 12:26:49.839806 (+ 89834us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:49.840203 (+   397us) write_op.cc:454] Released schema lock
0709 12:26:49.840294 (+    91us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:49.840916 (+   622us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:49.840955 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":218,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":123678,"apply.run_cpu_time_us":10296,"apply.run_wall_time_us":156634,"num_ops":16,"prepare.queue_time_us":152641,"prepare.run_cpu_time_us":8251,"prepare.run_wall_time_us":82595,"raft.queue_time_us":263956,"raft.run_cpu_time_us":30132,"raft.run_wall_time_us":96602,"replication_time_us":346014,"thread_start_us":525127,"threads_started":4,"wal-append.queue_time_us":8577,"wal-append.run_cpu_time_us":4417,"wal-append.run_wall_time_us":1553794}]]}
W20260709 12:26:52.230098 12466 log.cc:927] Time spent T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:26:52.219324 12393 raft_consensus.cc:2804] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:52.230201 12435 consensus_queue.cc:260] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:52.248025  9928 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:52.248428  9956 raft_consensus.cc:1275] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:52.225862  9713 catalog_manager.cc:5697] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 1 to 3, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 3 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:52.254252  9961 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:52.255367  9957 raft_consensus.cc:1240] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:52.220744 12386 raft_consensus.cc:2804] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:52.324254  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:52.255540 12438 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:52.251296 12414 raft_consensus.cc:2764] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:26:52.338968  9962 raft_consensus.cc:2393] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 4: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:52.255638 12251 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.327358 12386 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:52.431145 12386 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:52.436167  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 188210us
I20260709 12:26:52.436754 12421 consensus_queue.cc:1048] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:52.437129 12387 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.437630 12396 raft_consensus.cc:2804] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:52.437708 12336 consensus_queue.cc:1048] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:52.438657  9713 catalog_manager.cc:5697] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.440526 12415 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:52.496490 12415 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:52.442735 12394 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:52.514783  9810 raft_consensus.cc:1240] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:52.515827 12394 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:52.450333 12251 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:52.517800 12251 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:52.452265  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:52.519955 12477 log.cc:927] Time spent T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 12:26:52.520068  9962 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:26:52.455636 12472 log.cc:927] Time spent T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.214s	user 0.002s	sys 0.000s
I20260709 12:26:52.458495 12435 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:52.339864 12445 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:52.460283  9955 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:26:52.306681 12480 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:52.486112  9928 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:52.449792 12355 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:52.487644 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 232068us
I20260709 12:26:52.305895 12351 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:52.482100 12408 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:52.261701 12248 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.221s
I20260709 12:26:52.493659  9713 catalog_manager.cc:5697] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:52.343459 12438 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:52.527275 12478 log.cc:927] Time spent T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.288s	user 0.001s	sys 0.001s
I20260709 12:26:52.531903  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:52.603286  9713 catalog_manager.cc:5697] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 2 to 3, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 3 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:52.537135  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 276416us
W20260709 12:26:52.539584 12476 log.cc:927] Time spent T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.297s	user 0.002s	sys 0.000s
I20260709 12:26:52.553277 12359 raft_consensus.cc:3055] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:26:52.558240  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 473982us
W20260709 12:26:52.558869  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 439894us
W20260709 12:26:52.608577  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.559453 12418 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:52.614033  9890 raft_consensus.cc:1240] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:52.617817  9888 raft_consensus.cc:1275] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:52.618925  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:52.521893 12396 raft_consensus.cc:697] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:26:52.629894  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:52.631515  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.626782  9885 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:26:52.627550  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 145846us
I20260709 12:26:52.644600  9884 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:52.627493  9713 catalog_manager.cc:5697] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 3 to 4, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 4 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:52.628293  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:52.646529  9882 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:52.604724 12406 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:52.497915 12387 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:52.623332 12359 raft_consensus.cc:740] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:52.655155 10527 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:26:52.638985 12251 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:26:52.660858 10525 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:52.663733 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:52.667691  9928 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:52.670105 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:52.672902 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:52.672834 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:52.673761 10532 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 8: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:52.601331 12445 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:52.675722 10530 raft_consensus.cc:1240] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:52.675746  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:52.676462 10529 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:52.627761 12408 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:52.686050 12487 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:52.686200 10524 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:26:52.686760  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:52.686640 12487 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:52.686237 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:52.688233 10532 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:52.688476 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:52.685895 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:52.692929 10527 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:52.606076 12480 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:52.739495  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 119872us
I20260709 12:26:52.747619  9713 catalog_manager.cc:5697] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 4 to 5, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 5 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.751223  9885 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:26:52.759222  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:52.696837 12406 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:52.765723  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:53.253716  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:53.254261  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:53.253769  9812 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 2.
W20260709 12:26:53.062642  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:52.746488 12457 log.cc:927] Time spent T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:26:52.806135  9810 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: []
W20260709 12:26:53.037164  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 407319us
W20260709 12:26:53.260211  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 592558us
I20260709 12:26:53.287889  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:53.260574 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:53.289796 10529 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
W20260709 12:26:52.786662 12288 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.019s	sys 0.027s
I20260709 12:26:52.819501  9713 catalog_manager.cc:5697] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:52.778169 12226 consensus_meta.cc:287] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.774s	user 0.005s	sys 0.002s
I20260709 12:26:52.757264 12403 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:53.220175 12438 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:53.121291 12206 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:52.932473 12071 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.354249  9959 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:26:52.775074 12351 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:53.332782 12430 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:26:53.029152 12386 consensus_meta.cc:287] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.000s
I20260709 12:26:53.027601 12155 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:53.259039 10524 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.011s	sys 0.024s
W20260709 12:26:53.554445 10524 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.016s	sys 0.024s
W20260709 12:26:53.341615 12288 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.048s	sys 0.075s
I20260709 12:26:52.766057 12251 consensus_queue.cc:1059] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.588s
I20260709 12:26:52.931651 12301 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.594s
I20260709 12:26:53.562700 12301 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.563609 12301 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:53.032692 12442 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.520231 12415 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:26:53.551705 10526 consensus_meta.cc:287] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.863s	user 0.003s	sys 0.006s
I20260709 12:26:52.823469 12413 raft_consensus.cc:3055] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:52.781973 12445 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:53.216606 12418 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.336148 12356 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.020067 12489 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.780493 12443 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:26:52.770975 12355 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:52.829548 12072 raft_consensus.cc:3055] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:26:53.348958  9853 leader_election.cc:336] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 2.199s (SENT)
I20260709 12:26:53.331960 12408 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:53.086289 12393 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.021s	sys 0.060s
W20260709 12:26:53.543459  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 255667us
I20260709 12:26:53.604425  9928 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:53.349265  9713 catalog_manager.cc:5697] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 4 to 5, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 5 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
W20260709 12:26:53.353224  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 93328.1us
I20260709 12:26:52.833609 12485 consensus_queue.cc:1048] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.685s
I20260709 12:26:52.784291 12396 consensus_queue.cc:237] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:53.541960 12071 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:53.553386 12155 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:53.029215 12275 consensus_queue.cc:260] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:53.348315 12482 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.016s	sys 0.013s
I20260709 12:26:53.354368 12484 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.508504 12226 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:53.147332 12446 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:53.550577 12403 raft_consensus.cc:697] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:53.551397 12430 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:53.517593 12486 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.544167 12206 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:53.094676 12392 consensus_meta.cc:287] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.931s	user 0.002s	sys 0.008s
W20260709 12:26:53.621821  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 272864us
I20260709 12:26:53.573107 12413 raft_consensus.cc:740] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:53.614174  9927 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:26:53.709874  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 95805.6us
I20260709 12:26:53.574682 12387 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:53.603801 12393 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.028s	sys 0.061s
W20260709 12:26:53.668509  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 64196.3us
W20260709 12:26:53.673817  9960 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.913s	user 0.053s	sys 0.107s
W20260709 12:26:53.711931  9960 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.053s	sys 0.107s
I20260709 12:26:53.575102 10526 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:53.703395 12275 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:53.573619 12442 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:53.615634 12415 raft_consensus.cc:697] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:53.675357  9713 catalog_manager.cc:5697] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 2 to 4, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 4 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:53.577958 12418 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:53.708611 10531 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:53.667088 12373 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:52.907018 12359 consensus_queue.cc:260] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:53.655893 12482 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.018s	sys 0.018s
I20260709 12:26:53.582345 12274 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:53.611523 12489 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:53.580350 12356 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:53.628223 12394 consensus_queue.cc:1048] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
W20260709 12:26:53.707114 12479 log.cc:927] Time spent T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195: Append to log took a long time: real 1.213s	user 0.000s	sys 0.005s
I20260709 12:26:53.595868 12072 raft_consensus.cc:740] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:53.721673 12306 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:26:53.760347  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.854625  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:53.855435  9958 raft_consensus.cc:2393] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:53.790028  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:53.790768  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:53.856437  9962 raft_consensus.cc:2368] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
I20260709 12:26:53.857077 12390 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:53.857607 12390 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:53.795816  9713 catalog_manager.cc:5697] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 1 to 2, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:26:53.859082  9713 catalog_manager.cc:5697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 2 to 3, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 3 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:53.797662  9854 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.046s	sys 0.035s
W20260709 12:26:53.861383  9854 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.047s	sys 0.035s
I20260709 12:26:53.799136  9957 raft_consensus.cc:1275] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:53.723842 10526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 528) took 1067 ms. Trace:
I20260709 12:26:53.806483  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:53.808292  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:53.809060  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:53.708694 12446 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:53.812753  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:53.558941 12386 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:53.814847  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:53.873890  9956 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:53.719081 12393 raft_consensus.cc:697] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:53.670639 12484 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:53.712387 12392 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:53.801618 10533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.000s	sys 0.010s
I20260709 12:26:53.811827 12301 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:53.893153  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:53.894109  9964 raft_consensus.cc:2393] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:53.894735 10533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36672 (request call id 720) took 1277 ms. Trace:
I20260709 12:26:53.878597  9713 catalog_manager.cc:5697] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
W20260709 12:26:53.898818 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:53.899739  9779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.005s	sys 0.013s
I20260709 12:26:53.864761 12306 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:53.900130  9779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.005s	sys 0.013s
I20260709 12:26:53.902161  9961 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:53.903239 12072 consensus_queue.cc:260] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:53.881230 12406 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:53.904614 12072 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:53.905014 12487 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:53.905908 12415 consensus_queue.cc:237] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:53.903740 12155 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:53.913848  9963 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:53.712172 12486 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:53.814584 12274 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:53.933768  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:53.935016  9963 raft_consensus.cc:2410] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:26:53.936204  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:53.910701  9960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 392) took 1261 ms. Trace:
I20260709 12:26:53.925299  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:53.892190 10524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 530) took 1215 ms. Trace:
W20260709 12:26:53.941864  9780 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.004s	sys 0.014s
I20260709 12:26:53.876376 12413 consensus_queue.cc:260] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:53.942250  9780 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.004s	sys 0.014s
I20260709 12:26:53.942986 12413 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:53.945758 12274 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:53.939424 10524 rpcz_store.cc:276] 0709 12:26:52.662557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.687124 (+ 24567us) service_pool.cc:224] Handling call
0709 12:26:52.687422 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:52.687643 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:26:53.554946 (+867303us) log.cc:844] Serialized 14 byte log entry
0709 12:26:53.795331 (+240385us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:53.802807 (+  7476us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:53.808801 (+  5994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:53.862784 (+ 53983us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:53.878021 (+ 15237us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":863420,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":97,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":2230,"thread_start_us":1034511,"threads_started":2,"wal-append.queue_time_us":318585}
I20260709 12:26:53.948457 12444 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:53.961191 12071 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:53.967590  9778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.002s	sys 0.033s
I20260709 12:26:53.937666  9960 rpcz_store.cc:276] 0709 12:26:52.649428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.649613 (+   185us) service_pool.cc:224] Handling call
0709 12:26:52.661991 (+ 12378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:52.666645 (+  4654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:52.666689 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:52.678144 (+ 11455us) log.cc:844] Serialized 26 byte log entry
0709 12:26:53.712354 (+1034210us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:53.712397 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:53.712467 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:53.910452 (+197985us) raft_consensus.cc:1685] finished
0709 12:26:53.910471 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:53.910626 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4496,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":21221,"thread_start_us":951191,"threads_started":1,"wal-append.queue_time_us":1002698}
W20260709 12:26:53.968151  9778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.002s	sys 0.034s
W20260709 12:26:53.968780  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 669800us
I20260709 12:26:53.909824 12306 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:53.869396 10526 rpcz_store.cc:276] 0709 12:26:52.656115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.664561 (+  8446us) service_pool.cc:224] Handling call
0709 12:26:53.721845 (+1057284us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:53.933871 10497 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:26:53.968658  9853 connection.cc:256] RPC call timeout handler was delayed by -2.5017385930000273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260709 12:26:53.979044  9853 connection.cc:256] RPC call timeout handler was delayed by -2.5017385930000273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
W20260709 12:26:53.980093 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 46351.3us
W20260709 12:26:53.982766  9855 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.004s	sys 0.032s
W20260709 12:26:53.987124  9855 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.004s	sys 0.032s
I20260709 12:26:53.983302  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:53.879709 12403 consensus_queue.cc:237] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:53.962821 12393 consensus_queue.cc:237] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:53.982971 12491 log.cc:927] Time spent T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 12:26:54.005730  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:54.009285  9955 raft_consensus.cc:2368] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 2. Current term is 3.
W20260709 12:26:54.010149  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.982925 12509 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.983006 12501 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.986109 12336 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:53.982892 12373 raft_consensus.cc:697] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:26:54.015548  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 305031us
I20260709 12:26:53.982934 12498 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:53.998764 12497 log.cc:927] Time spent T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.373s	user 0.000s	sys 0.001s
I20260709 12:26:54.019543  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:54.006115 12510 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:54.029464  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:53.999493 12351 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:26:54.040091  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:53.996387 12505 consensus_queue.cc:1059] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:26:54.040889  9963 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:54.018123 12336 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:54.045341 12355 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.051645  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:54.051563 12355 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.052356  9964 raft_consensus.cc:2393] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:54.019948 12501 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.057372 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:54.021399 12415 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:54.059790 10529 raft_consensus.cc:2393] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:54.029866 12506 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.031845 12438 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:54.050824 12435 consensus_meta.cc:287] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 1.460s	user 0.014s	sys 0.000s
I20260709 12:26:54.072938  9963 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:54.041021 12406 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.045996 12336 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:54.060951 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:54.077643 10529 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:54.028637 12071 consensus_queue.cc:1059] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:26:54.058108 12445 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.057062 12503 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:54.057303 12418 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:54.058482 12482 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:26:54.084369  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.088313  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:54.095157  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:54.060381 12512 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.070619 12408 raft_consensus.cc:3055] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:54.060570 12511 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.168357 10529 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:26:54.078891 12356 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:54.080706 12505 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.023259 12509 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.171772  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 496) took 1557 ms. Trace:
I20260709 12:26:54.098091 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:54.024601 12498 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.174263 10529 raft_consensus.cc:1240] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:26:54.064275 12415 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:54.099035 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:54.177233  9884 rpcz_store.cc:276] 0709 12:26:52.610028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.610175 (+   147us) service_pool.cc:224] Handling call
0709 12:26:52.620244 (+ 10069us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:52.645139 (+ 24895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.167164 (+1522025us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b54003f93d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:54.167337 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55001856}
W20260709 12:26:54.175498 12500 log.cc:927] Time spent T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.251s	user 0.000s	sys 0.010s
I20260709 12:26:54.158885 12418 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:54.160887 12446 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:54.092231 12438 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:54.208039  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.208230  9964 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:54.179335 12356 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:54.094776 12445 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:54.170830 12408 raft_consensus.cc:740] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:54.083099 12406 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.058714 12510 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:54.210837  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:54.081575 12373 consensus_queue.cc:237] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.209542  9811 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:26:54.216265  9853 connection.cc:256] RPC call timeout handler was delayed by -2.2947806939996553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2504s for a response
I20260709 12:26:54.203979 12514 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.207993 12019 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.161798 12482 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.084437 12506 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.099049 12503 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:54.172997 12511 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.180894 12505 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.177608 12512 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.209733 10526 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:54.218918  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:54.417351  9810 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:26:54.210999  9881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1199) took 2215 ms. Trace:
W20260709 12:26:54.291255 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 132965us
W20260709 12:26:54.400805  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.245146  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:54.420462  9808 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
W20260709 12:26:54.335008  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:54.424412  9853 leader_election.cc:336] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 2.679s (SENT)
I20260709 12:26:54.424958  9853 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:54.424994  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:54.415038 12512 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:54.395623  9964 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:54.430621  9885 raft_consensus.cc:1275] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:26:54.245536 12502 log.cc:927] Time spent T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
W20260709 12:26:54.420351 10497 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.849s (SENT) [suppressed 12 similar messages]
W20260709 12:26:54.245322 12499 log.cc:927] Time spent T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 12:26:54.435096  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.435724  9887 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:26:54.437057  9886 raft_consensus.cc:1240] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:54.215929 12446 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:54.442538 12520 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.290702 12521 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:54.410331 12519 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:54.245321 12516 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.446452  9809 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:26:54.455516  9809 pending_rounds.cc:85] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71: Aborting all ops after (but not including) 5
I20260709 12:26:54.273168 12072 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:54.219018 12356 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.449878  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:54.449946  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:54.459576  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.459924  9812 raft_consensus.cc:2410] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:26:54.458801  9890 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:54.455849  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:54.455821  9809 pending_rounds.cc:107] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:26:54.460680  9809 raft_consensus.cc:2889] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:54.460747  9810 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:26:54.217800 12418 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.448166  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:26:54.466922  9853 connection.cc:256] RPC call timeout handler was delayed by -1.997908599999846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
I20260709 12:26:54.467264  9885 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:26:54.467449  9853 connection.cc:256] RPC call timeout handler was delayed by -1.997908599999846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
I20260709 12:26:54.467485  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.463380  9890 raft_consensus.cc:1240] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:53.895243 10533 rpcz_store.cc:276] 0709 12:26:52.610909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.611045 (+   136us) service_pool.cc:224] Handling call
0709 12:26:52.642654 (+ 31609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:52.642838 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:26:53.119418 (+476580us) log.cc:844] Serialized 14 byte log entry
0709 12:26:53.887253 (+767835us) log.cc:844] Serialized 14 byte log entry
0709 12:26:53.887463 (+   210us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:53.887519 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:53.887575 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:53.887668 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:53.887803 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4805,"prepare.queue_time_us":902780,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":101,"spinlock_wait_cycles":14129024,"thread_start_us":1010035,"threads_started":2}
I20260709 12:26:54.456881  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:54.468762  9888 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:54.444980 12501 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:54.447041 12524 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:54.467895  9853 connection.cc:256] RPC call timeout handler was delayed by -1.8531104300000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2783s for a response
I20260709 12:26:54.460121  9886 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:54.474161  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2184) took 1799 ms. Trace:
I20260709 12:26:54.474368 12442 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:54.475414  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:54.474617  9813 rpcz_store.cc:276] 0709 12:26:52.674722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.674855 (+   133us) service_pool.cc:224] Handling call
0709 12:26:52.692886 (+ 18031us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:52.693252 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:52.693281 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:52.693849 (+   568us) log.cc:844] Serialized 52 byte log entry
0709 12:26:53.629166 (+935317us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:53.629226 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:53.629321 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:54.473945 (+844624us) raft_consensus.cc:1685] finished
0709 12:26:54.473968 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:54.474103 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3361,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":78047,"thread_start_us":375957,"threads_started":1,"wal-append.queue_time_us":1025805}
I20260709 12:26:54.476019  9812 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:54.476999 12528 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.477826 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:54.478631 10527 raft_consensus.cc:2410] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:26:54.479058 10527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 537) took 1777 ms. Trace:
I20260709 12:26:54.420939  9881 rpcz_store.cc:276] 0709 12:26:51.989219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.997782 (+  8563us) service_pool.cc:224] Handling call
0709 12:26:52.030573 (+ 32791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:52.549997 (+519424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:52.550046 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:52.550712 (+   666us) log.cc:844] Serialized 26 byte log entry
0709 12:26:52.751767 (+201055us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:53.296401 (+544634us) log.cc:844] Serialized 14 byte log entry
0709 12:26:53.941525 (+645124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:53.972349 (+ 30824us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:54.176091 (+203742us) raft_consensus.cc:1685] finished
0709 12:26:54.176119 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:54.204628 (+ 28509us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":494342,"prepare.queue_time_us":496671,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":1178197,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":7741,"thread_start_us":724323,"threads_started":2,"wal-append.queue_time_us":1070455}
I20260709 12:26:54.479375 10527 rpcz_store.cc:276] 0709 12:26:52.701732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.701846 (+   114us) service_pool.cc:224] Handling call
0709 12:26:54.477698 (+1775852us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b58001f1a98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:54.479003 (+  1305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3574144}
I20260709 12:26:54.486665 12418 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:54.487229  9882 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:54.487854 12503 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:54.491099 12490 log.cc:927] Time spent T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.689s	user 0.000s	sys 0.003s
I20260709 12:26:54.455716 12446 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.430440 12019 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.499846 10525 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:26:54.506173 10531 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 525) took 1850 ms (client timeout 1682 ms). Trace:
I20260709 12:26:54.456826 12519 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:54.506588 10531 rpcz_store.cc:269] 0709 12:26:52.655303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.655886 (+   583us) service_pool.cc:224] Handling call
0709 12:26:54.505964 (+1850078us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400832054. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:54.506068 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2386518272}
I20260709 12:26:54.508731 12519 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:54.458094 12520 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.511569 12359 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:54.496619 12510 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:54.512576 12520 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:54.512790 10525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 538) took 1806 ms. Trace:
I20260709 12:26:54.458554 12521 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.501291 12019 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:54.506589 12524 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:54.493623 12446 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:54.516701 12524 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:54.517608 12517 log.cc:927] Time spent T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 12:26:54.513181 10525 rpcz_store.cc:276] 0709 12:26:52.706696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.706838 (+   142us) service_pool.cc:224] Handling call
0709 12:26:54.499148 (+1792310us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b58001f1a98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:54.499416 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:54.503274 (+  3858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.512737 (+  9463us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3409792}
W20260709 12:26:54.524343  9853 connection.cc:256] RPC call timeout handler was delayed by -1.08214993699994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
W20260709 12:26:54.524750  9853 connection.cc:256] RPC call timeout handler was delayed by -1.0594549520001237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 12:26:54.525045  9853 connection.cc:256] RPC call timeout handler was delayed by -1.0594549520001237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 12:26:54.525372  9853 connection.cc:256] RPC call timeout handler was delayed by -1.0281385519997457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1685s for a response
I20260709 12:26:54.525580  9882 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
W20260709 12:26:54.525699  9853 connection.cc:256] RPC call timeout handler was delayed by -1.0281385519997457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1685s for a response
W20260709 12:26:54.526743  9853 connection.cc:256] RPC call timeout handler was delayed by -1.022738551999737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
I20260709 12:26:54.419876 12514 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.545779  9888 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:26:54.556983  9885 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:26:54.432053 12408 consensus_queue.cc:260] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:54.559320  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:54.561216  9812 raft_consensus.cc:2393] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 6: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:54.561422  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.461256 12072 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.561975  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2190) took 1824 ms. Trace:
W20260709 12:26:54.560178  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.562045  9886 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
W20260709 12:26:54.564754  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.562810  9888 raft_consensus.cc:1275] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:26:54.566741 12523 log.cc:927] Time spent T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:26:54.536851 12442 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:54.569324 12442 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:54.569926 10528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 529) took 1907 ms. Trace:
I20260709 12:26:54.571345 12442 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:54.571480 12521 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:54.570323 10528 rpcz_store.cc:276] 0709 12:26:52.662255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.664621 (+  2366us) service_pool.cc:224] Handling call
0709 12:26:53.963120 (+1298499us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b58001f1a98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:53.963331 (+   211us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:53.963582 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:53.963616 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:53.980110 (+ 16494us) log.cc:844] Serialized 26 byte log entry
0709 12:26:54.215429 (+235319us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:54.285284 (+ 69855us) log.cc:844] Serialized 14 byte log entry
0709 12:26:54.375662 (+ 90378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.398105 (+ 22443us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:54.477024 (+ 78919us) spinlock_profiling.cc:243] Waited 54.3 ms on lock 0x7b180043e1c0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f3f3 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:26:54.569710 (+ 92686us) raft_consensus.cc:1685] finished
0709 12:26:54.569733 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:54.569869 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32012,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":29821,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":150452864,"thread_start_us":185854,"threads_started":1,"wal-append.queue_time_us":399773}
I20260709 12:26:54.564054  9814 rpcz_store.cc:276] 0709 12:26:52.737767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.741425 (+  3658us) service_pool.cc:224] Handling call
0709 12:26:52.741775 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:52.749819 (+  8044us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:52.749862 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:52.749914 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:52.749956 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.561774 (+1811818us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b54002d8554. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:54.561820 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:54.561923 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17987968}
I20260709 12:26:54.575910 12408 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:54.458802 12516 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.587695  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:54.586063  9809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 388) took 2329 ms. Trace:
I20260709 12:26:54.594486 12516 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:54.595434  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.596920  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.591248  9809 rpcz_store.cc:276] 0709 12:26:52.253526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.253641 (+   115us) service_pool.cc:224] Handling call
0709 12:26:52.315741 (+ 62100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:54.469505 (+2153764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.582306 (+112801us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b54002d6754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:54.582526 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4894419328}
I20260709 12:26:54.599633  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.600534  9888 raft_consensus.cc:2393] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 6: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:54.606235 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:54.606860 10532 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:54.607918  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.608527  9887 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:54.609270  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:54.610047  9960 raft_consensus.cc:2410] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:26:54.612650 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:54.613196 10532 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:26:54.612974  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:54.613827  9886 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:54.574213 12444 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:54.574539 12498 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:54.598459 12521 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:54.622295  9883 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 1.
W20260709 12:26:54.598771 12306 consensus_meta.cc:287] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.002s
I20260709 12:26:54.601935 12522 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.628147  9853 leader_election.cc:400] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
W20260709 12:26:54.631743  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.631910  9853 leader_election.cc:403] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:26:54.633378 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.633991  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:54.640465  9853 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:26:54.641700 12515 log.cc:927] Time spent T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 12:26:54.641850  9888 raft_consensus.cc:1275] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:54.643121 12522 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:54.645646 12522 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:54.646528  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.647296 12516 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
I20260709 12:26:54.647421  9890 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:26:54.648535  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:54.646579 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:54.649847 10533 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:26:54.650760  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.651746  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.653427 12522 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:54.654520  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.655090  9888 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:26:54.656087  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.657065  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.657557  9888 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
W20260709 12:26:54.657668  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.658905  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.659440  9888 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:26:54.660166 12445 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:54.660645 12445 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.661312 12248 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.610484 12480 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:54.661782 12248 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:54.662200 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:54.662410 12480 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.662957 10530 raft_consensus.cc:2410] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:26:54.663506 10530 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 536) took 1980 ms (client timeout 1831 ms). Trace:
I20260709 12:26:54.663805 12248 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:54.663903 10530 rpcz_store.cc:269] 0709 12:26:52.682991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.685347 (+  2356us) service_pool.cc:224] Handling call
0709 12:26:54.662065 (+1976718us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b58001f1a98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:26:54.663428 (+  1363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2995584}
I20260709 12:26:54.662998 12480 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.661101 12445 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.666554 12489 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:54.666942 12480 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:54.667048 12445 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:54.660146  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.668596 12482 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:54.668955  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:26:54.669924  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.670228  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.671020  9888 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:26:54.671959  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.672655 12072 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:54.673095  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.673785  9888 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:54.676890 12392 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:54.678128 12438 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:54.678418 12513 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:54.678978 12513 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:54.616890  9881 raft_consensus.cc:1275] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:54.681221  9885 raft_consensus.cc:1240] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:54.685562  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:54.688688  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 48319.9us
I20260709 12:26:54.689550  9853 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:54.691959  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.692934  9882 raft_consensus.cc:2410] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:26:54.701321  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:26:54.718552 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 50923.8us
I20260709 12:26:54.699638 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:54.720373  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.720373  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:54.632910 12396 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.724074  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:54.719338  9814 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:54.723064  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:54.687225 12071 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.003s	sys 0.026s
I20260709 12:26:54.723563  9955 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:54.719861  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:54.725505 10530 raft_consensus.cc:1240] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:54.687878 12251 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.625356 12444 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.721100  9888 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:54.728760 12396 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.729298  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:54.732332  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:54.729852  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:54.727890 12071 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.004s	sys 0.027s
I20260709 12:26:54.727291  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:54.734476 10497 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:54.735276 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:54.735795 10496 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:54.740685 10496 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:54.740839 10497 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:54.741689 12399 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:54.741801 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:54.742105 12399 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.742496 12399 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:54.742722 12438 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:54.743083 12438 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:54.743445 12438 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:54.743801 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:54.718889 12394 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.717736 12507 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.755671 10529 raft_consensus.cc:1240] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: [5.7-6.8]
I20260709 12:26:54.757131 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:54.737715  9928 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:54.631220 12306 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:54.692265 12336 consensus_meta.cc:287] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.001s
W20260709 12:26:54.758270  9779 connection.cc:256] RPC call timeout handler was delayed by -1.3452944090004166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
W20260709 12:26:54.747026  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 57559.9us
I20260709 12:26:54.737797  9809 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:54.767601  9853 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:54.747351  9882 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:26:54.754163  9810 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:26:54.746996 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:54.769600 10527 raft_consensus.cc:2393] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 3: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:26:54.761310  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 140885us
I20260709 12:26:54.769905 12480 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.770499 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:54.770510 12480 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:54.770691 12019 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:54.772491 12019 raft_consensus.cc:697] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:54.750726  9854 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:54.771093 12336 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.774242  9854 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:54.775156 12446 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:54.775565 12446 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.775939 12446 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:54.776563  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:54.777107  9963 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:54.777570  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.777917  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.773476 12019 consensus_queue.cc:237] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:54.778330  9881 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:54.778581  9890 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 1.
I20260709 12:26:54.769179  9853 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:54.779178 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:54.780012  9882 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:26:54.762195 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:54.803169 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:54.806903  9778 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:54.802637  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:54.807791  9813 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:26:54.784538  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:54.802891  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:54.791703 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 50944.7us
I20260709 12:26:54.783113  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:54.781919  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:54.780074 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:54.810539  9815 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:26:54.810902 10533 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:26:54.735550 12531 raft_consensus.cc:2764] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:26:54.802438  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:54.816819  9890 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:54.763041 12351 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.794497  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:54.813840  9886 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:54.752677 12226 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:54.724706 12482 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:26:54.812891 10497 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:54.724107 12503 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:26:54.818315  9811 raft_consensus.cc:1240] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:26:54.819641  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 50536.1us
I20260709 12:26:54.774292 12442 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:26:54.802654 12275 consensus_meta.cc:287] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 1.004s	user 0.011s	sys 0.000s
I20260709 12:26:54.746568 12529 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.768285 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:54.753160 12489 consensus_queue.cc:1048] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:26:54.753738 12359 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:26:54.748183 12251 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.821334  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:55.282473  9853 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:55.283295 10525 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
W20260709 12:26:55.189018  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 380695us
I20260709 12:26:54.835073  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:55.180279  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:55.285094  9890 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:55.028522 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:54.884532  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:55.282981 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 470100us
W20260709 12:26:55.281550  9957 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.006s	sys 0.007s
W20260709 12:26:55.153529 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.177466  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:55.285005  9958 raft_consensus.cc:2393] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 3: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:26:55.287547  9957 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.006s	sys 0.008s
I20260709 12:26:55.172610  9814 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:55.285534  9883 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:54.768309 12475 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.287508 10497 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:26:55.029374  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 291703us
I20260709 12:26:54.763443 12445 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.288118  9887 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:54.746920 12516 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:26:55.296026  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 529696us
I20260709 12:26:55.298090  9927 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:26:55.017177 12413 consensus_meta.cc:287] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 1.074s	user 0.007s	sys 0.001s
W20260709 12:26:54.888619 12538 log.cc:927] Time spent T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 12:26:55.299096  9779 connection.cc:256] RPC call timeout handler was delayed by -1.3249681260003854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2126s for a response
I20260709 12:26:54.856393 12498 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:54.872666 12392 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:55.292514 12274 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.293049 12351 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:55.301230 12251 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:55.301805 12275 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:55.082877 12480 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:55.025779 12306 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:55.302018 12541 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:55.302532 12554 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:55.015152 10524 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:26:55.012301 12438 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:55.022871 12396 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:54.884796  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:55.301862  9927 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:26:55.415262 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 117719us
I20260709 12:26:55.304672 12553 consensus_queue.cc:1059] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:55.283878 12387 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:55.416218 12387 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.416391 12553 raft_consensus.cc:2804] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:55.308313 12521 consensus_queue.cc:1059] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:54.769232 12507 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:54.861030 12408 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:26:55.309266 10496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.014s	sys 0.038s
I20260709 12:26:54.848213 12533 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:55.317898 12275 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:55.311013  9779 connection.cc:256] RPC call timeout handler was delayed by -1.2034681260001889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22610000000000002s for a response
W20260709 12:26:55.456615  9779 connection.cc:256] RPC call timeout handler was delayed by -1.1436944090005454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20550000000000002s for a response
W20260709 12:26:55.457111  9779 connection.cc:256] RPC call timeout handler was delayed by -1.121194409000509s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
I20260709 12:26:55.458490  9779 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:55.284654 12442 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.284044 12226 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:54.835804 12071 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:54.915198 12336 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:54.764999 12394 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:54.854802 12547 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:55.318770  9887 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:55.022249 12446 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:55.566380 12547 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.566841 12547 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:55.567472 12394 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:55.021503 12399 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:55.415489  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 113683us
I20260709 12:26:55.416594 10497 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:55.308929 12415 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:55.450938  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 157746us
I20260709 12:26:55.416694 12387 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:55.365885 12541 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:55.447979 10496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.014s	sys 0.038s
I20260709 12:26:55.316354 12392 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:55.310737  9959 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:26:55.540751 10532 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8. Ops: []
W20260709 12:26:55.540786  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 82588.9us
I20260709 12:26:55.591928  9928 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:26:55.417213 12373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.008s	sys 0.036s
I20260709 12:26:55.447714 12408 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.539717 12275 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:55.553661 12507 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:55.450964 12480 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.417084 12553 raft_consensus.cc:697] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:55.550674 12435 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:55.365672 12274 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:55.555140 12488 raft_consensus.cc:3055] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:55.556130 12351 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:26:55.602152 12373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.009s	sys 0.037s
I20260709 12:26:55.293272 12529 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:55.594602 12392 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:55.560194 12226 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:55.310484 12475 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:55.591418 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 849593us
W20260709 12:26:55.595459 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 178937us
I20260709 12:26:55.602728 12555 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:55.600592  9779 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:55.615798 10527 raft_consensus.cc:2393] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 7: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:55.592257 12541 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:55.546190 12442 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:55.634763 12529 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:55.636125  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:55.636791  9881 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:55.596031 12396 consensus_queue.cc:1048] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:26:55.638546 12351 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:55.620573 12435 raft_consensus.cc:697] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:55.639954 12435 consensus_queue.cc:237] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:55.641316 12275 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:55.641719 12442 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:55.311259 12445 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:55.643923  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.645529  9808 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:55.645370 12445 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:55.568830 12438 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:55.607757 12408 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:55.647451 12442 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:55.618618  9928 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:55.612565 12403 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:55.648092 12403 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:55.648494 12403 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:26:55.594300  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.616796 12488 raft_consensus.cc:740] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:55.651435 12444 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:55.652685 12251 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.653124 12251 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:55.622826 10496 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:55.655536 10496 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
W20260709 12:26:55.656766 12532 log.cc:927] Time spent T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.998s	user 0.010s	sys 0.007s
I20260709 12:26:55.657214 12498 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:55.657373 12336 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:55.657620 12498 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.657893 12336 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:55.658082 12498 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:55.658375 12336 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:55.659417 12386 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:55.660501 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:55.623121 12553 consensus_queue.cc:237] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:55.662621 12275 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:55.655652 12251 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:55.627455 12506 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:55.628221 12475 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:55.632583  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:55.664625  9887 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:55.633597 10531 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
I20260709 12:26:55.666088 12509 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:55.642406 12359 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:55.616709 12480 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:55.643105 12399 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:55.567662 12446 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:55.645349 12351 consensus_queue.cc:1059] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:55.651130 12390 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:55.669520 12480 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:55.669875 12390 raft_consensus.cc:3055] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:55.670256 12390 raft_consensus.cc:740] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:55.671131 12390 consensus_queue.cc:260] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:55.656661 10496 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:55.672832 12359 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.673359 12275 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:55.673307 12359 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:55.673653 10496 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:55.674388 12487 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:55.675781 12359 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:55.677739 10496 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:55.565289 12071 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:55.678812 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:55.679659 12487 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:55.680073 12071 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:55.680265 12482 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:55.680466 12275 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:55.681039 12482 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:55.681819 12487 raft_consensus.cc:697] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:55.682266  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 1895) took 1784 ms. Trace:
I20260709 12:26:55.682363 10532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36672 (request call id 723) took 1062 ms. Trace:
I20260709 12:26:55.682729  9959 rpcz_store.cc:276] 0709 12:26:53.897541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.898659 (+  1118us) service_pool.cc:224] Handling call
0709 12:26:53.915054 (+ 16395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:55.592452 (+1677398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:55.682050 (+ 89598us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400114754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:55.682206 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3208757120}
I20260709 12:26:55.684870 12406 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:55.682799 10532 rpcz_store.cc:276] 0709 12:26:54.619984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.620261 (+   277us) service_pool.cc:224] Handling call
0709 12:26:55.307159 (+686898us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b58001f1a98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:55.307344 (+   185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:55.592620 (+285276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:55.682118 (+ 89498us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54004a2c54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:55.682303 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540435584}
I20260709 12:26:55.686203 12498 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:55.688356 12498 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:55.689658 12511 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:55.682753 12487 consensus_queue.cc:237] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:55.691025 12505 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:55.619261 12554 consensus_queue.cc:1059] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:26:55.691320 12355 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:55.692170  9956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 396) took 1646 ms. Trace:
I20260709 12:26:55.681103 12206 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:55.692682 12484 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:55.679040  9885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 500) took 1038 ms. Trace:
I20260709 12:26:55.693979  9964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 397) took 1637 ms. Trace:
I20260709 12:26:55.694404  9964 rpcz_store.cc:276] 0709 12:26:54.057119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.059131 (+  2012us) service_pool.cc:224] Handling call
0709 12:26:54.068888 (+  9757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:54.427135 (+358247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:55.693781 (+1266646us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400150ed4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:55.693926 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320133888}
I20260709 12:26:55.695416 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:55.696213 10526 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:55.624226 12555 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.697280 12555 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:55.697561  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:55.697768  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:55.698539  9964 raft_consensus.cc:2393] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 4: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:55.694124  9885 rpcz_store.cc:276] 0709 12:26:54.640868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.642408 (+  1540us) service_pool.cc:224] Handling call
0709 12:26:54.681032 (+ 38624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:54.688489 (+  7457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:55.678866 (+990377us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b54002c5bd0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:55.678986 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87973248}
W20260709 12:26:55.699524  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 81184.6us
I20260709 12:26:55.700197  9928 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:55.701529  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:55.684571 12403 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:55.694795  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 49661.8us
I20260709 12:26:55.718043  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:55.708380  9928 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:55.692523  9956 rpcz_store.cc:276] 0709 12:26:54.045681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.045851 (+   170us) service_pool.cc:224] Handling call
0709 12:26:54.053180 (+  7329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:54.415895 (+362715us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:54.415942 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:54.416558 (+   616us) log.cc:844] Serialized 26 byte log entry
0709 12:26:54.530477 (+113919us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:54.547365 (+ 16888us) log.cc:844] Serialized 14 byte log entry
0709 12:26:54.684500 (+137135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.684578 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:55.656208 (+971630us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:26:55.691918 (+ 35710us) raft_consensus.cc:1685] finished
0709 12:26:55.692006 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:55.692116 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16693,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":199190,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":30065,"spinlock_wait_cycles":51711872,"thread_start_us":577115,"threads_started":3,"wal-append.queue_time_us":189935}
W20260709 12:26:55.722662  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 440210us
W20260709 12:26:55.723043  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.723954  9853 leader_election.cc:400] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 2. Current term is 3.
I20260709 12:26:55.724357  9853 leader_election.cc:403] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:55.725864  9779 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:55.727473  9779 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:55.731145  9928 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:55.732479  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:55.733613  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:55.738376  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:55.738920  9888 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:55.619781 12415 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.112s
I20260709 12:26:55.732991 12539 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:55.742805  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:55.743439  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:55.722313 12498 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.729439 12505 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:26:55.744342  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:55.690143 12336 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:55.753376  9853 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:55.732180 12475 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:55.755324  9956 raft_consensus.cc:2410] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:26:55.735579 12251 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:55.757200  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:55.779930  9886 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:26:55.722616 12430 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:55.746702 12509 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:55.737758 12480 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:55.737638 12019 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:55.795814  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:55.796720  9963 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
W20260709 12:26:55.800760  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 47450.4us
I20260709 12:26:55.801448 10531 raft_consensus.cc:1240] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:55.800077  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:55.757870 12498 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:55.737869 12554 consensus_queue.cc:1048] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:26:55.813483  9888 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:26:55.746563 12421 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:26:55.816017 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.816080  9886 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:26:55.785154 12533 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:55.758319 12539 raft_consensus.cc:697] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:55.779397 12475 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:55.818964  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 77380.4us
I20260709 12:26:55.740170  9779 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:55.826730  9928 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:55.830469  9928 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:55.848789  9854 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:55.745954 12396 consensus_queue.cc:1048] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:26:55.855789 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:55.794667 12509 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:55.861055 10497 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:55.873945 10497 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:55.800773 12520 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:26:55.862262  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 122155us
W20260709 12:26:55.876410  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 60392.3us
I20260709 12:26:55.793115 12306 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:26:55.877153  9779 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:55.872503 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:55.806348 12498 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:55.802487 12251 raft_consensus.cc:697] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:55.874912  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:55.855139 12071 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:26:55.882615 12509 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:55.920883 10533 raft_consensus.cc:1275] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:55.857599 12413 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:55.922253 10530 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:55.921777  9779 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:55.948563  9779 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:55.857307 12475 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:55.869975 12480 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:55.863812 12549 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:55.954566  9779 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:55.957715  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:55.915743 12438 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:55.875892 12516 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:55.964923 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:56.000433 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:56.007006 10529 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:55.992800  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 402) took 1202 ms. Trace:
I20260709 12:26:56.007789  9808 rpcz_store.cc:276] 0709 12:26:54.779881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.782838 (+  2957us) service_pool.cc:224] Handling call
0709 12:26:55.981619 (+1198781us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b540002d5d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:55.981767 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1920871808}
I20260709 12:26:55.993072  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:56.009338  9812 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 4: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:55.980949 10525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 540) took 1226 ms. Trace:
I20260709 12:26:56.010353 10525 rpcz_store.cc:276] 0709 12:26:54.754479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.754593 (+   114us) service_pool.cc:224] Handling call
0709 12:26:55.980727 (+1226134us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b5400690354. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:55.980876 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156539776}
I20260709 12:26:55.863242 12553 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 12:26:56.001991  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:55.915606 12206 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:55.916780 10526 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:26:56.018404 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:55.950099 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:56.003944 12551 log.cc:927] Time spent T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 12:26:55.950001 12386 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:55.951378 12506 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:55.981717 12445 raft_consensus.cc:2804] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:56.020309  9853 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:55.967989 12480 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:55.962877 12485 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:56.006420 12516 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.045399 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:55.951632 12505 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 12:26:56.045612 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:56.016427 12071 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:55.993346 12394 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:56.047832 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:56.024482 12554 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.965664 12444 consensus_queue.cc:1059] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 12:26:55.944429 12528 consensus_queue.cc:1059] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 12:26:56.051673 10525 raft_consensus.cc:2376] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6. Re-sending same reply.
I20260709 12:26:56.046012 12445 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.045256 12480 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:56.088764 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:56.029810 12356 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:56.039307 12403 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:56.041086 12396 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.032259 12438 raft_consensus.cc:697] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:56.026177 12408 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:56.039047 12206 raft_consensus.cc:697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:56.059517  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:56.051923 12516 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:56.046931 10528 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:26:56.062242 12435 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:56.026562 12547 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.041059 12539 consensus_queue.cc:237] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:56.055016 12251 consensus_queue.cc:237] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:56.327611  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 279138us
I20260709 12:26:56.177850  9955 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:56.054788 12442 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:56.226552 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:56.346305  9915 heartbeater.cc:646] Failed to heartbeat to 127.8.111.126:43135 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.8.111.126:43135 timed out after 15.000s (SENT)
I20260709 12:26:56.361496 10533 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:56.278990  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:56.200621 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:56.195262  9779 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
W20260709 12:26:56.363130  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 167963us
I20260709 12:26:56.365576 12529 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.365571 12444 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:56.366266 12529 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.364102  9779 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:56.376317  9779 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
W20260709 12:26:56.349152 12566 log.cc:927] Time spent T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.325s	user 0.000s	sys 0.000s
W20260709 12:26:56.348055 12568 log.cc:927] Time spent T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
W20260709 12:26:56.347307 12564 log.cc:927] Time spent T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
W20260709 12:26:56.344619 12572 log.cc:927] Time spent T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.253s	user 0.006s	sys 0.000s
I20260709 12:26:56.377802  9779 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
W20260709 12:26:56.391639  9889 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.001s	sys 0.010s
W20260709 12:26:56.392066  9889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.002s	sys 0.010s
W20260709 12:26:56.348749 12569 log.cc:927] Time spent T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.258s	user 0.000s	sys 0.000s
I20260709 12:26:56.348719 12390 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:56.090713 12445 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:56.360610 12392 consensus_meta.cc:287] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.735s	user 0.008s	sys 0.008s
I20260709 12:26:56.393810 10532 raft_consensus.cc:1240] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:56.225803 12336 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:56.205077 12549 raft_consensus.cc:697] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:56.397706 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:56.079084 12554 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:56.357416 12562 log.cc:927] Time spent T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.501s	user 0.002s	sys 0.000s
I20260709 12:26:56.395340  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:56.396759 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:56.398397 10533 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:56.403749  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:56.404780  9779 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:56.379441 12550 raft_consensus.cc:2764] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:26:56.393625 12373 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.004s	sys 0.004s
W20260709 12:26:56.413446 12373 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.005s	sys 0.005s
I20260709 12:26:56.409914 12430 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:56.414662 12430 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.414698 12554 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:56.415164 12430 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:56.400877 12567 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:56.415762 12567 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:56.417831 12567 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:56.087220 12541 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:56.419615  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:56.419865 12541 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:56.420251  9887 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:26:56.420429 12541 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:56.421021 12541 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.421414  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:56.422025  9887 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:56.079875 12071 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.422930  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:56.423648  9883 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:56.423708 12071 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:56.424409  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:56.401113 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:56.387816 12485 raft_consensus.cc:2804] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:56.435773 12485 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:56.436049 12533 consensus_meta.cc:287] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.572s	user 0.005s	sys 0.002s
I20260709 12:26:56.436262 12485 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:56.436483 12533 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 2. Current term is 3.
W20260709 12:26:56.436913  9881 consensus_meta.cc:287] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.739s	user 0.009s	sys 0.001s
I20260709 12:26:56.437225  9881 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:56.439625  9809 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:26:56.086032 12394 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.383489 12403 consensus_queue.cc:1048] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:26:56.400362 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:56.412722 12574 log.cc:927] Time spent T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:26:56.412361 12549 consensus_queue.cc:237] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.417438 12488 consensus_queue.cc:260] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:56.388236 12386 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:56.430986 12582 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:56.431660  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:56.462725  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:56.463441  9883 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:26:56.464371  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:56.394613 12206 consensus_queue.cc:237] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.432826 12446 raft_consensus.cc:3055] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:56.393868 12438 consensus_queue.cc:237] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.438035  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:56.483548  9881 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
W20260709 12:26:56.441614  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 319494us
I20260709 12:26:56.189419 12396 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.488618 12396 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:56.094796 12226 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:56.441327 12421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.011s	sys 0.021s
I20260709 12:26:56.394259 12512 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:26:56.504324  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:56.505107  9883 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
W20260709 12:26:56.446777 12555 consensus_meta.cc:287] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.749s	user 0.004s	sys 0.006s
I20260709 12:26:56.516820 12506 raft_consensus.cc:3055] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:56.517402 12506 raft_consensus.cc:740] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:56.518453 12506 consensus_queue.cc:260] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.520049 12506 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:56.528506 10496 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:56.531409 12513 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:56.532977 12301 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:56.533505 12301 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:56.533943 12301 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:56.537559  9928 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:56.538677  9928 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:56.539950  9928 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:56.540587 12396 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:56.540989 12396 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.541318 12396 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:56.546826 12541 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:56.547417 12541 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:56.547660 12514 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:56.477532 12446 raft_consensus.cc:740] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:56.548379 12396 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.548825 12446 consensus_queue.cc:260] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.553134 12396 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:56.555902 12226 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:56.556079 10527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 545) took 1798 ms (client timeout 1630 ms). Trace:
W20260709 12:26:56.556636 10527 rpcz_store.cc:269] 0709 12:26:54.757781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.770237 (+ 12456us) service_pool.cc:224] Handling call
0709 12:26:56.555826 (+1785589us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b54003d18d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:56.555992 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1942004480}
I20260709 12:26:56.557678 12524 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.558318 12524 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:56.558657  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:56.560034  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:56.560547  9882 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:26:56.560752 12524 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:56.561373  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:56.562032  9882 raft_consensus.cc:2393] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 8: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:56.564203 12518 raft_consensus.cc:3055] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:56.564590 12518 raft_consensus.cc:740] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:56.445708 12444 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:56.446240 12505 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:56.400693 12392 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:56.486027 12561 log.cc:927] Time spent T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259: Append to log took a long time: real 0.688s	user 0.003s	sys 0.000s
I20260709 12:26:56.485998  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:56.500306 12488 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:56.565593 12518 consensus_queue.cc:260] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:56.362040 12435 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.459318 12386 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:56.547751 12541 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:56.567667  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.468557 12582 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:56.571187  9928 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:56.619334  9961 raft_consensus.cc:1240] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:56.622072  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:56.622344  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:56.622915  9815 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:56.575049  9890 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:56.575857  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:56.579028  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:26:56.498704 12421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.011s	sys 0.022s
I20260709 12:26:56.593118  9881 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:26:56.486986  9853 leader_election.cc:400] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
W20260709 12:26:56.629402  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 142519us
I20260709 12:26:56.629832  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:56.596043  9887 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:56.630573  9853 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:26:56.653753  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 82668.4us
I20260709 12:26:56.630399  9811 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:56.653291  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:56.475903 10533 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:26:56.653753 12584 consensus_queue.cc:1059] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:26:56.654873  9928 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:56.659134  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:56.625483 12470 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:56.660290 12470 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:56.625708 12248 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:26:56.663328 12581 log.cc:927] Time spent T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 12:26:56.662953 12248 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:56.667351 12470 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:56.667524 12430 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.668545 12524 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:56.599406 10496 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:56.546842 12072 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:56.580433 12444 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.659751  9813 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:56.668800  9808 raft_consensus.cc:1240] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:26:56.454515 12533 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.665900 12248 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:56.592499 12336 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:26:56.597195 12559 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:26:56.618950 12386 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:56.597395  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 192668us
I20260709 12:26:56.655328  9853 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:56.656176  9882 raft_consensus.cc:2376] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6. Re-sending same reply.
W20260709 12:26:56.669902 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 70531us
I20260709 12:26:56.655581  9883 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:56.583494 12555 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.706887  9779 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:56.707376  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:56.705462  9815 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:26:56.675763  9811 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:26:56.678721  9813 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:26:56.699057  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:56.716151  9881 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 4: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:56.655083  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:56.717307  9812 raft_consensus.cc:2410] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:26:56.626598 12541 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:26:56.702477  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 47673us
I20260709 12:26:56.721410  9779 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:56.721869  9928 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:56.722970  9779 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:26:56.707366  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 52143.1us
I20260709 12:26:56.724040  9853 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:56.722944  9928 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:56.720404  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:56.725829  9928 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:56.727283  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:56.727823  9811 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:56.727639  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:56.724479  9957 raft_consensus.cc:1275] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:56.731138  9883 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:26:56.733016  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:56.733882  9883 raft_consensus.cc:2368] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8.
I20260709 12:26:56.626057 12582 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:56.740761  9889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1213) took 1962 ms. Trace:
I20260709 12:26:56.741331  9889 rpcz_store.cc:276] 0709 12:26:54.777927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.277939 (+500012us) service_pool.cc:224] Handling call
0709 12:26:55.278392 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:55.731943 (+453551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:55.731977 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:55.742911 (+ 10934us) log.cc:844] Serialized 26 byte log entry
0709 12:26:56.392460 (+649549us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:56.392500 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:56.392577 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:56.740447 (+347870us) raft_consensus.cc:1685] finished
0709 12:26:56.740475 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:56.740661 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":453250,"raft.queue_time_us":454539,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":1882,"thread_start_us":608038,"threads_started":1,"wal-append.queue_time_us":707933}
I20260709 12:26:56.631697 12421 raft_consensus.cc:697] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:56.747427 12559 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:56.670094 12355 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:56.701947 12518 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:56.729460  9962 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:56.759599  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:56.749611  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:56.700961 12392 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:56.713212 12403 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:56.670202 12444 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:56.720029 12505 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.750310  9853 leader_election.cc:400] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 6. Current term is 7.
I20260709 12:26:56.750962 10531 raft_consensus.cc:2393] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:26:56.751156 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 133065us
I20260709 12:26:56.752754  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:56.766424 10497 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:56.740510 12522 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:56.631850 12480 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.669721 12430 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:56.764357  9853 leader_election.cc:403] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:26:56.697211 12587 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:26:56.763815 12413 consensus_meta.cc:287] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.813s	user 0.011s	sys 0.000s
I20260709 12:26:56.742564 12550 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:56.765259 10496 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:56.761287 12072 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:56.699883 12486 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:56.754599  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:56.671169 12533 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:56.776482  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:56.792507  9807 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 4: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:56.778481  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:26:56.779807 12577 log.cc:927] Time spent T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
W20260709 12:26:56.780752 12580 log.cc:927] Time spent T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:26:56.781078 12527 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:56.809175 12527 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:56.809620 12527 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:56.781469 12585 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:56.811762 12555 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:56.740041 12396 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:56.812755  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:26:56.814158 10526 consensus_meta.cc:287] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.767s	user 0.009s	sys 0.001s
I20260709 12:26:56.786677 10496 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:56.692850 12529 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:56.771708 12387 consensus_meta.cc:287] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 1.160s	user 0.012s	sys 0.000s
I20260709 12:26:56.761255 12567 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:56.756084 12355 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:26:56.788380  9853 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:26:56.842965  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 54666.3us
I20260709 12:26:56.843796  9853 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:56.847975 12590 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:56.848623 12590 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:56.769763  9811 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:26:56.851342  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:56.851890  9811 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:26:56.763566 12403 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.852550 12403 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:56.753895  9779 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:26:56.858620  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 104792us
I20260709 12:26:56.858714 12522 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:56.859227 12522 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:56.859640 12522 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:56.860486  9779 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:56.767563 12505 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:56.862519 12430 raft_consensus.cc:2804] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:56.863144 12430 raft_consensus.cc:697] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:56.864354 12430 consensus_queue.cc:237] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.783813 12559 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:56.789176 12226 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:56.796985 12592 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:56.866648 12226 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.867053 12226 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:56.797821 12591 raft_consensus.cc:3055] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:56.869830 12591 raft_consensus.cc:740] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
W20260709 12:26:56.800805 10524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 774) took 2744 ms (client timeout 1692 ms). Trace:
I20260709 12:26:56.871112  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:56.802433 12594 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 6. Current term is 7.
I20260709 12:26:56.803829 12408 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:56.804656 12547 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:56.804497 12445 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.808001  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:56.808192 12485 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:56.814527 10526 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:26:56.795070 12394 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:56.822764 12421 consensus_queue.cc:237] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.793963 12413 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:56.823791 12587 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:56.825526 12533 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:56.815104 12550 raft_consensus.cc:697] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:26:56.825958 12569 log.cc:927] Time spent T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.407s	user 0.000s	sys 0.001s
I20260709 12:26:56.827081  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 529) took 1028 ms. Trace:
W20260709 12:26:56.795433 12475 consensus_meta.cc:287] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.833s	user 0.010s	sys 0.000s
I20260709 12:26:56.829907 12480 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:56.820267  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:56.788335 12072 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:26:56.873179 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 86577.4us
I20260709 12:26:56.875394 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:56.877761  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.876322  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:56.830811 12509 consensus_meta.cc:287] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.877s	user 0.009s	sys 0.001s
I20260709 12:26:56.920722  9810 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:26:56.908962  9853 leader_election.cc:336] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 2.159s (SENT)
I20260709 12:26:56.829744 12444 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.870687 12591 consensus_queue.cc:260] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.830500 12301 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:56.923154 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:57.313521 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:57.314911 12489 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:26:57.316963  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.317698  9779 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:57.150319  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:57.318825  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:56.932255  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.055646 10497 leader_election.cc:400] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8.
I20260709 12:26:57.319995 10497 leader_election.cc:403] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:56.966315  9814 raft_consensus.cc:2393] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 4: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:57.080231  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:56.978515  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2082) took 2556 ms. Trace:
I20260709 12:26:57.157006 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:57.322613  9889 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:26:56.956732 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:57.324033 10530 raft_consensus.cc:2393] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 6: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:26:57.322587  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 413634us
I20260709 12:26:56.931980  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:57.044308  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:57.048672  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:56.872053 12355 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:56.877313 12559 raft_consensus.cc:697] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:26:57.339169 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 283668us
I20260709 12:26:57.159215  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:57.340246  9815 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:57.320492  9886 rpcz_store.cc:276] 0709 12:26:55.799028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.817262 (+ 18234us) service_pool.cc:224] Handling call
0709 12:26:55.817573 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:55.817918 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:55.817947 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:55.927624 (+109677us) log.cc:844] Serialized 26 byte log entry
0709 12:26:56.169249 (+241625us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:56.169309 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:56.169402 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:56.826869 (+657467us) raft_consensus.cc:1685] finished
0709 12:26:56.826890 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:56.827025 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":118,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":40149,"thread_start_us":153675,"threads_started":1,"wal-append.queue_time_us":524737}
W20260709 12:26:57.167058  9890 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 2100) took 1320 ms (client timeout 1557 ms). Trace:
W20260709 12:26:56.933008  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.049394 10532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 779) took 1204 ms. Trace:
W20260709 12:26:57.345203  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.344931 10532 rpcz_store.cc:276] 0709 12:26:55.845239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.846456 (+  1217us) service_pool.cc:224] Handling call
0709 12:26:55.846795 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:56.394349 (+547554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:57.049113 (+654764us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54005ea1d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:57.049326 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1248026880}
I20260709 12:26:56.931676  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.347191  9963 raft_consensus.cc:2410] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:26:57.323230 10525 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.165467  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:57.348322  9882 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:56.877875 12555 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:56.831862 12435 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:57.322928  9884 rpcz_store.cc:276] 0709 12:26:54.422446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.422598 (+   152us) service_pool.cc:224] Handling call
0709 12:26:54.442355 (+ 19757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:54.507742 (+ 65387us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:26:54.690961 (+183219us) log.cc:844] Serialized 14 byte log entry
0709 12:26:54.763846 (+ 72885us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:54.763901 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:54.763948 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:55.696195 (+932247us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b180033eb60. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b3a9c0a 00007f2f94ae9219 00007f2f923f058f 00007f2f8b42f571 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd
0709 12:26:56.978287 (+1282092us) spinlock_profiling.cc:243] Waited 65.2 ms on lock 0x7b5400328a54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:56.978336 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:56.978462 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46349,"prepare.queue_time_us":227841,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":41001,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":35531,"spinlock_wait_cycles":183349248,"thread_start_us":214437,"threads_started":2,"wal-append.queue_time_us":160249,"wal-append.run_cpu_time_us":1401,"wal-append.run_wall_time_us":1018352}
W20260709 12:26:57.356592  9853 connection.cc:256] RPC call timeout handler was delayed by -1.1570082829998682s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19910000000000003s for a response
I20260709 12:26:56.871860 12529 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.390558 12529 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:57.392549  9961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1273) took 2598 ms. Trace:
I20260709 12:26:57.392735 12529 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:57.393074  9961 rpcz_store.cc:276] 0709 12:26:54.794559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.794700 (+   141us) service_pool.cc:224] Handling call
0709 12:26:55.024030 (+229330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:56.619794 (+1595764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:57.392225 (+772431us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b540014d7d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:57.392445 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3668257152}
I20260709 12:26:57.394696  9810 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:26:56.842123 12567 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:57.397060  9959 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
W20260709 12:26:57.343921  9890 rpcz_store.cc:269] 0709 12:26:55.846777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.205563 (+358786us) service_pool.cc:224] Handling call
0709 12:26:57.166844 (+961281us) spinlock_profiling.cc:243] Waited 77.6 ms on lock 0x7b54002c60d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:57.166985 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178444160}
I20260709 12:26:57.359193  9779 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
W20260709 12:26:57.383244  9853 connection.cc:256] RPC call timeout handler was delayed by -1.0301082830001178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
I20260709 12:26:56.842511 12387 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:57.360387 12588 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.384399 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:56.977679 12445 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:57.384991  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:26:56.877205 10524 rpcz_store.cc:269] 0709 12:26:54.056699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.061057 (+  4358us) service_pool.cc:224] Handling call
0709 12:26:56.800567 (+2739510us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54005208d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:56.800718 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":840161664}
I20260709 12:26:57.338608 12072 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:57.110450 12505 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:57.385824 12301 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:57.043025 12599 log.cc:927] Time spent T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:26:57.375114 12585 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:57.361613 12587 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:57.322885 12509 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:57.155967 12573 log.cc:927] Time spent T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.779s	user 0.000s	sys 0.001s
I20260709 12:26:57.398870  9853 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:57.399791  9779 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:57.402416  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:57.458024  9810 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:57.403506  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:26:57.360761 12506 consensus_meta.cc:287] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.836s	user 0.003s	sys 0.008s
I20260709 12:26:57.356060 12470 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:57.400338 12567 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:57.405946 12403 consensus_meta.cc:287] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.000s
I20260709 12:26:57.409631  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:57.384346 12555 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:26:57.401847 12528 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.011s	user 0.031s	sys 0.039s
W20260709 12:26:57.386638 12576 log.cc:927] Time spent T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 1.032s	user 0.000s	sys 0.003s
I20260709 12:26:57.338043 12521 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:57.513007  9807 raft_consensus.cc:2368] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8.
I20260709 12:26:57.360527 12336 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8.
I20260709 12:26:57.372641 12533 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:57.078624 12274 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:57.526075  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:57.526783  9886 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.425262  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.440831  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:57.357571 12475 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:57.458349  9957 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.004s	sys 0.011s
W20260709 12:26:57.537693  9957 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.004s	sys 0.011s
W20260709 12:26:57.458127  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 58434.8us
W20260709 12:26:57.457643  9778 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.007s	sys 0.008s
I20260709 12:26:57.443243  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:57.538157  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:26:57.538424  9778 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.007s	sys 0.009s
W20260709 12:26:57.461568  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 62909.2us
I20260709 12:26:57.462113  9815 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
W20260709 12:26:57.538744  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 701586us
I20260709 12:26:57.408733  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:57.539429  9890 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:26:57.504110 12528 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.116s	user 0.031s	sys 0.040s
I20260709 12:26:56.963928 10526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 739) took 1131 ms. Trace:
I20260709 12:26:57.407402 10528 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:57.055480 12485 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:57.451802 12600 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.029s	sys 0.038s
I20260709 12:26:57.503242 12413 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:57.404663 12435 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:57.519013  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:57.611101  9887 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:57.407483 12588 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:57.499496 12408 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:57.530697  9961 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:26:57.530706  9889 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 2.
I20260709 12:26:57.538910  9884 raft_consensus.cc:2393] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:57.497486 12470 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.540370  9927 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:26:57.627229  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 86934.3us
W20260709 12:26:57.604858 12600 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.030s	sys 0.039s
I20260709 12:26:57.542701  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:26:57.637763  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 95138us
I20260709 12:26:57.639046  9853 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:57.640658  9853 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:57.501340 12503 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:57.025637 12582 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:57.542984  9779 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:57.503582 12403 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:57.515606 12541 consensus_meta.cc:287] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.770s	user 0.008s	sys 0.001s
I20260709 12:26:57.579404  9810 raft_consensus.cc:1240] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
W20260709 12:26:57.648128  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 105212us
W20260709 12:26:57.558346  9959 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 413) took 1738 ms (client timeout 1863 ms). Trace:
W20260709 12:26:57.648893  9959 rpcz_store.cc:269] 0709 12:26:55.819801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.819945 (+   144us) service_pool.cc:224] Handling call
0709 12:26:57.558134 (+1738189us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54001de054. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:57.558263 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3399982464}
I20260709 12:26:57.561002  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.545823  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:57.578226  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:57.646437 12520 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:57.652818  9807 raft_consensus.cc:2393] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:57.568182  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:57.506138 12555 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:57.554037  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.580401 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:57.579785 12587 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:57.564678 12509 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:57.561172 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:57.560326  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.597059  9955 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:57.562904  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:57.524740 12521 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:57.612370  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:57.662771  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.663326  9887 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:57.663487  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.664250  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:57.424681 12518 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.546588 12356 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.546749 12274 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:57.551030 12527 consensus_meta.cc:287] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.741s	user 0.007s	sys 0.003s
I20260709 12:26:57.542389 10526 rpcz_store.cc:276] 0709 12:26:55.826895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.855482 (+ 28587us) service_pool.cc:224] Handling call
0709 12:26:56.958016 (+1102534us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:57.548425 12475 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:57.546263 12444 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:57.570689 12505 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:57.610687 12435 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.513115 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:57.408492 12591 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.655815 12537 consensus_queue.cc:1059] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
W20260709 12:26:57.643301  9853 leader_election.cc:336] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 2.132s (SENT)
I20260709 12:26:57.726903  9853 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:26:57.593173 12226 consensus_meta.cc:287] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.726s	user 0.007s	sys 0.000s
I20260709 12:26:57.441063 12306 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:57.728732 12306 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:57.710812 12518 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:57.653069  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:57.730533  9884 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.731353 12518 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:57.731768 12588 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:57.733565 12555 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:26:57.653667  9882 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:57.734452  9960 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:57.735069  9958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 420) took 1017 ms. Trace:
I20260709 12:26:57.735421  9958 rpcz_store.cc:276] 0709 12:26:56.717890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.718734 (+   844us) service_pool.cc:224] Handling call
0709 12:26:56.719167 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:56.719608 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:26:56.872945 (+153337us) log.cc:844] Serialized 14 byte log entry
0709 12:26:57.458207 (+585262us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:57.542486 (+ 84279us) log.cc:844] Serialized 26 byte log entry
0709 12:26:57.604588 (+ 62102us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:57.604665 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:57.604757 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:57.734865 (+130108us) raft_consensus.cc:1685] finished
0709 12:26:57.734884 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:57.735011 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":294139,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":2075,"raft.queue_time_us":2203,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":58220,"thread_start_us":602422,"threads_started":2,"wal-append.queue_time_us":791930}
I20260709 12:26:57.736403  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.737190  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.737577  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.551067  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:57.656242 12616 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:57.548364 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:57.656205  9809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 406) took 1036 ms. Trace:
I20260709 12:26:57.740748  9809 rpcz_store.cc:276] 0709 12:26:56.620210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.620328 (+   118us) service_pool.cc:224] Handling call
0709 12:26:56.620632 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:56.656831 (+ 36199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:56.656859 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:56.662486 (+  5627us) log.cc:844] Serialized 26 byte log entry
0709 12:26:56.788976 (+126490us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:56.789024 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:57.514308 (+725284us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b540036b354. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:57.514359 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:57.648193 (+133834us) raft_consensus.cc:1685] finished
0709 12:26:57.648213 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:57.656130 (+  7917us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82690304,"thread_start_us":126137,"threads_started":1,"wal-append.queue_time_us":179977}
W20260709 12:26:57.626086 12396 consensus_meta.cc:287] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.813s	user 0.010s	sys 0.000s
I20260709 12:26:57.588554 10529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 788) took 1530 ms. Trace:
I20260709 12:26:57.743153 10529 rpcz_store.cc:276] 0709 12:26:56.058626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.458139 (+399513us) service_pool.cc:224] Handling call
0709 12:26:56.614775 (+156636us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:56.783982 (+169207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:56.784012 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:56.792840 (+  8828us) log.cc:844] Serialized 52 byte log entry
0709 12:26:56.962367 (+169527us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:56.969589 (+  7222us) log.cc:844] Serialized 14 byte log entry
0709 12:26:56.970695 (+  1106us) log.cc:844] Serialized 14 byte log entry
0709 12:26:56.975557 (+  4862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:56.975639 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:57.588360 (+612721us) raft_consensus.cc:1685] finished
0709 12:26:57.588378 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:57.588501 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44296,"prepare.queue_time_us":539,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":2361,"raft.queue_time_us":56767,"raft.run_cpu_time_us":438,"raft.run_wall_time_us":62272,"spinlock_wait_cycles":16256,"thread_start_us":251558,"threads_started":2,"wal-append.queue_time_us":688891}
I20260709 12:26:57.656982  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:57.746747  9810 raft_consensus.cc:1240] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:26:57.748190  9810 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:26:57.658252 10532 raft_consensus.cc:2376] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b011791796d1457284b857d7d3422195 in term 6. Re-sending same reply.
I20260709 12:26:57.659535  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.665740  9779 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:26:57.749771  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 84126.3us
I20260709 12:26:57.750499 10530 raft_consensus.cc:2393] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:57.752405  9884 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:57.660157 12541 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:57.627942 12470 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:57.667284 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:57.667797  9808 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:57.542884 12533 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:57.604143 12019 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 12:26:57.659794 12522 consensus_meta.cc:287] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.800s	user 0.011s	sys 0.000s
I20260709 12:26:57.662173  9890 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:26:57.708973  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:57.810411  9890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54428 (request call id 536) took 1193 ms. Trace:
I20260709 12:26:57.654017 12488 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:57.715579 12274 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:57.684441  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:57.684569 10525 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
W20260709 12:26:57.635591  9806 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.023s	sys 0.036s
I20260709 12:26:57.620033 12413 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:57.712232  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.525120 12559 consensus_queue.cc:237] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:57.714692  9886 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:26:57.836573  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.660542 12528 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:57.656757 12351 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:57.496310 12585 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:57.678730  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:57.537519 12550 consensus_queue.cc:237] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:57.722476  9854 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:57.667294 12485 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:57.655781 12531 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:26:57.678162 12445 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:57.646662  9885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 521) took 1946 ms. Trace:
I20260709 12:26:57.576593 12446 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:57.799045 10527 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:57.726444 12435 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:57.858734  9887 raft_consensus.cc:2410] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:26:57.810734  9809 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:57.810770  9890 rpcz_store.cc:276] 0709 12:26:56.617252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.408494 (+791242us) service_pool.cc:224] Handling call
0709 12:26:57.810350 (+401856us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:57.860762  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:57.861032  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:57.862080  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:57.862793  9890 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.862720 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:57.863571 10527 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.716020 12356 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:57.752385 12386 consensus_meta.cc:287] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 1.057s	user 0.010s	sys 0.001s
I20260709 12:26:57.647907 12408 raft_consensus.cc:697] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:26:57.817684  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 174403us
I20260709 12:26:57.821518  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:57.823403  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:57.869170  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.869912  9960 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:57.751888 12387 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:57.751932 12520 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:57.718865 12527 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:57.873558 12356 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:57.874425  9889 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:57.876260 12442 raft_consensus.cc:3055] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:57.876804 12442 raft_consensus.cc:740] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:57.876927  9808 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:26:57.752074 12475 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:57.831744  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:57.878809  9884 raft_consensus.cc:2393] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 6: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:57.878458 12386 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:57.879261  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54428 (request call id 541) took 1062 ms. Trace:
I20260709 12:26:57.879663  9884 rpcz_store.cc:276] 0709 12:26:56.816917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.800137 (+983220us) service_pool.cc:224] Handling call
0709 12:26:57.879197 (+ 79060us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:57.834933 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:57.881338  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:57.881644 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:57.882259 10525 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:57.882369  9809 raft_consensus.cc:2393] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:57.883930 12408 consensus_queue.cc:237] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:57.714810  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.886876  9813 raft_consensus.cc:1240] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:57.887513  9959 raft_consensus.cc:2393] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:57.888398  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.877974 12442 consensus_queue.cc:260] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:57.889539  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.889748 12442 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:57.837775  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:57.838011  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:57.812208 12206 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.000s	sys 0.018s
W20260709 12:26:57.891207 12206 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.003s	sys 0.018s
W20260709 12:26:57.844748  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 122358us
I20260709 12:26:57.878854  9962 raft_consensus.cc:2393] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 10: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:57.892714 12549 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:57.844785 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:57.894376 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:57.894908 10529 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:57.895824 12582 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:57.896056  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:57.897203 10497 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:57.897742  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.846702  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:57.800596 12396 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:57.848982  9882 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:26:57.898532 12306 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:57.899031  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:57.899338  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:57.899890  9882 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:57.900172  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:57.900833  9886 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:26:57.851014  9885 rpcz_store.cc:276] 0709 12:26:55.700036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.700231 (+   195us) service_pool.cc:224] Handling call
0709 12:26:55.735622 (+ 35391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:55.754123 (+ 18501us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:55.754166 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:55.779423 (+ 25257us) log.cc:844] Serialized 26 byte log entry
0709 12:26:56.040521 (+261098us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:56.040561 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:56.044523 (+  3962us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:57.155574 (+1111051us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b240015b978. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b2b59c4 00007f2f8b2b3acb 00007f2f8b46edc9 00007f2f8b46ea55 00007f2f8b46e09d 00007f2f8e0a010e 00007f2f8e0b788c 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221
0709 12:26:57.628225 (+472651us) raft_consensus.cc:1685] finished
0709 12:26:57.628246 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:57.646586 (+ 18340us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18115,"raft.queue_time_us":22056,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":16531,"spinlock_wait_cycles":27211648,"thread_start_us":170305,"threads_started":1,"wal-append.queue_time_us":387339}
W20260709 12:26:57.851500  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 381739us
I20260709 12:26:57.826614 12597 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.902470 12597 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:57.855325  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.903839  9956 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:57.854537  9958 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:57.904697  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:57.905411  9956 raft_consensus.cc:2393] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 6: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:57.830586 12488 raft_consensus.cc:697] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:57.869357  9810 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:57.824205 10496 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:57.841857 12351 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:57.832123 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:57.835421  9806 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.028s	sys 0.040s
I20260709 12:26:57.742792 12226 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:57.850615 12485 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:57.914466 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 90466.6us
I20260709 12:26:57.914697 10497 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:57.915198 10496 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:57.906153  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.916630  9956 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 6: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:57.916540  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1221) took 1958 ms. Trace:
I20260709 12:26:57.851208 12616 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:57.822634 12522 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:57.911778 10525 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:26:57.900343 12413 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:57.933996  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:57.922740  9882 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:57.904693  9964 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:26:57.874082 12527 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:57.935633  9885 raft_consensus.cc:1240] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:57.935974  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.937104  9882 raft_consensus.cc:1240] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 6. Ops: []
I20260709 12:26:57.937770  9882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1222) took 1978 ms. Trace:
W20260709 12:26:57.919118  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.937630 10496 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:57.929415  9928 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:57.939042  9890 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:57.944496 10527 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:57.941166  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.945103  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:57.939404 10497 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:57.921898  9889 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:26:57.942499 10525 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:26:57.938730  9882 rpcz_store.cc:276] 0709 12:26:55.958894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.936683 (+1977789us) service_pool.cc:224] Handling call
0709 12:26:57.936955 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:57.937556 (+   601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:57.937721 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:57.850847 12484 consensus_queue.cc:1059] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:26:57.943962  9959 raft_consensus.cc:2393] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 6: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:57.945168 10531 raft_consensus.cc:2368] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 6. Current term is 7.
I20260709 12:26:57.945894  9960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55946 (request call id 1912) took 1065 ms. Trace:
I20260709 12:26:57.958700  9960 rpcz_store.cc:276] 0709 12:26:56.880139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.911394 (+1031255us) service_pool.cc:224] Handling call
0709 12:26:57.945835 (+ 34441us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:57.922495  9886 rpcz_store.cc:276] 0709 12:26:55.958587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.915564 (+1956977us) service_pool.cc:224] Handling call
0709 12:26:57.915949 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:57.916170 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:57.916205 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:57.916245 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:57.916276 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:57.916344 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:57.916471 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:57.946216  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:57.914583 12351 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:57.948364 10529 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
W20260709 12:26:57.995586  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 50542us
I20260709 12:26:57.994362  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:57.994037  9882 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:26:57.996606  9810 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:57.998576  9882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2110) took 1795 ms. Trace:
I20260709 12:26:57.926312 12529 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:57.999028  9882 rpcz_store.cc:276] 0709 12:26:56.203744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.993409 (+1789665us) service_pool.cc:224] Handling call
0709 12:26:57.993764 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:57.996546 (+  2782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:57.998516 (+  1970us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:58.028659  9882 raft_consensus.cc:1240] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:26:58.029424  9882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2112) took 1673 ms. Trace:
I20260709 12:26:58.029785  9882 rpcz_store.cc:276] 0709 12:26:56.358170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.027994 (+1669824us) service_pool.cc:224] Handling call
0709 12:26:58.028387 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:58.029119 (+   732us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.029362 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:58.005082  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:57.926750 12387 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:57.857647 12445 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:57.924815 10526 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:26:58.036602  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 421) took 1249 ms. Trace:
I20260709 12:26:57.944432 12206 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:57.997999 12537 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:58.043205  9808 rpcz_store.cc:276] 0709 12:26:56.787298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.812514 (+ 25216us) service_pool.cc:224] Handling call
0709 12:26:58.036438 (+1223924us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b54000307d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:58.036535 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1964977536}
W20260709 12:26:58.041999  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 44103.1us
I20260709 12:26:58.048079 10525 raft_consensus.cc:1240] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:58.049467  9956 raft_consensus.cc:1275] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:58.066639  9956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 1918) took 1173 ms. Trace:
I20260709 12:26:58.067091  9956 rpcz_store.cc:276] 0709 12:26:56.893626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.004070 (+1110444us) service_pool.cc:224] Handling call
0709 12:26:58.049021 (+ 44951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.066333 (+ 17312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.066573 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:57.941002 12616 raft_consensus.cc:697] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:58.062798  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:57.994608 12301 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:58.068869  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:58.078269  9960 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 6: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:58.044293 12527 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:58.091078 12527 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.091490 12527 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:58.059535 12518 consensus_queue.cc:1059] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:26:58.092744 12421 raft_consensus.cc:3055] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:58.093135 12421 raft_consensus.cc:740] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:58.059202 12206 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.094019 12421 consensus_queue.cc:260] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.095257 12421 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:58.095564 12541 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:58.096786  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:58.086901 12617 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:58.097505  9808 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:26:58.097669 12567 consensus_meta.cc:287] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.000s
I20260709 12:26:58.097918 12445 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:58.098039 12617 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:58.094516 12206 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:58.098696 12617 raft_consensus.cc:697] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:58.098834 12274 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:58.099323 12226 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:58.082510 10525 raft_consensus.cc:1240] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:26:58.099622 12617 consensus_queue.cc:237] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:58.068776 12592 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.020s	sys 0.033s
I20260709 12:26:58.102023  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:58.038036 12521 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:57.934005 12488 consensus_queue.cc:237] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:58.115679  9928 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:58.117439 12413 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:58.117803 12541 consensus_queue.cc:1059] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:58.119762  9928 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:58.122689 12518 consensus_queue.cc:1059] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:58.123883 12518 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:58.124342 12518 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:58.124814 12518 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:58.126626 12396 raft_consensus.cc:3055] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:58.127179 12396 raft_consensus.cc:740] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:58.128326 12396 consensus_queue.cc:260] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.129994 12396 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:58.139578 12541 consensus_queue.cc:1059] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:58.144307  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:26:58.105719 12592 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.020s	sys 0.033s
W20260709 12:26:58.149487  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:58.153328  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.149745  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:58.154067  9779 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:58.150934 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:58.151834  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 417) took 1400 ms. Trace:
I20260709 12:26:58.078759 12537 raft_consensus.cc:697] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:58.154932  9813 rpcz_store.cc:276] 0709 12:26:56.751874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.752050 (+   176us) service_pool.cc:224] Handling call
0709 12:26:56.752324 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:57.887456 (+1135132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.151583 (+264127us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540037e6d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:58.151778 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2608565504}
W20260709 12:26:58.164088 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 169069us
I20260709 12:26:58.150331  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:58.164897  9956 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:58.155462  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:58.164980 10496 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:58.168857 10528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36672 (request call id 741) took 1545 ms. Trace:
I20260709 12:26:58.169371 10528 rpcz_store.cc:276] 0709 12:26:56.623786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.626109 (+  2323us) service_pool.cc:224] Handling call
0709 12:26:56.693891 (+ 67782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:57.614689 (+920798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.149523 (+534834us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b54006702d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:58.168781 (+ 19258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1611898112}
I20260709 12:26:58.170933 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:58.175508 12356 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:58.142947 12445 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:58.179586  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.099359 12274 consensus_queue.cc:1059] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:26:58.182592 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:58.098111 12567 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:58.183895 10528 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:26:58.143383 12624 consensus_queue.cc:1059] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
I20260709 12:26:58.306630  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:58.299459  9888 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:58.293434 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:26:58.336663  9928 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:26:58.228019 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:58.214931  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:26:58.216655  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 62655.7us
I20260709 12:26:58.179663 12541 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.353828  9779 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:58.336877 12485 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:58.325125 12430 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:26:58.356230  9964 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55946 (request call id 1903) took 1485 ms (client timeout 1780 ms). Trace:
I20260709 12:26:58.357582  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:58.344786 12626 log.cc:927] Time spent T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:26:58.358561 10529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 794) took 1037 ms. Trace:
W20260709 12:26:58.301411  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:58.337730 12620 log.cc:927] Time spent T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:26:58.229043 12616 consensus_queue.cc:237] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.342973 12537 consensus_queue.cc:237] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:26:58.426345  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.414552  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:58.437943  9853 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:58.428681 10528 raft_consensus.cc:1240] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:58.392388 10529 rpcz_store.cc:276] 0709 12:26:57.320764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.025870 (+705106us) service_pool.cc:224] Handling call
0709 12:26:58.026261 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:58.026548 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:58.026586 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:58.027076 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:26:58.236259 (+209183us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:58.236313 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.236407 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:58.358348 (+121941us) raft_consensus.cc:1685] finished
0709 12:26:58.358369 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:58.358501 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":208810,"threads_started":1,"wal-append.queue_time_us":328745}
W20260709 12:26:58.381458 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 88107.6us
I20260709 12:26:58.362762  9881 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:26:58.383615  9809 raft_consensus.cc:2410] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:26:58.382783  9964 rpcz_store.cc:269] 0709 12:26:56.870674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.870800 (+   126us) service_pool.cc:224] Handling call
0709 12:26:58.356085 (+1485285us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001513d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:58.356180 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2375434496}
W20260709 12:26:58.180289 12072 consensus_meta.cc:287] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.738s	user 0.006s	sys 0.004s
W20260709 12:26:58.432783  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.279345 12356 raft_consensus.cc:697] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:58.427644  9888 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:26:58.214429 12413 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.350090  9813 raft_consensus.cc:2368] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 2. Current term is 3.
I20260709 12:26:58.359437  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:58.441810 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:26:58.325577 12355 consensus_meta.cc:287] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.930s	user 0.011s	sys 0.000s
I20260709 12:26:58.443270  9853 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:58.216197 12592 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:58.179113 12529 raft_consensus.cc:697] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:58.451804  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:58.457595  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:26:58.406376 12625 log.cc:927] Time spent T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 12:26:58.453428  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 94081.8us
I20260709 12:26:58.441028  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:58.464303  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:58.464920  9809 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:58.339535 10524 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:26:58.228348  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:58.410791 12484 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:58.292912 12588 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:58.307622 12387 raft_consensus.cc:697] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:26:58.458593 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 142405us
I20260709 12:26:58.464143 12446 consensus_queue.cc:1059] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:58.452860 10496 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
W20260709 12:26:58.476312  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 139733us
I20260709 12:26:58.476991  9928 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:58.477336 10496 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:58.478790 10496 leader_election.cc:400] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8.
I20260709 12:26:58.449159 12520 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:58.384651 12550 raft_consensus.cc:2804] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:58.214478 12528 consensus_queue.cc:1059] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.237s
I20260709 12:26:58.485635 10528 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:58.432163 12585 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:58.434369 12403 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:58.411242 12567 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:58.440620 12521 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.435304 12632 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:58.469611  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:26:58.486268 12591 consensus_meta.cc:287] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.745s	user 0.005s	sys 0.005s
W20260709 12:26:58.514824  9812 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 416) took 1773 ms (client timeout 1863 ms). Trace:
W20260709 12:26:58.515218  9812 rpcz_store.cc:269] 0709 12:26:56.741631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.742766 (+  1135us) service_pool.cc:224] Handling call
0709 12:26:58.514641 (+1771875us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54002526d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:58.514768 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3550367488}
I20260709 12:26:58.515589 10529 raft_consensus.cc:1275] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:58.484701  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:58.517781  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:58.519086  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:58.519543 12585 raft_consensus.cc:3055] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:58.519917 12585 raft_consensus.cc:740] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:58.520183  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:58.521102 12435 consensus_meta.cc:287] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.617s	user 0.007s	sys 0.000s
I20260709 12:26:58.520685 12585 consensus_queue.cc:260] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.521469 12435 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:58.454497 12624 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:26:58.487392  9928 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:58.488240  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:58.462733 12355 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.216255 12445 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:58.498494 10497 leader_election.cc:336] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.908s (SENT)
I20260709 12:26:58.410154 12527 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.436134 12430 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.457451 12592 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:58.385699 12541 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:58.523088 12403 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:26:58.510783 10496 connection.cc:256] RPC call timeout handler was delayed by -1.0177273220001553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
I20260709 12:26:58.516096 12632 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:58.482985  9779 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:26:58.512609  9809 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
W20260709 12:26:58.553153  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 70223.4us
I20260709 12:26:58.470723 12484 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:26:58.501391 12442 consensus_meta.cc:287] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.611s	user 0.009s	sys 0.000s
I20260709 12:26:58.448807 12072 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.456940 12413 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:58.493747 12555 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:58.423393 12351 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:58.572216 12351 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:58.572815  9815 raft_consensus.cc:1240] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 6. Current term is 7. Ops: []
W20260709 12:26:58.574872 12638 log.cc:927] Time spent T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:26:58.575100 12527 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:58.575663  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2210) took 1485 ms. Trace:
I20260709 12:26:58.576483  9890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2106) took 2578 ms. Trace:
I20260709 12:26:58.576859  9890 rpcz_store.cc:276] 0709 12:26:55.997844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.945274 (+1947430us) service_pool.cc:224] Handling call
0709 12:26:58.028197 (+ 82923us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:58.028553 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:58.028579 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:58.075663 (+ 47084us) log.cc:844] Serialized 26 byte log entry
0709 12:26:58.350589 (+274926us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:58.545985 (+195396us) log.cc:844] Serialized 14 byte log entry
0709 12:26:58.546209 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.546337 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:58.576295 (+ 29958us) raft_consensus.cc:1685] finished
0709 12:26:58.576316 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:58.576432 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5023,"raft.queue_time_us":167,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":17079,"thread_start_us":271839,"threads_started":2,"wal-append.queue_time_us":310067}
I20260709 12:26:58.578665  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:58.579275  9890 raft_consensus.cc:2368] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7.
I20260709 12:26:58.535401  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:58.501262 12550 raft_consensus.cc:697] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:58.579808  9812 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
W20260709 12:26:58.580240 12470 consensus_meta.cc:287] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.764s	user 0.007s	sys 0.002s
I20260709 12:26:58.580545  9812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:26:58.580632 12470 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:58.581074  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:58.581224  9812 raft_consensus.cc:606] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:58.581599  9890 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:58.581718  9812 raft_consensus.cc:614] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:58.583420  9808 raft_consensus.cc:2393] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:58.583743 12541 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:58.522554 12629 consensus_queue.cc:1059] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:26:58.493971 12631 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:26:58.536017  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 92822.7us
I20260709 12:26:58.592293  9853 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:58.557791 12394 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:58.594844 12394 raft_consensus.cc:697] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:58.595975 12394 consensus_queue.cc:237] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.554553 12632 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:58.599546 12430 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:58.599699 12386 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:58.600875 12518 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.603039 12445 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:58.603726 12072 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:58.603921 12631 raft_consensus.cc:697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:58.604329 12518 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:58.604622  9963 raft_consensus.cc:1240] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:58.552026 12643 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:58.605036 12631 consensus_queue.cc:237] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.605985  9963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1280) took 1192 ms. Trace:
I20260709 12:26:58.606511  9960 raft_consensus.cc:1240] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:58.606416  9963 rpcz_store.cc:276] 0709 12:26:57.413562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.385160 (+971598us) service_pool.cc:224] Handling call
0709 12:26:58.432400 (+ 47240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.605106 (+172706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.605730 (+   624us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54000b45d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:58.605918 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":395591936}
I20260709 12:26:58.607122 12470 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:58.607831  9960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1279) took 1194 ms. Trace:
I20260709 12:26:58.607988  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:58.608633  9963 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:26:58.547669 12529 consensus_queue.cc:237] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:58.544304 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 45861.7us
I20260709 12:26:58.568352 12387 consensus_queue.cc:237] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:58.536274  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 48931.9us
I20260709 12:26:58.611920  9810 raft_consensus.cc:2410] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:26:58.612376  9928 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:26:58.523098 12607 log.cc:927] Time spent T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.803s	user 0.008s	sys 0.005s
I20260709 12:26:58.515100 12597 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:26:58.510517  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 142415us
I20260709 12:26:58.555915 12403 raft_consensus.cc:697] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:58.483531 12588 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:58.549983 10496 connection.cc:256] RPC call timeout handler was delayed by -1.0177273220001553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18630000000000002s for a response
I20260709 12:26:58.618475 12597 raft_consensus.cc:3055] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:58.618880 12597 raft_consensus.cc:740] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:58.619181 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:58.619969 12588 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:58.550143  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:58.620409 10496 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:58.471469 12480 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:58.620800 10527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 790) took 1306 ms. Trace:
I20260709 12:26:58.621196  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:58.621771  9807 raft_consensus.cc:2410] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:26:58.622021  9964 raft_consensus.cc:2410] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:26:58.622872  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:58.623769  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:58.624147 12629 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:58.624428  9964 raft_consensus.cc:2393] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:26:58.624989 12648 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:58.623696 12633 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:58.554035  9809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2216) took 1461 ms. Trace:
W20260709 12:26:58.550724  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.625802 12633 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:58.569919 12634 log.cc:927] Time spent T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:26:58.570493 12435 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:26:58.579038  9881 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54428 (request call id 537) took 1961 ms (client timeout 1908 ms). Trace:
I20260709 12:26:58.505414 12520 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:58.522747 12521 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.576160  9815 rpcz_store.cc:276] 0709 12:26:57.090574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.739517 (+648943us) service_pool.cc:224] Handling call
0709 12:26:57.739829 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.573185 (+833356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.575363 (+  2178us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b54002b0054. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:58.575591 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1915281152}
I20260709 12:26:58.588960  9890 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:26:58.650359  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:58.580250 12550 consensus_queue.cc:237] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:58.608203  9960 rpcz_store.cc:276] 0709 12:26:57.413276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.173069 (+759793us) service_pool.cc:224] Handling call
0709 12:26:58.173451 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.607078 (+433627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.607630 (+   552us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b54000b31d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:58.607778 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":995489024}
I20260709 12:26:58.506150  9806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 414) took 1796 ms. Trace:
I20260709 12:26:58.636194 12633 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:58.614797  9853 leader_election.cc:400] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 2. Current term is 3.
W20260709 12:26:58.568817 12516 consensus_meta.cc:287] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 2.188s	user 0.010s	sys 0.004s
I20260709 12:26:58.548691  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:58.547204  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 106900us
I20260709 12:26:58.601423 12355 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:58.619623 12597 consensus_queue.cc:260] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.625433  9964 raft_consensus.cc:1240] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:26:58.625867  9809 rpcz_store.cc:276] 0709 12:26:57.092252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.553161 (+1460909us) service_pool.cc:224] Handling call
0709 12:26:58.553427 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.553623 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:58.553656 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:58.553713 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:58.553759 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.553834 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:58.553967 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:58.556335 10533 raft_consensus.cc:1240] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:58.548180 12592 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.553958  9779 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:58.629745  9927 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:58.621344 10527 rpcz_store.cc:276] 0709 12:26:57.314466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.946731 (+632265us) service_pool.cc:224] Handling call
0709 12:26:57.947244 (+   513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:58.173889 (+226645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:58.173934 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:58.174547 (+   613us) log.cc:844] Serialized 26 byte log entry
0709 12:26:58.451171 (+276624us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:58.545985 (+ 94814us) log.cc:844] Serialized 14 byte log entry
0709 12:26:58.546523 (+   538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.546582 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:58.620602 (+ 74020us) raft_consensus.cc:1685] finished
0709 12:26:58.620619 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:58.620753 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65898,"prepare.queue_time_us":26699,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":152708,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":4187,"thread_start_us":504049,"threads_started":3,"wal-append.queue_time_us":371061}
I20260709 12:26:58.638935 12488 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:26:58.640288  9881 rpcz_store.cc:269] 0709 12:26:56.617595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.752582 (+134987us) service_pool.cc:224] Handling call
0709 12:26:58.578827 (+1826245us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b5400218754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:58.578952 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3577662720}
I20260709 12:26:58.704706  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:58.580258 12522 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:58.656955  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:58.708408  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:58.557011 12484 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:58.554680 12356 consensus_queue.cc:237] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.664872  9853 leader_election.cc:403] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:58.664706  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:58.664979  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:58.713783  9890 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:58.714078 12527 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:58.665467  9882 raft_consensus.cc:1275] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:26:58.667397  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.667308 10497 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:58.685953 12516 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.687001  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:58.687718 12403 consensus_queue.cc:237] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:58.692219 12206 consensus_meta.cc:287] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.593s	user 0.008s	sys 0.000s
I20260709 12:26:58.698171  9928 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:58.699883  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2111) took 2423 ms. Trace:
I20260709 12:26:58.700008  9963 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:26:58.701097  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:58.702675  9964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1287) took 1200 ms. Trace:
W20260709 12:26:58.706380  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 152519us
W20260709 12:26:58.709419  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 79733.7us
I20260709 12:26:58.709775  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:26:58.713456  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 98813.2us
I20260709 12:26:58.668648 12435 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:58.658603 12509 consensus_queue.cc:1059] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:26:58.700410 12518 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:58.697307 10526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 562) took 1017 ms. Trace:
I20260709 12:26:58.714455  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:58.823264  9779 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:26:58.856455  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:58.877907 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:58.710794 12421 consensus_meta.cc:287] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.000s
I20260709 12:26:58.755149  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 1957) took 1002 ms. Trace:
I20260709 12:26:58.816097  9809 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:58.816186  9889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1241) took 1161 ms. Trace:
I20260709 12:26:58.817461  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:58.817356  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 119304us
I20260709 12:26:58.818162  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:26:58.814231 12611 log.cc:927] Time spent T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.999s	user 0.005s	sys 0.000s
I20260709 12:26:58.818045  9927 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:26:58.818392  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:58.700457 12528 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.886175  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:58.809350 12533 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:58.821027  9853 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:26:58.818251 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 151014us
I20260709 12:26:58.895481  9889 rpcz_store.cc:276] 0709 12:26:57.654595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.656456 (+  1861us) service_pool.cc:224] Handling call
0709 12:26:58.816018 (+1159562us) spinlock_profiling.cc:243] Waited 51.5 ms on lock 0x7b54003f98d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:58.816132 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118511488}
I20260709 12:26:58.819020  9886 rpcz_store.cc:276] 0709 12:26:56.276671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.999767 (+1723096us) service_pool.cc:224] Handling call
0709 12:26:58.000105 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:58.000464 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:58.000494 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:58.035010 (+ 34516us) log.cc:844] Serialized 26 byte log entry
0709 12:26:58.583899 (+548889us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b180031b580. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b411e07 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f8e0b620b 00007f2f8e0bbd23 00007f2f8e0bc0d1 00007f2f8e4d7a0f
0709 12:26:58.654629 (+ 70730us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:58.655247 (+   618us) log.cc:844] Serialized 14 byte log entry
0709 12:26:58.666896 (+ 11649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.666961 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:58.666995 (+    34us) raft_consensus.cc:1685] finished
0709 12:26:58.699629 (+ 32634us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:58.699811 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19000,"prepare.queue_time_us":175,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":12005,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":40457,"spinlock_wait_cycles":3884416,"thread_start_us":70551,"threads_started":1,"wal-append.queue_time_us":611977}
I20260709 12:26:58.899209  9883 raft_consensus.cc:2393] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 4: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:26:58.816444  9964 rpcz_store.cc:276] 0709 12:26:57.501895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.624949 (+1123054us) service_pool.cc:224] Handling call
0709 12:26:58.625241 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:58.702398 (+ 77157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.702619 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:58.814929 12597 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:58.898005  9815 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:26:58.815284  9813 raft_consensus.cc:2393] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 7: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:26:58.822751  9890 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:26:58.711169 12475 raft_consensus.cc:2764] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:26:58.886529  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 63945.9us
I20260709 12:26:58.908267  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:58.896525  9881 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:58.712785 12488 raft_consensus.cc:697] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:58.799234 12531 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.714465 12527 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.740396 12019 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 2. Current term is 3.
I20260709 12:26:58.928761 12527 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:58.930639 12413 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:58.937063 12633 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.913782  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:58.911963 12528 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.939703  9963 raft_consensus.cc:1240] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:58.940434  9963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1288) took 1428 ms. Trace:
I20260709 12:26:58.940536 12528 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:58.940892  9963 rpcz_store.cc:276] 0709 12:26:57.511741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.939108 (+1427367us) service_pool.cc:224] Handling call
0709 12:26:58.939483 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.940147 (+   664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.940361 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:58.885839 12442 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.836876 12550 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.920449  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:58.912637  9886 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:58.912706  9815 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:26:58.911784 12652 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.960387  9809 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:26:58.710654 12632 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.912798  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:58.923751 12516 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:58.924316  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:58.885573 12470 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.927690  9957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 422) took 2169 ms. Trace:
I20260709 12:26:58.950793 12421 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:58.896901 12518 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.885885 12617 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:26:58.918210  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.044463 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:58.889222  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:58.912381  9779 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:59.007763 12226 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:26:58.908646  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:26:58.944955  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 126957us
I20260709 12:26:59.048827  9889 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:26:58.955561  9815 raft_consensus.cc:606] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:26:58.958475  9881 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:26:58.961776  9809 raft_consensus.cc:1275] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:59.051173  9809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2223) took 1735 ms. Trace:
I20260709 12:26:59.051530  9809 rpcz_store.cc:276] 0709 12:26:57.315780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.961166 (+1645386us) service_pool.cc:224] Handling call
0709 12:26:58.961474 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.050900 (+ 89426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.051110 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:58.962046  9813 raft_consensus.cc:1240] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:59.052971  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2221) took 1737 ms. Trace:
I20260709 12:26:59.053313  9813 rpcz_store.cc:276] 0709 12:26:57.315256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.946394 (+1631138us) service_pool.cc:224] Handling call
0709 12:26:58.961889 (+ 15495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.052744 (+ 90855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.052919 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.053958  9960 raft_consensus.cc:1240] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:59.053138  9964 raft_consensus.cc:3055] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:59.054399  9964 raft_consensus.cc:740] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:59.054513  9813 raft_consensus.cc:1240] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:58.907883 12651 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.946707 12531 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:58.896294  9810 rpcz_store.cc:276] 0709 12:26:57.752599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.438112 (+685513us) service_pool.cc:224] Handling call
0709 12:26:58.754929 (+316817us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b540036b354. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:58.755081 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355181312}
I20260709 12:26:59.057262  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2228) took 1550 ms. Trace:
I20260709 12:26:58.885358 12206 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.968789  9886 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:26:58.942624 12533 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:59.009382  9808 raft_consensus.cc:1240] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:58.951453 12442 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:59.063213  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2222) took 1747 ms. Trace:
I20260709 12:26:59.010972  9963 raft_consensus.cc:1217] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[3.5-3.5]   Dedup: 3.5->[]
I20260709 12:26:58.885706 12435 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:58.914443 12588 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:59.021526 12421 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.919232 12622 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:58.914667 12509 raft_consensus.cc:3055] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:59.017061  9812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2219) took 1702 ms. Trace:
I20260709 12:26:59.018573  9957 rpcz_store.cc:276] 0709 12:26:56.758012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.758154 (+   142us) service_pool.cc:224] Handling call
0709 12:26:56.762181 (+  4027us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:56.762552 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:56.762584 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:56.773553 (+ 10969us) log.cc:844] Serialized 52 byte log entry
0709 12:26:57.538067 (+764514us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:58.034354 (+496287us) log.cc:844] Serialized 14 byte log entry
0709 12:26:58.034717 (+   363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.034809 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:58.754231 (+719422us) spinlock_profiling.cc:243] Waited 74.8 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:26:58.927353 (+173122us) raft_consensus.cc:1685] finished
0709 12:26:58.927475 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:58.927619 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":626758,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":1657,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":37242,"spinlock_wait_cycles":172142976,"thread_start_us":1181579,"threads_started":2,"wal-append.queue_time_us":922326}
W20260709 12:26:58.916523  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 95552.4us
I20260709 12:26:59.075088  9812 rpcz_store.cc:276] 0709 12:26:57.314723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.582690 (+1267967us) service_pool.cc:224] Handling call
0709 12:26:58.582983 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.584473 (+  1490us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:26:58.651011 (+ 66538us) log.cc:844] Serialized 14 byte log entry
0709 12:26:59.015874 (+364863us) log.cc:844] Serialized 14 byte log entry
0709 12:26:59.016764 (+   890us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:59.016808 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:59.016848 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.016906 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:59.017007 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":700,"prepare.queue_time_us":117698,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":25209,"raft.queue_time_us":2039,"raft.run_wall_time_us":25423,"spinlock_wait_cycles":29551104,"thread_start_us":430323,"threads_started":2}
I20260709 12:26:59.047173 10527 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:59.075670  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:59.078399  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:26:59.055956  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 143650us
I20260709 12:26:59.076107  9853 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:59.079375  9779 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:59.057648  9813 rpcz_store.cc:276] 0709 12:26:57.507452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.054062 (+1546610us) service_pool.cc:224] Handling call
0709 12:26:59.054346 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.057020 (+  2674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.057211 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.059003  9960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1300) took 1033 ms. Trace:
I20260709 12:26:59.061057  9809 raft_consensus.cc:1240] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:58.960879 12550 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:59.063637  9808 rpcz_store.cc:276] 0709 12:26:57.315496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.949105 (+1633609us) service_pool.cc:224] Handling call
0709 12:26:59.009163 (+ 60058us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.062993 (+ 53830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.063171 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.063889  9963 raft_consensus.cc:1240] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:26:59.082528  9963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 1922) took 1153 ms. Trace:
I20260709 12:26:59.082901  9963 rpcz_store.cc:276] 0709 12:26:57.928980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.941878 (+1012898us) service_pool.cc:224] Handling call
0709 12:26:59.010846 (+ 68968us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:59.082311 (+ 71465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.082479 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.067445 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:58.964259 12652 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:59.084908  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:59.058506 12617 raft_consensus.cc:697] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:26:59.070575  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2231) took 1424 ms. Trace:
I20260709 12:26:59.078824  9957 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:59.080605  9960 rpcz_store.cc:276] 0709 12:26:58.025970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.049710 (+1023740us) service_pool.cc:224] Handling call
0709 12:26:59.049990 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.058756 (+  8766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.058947 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.080971  9809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2225) took 1764 ms. Trace:
I20260709 12:26:59.066944 12306 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:59.059777 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:26:59.072623  9964 consensus_queue.cc:260] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:59.099676  9964 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:59.085481  9853 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:59.065955 12394 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:59.146440  9885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2103) took 3279 ms. Trace:
I20260709 12:26:59.146823  9885 rpcz_store.cc:276] 0709 12:26:55.867122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.901835 (+2034713us) service_pool.cc:224] Handling call
0709 12:26:57.935468 (+ 33633us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:57.936002 (+   534us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.146254 (+1210252us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b54003c78d0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:59.146385 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76638592}
I20260709 12:26:59.147441  9957 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:26:59.088531  9810 rpcz_store.cc:276] 0709 12:26:57.646478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.057463 (+1410985us) service_pool.cc:224] Handling call
0709 12:26:59.070078 (+ 12615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.070263 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:59.070310 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:59.070350 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:59.070383 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.070431 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:59.070521 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.067044 12533 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:26:59.091310  9960 raft_consensus.cc:1240] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:59.089241  9809 rpcz_store.cc:276] 0709 12:26:57.316285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.060593 (+1744308us) service_pool.cc:224] Handling call
0709 12:26:59.060890 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.080737 (+ 19847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.080903 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.046700 12470 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:59.071285 12421 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:59.103133 12435 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:59.105561 12484 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:59.075026 12509 raft_consensus.cc:740] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:26:59.087826  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.107228 12527 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:59.110354 12550 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:59.110661 10524 raft_consensus.cc:2393] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 4: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:26:59.111653  9853 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:59.074152 12643 consensus_queue.cc:1048] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:26:59.081569 12616 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:59.082820 12588 consensus_queue.cc:1059] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:26:59.163887 12588 consensus_queue.cc:1243] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [LEADER]: Peer 4104e34a61b7448281d6d91ce23ebf71 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:26:59.114737  9812 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:59.164582 12019 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:59.164848  9812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2234) took 1332 ms. Trace:
I20260709 12:26:59.165243  9812 rpcz_store.cc:276] 0709 12:26:57.832162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.100809 (+1268647us) service_pool.cc:224] Handling call
0709 12:26:59.114579 (+ 13770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.164607 (+ 50028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.164795 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.084553 12528 consensus_queue.cc:1059] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:26:59.119475 12537 consensus_queue.cc:1059] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:59.120079 12539 consensus_queue.cc:1059] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:59.120340  9814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:26:59.170821  9814 raft_consensus.cc:606] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:59.171178  9814 raft_consensus.cc:614] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:59.121071  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:59.060058 12488 consensus_queue.cc:237] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:59.123477 12442 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:59.125272 12306 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:59.087658 12475 raft_consensus.cc:2804] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:59.089550 12445 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 12:26:59.127465 12658 log.cc:927] Time spent T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:26:59.083359 12622 raft_consensus.cc:697] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:59.128407  9887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 2115) took 1810 ms. Trace:
I20260709 12:26:59.129379 12567 raft_consensus.cc:3055] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:59.129472 12518 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:59.134617 12516 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:59.136695 12521 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:59.137748 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:26:59.138338 12531 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:59.059976 12403 consensus_queue.cc:1059] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:26:58.658495  9806 rpcz_store.cc:276] 0709 12:26:56.709877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.714241 (+  4364us) service_pool.cc:224] Handling call
0709 12:26:56.774070 (+ 59829us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:56.794705 (+ 20635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:56.802545 (+  7840us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:56.803042 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 12:26:56.924076 (+121034us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:57.926575 (+1002499us) log.cc:844] Serialized 14 byte log entry
0709 12:26:58.463046 (+536471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.471541 (+  8495us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:58.481649 (+ 10108us) raft_consensus.cc:1685] finished
0709 12:26:58.483974 (+  2325us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:58.501551 (+ 17577us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18870,"prepare.queue_time_us":562736,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":17134,"raft.queue_time_us":133886,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":14287,"spinlock_wait_cycles":41801984,"thread_start_us":1458924,"threads_started":4,"wal-append.queue_time_us":421281,"wal-append.run_cpu_time_us":1434,"wal-append.run_wall_time_us":1002140}
I20260709 12:26:59.289600  9806 raft_consensus.cc:1275] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:59.290432  9806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 1963) took 1364 ms. Trace:
I20260709 12:26:59.290863  9806 rpcz_store.cc:276] 0709 12:26:57.925637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.288691 (+1363054us) service_pool.cc:224] Handling call
0709 12:26:59.289128 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.290085 (+   957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.290352 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.291468  9813 raft_consensus.cc:1240] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:59.292135  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 424) took 1357 ms. Trace:
I20260709 12:26:59.140882 12652 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:58.822947 10526 rpcz_store.cc:276] 0709 12:26:57.650644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.081602 (+430958us) service_pool.cc:224] Handling call
0709 12:26:58.090773 (+  9171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.101577 (+ 10804us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:26:58.309070 (+207493us) log.cc:844] Serialized 14 byte log entry
0709 12:26:58.515069 (+205999us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:58.523316 (+  8247us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:58.534090 (+ 10774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.627214 (+ 93124us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b180043e6a0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b3fd2a6 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419
0709 12:26:58.656851 (+ 29637us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b540069f854. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:58.658752 (+  1901us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:58.668134 (+  9382us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17022,"prepare.queue_time_us":333249,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":23876,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":47058432,"thread_start_us":380431,"threads_started":2,"wal-append.queue_time_us":208507}
I20260709 12:26:59.077435 12587 raft_consensus.cc:3055] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:59.143965 10532 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:26:59.058928 12226 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:59.149796  9807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 1961) took 1349 ms. Trace:
I20260709 12:26:59.150337 10533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36672 (request call id 742) took 2518 ms. Trace:
I20260709 12:26:59.108693 12206 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:59.155717  9779 leader_election.cc:400] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7.
I20260709 12:26:59.158294 10496 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:26:59.103149 12520 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:59.156576  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:59.063606 12651 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:59.160688  9956 raft_consensus.cc:1240] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:59.150962 12533 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:59.292459  9806 raft_consensus.cc:1240] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: []
W20260709 12:26:59.163883  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 52330.2us
W20260709 12:26:59.278141  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 382179us
I20260709 12:26:59.151135 12394 raft_consensus.cc:697] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:59.168514  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:59.175712  9887 rpcz_store.cc:276] 0709 12:26:57.317761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.664029 (+346268us) service_pool.cc:224] Handling call
0709 12:26:59.128233 (+1464204us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54003f93d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:59.128353 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":444729216}
I20260709 12:26:59.180006  9964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1299) took 1181 ms. Trace:
I20260709 12:26:59.181087  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:59.181622  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:59.180929 12537 raft_consensus.cc:3055] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:59.179524 12413 raft_consensus.cc:3055] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:59.184592  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:59.326784  9812 raft_consensus.cc:2368] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
I20260709 12:26:59.210841 12632 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:59.178112 12567 raft_consensus.cc:740] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:26:59.334264  9814 raft_consensus.cc:1240] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:59.334196 12567 consensus_queue.cc:260] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:59.335204  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 1967) took 1247 ms. Trace:
I20260709 12:26:59.335835 12567 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:59.212507 12470 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:59.215852 12484 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:59.226714 12403 raft_consensus.cc:3055] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:59.315935 12587 raft_consensus.cc:740] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:59.242947  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:26:59.353579  9808 raft_consensus.cc:2393] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
W20260709 12:26:59.252981 10531 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 793) took 1932 ms (client timeout 2027 ms). Trace:
W20260709 12:26:59.258883  9962 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55946 (request call id 1906) took 2384 ms (client timeout 1785 ms). Trace:
I20260709 12:26:59.260005 12549 raft_consensus.cc:3055] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:59.260776  9959 raft_consensus.cc:1240] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 9. Current term is 10. Ops: []
W20260709 12:26:59.354477  9962 rpcz_store.cc:269] 0709 12:26:56.874840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.876110 (+  1270us) service_pool.cc:224] Handling call
0709 12:26:59.258555 (+2382445us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b54001d3654. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:59.258756 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1254054784}
I20260709 12:26:59.272100 12509 consensus_queue.cc:260] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:59.275002  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:59.280547  9882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 532) took 2665 ms. Trace:
I20260709 12:26:59.388005  9882 rpcz_store.cc:276] 0709 12:26:56.615394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.035573 (+1420179us) service_pool.cc:224] Handling call
0709 12:26:58.586115 (+550542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.815782 (+229667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.279195 (+463413us) spinlock_profiling.cc:243] Waited 78.2 ms on lock 0x7b5400218754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:59.280279 (+  1084us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b5400218750. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:59.280468 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1445305856}
W20260709 12:26:59.283089  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.292412  9813 rpcz_store.cc:276] 0709 12:26:57.934634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.291042 (+1356408us) service_pool.cc:224] Handling call
0709 12:26:59.291316 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.291924 (+   608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.292078 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.315003  9885 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:26:59.303155  9961 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55946 (request call id 1919) took 2408 ms (client timeout 1925 ms). Trace:
W20260709 12:26:59.390614  9961 rpcz_store.cc:269] 0709 12:26:56.895131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.643535 (+748404us) service_pool.cc:224] Handling call
0709 12:26:59.302894 (+1659359us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b54003bb854. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:59.303065 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2032191744}
I20260709 12:26:59.315464 10533 rpcz_store.cc:276] 0709 12:26:56.624638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.674873 (+ 50235us) service_pool.cc:224] Handling call
0709 12:26:57.046431 (+371558us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b58001f1a98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:26:57.046675 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:58.700997 (+1654322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.142978 (+441981us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b540031b0d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:59.143174 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3535213824}
I20260709 12:26:59.316568  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:26:59.316960  9779 leader_election.cc:403] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 12:26:59.393262  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 237661us
I20260709 12:26:59.318753  9964 rpcz_store.cc:276] 0709 12:26:57.998482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.016880 (+1018398us) service_pool.cc:224] Handling call
0709 12:26:59.053022 (+ 36142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.179123 (+126101us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:26:59.179163 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:59.179200 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:59.179233 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.179293 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:59.179393 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110019,"raft.queue_time_us":3571,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":18068}
I20260709 12:26:59.395061  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:59.320026  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:59.394135  9779 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:26:59.397900  9779 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:26:59.250058 10497 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:26:59.319182  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:26:59.399044  9887 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:59.317148  9806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 1965) took 1281 ms. Trace:
I20260709 12:26:59.399982  9806 rpcz_store.cc:276] 0709 12:26:58.035685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.291910 (+1256225us) service_pool.cc:224] Handling call
0709 12:26:59.292238 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.316905 (+ 24667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.317094 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:59.401547 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 151596us
I20260709 12:26:59.152302  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:26:59.317070  9807 rpcz_store.cc:276] 0709 12:26:57.800731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.519973 (+719242us) service_pool.cc:224] Handling call
0709 12:26:59.146077 (+626104us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54002d6754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:59.149737 (+  3660us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231579392}
I20260709 12:26:59.318517  9810 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
W20260709 12:26:59.325798 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 167582us
I20260709 12:26:59.180540 12475 raft_consensus.cc:697] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:59.180632 12516 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:26:59.333110  9812 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:26:59.335693  9814 rpcz_store.cc:276] 0709 12:26:58.087762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.319264 (+1231502us) service_pool.cc:224] Handling call
0709 12:26:59.334098 (+ 14834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.334851 (+   753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.335098 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.214520 12306 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:59.428932  9806 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:26:59.429723  9813 raft_consensus.cc:1240] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: []
W20260709 12:26:59.352938 12592 consensus_meta.cc:287] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.000s
I20260709 12:26:59.342518 10530 raft_consensus.cc:1240] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: []
W20260709 12:26:59.232343 12639 log.cc:927] Time spent T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.714s	user 0.004s	sys 0.003s
W20260709 12:26:59.351619  9958 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55946 (request call id 1910) took 2475 ms (client timeout 2219 ms). Trace:
W20260709 12:26:59.448412  9958 rpcz_store.cc:269] 0709 12:26:56.875865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.736982 (+861117us) service_pool.cc:224] Handling call
0709 12:26:59.351445 (+1614463us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54001dd654. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:59.351541 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268459392}
W20260709 12:26:59.354038 10531 rpcz_store.cc:269] 0709 12:26:57.320145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.360881 (+ 40736us) service_pool.cc:224] Handling call
0709 12:26:59.252744 (+1891863us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b54005c12d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:59.252904 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1250343680}
I20260709 12:26:59.347039 12394 consensus_queue.cc:237] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:59.347829 12633 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:26:59.326327 12537 raft_consensus.cc:740] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:59.504329  9815 raft_consensus.cc:3055] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:59.504817  9815 raft_consensus.cc:740] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:26:59.505548  9885 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:26:59.327929 12413 raft_consensus.cc:740] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:59.371062 12622 consensus_queue.cc:237] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:26:59.374253 12649 log.cc:927] Time spent T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.775s	user 0.001s	sys 0.001s
I20260709 12:26:59.348304 12403 raft_consensus.cc:740] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:59.357048 12549 raft_consensus.cc:740] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:26:59.331907 12274 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:59.172830 12617 consensus_queue.cc:237] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:59.358479  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:59.323539  9928 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:26:59.293501 12582 raft_consensus.cc:3055] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:59.424743  9812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 1968) took 1336 ms. Trace:
I20260709 12:26:59.424232 12520 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:59.424962 12470 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:59.458527  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:26:59.428411 12522 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:59.462738  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:59.464084  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 1970) took 1375 ms. Trace:
I20260709 12:26:59.329010 12643 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.083s
W20260709 12:26:59.469286  9778 leader_election.cc:336] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.513s (SENT)
I20260709 12:26:59.490850  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:26:59.493361  9887 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:26:59.495317  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:59.411190 12445 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7.
I20260709 12:26:59.513890  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:26:59.458047 12475 consensus_queue.cc:237] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:26:59.519088  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1278) took 2106 ms. Trace:
W20260709 12:27:00.006134 10525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 567) took 1855 ms (client timeout 2010 ms). Trace:
I20260709 12:26:59.922398  9882 raft_consensus.cc:1240] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:00.061486  9889 raft_consensus.cc:2410] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:26:59.660987  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:59.869953  9888 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1231) took 3007 ms (client timeout 2201 ms). Trace:
I20260709 12:27:00.012354  9956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1281) took 2598 ms. Trace:
W20260709 12:27:00.059540  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.063683  9881 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
W20260709 12:26:59.742259  9963 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.065s	sys 0.081s
I20260709 12:26:59.433274 12516 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:00.063752  9886 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:00.078496  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1249) took 1035 ms. Trace:
I20260709 12:27:00.078938  9886 rpcz_store.cc:276] 0709 12:26:59.042849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.495023 (+452174us) service_pool.cc:224] Handling call
0709 12:27:00.078425 (+583402us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:59.763267  9884 raft_consensus.cc:1240] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:00.060544  9962 raft_consensus.cc:2410] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:27:00.060240  9959 rpcz_store.cc:276] 0709 12:26:57.413010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.035407 (+622397us) service_pool.cc:224] Handling call
0709 12:26:59.260492 (+1225085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.357352 (+ 96860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.518857 (+161505us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54001d3650. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:59.519019 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2725776128}
W20260709 12:27:00.064404  9963 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.069s	sys 0.089s
I20260709 12:27:00.061949  9882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 533) took 3445 ms. Trace:
I20260709 12:27:00.063393  9956 rpcz_store.cc:276] 0709 12:26:57.413841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.468098 (+1054257us) service_pool.cc:224] Handling call
0709 12:26:58.511621 (+ 43523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.320218 (+808597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.012029 (+691811us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b54001527d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:00.012275 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1492234624}
W20260709 12:27:00.060628 10525 rpcz_store.cc:269] 0709 12:26:58.150559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.150696 (+   137us) service_pool.cc:224] Handling call
0709 12:27:00.005849 (+1855153us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400690354. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:00.006043 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3264325504}
W20260709 12:26:59.762850  9883 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54428 (request call id 538) took 2995 ms (client timeout 1550 ms). Trace:
W20260709 12:27:00.070904  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 754327us
I20260709 12:27:00.062549  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:00.063186  9888 rpcz_store.cc:269] 0709 12:26:56.862193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.442920 (+580727us) service_pool.cc:224] Handling call
0709 12:26:59.869727 (+2426807us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b54002e7a54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:59.869870 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1749531904}
I20260709 12:27:00.082831  9882 rpcz_store.cc:276] 0709 12:26:56.616297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.921728 (+3305431us) service_pool.cc:224] Handling call
0709 12:26:59.922137 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.061722 (+139585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.061897 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:00.082608  9883 rpcz_store.cc:269] 0709 12:26:56.767344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.043867 (+276523us) service_pool.cc:224] Handling call
0709 12:26:59.762585 (+2718718us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54001bc454. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:26:59.762763 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3600218496}
I20260709 12:27:00.113168  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2099) took 4270 ms. Trace:
I20260709 12:27:00.113724  9884 rpcz_store.cc:276] 0709 12:26:55.842617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:57.880365 (+2037748us) service_pool.cc:224] Handling call
0709 12:26:59.763048 (+1882683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.080372 (+317324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.112911 (+ 32539us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b54001bc450. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:00.113097 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4328838016}
I20260709 12:27:00.124487  9962 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:27:00.125336  9962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1318) took 1316 ms. Trace:
I20260709 12:27:00.072366  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:00.073092  9957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 431) took 1522 ms. Trace:
I20260709 12:26:59.412878 12632 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:27:00.076061 12336 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.001s	sys 0.019s
W20260709 12:26:59.872906 12662 log.cc:927] Time spent T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.701s	user 0.001s	sys 0.000s
I20260709 12:26:59.467190 12592 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:00.061378  9812 rpcz_store.cc:276] 0709 12:26:58.088074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.327321 (+1239247us) service_pool.cc:224] Handling call
0709 12:26:59.332847 (+  5526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:59.424459 (+ 91612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.424689 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.526960 12617 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.083669 12527 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:26:59.508930 12484 consensus_queue.cc:1059] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 1.096s
I20260709 12:27:00.604540 12617 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:00.060915  9813 rpcz_store.cc:276] 0709 12:26:58.088588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.389873 (+1301285us) service_pool.cc:224] Handling call
0709 12:26:59.429513 (+ 39640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.446925 (+ 17412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.464006 (+ 17081us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.395103 12678 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.075281 12585 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:00.606624 12484 raft_consensus.cc:3055] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:00.607309 12484 raft_consensus.cc:740] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:00.607656 12678 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:00.608560  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 433) took 1278 ms. Trace:
I20260709 12:27:00.574383  9806 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:27:00.449570 10526 raft_consensus.cc:1240] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:27:00.101172  9885 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:00.606173  9812 raft_consensus.cc:1240] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:27:00.598433  9956 raft_consensus.cc:1240] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:00.125741  9962 rpcz_store.cc:276] 0709 12:26:58.808877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.123693 (+1314816us) service_pool.cc:224] Handling call
0709 12:27:00.124077 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.125028 (+   951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.125270 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:00.401403 12421 consensus_meta.cc:287] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 1.244s	user 0.007s	sys 0.004s
I20260709 12:27:00.397362 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:00.394492 12674 log.cc:927] Time spent T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:27:00.084057 12306 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.020418  9815 consensus_queue.cc:260] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:59.670358 12652 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.609405 12484 consensus_queue.cc:260] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:00.642100 12421 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:00.642897  9806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2244) took 1581 ms. Trace:
I20260709 12:27:00.643399  9806 rpcz_store.cc:276] 0709 12:26:59.061776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.448060 (+386284us) service_pool.cc:224] Handling call
0709 12:26:59.466499 (+ 18439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:00.610716 (+1144217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.642500 (+ 31784us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540002e4d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:00.642799 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2545067904}
I20260709 12:27:00.644075 12484 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:00.241382 12356 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.005s	user 0.005s	sys 0.024s
W20260709 12:27:00.646788 12356 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.410s	user 0.021s	sys 0.056s
I20260709 12:27:00.627303  9812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 432) took 1295 ms. Trace:
I20260709 12:27:00.648073  9812 rpcz_store.cc:276] 0709 12:26:59.329763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.604657 (+1274894us) service_pool.cc:224] Handling call
0709 12:27:00.605577 (+   920us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:00.619423 (+ 13846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.624759 (+  5336us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.649715 12592 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:00.649242 12652 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:26:59.931718 12651 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:00.248888 12403 consensus_queue.cc:260] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:00.059892 12582 raft_consensus.cc:740] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:27:00.632647  9854 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.001s	sys 0.004s
W20260709 12:27:00.652282  9854 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.002s	sys 0.005s
W20260709 12:27:00.652880  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 551231us
I20260709 12:27:00.653342 12403 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:00.653127 12582 consensus_queue.cc:260] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:00.654403  9929 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.008s	sys 0.029s
W20260709 12:27:00.075524 12533 consensus_meta.cc:287] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.744s	user 0.007s	sys 0.002s
W20260709 12:27:00.654866  9929 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.008s	sys 0.029s
I20260709 12:27:00.656011  9964 raft_consensus.cc:2368] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7.
W20260709 12:27:00.656579  9927 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.037s	user 0.016s	sys 0.020s
W20260709 12:27:00.657094  9927 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.094s	user 0.016s	sys 0.020s
I20260709 12:27:00.655514 12533 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:00.658905  9811 raft_consensus.cc:1240] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:00.661165 12533 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:00.324826 12668 log.cc:927] Time spent T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:27:00.398919 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:00.101138 12509 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:00.638866  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 1.16935e+06us
I20260709 12:27:00.206791  9955 raft_consensus.cc:1275] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:27:00.376806 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:00.398586 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:00.639247 12306 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:00.376248 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:00.353824 12274 raft_consensus.cc:697] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:00.641203  9815 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:00.662137  9887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 540) took 3845 ms. Trace:
I20260709 12:27:00.280880 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:00.276512 12643 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:00.682606  9884 raft_consensus.cc:1240] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:00.683075 12274 consensus_queue.cc:237] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:00.684266  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 434) took 1338 ms. Trace:
I20260709 12:27:00.684739  9808 rpcz_store.cc:276] 0709 12:26:59.345880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.411190 (+ 65310us) service_pool.cc:224] Handling call
0709 12:27:00.684025 (+1272835us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.654191  9854 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:00.083899 12567 consensus_queue.cc:1059] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.571s
W20260709 12:27:00.324282 12669 log.cc:927] Time spent T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:27:00.176576 12438 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.016s	sys 0.023s
W20260709 12:27:00.401634 12665 log.cc:927] Time spent T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260709 12:27:00.601966 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 538631us
W20260709 12:27:00.212604 12539 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.006s	sys 0.006s
I20260709 12:27:00.174258  9958 raft_consensus.cc:1240] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:00.609170  9813 rpcz_store.cc:276] 0709 12:26:59.330080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.606896 (+1276816us) service_pool.cc:224] Handling call
0709 12:27:00.607497 (+   601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.607941 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:00.607973 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:00.608056 (+    83us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:00.608105 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.608175 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.608361 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.689821 12678 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:00.690622  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1319) took 1866 ms. Trace:
W20260709 12:27:00.690868 12438 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.404s	user 0.039s	sys 0.059s
I20260709 12:26:59.932055 12226 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:00.403203  9963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1307) took 2022 ms. Trace:
W20260709 12:27:00.656083  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.392345 10527 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:00.173743 12520 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.712919 12520 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:00.715066 12394 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.715672 12520 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:00.585181  9957 rpcz_store.cc:276] 0709 12:26:58.550533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.160041 (+609508us) service_pool.cc:224] Handling call
0709 12:26:59.169589 (+  9548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.200084 (+ 30495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:59.200111 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:59.200164 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:59.200194 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.502183 (+301989us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b54001d2c54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:26:59.502243 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.073037 (+570794us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69631360}
I20260709 12:27:00.715845 12394 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:00.716955  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:00.673254 12470 raft_consensus.cc:697] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:00.719473  9958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 434) took 1653 ms. Trace:
I20260709 12:27:00.720619 12470 consensus_queue.cc:237] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:00.673390 10533 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:00.674328 12652 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:00.675275 12488 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:00.675606 12522 raft_consensus.cc:697] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:00.729305 12522 consensus_queue.cc:237] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:00.729887 12617 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:00.676105 12336 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.342s	user 0.007s	sys 0.044s
I20260709 12:27:00.389101 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:00.678836  9961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 433) took 1612 ms. Trace:
I20260709 12:27:00.680621 12306 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:26:59.576341 12587 consensus_queue.cc:260] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:00.680599  9886 raft_consensus.cc:1240] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:00.681264 10532 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:00.378185 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:00.671886  9887 rpcz_store.cc:276] 0709 12:26:56.816570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.660344 (+3843774us) service_pool.cc:224] Handling call
0709 12:27:00.661132 (+   788us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.661556 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:00.661592 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:00.661665 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:00.661702 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.661757 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.661878 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.308681 12559 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:00.675421  9955 pending_rounds.cc:85] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 4
I20260709 12:27:00.075657 12529 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:00.694801  9811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2217) took 3458 ms. Trace:
I20260709 12:27:00.699541  9809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2236) took 2804 ms. Trace:
I20260709 12:27:00.752153  9815 raft_consensus.cc:1275] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:27:00.700383  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:00.753777  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:00.754303  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:00.702991  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 49072.8us
I20260709 12:27:00.755111 12438 raft_consensus.cc:3055] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:00.755554 12438 raft_consensus.cc:740] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:00.756937 12438 consensus_queue.cc:260] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:00.703771 12687 raft_consensus.cc:2764] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:27:00.703635  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:00.701897 12688 consensus_queue.cc:1059] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:27:00.704493 12539 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.334s	user 0.013s	sys 0.009s
I20260709 12:27:00.704368 12445 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.727209 12582 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:00.706398  9814 raft_consensus.cc:1240] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:27:00.706574  9956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1320) took 1786 ms. Trace:
W20260709 12:27:00.708189  9855 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.001s	sys 0.033s
I20260709 12:27:00.668008 12421 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:00.691071  9959 rpcz_store.cc:276] 0709 12:26:58.886179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.126423 (+1240244us) service_pool.cc:224] Handling call
0709 12:27:00.365411 (+238988us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.689380 (+323969us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:00.689444 (+    64us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:00.689500 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:00.689540 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.690180 (+   640us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b54001dd654. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:00.690227 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.690420 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":735444224}
I20260709 12:27:00.712134  9963 rpcz_store.cc:276] 0709 12:26:58.381001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.083632 (+702631us) service_pool.cc:224] Handling call
0709 12:26:59.122511 (+ 38879us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.122706 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:00.081651 (+958945us) log.cc:844] Serialized 14 byte log entry
0709 12:27:00.400855 (+319204us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:00.400903 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:00.400945 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.403031 (+  2086us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.403150 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129894,"prepare.queue_time_us":1130015,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":130080,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":1147021,"threads_started":2,"wal-append.queue_time_us":205624}
I20260709 12:27:00.720219  9958 rpcz_store.cc:276] 0709 12:26:59.066228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.173688 (+1107460us) service_pool.cc:224] Handling call
0709 12:27:00.174037 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.718734 (+544697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.719225 (+   491us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:00.695351  9964 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55952 (request call id 1322) took 1373 ms (client timeout 1615 ms). Trace:
I20260709 12:27:00.753008  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2247) took 1625 ms. Trace:
I20260709 12:27:00.249250 12549 consensus_queue.cc:260] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:00.775068  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1229) took 4144 ms. Trace:
I20260709 12:27:00.773613  9956 rpcz_store.cc:276] 0709 12:26:58.931519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.082601 (+1151082us) service_pool.cc:224] Handling call
0709 12:27:00.173247 (+ 90646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.634459 (+461212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.706219 (+ 71760us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b540014d7d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:00.706504 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":945628416}
W20260709 12:27:00.778118  9855 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.002s	sys 0.033s
I20260709 12:27:00.722848 12394 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:00.176275 12387 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.575s
I20260709 12:27:00.775614  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1235) took 3812 ms. Trace:
I20260709 12:27:00.771214  9955 pending_rounds.cc:107] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:27:00.783226  9955 raft_consensus.cc:2889] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:00.777139  9815 rpcz_store.cc:276] 0709 12:26:59.127717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.503849 (+376132us) service_pool.cc:224] Handling call
0709 12:26:59.504187 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.019951 (+515764us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b4c003a8b00. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8c7e8a20 00007f2f8c7f9a29 00007f2f8c7bf644 00007f2f8c7e6f2d 00007f2f8c7e6b93 00007f2f8e51718b 00007f2f8e517cb5 00007f2f8e512f30 00007f2f8e5147de 00007f2f8e51eb49 00007f2f8e51f416
0709 12:27:00.752648 (+732697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.752953 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95431424}
W20260709 12:27:00.771560  9779 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 2.201s (SENT) [suppressed 23 similar messages]
I20260709 12:27:00.751648  9811 rpcz_store.cc:276] 0709 12:26:57.236280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.581507 (+1345227us) service_pool.cc:224] Handling call
0709 12:26:58.581943 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.659433 (+2077490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.688334 (+ 28901us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b540036b854. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:00.694717 (+  6383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4775233792}
W20260709 12:27:00.777004  9964 rpcz_store.cc:269] 0709 12:26:59.297420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.394740 (+ 97320us) service_pool.cc:224] Handling call
0709 12:27:00.658091 (+1263351us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400413054. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:00.670586 (+ 12495us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2897335168}
I20260709 12:27:00.783023  9886 rpcz_store.cc:276] 0709 12:26:56.959187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.679636 (+3720449us) service_pool.cc:224] Handling call
0709 12:27:00.680183 (+   547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.750930 (+ 70747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.771924 (+ 20994us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:00.784032  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 47824.7us
I20260709 12:27:00.780690  9884 rpcz_store.cc:276] 0709 12:26:56.627183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.114909 (+3487726us) service_pool.cc:224] Handling call
0709 12:27:00.115276 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.683209 (+567933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.733702 (+ 50493us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b54001e3054. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:00.771248 (+ 37546us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1260490112}
I20260709 12:27:00.739619  9961 rpcz_store.cc:276] 0709 12:26:59.065973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.111606 (+1045633us) service_pool.cc:224] Handling call
0709 12:27:00.236696 (+125090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.236993 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:00.355382 (+118389us) log.cc:844] Serialized 14 byte log entry
0709 12:27:00.677940 (+322558us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:00.678059 (+   119us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:00.678162 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.678253 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.678588 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35135,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":31,"raft.queue_time_us":1557,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":303,"thread_start_us":385168,"threads_started":2,"wal-append.queue_time_us":106007}
I20260709 12:26:59.826197 12537 consensus_queue.cc:260] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:00.701934 12533 consensus_queue.cc:1048] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 12:27:00.800773  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2245) took 1738 ms. Trace:
I20260709 12:27:00.799841  9962 raft_consensus.cc:2393] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 6: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:27:00.796180  9853 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.011s	sys 0.005s
W20260709 12:27:00.801550  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 199750us
I20260709 12:27:00.801188  9814 rpcz_store.cc:276] 0709 12:26:59.062253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.456781 (+394528us) service_pool.cc:224] Handling call
0709 12:26:59.457213 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:00.790289 (+1333076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.799284 (+  8995us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540037e1d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:00.800704 (+  1420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2608492928}
I20260709 12:27:00.803304  9886 raft_consensus.cc:1240] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
W20260709 12:27:00.803900  9928 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.000s	sys 0.016s
W20260709 12:27:00.804330  9928 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.000s	sys 0.016s
I20260709 12:26:59.795552 12413 consensus_queue.cc:260] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:00.449385 12516 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:00.803066  9881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1230) took 4131 ms. Trace:
I20260709 12:27:00.804239  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 545) took 2911 ms. Trace:
W20260709 12:27:00.806146  9853 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.011s	sys 0.006s
I20260709 12:27:00.797603 12445 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:00.808750  9884 raft_consensus.cc:1275] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:00.808490 12559 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:00.813866  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.814478 12488 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:00.815248  9883 raft_consensus.cc:1275] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:00.819790  9886 rpcz_store.cc:276] 0709 12:26:57.893031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.800646 (+2907615us) service_pool.cc:224] Handling call
0709 12:27:00.802908 (+  2262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.803888 (+   980us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.804131 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.752413  9809 rpcz_store.cc:276] 0709 12:26:57.895374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.244576 (+1349202us) service_pool.cc:224] Handling call
0709 12:26:59.244997 (+   421us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:59.245452 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:59.245492 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:59.246254 (+   762us) log.cc:844] Serialized 52 byte log entry
0709 12:27:00.602352 (+1356098us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:00.602491 (+   139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.602663 (+   172us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:00.699221 (+ 96558us) raft_consensus.cc:1685] finished
0709 12:27:00.699238 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.699372 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23947,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":132,"thread_start_us":498264,"threads_started":1,"wal-append.queue_time_us":920466}
I20260709 12:27:00.825299  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1242) took 3161 ms. Trace:
I20260709 12:27:00.829253  9884 rpcz_store.cc:276] 0709 12:26:57.658188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.805473 (+3147285us) service_pool.cc:224] Handling call
0709 12:27:00.808337 (+  2864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.819699 (+ 11362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.819877 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.831357  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 548) took 2899 ms. Trace:
I20260709 12:27:00.831614 12445 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:00.831679  9884 rpcz_store.cc:276] 0709 12:26:57.932618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.830295 (+2897677us) service_pool.cc:224] Handling call
0709 12:27:00.830707 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.831041 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:00.831071 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:00.831109 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:00.831135 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.831198 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.831306 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.833511  9884 raft_consensus.cc:1240] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:00.834326  9887 raft_consensus.cc:1240] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:00.840759  9887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1239) took 3190 ms. Trace:
I20260709 12:27:00.841048  9887 rpcz_store.cc:276] 0709 12:26:57.650509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.804898 (+3154389us) service_pool.cc:224] Handling call
0709 12:27:00.834122 (+ 29224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.840523 (+  6401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.840712 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.842535  9887 raft_consensus.cc:1275] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:27:00.843029  9887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1246) took 2747 ms. Trace:
I20260709 12:27:00.843348  9887 rpcz_store.cc:276] 0709 12:26:58.096014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.841757 (+2745743us) service_pool.cc:224] Handling call
0709 12:27:00.842127 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.842843 (+   716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.842982 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.844673  9887 raft_consensus.cc:1240] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:00.845239  9887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1247) took 2749 ms. Trace:
I20260709 12:27:00.845323 12690 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:27:00.845606  9887 rpcz_store.cc:276] 0709 12:26:58.096272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.844077 (+2747805us) service_pool.cc:224] Handling call
0709 12:27:00.844434 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.845007 (+   573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.845185 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.827561 12520 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.846872 12520 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:00.835692  9959 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:27:00.836089 12688 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.836812 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:00.838781  9955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1311) took 2199 ms. Trace:
I20260709 12:27:00.847864  9959 pending_rounds.cc:85] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 3
I20260709 12:27:00.838935 12488 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:00.839452  9960 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:00.839993  9883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2122) took 3440 ms. Trace:
I20260709 12:27:00.805292 12438 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:00.826558  9956 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:27:00.876214  9959 pending_rounds.cc:107] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:27:00.876967  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1243) took 2781 ms. Trace:
I20260709 12:27:00.881578  9959 raft_consensus.cc:2889] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:00.875665  9955 rpcz_store.cc:276] 0709 12:26:58.639729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.062526 (+1422797us) service_pool.cc:224] Handling call
0709 12:27:00.174749 (+112223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.838461 (+663712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.838729 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:00.879105  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:00.878990  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.881852  9884 rpcz_store.cc:276] 0709 12:26:58.095216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.832844 (+2737628us) service_pool.cc:224] Handling call
0709 12:27:00.833262 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.874827 (+ 41565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.876902 (+  2075us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.816301  9881 rpcz_store.cc:276] 0709 12:26:56.627513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.610201 (+3982688us) service_pool.cc:224] Handling call
0709 12:27:00.706922 (+ 96721us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:00.707469 (+   547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:00.707509 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:00.708102 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 12:27:00.758197 (+ 50095us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:00.758242 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.758334 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:00.758380 (+    46us) raft_consensus.cc:1685] finished
0709 12:27:00.758395 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.758508 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":728,"raft.queue_time_us":32682,"raft.run_cpu_time_us":417,"raft.run_wall_time_us":62268,"thread_start_us":49687,"threads_started":1,"wal-append.queue_time_us":46965}
W20260709 12:27:00.878065  9856 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.025s	sys 0.038s
I20260709 12:27:00.878741  9883 rpcz_store.cc:276] 0709 12:26:57.399530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.806062 (+3406532us) service_pool.cc:224] Handling call
0709 12:27:00.814755 (+  8693us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.828029 (+ 13274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.839927 (+ 11898us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.881161  9956 pending_rounds.cc:85] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 5
I20260709 12:27:00.911968 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:00.876456  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 773574us
I20260709 12:27:00.885486 10532 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:27:00.925280  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1323) took 1590 ms. Trace:
I20260709 12:27:00.925810  9959 rpcz_store.cc:276] 0709 12:26:59.332662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.799082 (+1466420us) service_pool.cc:224] Handling call
0709 12:27:00.825082 (+ 26000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.923200 (+ 98118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.923441 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.927791  9956 pending_rounds.cc:107] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:27:00.928964  9956 raft_consensus.cc:2889] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:00.874589 12549 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:00.934779 12567 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:00.935322 10530 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:27:00.935551 12567 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:00.936676 12587 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:00.934664  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 1.61104e+06us
W20260709 12:27:00.929824  9856 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.025s	sys 0.043s
I20260709 12:27:00.937997 12567 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:00.945312  9885 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
W20260709 12:27:00.950820  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 228658us
I20260709 12:27:00.958789  9957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 435) took 1890 ms. Trace:
W20260709 12:27:00.960249 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.921835 12687 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:00.951413  9778 connection.cc:256] RPC call timeout handler was delayed by -1.1596809520001443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
I20260709 12:27:00.965952 10531 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
W20260709 12:27:00.973305 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.959208  9957 rpcz_store.cc:276] 0709 12:26:59.068675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.718194 (+1649519us) service_pool.cc:224] Handling call
0709 12:27:00.718697 (+   503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.719114 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:00.742326 (+ 23212us) log.cc:844] Serialized 14 byte log entry
0709 12:27:00.944450 (+202124us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:00.944502 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:00.958530 (+ 14028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.958596 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.958732 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15877,"prepare.queue_time_us":19157,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":31639,"thread_start_us":119205,"threads_started":1}
I20260709 12:27:00.976020  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:00.976465  9881 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:00.977097  9881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 556) took 1967 ms. Trace:
I20260709 12:27:00.977486  9881 rpcz_store.cc:276] 0709 12:26:59.010144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.914458 (+1904314us) service_pool.cc:224] Handling call
0709 12:27:00.952234 (+ 37776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.976832 (+ 24598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.977041 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.980195 12651 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.980386  9807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2249) took 1812 ms. Trace:
I20260709 12:27:00.970216  9956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 436) took 1901 ms. Trace:
I20260709 12:27:00.984947  9956 rpcz_store.cc:276] 0709 12:26:59.068916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.783471 (+1714555us) service_pool.cc:224] Handling call
0709 12:27:00.805200 (+ 21729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.966926 (+161726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.970060 (+  3134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:00.980933  9807 rpcz_store.cc:276] 0709 12:26:59.168077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.541954 (+373877us) service_pool.cc:224] Handling call
0709 12:26:59.672242 (+130288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:00.573985 (+901743us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:00.574087 (+   102us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:00.575674 (+  1587us) log.cc:844] Serialized 26 byte log entry
0709 12:27:00.781928 (+206254us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:27:00.782092 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.802460 (+ 20368us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:00.979957 (+177497us) raft_consensus.cc:1685] finished
0709 12:27:00.979985 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.980183 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126669,"raft.queue_time_us":950570,"raft.run_cpu_time_us":398,"raft.run_wall_time_us":13591,"thread_start_us":205531,"threads_started":1,"wal-append.queue_time_us":229788}
W20260709 12:27:01.025108  9885 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54428 (request call id 557) took 1718 ms (client timeout 2248 ms). Trace:
I20260709 12:27:00.932574 12688 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:01.027006  9885 rpcz_store.cc:269] 0709 12:26:59.251750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.506983 (+255233us) service_pool.cc:224] Handling call
0709 12:27:00.954518 (+1447535us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:01.030179  9887 raft_consensus.cc:1240] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:00.962301 12522 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.027674  9882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 542) took 4192 ms. Trace:
I20260709 12:27:00.934208 12529 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.030881  9887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 551) took 2851 ms. Trace:
I20260709 12:27:01.035163  9887 rpcz_store.cc:276] 0709 12:26:58.179424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.876467 (+2697043us) service_pool.cc:224] Handling call
0709 12:27:00.964875 (+ 88408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.030642 (+ 65767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.030828 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:01.036372  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:01.037184  9809 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:01.037611 12652 raft_consensus.cc:3055] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:01.038371  9889 raft_consensus.cc:1240] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:01.040968  9889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 543) took 3700 ms. Trace:
I20260709 12:27:01.041375  9889 rpcz_store.cc:276] 0709 12:26:57.340621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.699084 (+3358463us) service_pool.cc:224] Handling call
0709 12:27:00.699478 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.038911 (+339433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.040726 (+  1815us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b54001e2b54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:01.040908 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":500335488}
I20260709 12:27:01.043352  9888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2114) took 3711 ms. Trace:
I20260709 12:27:01.043789  9888 rpcz_store.cc:276] 0709 12:26:57.316412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.683790 (+3367378us) service_pool.cc:224] Handling call
0709 12:27:00.684342 (+   552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.684785 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:27:00.922438 (+237653us) log.cc:844] Serialized 14 byte log entry
0709 12:27:01.025944 (+103506us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:01.025999 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:01.026047 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.026112 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:01.028135 (+  2023us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41493,"raft.queue_time_us":45344,"thread_start_us":292789,"threads_started":2}
W20260709 12:27:01.048956  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.049856  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:01.051216  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:01.051941  9957 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:01.054750  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:01.055473  9807 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:27:01.059335 12691 raft_consensus.cc:3055] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:01.059837 12691 raft_consensus.cc:740] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:01.060050 12688 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:01.061098 12691 consensus_queue.cc:260] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.077468  9881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 558) took 1825 ms. Trace:
I20260709 12:27:01.078423 12687 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.079425 12520 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:01.080116 10496 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:01.080943 12687 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:01.083441  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:01.084365 12226 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.085004 12226 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.086560 12633 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.087234 12633 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.087723  9890 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:01.089579 12633 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:01.089881  9957 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:01.082032 12522 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.077931  9881 rpcz_store.cc:276] 0709 12:26:59.252099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.987529 (+1735430us) service_pool.cc:224] Handling call
0709 12:27:01.076705 (+ 89176us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.077135 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:01.077162 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:01.077208 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:01.077237 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.077294 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:01.077412 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2893}
I20260709 12:27:01.071497  9779 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:01.032163  9882 rpcz_store.cc:276] 0709 12:26:56.833460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.661353 (+3827893us) service_pool.cc:224] Handling call
0709 12:27:00.661873 (+   520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.662427 (+   554us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:00.915065 (+252638us) log.cc:844] Serialized 14 byte log entry
0709 12:27:00.993618 (+ 78553us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:00.993702 (+    84us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:01.025524 (+ 31822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.025591 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:01.025730 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23923,"thread_start_us":232291,"threads_started":2}
W20260709 12:27:01.094872  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 67772.1us
W20260709 12:27:01.095554  9778 connection.cc:256] RPC call timeout handler was delayed by -1.0552809519999755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
W20260709 12:27:01.096866  9778 connection.cc:256] RPC call timeout handler was delayed by -1.0129809519999071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
W20260709 12:27:01.094226  9853 connection.cc:256] RPC call timeout handler was delayed by -2.1877128690002792s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
W20260709 12:27:01.097818  9778 connection.cc:256] RPC call timeout handler was delayed by -1.0084809519998998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
I20260709 12:27:01.098830  9814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:27:01.099485 12403 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:01.123164 12306 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:01.133708 12403 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.102631  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:01.103247  9889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1254) took 1688 ms. Trace:
I20260709 12:27:01.135823  9882 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:27:01.135680  9889 rpcz_store.cc:276] 0709 12:26:59.414521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.063348 (+1648827us) service_pool.cc:224] Handling call
0709 12:27:01.102663 (+ 39315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.102901 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:01.102930 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:01.102969 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:01.102997 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.103071 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:01.103177 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:01.103469 12691 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:01.106686  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:01.107199 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:01.038053 12652 raft_consensus.cc:740] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:01.107858 12632 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:00.980943 12651 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.108296  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:01.108834  9958 raft_consensus.cc:1275] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:27:01.142534  9958 pending_rounds.cc:85] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 3
I20260709 12:27:01.142328  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:01.142794  9958 pending_rounds.cc:107] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 5.4
W20260709 12:27:01.109517  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 84902.5us
I20260709 12:27:01.110603  9884 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:01.111392 12529 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:01.111792 12592 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:01.112210  9813 raft_consensus.cc:1275] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:01.034193 12701 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.116927 12673 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.117755  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:01.082011 10496 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:01.142963  9814 raft_consensus.cc:606] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:01.130069  9809 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:01.131250  9807 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:01.129884  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:01.138706  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 55364.3us
I20260709 12:27:01.143115  9958 raft_consensus.cc:2889] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:01.155416  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 553) took 2244 ms. Trace:
I20260709 12:27:01.164558  9884 rpcz_store.cc:276] 0709 12:26:58.911137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.917677 (+2006540us) service_pool.cc:224] Handling call
0709 12:27:00.987097 (+ 69420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.143672 (+156575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.155343 (+ 11671us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:01.141772  9883 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:27:01.156399  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.127457 12633 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.165402  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 431) took 2309 ms. Trace:
I20260709 12:27:01.187033 10530 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:01.187566  9884 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:01.189469  9884 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:01.190356  9814 raft_consensus.cc:614] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:01.190634  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:01.191493  9888 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:01.191592  9779 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:01.191781 12403 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:01.192708 12673 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.194691  9928 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:27:01.196873  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.165711  9883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1252) took 2041 ms. Trace:
W20260709 12:27:01.191028 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.198050  9883 rpcz_store.cc:276] 0709 12:26:59.123975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.930181 (+1806206us) service_pool.cc:224] Handling call
0709 12:27:01.074517 (+144336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.165458 (+ 90941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.165660 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:01.195057 12673 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:01.195403  9885 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:27:01.133711 12306 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:01.184237 12592 raft_consensus.cc:697] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:01.214433 12533 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:01.220758  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.223158 12306 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:01.216159  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.233724  9882 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:27:01.223402 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 141537us
I20260709 12:27:01.184969  9810 rpcz_store.cc:276] 0709 12:26:58.666617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.404305 (+737688us) service_pool.cc:224] Handling call
0709 12:27:00.721171 (+1316866us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.721758 (+   587us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:00.754453 (+ 32695us) log.cc:844] Serialized 14 byte log entry
0709 12:27:00.965673 (+211220us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:00.965719 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:00.971858 (+  6139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.971950 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.975876 (+  3926us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32239,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":64,"raft.queue_time_us":12987,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"spinlock_wait_cycles":81664,"thread_start_us":212763,"threads_started":2}
W20260709 12:27:01.238209  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 132102us
W20260709 12:27:01.216099  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 56042.6us
W20260709 12:27:01.241278  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.241164 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:01.235873  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 108034us
I20260709 12:27:01.253756  9886 raft_consensus.cc:1240] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:01.255110 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:27:01.257519  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.258000 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:01.239348 12559 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:01.259893  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2125) took 2804 ms. Trace:
I20260709 12:27:01.260259  9886 rpcz_store.cc:276] 0709 12:26:58.455161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.185869 (+2730708us) service_pool.cc:224] Handling call
0709 12:27:01.236691 (+ 50822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.259645 (+ 22954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.259826 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:01.258857 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:01.166306 12701 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.263965 12550 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:01.264353 12673 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:01.265115 12652 consensus_queue.cc:260] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.269747 12522 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:01.264232  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 69698.9us
I20260709 12:27:01.273799 12710 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.281185 12711 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.299875  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:01.299760 12711 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:01.300545  9810 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:01.281437  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:01.280762  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.282636 12567 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.308830 12567 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.311501 12651 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:01.282269  9853 connection.cc:256] RPC call timeout handler was delayed by -2.0302128690004793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23940000000000003s for a response
W20260709 12:27:01.313483  9853 connection.cc:256] RPC call timeout handler was delayed by -1.8484128690001853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2596s for a response
W20260709 12:27:01.285750  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.313388  9710 catalog_manager.cc:5697] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 2 to 5, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 5 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
W20260709 12:27:01.314813  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.316141  9710 catalog_manager.cc:5697] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 3 to 4, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 4 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:01.251657 12582 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:01.318611 12582 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.320725 12582 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:01.252751 12529 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:01.292366 12445 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.321308 12529 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.321768 12529 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:01.321523 12445 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:01.322151  9713 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59986 (request call id 331) took 20315 ms (client timeout 15000 ms). Trace:
I20260709 12:27:01.323873 12445 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:01.326874  9928 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:01.328680 10497 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:01.329576  9928 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:01.243891 12633 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.305289 12711 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:01.350710 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:01.350752 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:01.351529 10532 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:27:01.306847 12226 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:01.352285 12633 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:01.307852 12559 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:01.313580  9890 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54428 (request call id 549) took 3166 ms (client timeout 2638 ms). Trace:
I20260709 12:27:01.330716 12387 consensus_queue.cc:1059] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:27:01.331897  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:01.353688  9890 rpcz_store.cc:269] 0709 12:26:58.146868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.911128 (+764260us) service_pool.cc:224] Handling call
0709 12:27:01.313350 (+2402222us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b5400328554. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:01.313494 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4765708672}
I20260709 12:27:01.354997 12387 raft_consensus.cc:3055] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:01.355195  9958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1325) took 2021 ms. Trace:
I20260709 12:27:01.355396 12387 raft_consensus.cc:740] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:01.355647  9958 rpcz_store.cc:276] 0709 12:26:59.333620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.800896 (+1467276us) service_pool.cc:224] Handling call
0709 12:27:00.815631 (+ 14735us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.223178 (+407547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.354954 (+131776us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b5400115654. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:01.355131 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673204992}
W20260709 12:27:01.356822 12704 log.cc:927] Time spent T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.314s	user 0.003s	sys 0.002s
I20260709 12:27:01.356482 12387 consensus_queue.cc:260] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.358496 12387 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:01.358749  9960 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55952 (request call id 1324) took 2025 ms (client timeout 1893 ms). Trace:
W20260709 12:27:01.359174  9960 rpcz_store.cc:269] 0709 12:26:59.333205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.417340 (+ 84135us) service_pool.cc:224] Handling call
0709 12:27:01.358542 (+1941202us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54000b3bd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:01.358675 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347538816}
W20260709 12:27:01.360103  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.331749 12692 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:27:01.363498  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.364702 12652 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:01.365437 12226 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:01.367175  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:01.368160  9809 raft_consensus.cc:2393] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 6: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:01.368755 12559 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:27:01.369467 12699 log.cc:927] Time spent T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.337s	user 0.004s	sys 0.000s
I20260709 12:27:01.371625 12549 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:01.373550 12403 consensus_queue.cc:1048] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:27:01.322624  9713 rpcz_store.cc:269] 0709 12:26:41.006954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.007262 (+   308us) service_pool.cc:224] Handling call
0709 12:27:01.321898 (+20314636us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:54.781002 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:54.973268 (+192266us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:54.973333 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:26:54.973360 (+    27us) tablet.cc:662] Decoding operations
0709 12:26:55.259192 (+285832us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:55.259299 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:55.259339 (+    40us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:26:55.260867 (+  1528us) tablet.cc:701] Row locks acquired
0709 12:26:55.260926 (+    59us) write_op.cc:260] PREPARE: finished
0709 12:26:55.261139 (+   213us) write_op.cc:270] Start()
0709 12:26:55.261315 (+   176us) write_op.cc:276] Timestamp: P: 1783600015261068 usec, L: 0
0709 12:26:55.261347 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:26:55.262190 (+   843us) log.cc:844] Serialized 5115 byte log entry
0709 12:26:56.930368 (+1668178us) op_driver.cc:464] REPLICATION: finished
0709 12:26:57.615900 (+685532us) write_op.cc:301] APPLY: starting
0709 12:26:57.615985 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:57.616353 (+   368us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:57.616482 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:57.617980 (+  1498us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:57.631507 (+ 13527us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:26:57.647345 (+ 15838us) write_op.cc:312] APPLY: finished
0709 12:26:57.720329 (+ 72984us) log.cc:844] Serialized 95 byte log entry
0709 12:26:57.724566 (+  4237us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:57.724789 (+   223us) write_op.cc:454] Released schema lock
0709 12:26:57.724853 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:57.728187 (+  3334us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:57.728222 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2215859,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":685260,"apply.run_cpu_time_us":4215,"apply.run_wall_time_us":112215,"num_ops":13,"prepare.queue_time_us":422761,"prepare.run_cpu_time_us":222230,"prepare.run_wall_time_us":803501,"raft.queue_time_us":208687,"raft.run_cpu_time_us":69978,"raft.run_wall_time_us":716823,"replication_time_us":1668809,"thread_start_us":1278083,"threads_started":4,"wal-append.queue_time_us":472902,"wal-append.run_cpu_time_us":11089,"wal-append.run_wall_time_us":3002948}]]}
I20260709 12:27:01.332367 12632 consensus_queue.cc:1059] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:01.332574 12336 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:01.279582 12550 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:01.311654 12567 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:01.331779 12587 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:01.382269 12587 raft_consensus.cc:697] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:01.383351 12587 consensus_queue.cc:237] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:01.281883 12687 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:27:01.386493 12692 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:01.388029 12692 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:01.250394 12533 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:01.389300 12692 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:27:01.298731  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 47134.8us
I20260709 12:27:01.336282 12516 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:01.390393 12336 raft_consensus.cc:697] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:01.339236 12710 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:01.390997 12438 raft_consensus.cc:3055] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:01.391526 12438 raft_consensus.cc:740] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:01.391695 12336 consensus_queue.cc:237] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.392729 12438 consensus_queue.cc:260] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.393193 12527 consensus_queue.cc:1048] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:01.390359 12533 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:01.392752 12710 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:01.395665  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:01.396057 12527 consensus_queue.cc:1059] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:01.397352 12539 raft_consensus.cc:3055] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:01.397859 12539 raft_consensus.cc:740] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:27:01.314194  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.342247 12701 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:01.344307 12537 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:01.398662  9853 connection.cc:256] RPC call timeout handler was delayed by -1.4191128690004007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3073s for a response
I20260709 12:27:01.399061 12539 consensus_queue.cc:260] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:01.399850  9853 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:01.401042 12539 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:01.401522  9853 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:01.347582 12651 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.350023 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:01.402712 12533 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.354017 12413 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:01.403246 12533 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.406872 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:01.406642 12651 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.408557 12533 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:01.338559 12592 consensus_queue.cc:237] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:01.409147 12533 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:01.338419 12673 raft_consensus.cc:697] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:01.410355 12673 consensus_queue.cc:237] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:01.381407 12550 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:01.380450 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 133866us
I20260709 12:27:01.332278  9710 catalog_manager.cc:5697] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 2 to 3, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 3 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
W20260709 12:27:01.412757  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 154245us
I20260709 12:27:01.414593  9889 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:01.379940  9810 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:01.426676  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:01.427264  9882 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:27:01.422452 12438 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:01.454985  9810 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:27:01.426142 12701 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:01.462841  9814 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:01.465746  9886 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:01.466218 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:01.462201  9779 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:01.463891  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:01.468386  9887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 559) took 2216 ms. Trace:
I20260709 12:27:01.469908  9927 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:01.467245  9888 pending_rounds.cc:85] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 7
I20260709 12:27:01.500337  9888 pending_rounds.cc:107] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:27:01.500982  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:01.501616  9882 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:01.459726 12701 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:01.503415  9888 raft_consensus.cc:2889] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:01.504932 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:01.470502  9887 rpcz_store.cc:276] 0709 12:26:59.252399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.065673 (+1813274us) service_pool.cc:224] Handling call
0709 12:27:01.129653 (+ 63980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.155817 (+ 26164us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:01.234972 (+ 79155us) log.cc:844] Serialized 14 byte log entry
0709 12:27:01.467982 (+233010us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:01.468044 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:01.468101 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.468190 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:01.468323 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5883,"prepare.queue_time_us":36880,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":6079,"thread_start_us":247630,"threads_started":2}
W20260709 12:27:01.507774  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 57291.1us
I20260709 12:27:01.465505 12651 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:01.457676 12529 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:01.510150  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:01.511194  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 48161.7us
W20260709 12:27:01.512297 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.523005 10530 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:01.508067 12701 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:01.527302  9854 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:01.470073 12710 consensus_queue.cc:1048] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:27:01.513779 12559 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:01.541397 12712 log.cc:927] Time spent T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:27:01.542006 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:01.542869 10530 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:01.535856  9779 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:01.548895  9853 leader_election.cc:400] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
I20260709 12:27:01.549232  9853 leader_election.cc:403] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:27:01.512532 12690 consensus_queue.cc:1048] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:27:01.548636 12533 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:01.552708  9927 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:01.533951 12470 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:27:01.554962 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 123620us
I20260709 12:27:01.557679  9887 raft_consensus.cc:1240] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 6. Current term is 7. Ops: []
W20260709 12:27:01.557073  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.546051 12691 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:01.571254  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 57633.5us
I20260709 12:27:01.551117 12421 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.567873 12651 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
W20260709 12:27:01.579424  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 44532.4us
I20260709 12:27:01.566444 12533 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.580333  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:01.568383 12470 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:01.585287  9887 raft_consensus.cc:2376] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b011791796d1457284b857d7d3422195 in term 3. Re-sending same reply.
I20260709 12:27:01.602505  9808 raft_consensus.cc:1275] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:01.607373 12643 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:01.607997 12643 raft_consensus.cc:697] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:01.609017 12643 consensus_queue.cc:237] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:01.613500 12717 log.cc:927] Time spent T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:27:01.607450  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:01.620456  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:01.570431 12549 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.606526 12470 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:01.585981  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:01.579715 12529 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:01.585304 12445 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:01.586313 12533 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:01.642791  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:01.643456  9887 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:01.654425 10496 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:01.584055 12413 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.619807 12306 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.656870  9815 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:01.600116 12537 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:01.579828 12691 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:01.659382  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 69300.8us
I20260709 12:27:01.664011 10530 raft_consensus.cc:1240] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:01.584381 12421 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:01.672154 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.631850 12549 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:01.688102 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.658741 12527 consensus_queue.cc:1048] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:27:01.663383 12445 raft_consensus.cc:697] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:01.667366 12537 raft_consensus.cc:697] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:01.700788 12522 consensus_queue.cc:1048] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:01.689314  9964 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:01.682698 12336 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:01.661494 12413 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.685953 12488 consensus_queue.cc:1059] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 12:27:01.704257 12722 log.cc:927] Time spent T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:27:01.722750  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 95134.1us
W20260709 12:27:01.725555  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.731158 10530 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:27:01.729075  9853 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:01.735402  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:01.738245 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 155713us
W20260709 12:27:01.754990  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.736687 12336 raft_consensus.cc:697] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:27:01.762676  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 63333.3us
I20260709 12:27:01.760205 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:01.731974 12582 consensus_queue.cc:1059] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
W20260709 12:27:01.784010  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 100072us
I20260709 12:27:01.796037 12306 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:01.796505 12721 log.cc:927] Time spent T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:27:01.796754 12719 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:01.797539  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.788101 12445 consensus_queue.cc:237] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:01.800226 12724 log.cc:927] Time spent T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:27:01.801365 12729 log.cc:927] Time spent T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:27:01.801528  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:01.802142 12413 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:01.805051  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.806355 12549 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:01.807310  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 64221.7us
I20260709 12:27:01.808130  9778 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:01.802217  9883 raft_consensus.cc:2376] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b011791796d1457284b857d7d3422195 in term 3. Re-sending same reply.
I20260709 12:27:01.808687 12522 consensus_queue.cc:1059] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:01.809357  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:01.796164 12723 log.cc:927] Time spent T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:27:01.809993  9883 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:01.824209 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:01.826519  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:01.788769 12550 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.844071 12550 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:01.850103 12550 raft_consensus.cc:2764] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:27:01.851102  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:01.854010 12550 raft_consensus.cc:3055] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:01.857072 12550 raft_consensus.cc:740] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:01.858266 12550 consensus_queue.cc:260] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:01.783367 12592 consensus_queue.cc:1048] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:27:01.863508 12336 consensus_queue.cc:237] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.816546 12470 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:01.866573 12470 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:01.867465 12539 raft_consensus.cc:3055] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:01.867864 12539 raft_consensus.cc:740] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:01.868248  9813 raft_consensus.cc:1240] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:01.868726 12539 consensus_queue.cc:260] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.870003 12539 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:01.794718 12537 consensus_queue.cc:237] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:01.896327  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:01.856942 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:01.896597 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:01.899075 10532 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:01.900945  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:01.894547  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:01.907419  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 97346.1us
W20260709 12:27:01.875598  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.911949  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:01.909243  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 118615us
I20260709 12:27:01.909618  9958 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:01.910303  9960 raft_consensus.cc:1240] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:01.926788  9964 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:01.929759  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:01.931854 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:01.932824  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:01.873647 12691 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:01.942499  9955 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:01.943398  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:01.944024  9964 raft_consensus.cc:2410] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:27:01.950935 10532 raft_consensus.cc:1240] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: []
W20260709 12:27:01.955894 12438 consensus_meta.cc:287] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.000s
I20260709 12:27:01.958999  9881 raft_consensus.cc:1240] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:01.960338  9881 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 12:27:01.960800  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.962756 12488 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.963374 12488 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.964900 12421 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:01.913324 12559 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:01.966185 12488 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:01.967015 12728 log.cc:927] Time spent T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.179s	user 0.002s	sys 0.001s
W20260709 12:27:01.969820 12740 log.cc:927] Time spent T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:27:01.970531  9778 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:01.973821 12736 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:01.974514 12736 consensus_queue.cc:1059] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:01.975539 12736 consensus_queue.cc:1059] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:01.975968 12533 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.976608 12736 raft_consensus.cc:3055] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:01.976955 12736 raft_consensus.cc:740] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:01.978785  9959 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:01.978873 12736 consensus_queue.cc:260] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.980088 12736 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:01.928747 12470 consensus_queue.cc:1059] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:27:01.945438  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:01.983527 12470 raft_consensus.cc:3055] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:01.983889 12470 raft_consensus.cc:740] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:01.984696 12470 consensus_queue.cc:260] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:01.984016  9956 raft_consensus.cc:2410] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:27:01.985867 12470 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:01.990072  9887 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:01.965858 12701 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:01.996600 12226 consensus_queue.cc:1059] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:27:01.978125 12533 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:02.011230  9964 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 12:27:02.001456 12721 log.cc:927] Time spent T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:27:02.016217  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:02.023267  9887 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
W20260709 12:27:02.042393  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.047808  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:02.048708  9812 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:02.054806  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:02.062638  9854 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:02.064607 12719 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:02.065127 12719 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.065531 12719 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:02.066471 12742 log.cc:927] Time spent T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.192s	user 0.000s	sys 0.003s
I20260709 12:27:02.071342 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:02.072244 12550 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:02.074671 10532 raft_consensus.cc:1240] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:02.075676  9778 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:02.077587  9956 raft_consensus.cc:3055] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:02.077953  9956 raft_consensus.cc:740] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:02.022821 12678 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
W20260709 12:27:02.082355  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:02.084378 12732 log.cc:927] Time spent T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:27:02.098812 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.079051 12744 raft_consensus.cc:3055] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:27:02.103152 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 160654us
W20260709 12:27:02.106992  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 90938.3us
I20260709 12:27:02.112979  9887 raft_consensus.cc:1275] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:27:02.113622 12735 log.cc:927] Time spent T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:27:02.113003 12445 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:27:02.117789 12445 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:02.107674  9779 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:02.108436  9956 consensus_queue.cc:260] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:02.129009 10530 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:27:02.106225 12744 raft_consensus.cc:740] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:27:02.154505  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 210133us
W20260709 12:27:02.134867 12734 log.cc:927] Time spent T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
I20260709 12:27:02.156013  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:02.129798 12445 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:02.201495 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:02.208779 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 50574.4us
I20260709 12:27:02.200917  9956 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:02.202708  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:02.203023  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 185252us
I20260709 12:27:02.221822  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:02.138363 12763 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:27:02.214994 12445 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:02.230093 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 242711us
I20260709 12:27:02.233135 10497 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:02.238489 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:02.225972 12539 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:02.243041  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:02.243777  9887 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 5: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
W20260709 12:27:02.251024 12727 log.cc:927] Time spent T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.618s	user 0.004s	sys 0.000s
I20260709 12:27:02.252614 12691 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:02.252795  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 566) took 1092 ms. Trace:
I20260709 12:27:02.252902 12533 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:02.253252 12691 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:02.253679 12533 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:02.253526  9884 rpcz_store.cc:276] 0709 12:27:01.160793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.190189 (+ 29396us) service_pool.cc:224] Handling call
0709 12:27:01.233298 (+ 43109us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:01.453645 (+220347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:01.453692 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:01.499532 (+ 45840us) log.cc:844] Serialized 26 byte log entry
0709 12:27:01.548850 (+ 49318us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:01.577785 (+ 28935us) log.cc:844] Serialized 14 byte log entry
0709 12:27:01.581097 (+  3312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.581170 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:01.612647 (+ 31477us) spinlock_profiling.cc:243] Waited 9.24 ms on lock 0x7b48000030d8. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f93445aa1 00007f2f9343cb37 00007f2f9343c9ca 00007f2f9353426f 00007f2f93533f37 00007f2f9354855c 00007f2f93548508 00007f2f93548488 00007f2f93548443 00007f2f935476ec 00007f2f92471a96
0709 12:27:01.808736 (+196089us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b18003e1520. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b3a9c0a 00007f2f94ae9219 00007f2f923f058f 00007f2f8b42f571 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd
0709 12:27:02.250365 (+441629us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:02.252554 (+  2189us) raft_consensus.cc:1685] finished
0709 12:27:02.252577 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.252717 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37819,"prepare.queue_time_us":23192,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":78743,"raft.run_cpu_time_us":875,"raft.run_wall_time_us":27111,"spinlock_wait_cycles":93223424,"thread_start_us":137253,"threads_started":2,"wal-append.queue_time_us":109664}
I20260709 12:27:02.255357 12691 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:02.255774 12533 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:02.220311 12559 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:27:02.231920 12445 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:02.229809 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:02.229677 12592 consensus_queue.cc:1048] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:27:02.266359 12744 consensus_queue.cc:260] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:02.264340  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 123173us
I20260709 12:27:02.241531 12632 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:27:02.287034  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:02.288031  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.288520 12765 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:02.289186 12765 raft_consensus.cc:697] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:02.289629 12744 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:02.290297 12765 consensus_queue.cc:237] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:02.293432  9927 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:02.300577  9887 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:02.302410  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:02.265971 12719 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:02.308475 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 79032.2us
I20260709 12:27:02.309494  9887 raft_consensus.cc:1275] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:27:02.311117  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.311970  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:02.295038 12701 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:02.283493 12539 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:02.333329 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:02.305987 12516 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.331485  9887 raft_consensus.cc:1275] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:27:02.334652 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 97392.5us
I20260709 12:27:02.305706 12306 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:02.333317 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:02.322229 12488 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.300320 12537 consensus_queue.cc:1059] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:27:02.340943  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:02.342024  9887 raft_consensus.cc:2410] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:27:02.321979 12632 raft_consensus.cc:697] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:02.344275 10528 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:02.344831  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:02.345444  9884 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:27:02.347868 10532 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:02.350430 10531 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:27:02.354208  9928 connection.cc:256] RPC call timeout handler was delayed by -2.2365552639998896s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
W20260709 12:27:02.358996 12766 log.cc:927] Time spent T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:27:02.333838 12763 consensus_queue.cc:1059] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
W20260709 12:27:02.359719 12750 log.cc:927] Time spent T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:27:02.359943 12761 raft_consensus.cc:3055] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:02.360356 12761 raft_consensus.cc:740] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:02.361174 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:02.361820 10527 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:27:02.343006 12516 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:02.364033 12539 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:02.364291 12516 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:02.365096 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:02.338814 12306 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.378405 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:02.378486  9964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:56648
I20260709 12:27:02.379086 10532 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:27:02.379148  9964 raft_consensus.cc:606] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:02.380327  9964 raft_consensus.cc:614] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:02.347214 12488 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:02.381093 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:02.381444  9811 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:02.382313 12488 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:02.382618  9884 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:02.383329  9959 raft_consensus.cc:1240] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:27:02.387260 10528 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:02.321909 12769 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 12:27:02.396800  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.400631  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:02.400462 12632 consensus_queue.cc:237] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:02.334336 12470 consensus_queue.cc:1059] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:27:02.402500 12550 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.428740  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:02.600483  9957 raft_consensus.cc:2368] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
I20260709 12:27:02.600327 12550 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:02.600716 12470 raft_consensus.cc:3055] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:02.601445  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:02.601557 12470 raft_consensus.cc:740] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:02.602237  9957 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:02.602581 12550 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:02.402956 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 78375.8us
I20260709 12:27:02.429278 12765 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.603529 10496 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:02.603487 12765 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:02.604503 10496 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:02.604024 12470 consensus_queue.cc:260] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:02.605513 12765 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:02.462494  9960 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:02.458807  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:02.605484 12559 raft_consensus.cc:2764] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:27:02.606375 12470 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:02.459504  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.607321  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.607980  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:02.608819  9958 raft_consensus.cc:2393] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 6: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:02.361192 12761 consensus_queue.cc:260] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:02.609412 12761 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:02.609609  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.610668  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.611225  9958 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:27:02.611958  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.612479  9958 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:02.613214  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.613885  9958 raft_consensus.cc:2393] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:02.429301  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.603066  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.614555  9959 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:27:02.614670  9957 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
W20260709 12:27:02.420826  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.429850  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.607931 12559 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:02.616160  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.462680  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.615921 12559 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:02.417501  9956 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:27:02.463263  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.616681  9963 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:02.617185  9962 raft_consensus.cc:2410] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:27:02.386453 12306 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:02.430550  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:02.432842  9854 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:02.617528  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:02.484370  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.606184 10496 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:02.417547  9809 raft_consensus.cc:1275] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:27:02.525125  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 255303us
W20260709 12:27:02.412145  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 127919us
W20260709 12:27:02.618044  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 185295us
W20260709 12:27:02.620620  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.532332  9814 raft_consensus.cc:1275] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:02.555721 12739 raft_consensus.cc:3055] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:02.570103 12690 raft_consensus.cc:3055] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:02.589056 12484 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:02.616703  9956 pending_rounds.cc:85] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 7
I20260709 12:27:02.648687  9956 pending_rounds.cc:107] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:27:02.629292  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.649209  9956 raft_consensus.cc:2889] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:02.591317  9811 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:02.402741 12744 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:02.436843 12516 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.460188  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.437069 12701 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.606097 12765 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:02.661928  9779 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:02.606977  9955 raft_consensus.cc:2410] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:02.608623  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.663508  9960 raft_consensus.cc:2410] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:27:02.618374  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:02.558951 12776 log.cc:927] Time spent T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.175s	user 0.003s	sys 0.000s
I20260709 12:27:02.567237  9882 raft_consensus.cc:1240] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
W20260709 12:27:02.482544 12762 log.cc:927] Time spent T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.241s	user 0.003s	sys 0.000s
W20260709 12:27:02.489981 12736 consensus_meta.cc:287] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.509s	user 0.008s	sys 0.003s
I20260709 12:27:02.656201  9957 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:27:02.656661  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.668906  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.649748  9963 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:27:02.490211 12529 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.618286 12719 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:02.666731 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:02.675669 10530 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:02.623925 12533 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:02.666857  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.668977  9964 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:02.669694  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:02.634526 12739 raft_consensus.cc:740] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:02.648802 12690 raft_consensus.cc:740] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:02.673835  9962 raft_consensus.cc:1240] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:27:02.669627  9961 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
W20260709 12:27:02.674631  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.664412 12765 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:02.485582 12445 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:02.691390  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:02.666832 12537 consensus_queue.cc:1048] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:27:02.676872 12533 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.699365  9963 raft_consensus.cc:2368] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
I20260709 12:27:02.700225  9779 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:02.707815 10530 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:02.667002 12778 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:02.682888 12522 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:02.689378 12765 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:02.665956 12744 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:02.667753 12701 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:02.665023 12516 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:02.678797 12529 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:02.696825 12559 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:02.734066  9854 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:02.714624  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:02.748471  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.714772 12533 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:02.756969  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.755403  9778 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:02.759812 12691 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:02.764763 12529 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:02.713994 12778 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:02.765583 12778 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:02.768399  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.748584 12779 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:02.777678 12306 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:02.785161  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:02.782831  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 82721.7us
I20260709 12:27:02.787544  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.788128  9963 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:27:02.780373 12779 raft_consensus.cc:697] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:02.791694 12779 consensus_queue.cc:237] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:02.780802 12736 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:02.777974 12739 consensus_queue.cc:260] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:02.781086 12690 consensus_queue.cc:260] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:02.807184 12445 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:02.809381 12739 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:02.811362 12701 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:02.812851 12516 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:02.814008 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:02.814190 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:02.814996 10528 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:27:02.816461  9854 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:02.817379 12516 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:02.817804 12516 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.818148 12516 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:02.818894  9779 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:02.821272 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:02.821784  9888 raft_consensus.cc:1275] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:02.822567 12736 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:02.822942  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:02.823240 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:02.823539 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:02.824055 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:02.824759 10527 raft_consensus.cc:2393] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 8: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:02.822964 12736 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:02.826018 12736 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:02.828593  9928 leader_election.cc:400] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 6. Current term is 7.
I20260709 12:27:02.828897  9928 leader_election.cc:403] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:02.829566  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:02.827067  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.830689  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.831434  9959 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:27:02.831961  9962 raft_consensus.cc:2410] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:27:02.830991  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.831045  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:02.830248  9961 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:02.832913  9964 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:27:02.833786  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:02.823519  9885 raft_consensus.cc:2376] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6. Re-sending same reply.
I20260709 12:27:02.837061 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:02.840914  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:02.852458  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:02.853550  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:02.855701  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:02.856180  9882 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:27:02.857247 10528 raft_consensus.cc:1275] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:27:02.857870  9888 raft_consensus.cc:2393] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:02.873687 10527 raft_consensus.cc:1275] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:02.875841  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:02.876973  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 48531.5us
I20260709 12:27:02.860855 12488 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:27:02.852949 12744 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:02.841245 12421 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 6. Current term is 7.
I20260709 12:27:02.840222 12691 raft_consensus.cc:697] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:02.884369  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:02.903965  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:02.894093 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:02.900389  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:02.902065  9928 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:02.855269 12533 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:02.905813  9811 raft_consensus.cc:2393] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:02.905741  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:02.908541  9885 raft_consensus.cc:2393] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 8: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:02.910038 10526 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:27:02.904210  9778 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:02.872059 12484 consensus_queue.cc:1048] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:27:02.916029 12306 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:02.916661 12306 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:02.919021  9888 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:02.921700  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:02.922267  9813 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:02.922590  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:02.923801  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:02.924902  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:02.926036  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:02.927176  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:02.927764  9812 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:02.929409  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:02.943773  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:02.949043  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.950651  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:02.951364  9815 raft_consensus.cc:2393] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:02.952884  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:02.928922 12701 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.962270  9928 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:02.951936 12719 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:02.968160 12719 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:02.973431 12529 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:02.973608 12387 raft_consensus.cc:3055] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:02.974097 12529 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.974195 12387 raft_consensus.cc:740] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:02.974534 12529 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:02.975215 12387 consensus_queue.cc:260] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:02.976199 12387 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:02.981055 12754 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:02.968465  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:02.933656  9883 raft_consensus.cc:2955] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
W20260709 12:27:02.989106 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 382962us
I20260709 12:27:02.990315 10496 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:02.955372 12744 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:03.007347  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:02.986138 12778 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:03.012738  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 108592us
I20260709 12:27:03.000969 12387 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:03.021960  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 65690.6us
I20260709 12:27:03.028556  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:03.029394  9959 raft_consensus.cc:2410] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:03.006979 12488 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:03.009850 12632 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:03.031911  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.038211  9807 raft_consensus.cc:2410] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:27:03.027745  9886 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:03.045552  9962 raft_consensus.cc:1240] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:27:03.001467 12701 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:03.009997 12777 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:27:03.057658  9928 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:03.015722 12336 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:27:03.058415  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.063978  9807 raft_consensus.cc:2410] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:27:03.015087 12633 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:27:03.059813  9778 leader_election.cc:400] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7.
I20260709 12:27:03.068285  9778 leader_election.cc:403] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:03.040186 12632 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:03.074178  9928 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:03.064046  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:03.076457  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.078943  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:03.079671  9890 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:27:03.080631 12799 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:03.084251  9955 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:03.032356 12387 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:03.018852 12691 consensus_queue.cc:237] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:03.070850 12770 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:03.083281 12527 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:03.079072 12632 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:03.114954  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.115795  9807 raft_consensus.cc:2393] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:03.063038 12306 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 12:27:03.138141  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.145908  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.103911 12799 raft_consensus.cc:697] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:03.147301  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:03.148922  9778 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:03.104650 12719 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:03.096184 12736 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:03.124740 12533 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:03.125602 12773 consensus_queue.cc:1048] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 12:27:03.185714  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.212352  9778 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:03.174633 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 109348us
I20260709 12:27:03.173234  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.220161  9807 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:03.205843 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:03.224256 12387 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:03.207165 12779 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7.
W20260709 12:27:03.178328  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 104216us
I20260709 12:27:03.157454 12763 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
W20260709 12:27:03.182075 12800 log.cc:927] Time spent T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 12:27:03.181958 12796 log.cc:927] Time spent T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:27:03.244395  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.248445  9807 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:03.175230 12744 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:03.132226 12770 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:03.218091 12778 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:03.163651 12516 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:03.251308  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 43497.1us
I20260709 12:27:03.255829  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:03.257882  9807 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:03.242316 12773 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:03.259891  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:03.260059  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:03.182106 12470 consensus_queue.cc:1048] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:27:03.262104  9886 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:03.270514 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:03.271032 10526 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:27:03.264709  9884 raft_consensus.cc:2393] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:03.265245  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:03.265777  9890 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:03.272819  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:03.273511  9812 raft_consensus.cc:2393] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 8: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:03.274171 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:03.274768 10527 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:03.275144 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:03.266947  9881 raft_consensus.cc:1275] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:27:03.275704 10533 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:03.278462  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:03.279011  9886 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:27:03.281003  9959 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:27:03.281948  9882 raft_consensus.cc:1240] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:27:03.291102  9807 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:03.291664  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:03.292394  9957 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 6: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:27:03.294488  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.295739  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:03.296411  9889 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:03.300925  9810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:27:03.301555  9810 raft_consensus.cc:606] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:03.301967  9810 raft_consensus.cc:614] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:03.302757  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.301465  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:03.305881  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:03.302606  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:03.308097 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:03.309383  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.310096  9807 raft_consensus.cc:2393] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 3: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:03.261795 12773 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:03.307823  9958 pending_rounds.cc:85] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 4
I20260709 12:27:03.322199  9958 pending_rounds.cc:107] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:27:03.322475  9958 raft_consensus.cc:2889] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:03.325178 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:03.325801 10527 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:03.332302  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:03.335247  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:03.335387  9886 raft_consensus.cc:3055] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:03.335820  9813 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:03.335834  9886 raft_consensus.cc:740] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:03.339800 10533 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:03.340466  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.341569  9853 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:03.307682 12533 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.314936 12701 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:03.327335 12773 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:03.353164  9809 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:27:03.357352  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:03.356348 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 133784us
I20260709 12:27:03.362802  9886 consensus_queue.cc:260] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:03.364112  9886 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:03.354166 12719 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:03.366564  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.367865  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.368891  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.369406  9811 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
W20260709 12:27:03.370160 12798 log.cc:927] Time spent T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 12:27:03.371248 12810 log.cc:927] Time spent T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:27:03.370160  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:03.382910 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:03.388789  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 57110.7us
I20260709 12:27:03.394701  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:03.395548  9811 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:03.350445 12809 log.cc:927] Time spent T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:27:03.262229 12799 consensus_queue.cc:237] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:03.367861 12805 log.cc:927] Time spent T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:27:03.325235 12792 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:27:03.410653  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.402045 10530 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:03.424572  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.403915 12736 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:03.428419  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 94029.1us
I20260709 12:27:03.429152  9853 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:03.358609 12533 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:03.427115  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.434799  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.433310  9806 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
W20260709 12:27:03.443221  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.410771 12438 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 12:27:03.462390 12797 log.cc:927] Time spent T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 12:27:03.466791 12445 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:03.466925 12763 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:03.468182  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.469508  9814 raft_consensus.cc:1240] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:03.470933  9814 raft_consensus.cc:1240] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:27:03.412282 12808 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:27:03.476589 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:03.477221 10528 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:03.479216 12529 consensus_meta.cc:287] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.001s
I20260709 12:27:03.479497 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:03.479647 12529 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:03.481155 10533 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:27:03.482146 12736 consensus_queue.cc:1048] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:03.482532  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.484086 10528 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:27:03.485572 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:03.486806  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.487696  9812 raft_consensus.cc:2393] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:03.421496 12387 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:27:03.504236 10533 raft_consensus.cc:1240] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:27:03.497897  9779 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:03.460455 12701 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:03.433063 12739 consensus_queue.cc:1048] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:27:03.510375  9812 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 8. Current term is 9. Ops: []
W20260709 12:27:03.523509  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 86484.3us
I20260709 12:27:03.525543  9853 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:03.526595  9853 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:03.531353 10526 pending_rounds.cc:85] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b: Aborting all ops after (but not including) 7
I20260709 12:27:03.531795 10526 pending_rounds.cc:107] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:27:03.532092 10526 raft_consensus.cc:2889] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:03.505249 12774 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 12:27:03.540573  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.548535  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:03.549723 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:03.519917  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:27:03.551323  9886 raft_consensus.cc:1275] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:27:03.551878  9886 pending_rounds.cc:85] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 3
I20260709 12:27:03.552253  9886 pending_rounds.cc:107] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:27:03.552611  9886 raft_consensus.cc:2889] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:03.545761 10527 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:03.549171  9814 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:03.513510 12763 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:03.562119  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:03.532898 12701 raft_consensus.cc:2804] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:03.572340  9959 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:27:03.542766 12801 log.cc:927] Time spent T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 12:27:03.571732 10496 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:03.580850 10496 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:03.582540  9813 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:03.583400 12539 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.589681 12539 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:03.590567  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 62441.5us
I20260709 12:27:03.591089 12632 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:03.591475  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:03.592028 12539 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:03.592356  9853 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:03.593097 12632 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:03.579017 12763 raft_consensus.cc:697] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:03.594515  9959 raft_consensus.cc:1275] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:27:03.594908  9959 pending_rounds.cc:85] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 4
I20260709 12:27:03.595127  9959 pending_rounds.cc:107] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:27:03.595362  9959 raft_consensus.cc:2889] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:03.595455 12763 consensus_queue.cc:237] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:03.597069  9959 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:27:03.597127 12792 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:03.597469  9959 pending_rounds.cc:85] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 6
I20260709 12:27:03.597555 12792 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:03.597791  9959 pending_rounds.cc:107] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:27:03.598021 12792 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:03.599555 12814 log.cc:927] Time spent T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:27:03.600699  9959 raft_consensus.cc:2889] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:03.546583 12818 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:27:03.601500  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.602358 12529 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:03.602442 12771 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:03.542129 12770 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:03.576777 12701 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:03.583985 12777 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:03.560635 12774 consensus_queue.cc:1059] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 12:27:03.630704  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.609493 12719 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:03.603164 12559 consensus_queue.cc:1059] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:27:03.607532 12818 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:03.612497 12488 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:03.639343  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 47064us
W20260709 12:27:03.633955 12765 consensus_meta.cc:287] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.886s	user 0.011s	sys 0.000s
I20260709 12:27:03.629333 12701 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:03.606891 12808 consensus_queue.cc:1059] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 12:27:03.648341  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 238594us
I20260709 12:27:03.636646 12529 raft_consensus.cc:3055] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:03.652249  9853 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:03.658432  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:03.659271  9956 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:03.662228  9853 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:03.641013 12818 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:03.664166  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 93695.7us
I20260709 12:27:03.668037  9778 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:03.668211  9811 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:03.669212  9778 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:03.671241  9928 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:27:03.674458  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.676801 12744 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:03.677107 12736 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:03.677330 12812 log.cc:927] Time spent T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:27:03.649470 12533 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:03.690482  9812 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:27:03.660877 12421 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.657832 12529 raft_consensus.cc:740] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:03.711946 12539 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:03.647142 12488 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:03.649813 12765 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:03.721180 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 136353us
W20260709 12:27:03.716022  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 44627.4us
W20260709 12:27:03.723902  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 61953.5us
I20260709 12:27:03.713956 12691 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:03.743985  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:03.744624  9956 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:03.747484 12777 consensus_queue.cc:1059] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:03.748019  9928 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:03.748344 12777 raft_consensus.cc:3055] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:03.748715 12777 raft_consensus.cc:740] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:03.749519 12777 consensus_queue.cc:260] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:03.750159 12803 log.cc:927] Time spent T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.593s	user 0.001s	sys 0.000s
W20260709 12:27:03.750418 12821 log.cc:927] Time spent T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:27:03.751003 12834 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:03.751407 12336 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:03.752302 12828 log.cc:927] Time spent T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:27:03.752956 12516 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:03.753152  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:03.772329  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.739065 12691 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:03.720609 12421 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:03.804862 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:03.819979  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 72036.9us
I20260709 12:27:03.791325 12834 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:27:03.829011  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 97205.4us
I20260709 12:27:03.834461  9962 raft_consensus.cc:2393] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:03.831979  9956 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:03.835037  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:03.814926 12691 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:03.847807  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:03.848608  9959 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:03.850991 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.823625 12777 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:03.894235 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 47508.4us
W20260709 12:27:03.905305  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.947052 10496 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:03.827734 12516 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.839020 12834 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:03.996961  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:03.997695  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 162760us
I20260709 12:27:04.047406  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:03.791996 12529 consensus_queue.cc:260] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:04.079852  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.984205 12643 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:27:04.092708 12839 log.cc:927] Time spent T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
W20260709 12:27:04.093122 12835 log.cc:927] Time spent T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.270s	user 0.000s	sys 0.000s
I20260709 12:27:04.124763 12823 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:04.125475 12823 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:04.125972 12823 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:04.127563 12837 log.cc:927] Time spent T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
W20260709 12:27:04.128445 12831 log.cc:927] Time spent T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.389s	user 0.001s	sys 0.000s
I20260709 12:27:04.148362 12765 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:04.150231 12843 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:04.161677 12825 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:04.164369 12438 raft_consensus.cc:3055] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:27:04.171559 12804 log.cc:927] Time spent T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.962s	user 0.006s	sys 0.004s
W20260709 12:27:04.176946 12802 log.cc:927] Time spent T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 1.013s	user 0.006s	sys 0.004s
I20260709 12:27:04.182982 12847 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:27:04.184158 12488 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:04.201176  9809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 1979) took 1280 ms (client timeout 1516 ms). Trace:
W20260709 12:27:04.272185  9809 rpcz_store.cc:269] 0709 12:27:02.920716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.929202 (+  8486us) service_pool.cc:224] Handling call
0709 12:27:04.174201 (+1244999us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b5400451fd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:04.201087 (+ 26886us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776699648}
I20260709 12:27:04.204520 10533 raft_consensus.cc:1240] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 8. Current term is 9. Ops: []
W20260709 12:27:04.205041  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.241534 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:04.274709 10528 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:04.259795 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:04.151499 12421 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:04.261180 12438 raft_consensus.cc:740] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:04.243183 12843 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.267964 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:27:04.268704 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.270593 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:03.995153 12516 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } }
I20260709 12:27:04.151629 12690 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:04.298568  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.300120 10528 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:04.261788 12774 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:04.277287 12701 consensus_meta.cc:287] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.614s	user 0.011s	sys 0.000s
I20260709 12:27:04.349987  9957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1336) took 1021 ms. Trace:
I20260709 12:27:04.352224  9957 rpcz_store.cc:276] 0709 12:27:03.328781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.328929 (+   148us) service_pool.cc:224] Handling call
0709 12:27:03.329279 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:03.344339 (+ 15060us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:03.344382 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:03.344886 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 12:27:03.653104 (+308218us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:03.653166 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.653265 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:04.349728 (+696463us) raft_consensus.cc:1685] finished
0709 12:27:04.349757 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.349912 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18279,"raft.queue_time_us":20762,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":19998,"thread_start_us":242985,"threads_started":1,"wal-append.queue_time_us":335307}
I20260709 12:27:04.358009 12533 consensus_queue.cc:1059] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:27:04.359452 12852 raft_consensus.cc:3055] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:04.359951 12852 raft_consensus.cc:740] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:04.361016 12852 consensus_queue.cc:260] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:04.362867 12852 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:04.303486 12850 consensus_queue.cc:1048] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.143s
I20260709 12:27:04.322036 12765 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.322168 12843 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:04.351861 12774 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:04.374850  9886 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:04.385402  9882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1274) took 1382 ms. Trace:
I20260709 12:27:04.512221  9882 rpcz_store.cc:276] 0709 12:27:03.003097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.003285 (+   188us) service_pool.cc:224] Handling call
0709 12:27:03.012712 (+  9427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:03.283565 (+270853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.385177 (+1101612us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b540043bcd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:04.385348 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618591616}
I20260709 12:27:04.380589 12701 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:04.515542 12701 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:04.395046 12818 consensus_meta.cc:287] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.680s	user 0.000s	sys 0.006s
I20260709 12:27:04.516417 12818 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:04.518483 12818 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:04.428752  9963 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:04.428843  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2289) took 1480 ms. Trace:
W20260709 12:27:04.434674  9959 consensus_meta.cc:287] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.585s	user 0.011s	sys 0.000s
I20260709 12:27:04.521644  9959 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
W20260709 12:27:04.455525  9778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.000s	sys 0.013s
I20260709 12:27:04.405735  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:04.439860  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:04.429275  9815 raft_consensus.cc:1240] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:27:04.436566  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:04.471421  9780 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.006s	sys 0.036s
I20260709 12:27:04.457011  9887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1265) took 1617 ms. Trace:
W20260709 12:27:04.504153  9779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.006s	sys 0.046s
I20260709 12:27:04.371568  9854 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:04.420233 12837 log.cc:927] Time spent T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:27:04.576728  9779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.011s	sys 0.049s
W20260709 12:27:04.576560  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 205101us
W20260709 12:27:04.531483  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.519977  9808 rpcz_store.cc:276] 0709 12:27:02.947984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.948097 (+   113us) service_pool.cc:224] Handling call
0709 12:27:02.948393 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:02.955248 (+  6855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.955276 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:02.967825 (+ 12549us) log.cc:844] Serialized 26 byte log entry
0709 12:27:03.071075 (+103250us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:03.071114 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.071181 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:04.170696 (+1099515us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:04.428419 (+257723us) raft_consensus.cc:1685] finished
0709 12:27:04.428451 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.428763 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9665,"raft.queue_time_us":12316,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"spinlock_wait_cycles":10655104,"thread_start_us":102914,"threads_started":1,"wal-append.queue_time_us":156465}
W20260709 12:27:04.486346  9927 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.037s	sys 0.081s
I20260709 12:27:04.391701  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:04.580217  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.577280  9887 rpcz_store.cc:276] 0709 12:27:02.839693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.839803 (+   110us) service_pool.cc:224] Handling call
0709 12:27:04.456761 (+1616958us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b540030d254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:04.456939 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1866118912}
W20260709 12:27:04.579927  9927 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.045s	sys 0.087s
W20260709 12:27:04.473109  9853 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.006s	sys 0.036s
W20260709 12:27:04.474802  9929 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.039s	sys 0.080s
I20260709 12:27:04.576606  9881 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
W20260709 12:27:04.506340 10496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.147s	sys 0.286s
W20260709 12:27:04.577891  9780 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.006s	sys 0.043s
W20260709 12:27:04.583005 10496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.150s	sys 0.289s
W20260709 12:27:04.583392 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 633417us
W20260709 12:27:04.508816  9781 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.015s	sys 0.039s
W20260709 12:27:04.449694  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 402331us
W20260709 12:27:04.583938  9781 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.018s	sys 0.043s
I20260709 12:27:04.577103  9885 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:04.578512  9886 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:27:04.584285  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:27:04.582104  9929 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.040s	sys 0.088s
W20260709 12:27:04.581779  9853 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.010s	sys 0.040s
I20260709 12:27:04.577445  9889 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
W20260709 12:27:04.576774  9778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.007s	sys 0.056s
W20260709 12:27:04.586879  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 751981us
W20260709 12:27:04.586213  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 926530us
I20260709 12:27:04.588128  9853 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:04.588387  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.581018  9888 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:27:04.373306 12754 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:27:04.488833 12842 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.007s	sys 0.034s
W20260709 12:27:04.380322 12773 consensus_meta.cc:287] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.983s	user 0.005s	sys 0.007s
I20260709 12:27:04.594568  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:04.595489  9853 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:04.495631 12719 consensus_meta.cc:287] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.851s	user 0.008s	sys 0.004s
I20260709 12:27:04.599327  9886 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:27:04.523347 12836 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.604658  9813 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:04.393007 12516 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:04.613075  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:04.612987  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:04.613972 10496 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:04.617491  9885 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:04.583528 12818 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:27:04.603199 12842 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.008s	sys 0.035s
I20260709 12:27:04.587635 12763 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:04.625404  9887 raft_consensus.cc:1240] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:27:04.620688  9928 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:04.619547  9779 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:04.591591 12701 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:04.631417  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 458) took 1086 ms. Trace:
I20260709 12:27:04.636531  9814 rpcz_store.cc:276] 0709 12:27:03.545208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.569513 (+ 24305us) service_pool.cc:224] Handling call
0709 12:27:03.578448 (+  8935us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:03.599581 (+ 21133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:03.599617 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:03.600085 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:27:03.645675 (+ 45590us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:03.690329 (+ 44654us) log.cc:844] Serialized 14 byte log entry
0709 12:27:03.835819 (+145490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.835897 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:04.631236 (+795339us) raft_consensus.cc:1685] finished
0709 12:27:04.631254 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.631363 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":65462,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":302322,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":46274,"thread_start_us":190224,"threads_started":2,"wal-append.queue_time_us":114428}
I20260709 12:27:04.648968  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:04.649644  9813 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:04.625329 12306 consensus_queue.cc:1048] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:27:04.618391 12862 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:04.655099  9885 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
W20260709 12:27:04.655663  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 60243.9us
I20260709 12:27:04.657385  9853 leader_election.cc:400] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
I20260709 12:27:04.659662  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:04.660444  9955 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:04.446017 12438 consensus_queue.cc:260] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:04.624629 12226 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:04.618755 12779 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.623631 12816 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.635139 12818 raft_consensus.cc:697] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:04.622287 12690 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:04.618602 12719 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:04.622212 12845 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.664727  9853 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:04.625432 12744 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:27:04.420708 12765 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:04.660082 12792 consensus_meta.cc:287] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 1.045s	user 0.010s	sys 0.005s
I20260709 12:27:04.693060  9813 raft_consensus.cc:1240] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: []
W20260709 12:27:04.666054 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 99111.3us
I20260709 12:27:04.647400 12484 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:04.669595  9807 raft_consensus.cc:1240] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:04.672416  9927 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:04.669902  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 44712.7us
W20260709 12:27:04.667033  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 46433.4us
W20260709 12:27:04.702247 12869 log.cc:927] Time spent T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:27:04.622393 12836 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:04.647367 12763 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:04.635752 12701 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:04.723230  9883 raft_consensus.cc:1240] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: []
W20260709 12:27:04.724568  9963 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55946 (request call id 1954) took 1930 ms (client timeout 2007 ms). Trace:
W20260709 12:27:04.748504  9963 rpcz_store.cc:269] 0709 12:27:02.794376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.794543 (+   167us) service_pool.cc:224] Handling call
0709 12:27:04.724416 (+1929873us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54000b4fd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:04.724516 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3630112640}
W20260709 12:27:04.713400  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 48726.1us
I20260709 12:27:04.750360  9853 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:04.731441  9928 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:04.751755 12825 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:04.752068  9928 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:04.753496  9928 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:04.659544 12862 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:04.754438 12862 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:04.695904 12690 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:04.758517 12690 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:04.720813 12849 log.cc:927] Time spent T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.602s	user 0.000s	sys 0.004s
I20260709 12:27:04.606763 12754 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:04.765365 12754 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:04.725063 12834 consensus_meta.cc:287] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.620s	user 0.010s	sys 0.000s
I20260709 12:27:04.766096 12834 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:04.768656 12834 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:04.769534  9882 raft_consensus.cc:1240] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:04.770465 12643 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:04.771298 12643 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:04.773222 12643 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:04.734529 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:27:04.744378  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 124929us
W20260709 12:27:04.745628  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 73277.3us
I20260709 12:27:04.774933  9779 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:04.775290  9927 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:04.776141 12719 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:04.776670 12719 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:04.777149 12719 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:04.777808 12825 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:04.778350 12825 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.778720 12533 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:04.778748 12825 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:04.779588 12533 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:04.787938  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:04.789637 12834 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:04.790170 12834 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:04.790705 12834 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:04.782068 12533 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:04.795243 12643 consensus_queue.cc:1059] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:04.796244 12643 consensus_queue.cc:1243] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [LEADER]: Peer 4104e34a61b7448281d6d91ce23ebf71 log is divergent from this leader: its last log entry 6.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:27:04.719399 12226 raft_consensus.cc:697] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:04.618507 12773 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:04.730494 12516 raft_consensus.cc:2749] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:04.822094  9964 raft_consensus.cc:1240] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
W20260709 12:27:04.822755 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 88407.7us
W20260709 12:27:04.817777 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 70315us
I20260709 12:27:04.828481 10497 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:04.810240 12701 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:04.807888 12867 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.807374 12306 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:04.746994 12774 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:04.715497 12779 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:04.850206  9806 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:04.725953 12845 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:04.696997 12816 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:04.844115 12822 raft_consensus.cc:3055] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:04.837474 12678 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:04.730001 12792 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:04.849838 12861 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.916854  9886 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:04.854267 12306 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.842432 12770 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:27:04.871786 12484 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:27:04.923834  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 125139us
I20260709 12:27:04.878839 12559 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:04.884925 12778 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:04.926168  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 151335us
I20260709 12:27:04.911706 12822 raft_consensus.cc:740] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:04.912755 12678 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:27:04.924264 12691 consensus_meta.cc:287] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.974s	user 0.011s	sys 0.000s
W20260709 12:27:04.929587  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 152936us
I20260709 12:27:04.941641  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:04.942742  9813 raft_consensus.cc:2376] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6. Re-sending same reply.
W20260709 12:27:04.944092  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 156236us
I20260709 12:27:04.922518 12306 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:04.945992  9853 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:04.950892  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:04.951624  9811 raft_consensus.cc:2393] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 8: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:04.873893 12867 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:04.949023 12858 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:04.944043 12850 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:04.926723 12484 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:04.939363 12678 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:04.954552  9810 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:27:04.967579  9810 pending_rounds.cc:85] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: Aborting all ops after (but not including) 7
I20260709 12:27:04.967862  9810 pending_rounds.cc:107] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:27:04.968129  9810 raft_consensus.cc:2889] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:04.960206  9806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 450) took 1541 ms. Trace:
I20260709 12:27:04.953878  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:04.976226  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:04.965034 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:04.853828 12818 consensus_queue.cc:237] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:04.979175  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:04.998925  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:04.985252  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 231783us
W20260709 12:27:04.975466 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 147043us
I20260709 12:27:04.998989  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:05.000476 10497 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:04.920403 12421 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:05.000531  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:04.986858  9779 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:04.970995  9806 rpcz_store.cc:276] 0709 12:27:03.418788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.483427 (+ 64639us) service_pool.cc:224] Handling call
0709 12:27:03.483698 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.855845 (+1372147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.959922 (+104077us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54002d6c54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:04.960114 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3142208768}
W20260709 12:27:04.953378 12873 log.cc:927] Time spent T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:27:05.008811  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:04.973510  9853 connection.cc:256] RPC call timeout handler was delayed by -1.625574092000079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
I20260709 12:27:04.924908 12559 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:27:05.016039 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 51110.8us
I20260709 12:27:05.006234  9779 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:05.019508  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:04.956889 12484 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:05.020267  9812 raft_consensus.cc:2393] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 9: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:04.937633 12754 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:27:05.019080  9779 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:05.002650 12470 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:04.923756 12861 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:05.028414  9853 connection.cc:256] RPC call timeout handler was delayed by -1.5751740919999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
I20260709 12:27:04.952088 12860 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:04.950258 12691 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.017562 12847 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:05.022897 12387 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:05.020562 12559 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:05.022997 12854 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:05.022730 12516 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:05.023064 12778 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:04.947785 12226 consensus_queue.cc:237] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.016229 12421 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:05.035502  9853 leader_election.cc:336] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 1.609s (SENT)
I20260709 12:27:04.963562 12880 consensus_queue.cc:1059] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:27:05.044817  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:05.032907 12470 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:05.043498  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:04.953562 12850 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:04.953133 12858 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:05.031999 12744 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:27:05.063269 12862 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.068011  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:05.066821 12763 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:05.065236  9890 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:05.067973  9884 raft_consensus.cc:1240] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:05.073558 12884 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:05.047785 12387 raft_consensus.cc:697] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:05.075373  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:05.068408 12516 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.081089  9779 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:05.082453 12816 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:05.084084 12779 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:05.085369 12825 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:05.086370  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.045930 12854 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.077418 12470 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:05.029722 12690 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:05.172681 12690 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:05.093506  9812 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:27:05.064882  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:05.062755 12739 raft_consensus.cc:3055] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:05.174041 12739 raft_consensus.cc:740] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:05.146515  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:05.020056 12822 consensus_queue.cc:260] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.042446 12719 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:05.175040  9890 raft_consensus.cc:2393] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 7: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:05.175424  9927 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:05.153249  9881 raft_consensus.cc:1240] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6. Ops: []
W20260709 12:27:05.152172  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 152254us
I20260709 12:27:05.090642 12773 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:05.094712 12842 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:05.181584  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 146151us
W20260709 12:27:05.190008  9853 connection.cc:256] RPC call timeout handler was delayed by -1.4195338839999749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27930000000000005s for a response
W20260709 12:27:05.190483  9853 connection.cc:256] RPC call timeout handler was delayed by -1.4059740920001786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260709 12:27:05.190889  9853 connection.cc:256] RPC call timeout handler was delayed by -1.3853338839999196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2831s for a response
W20260709 12:27:05.191258  9853 connection.cc:256] RPC call timeout handler was delayed by -1.3483740920000855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
W20260709 12:27:05.191639  9853 connection.cc:256] RPC call timeout handler was delayed by -1.3195740920000389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19870000000000002s for a response
I20260709 12:27:05.090126 12834 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:05.193085 12879 consensus_queue.cc:1048] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
W20260709 12:27:05.194293 12888 log.cc:927] Time spent T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:27:05.194608 12881 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:05.195506 12516 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:05.198350 12848 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:05.198566  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:05.199092  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.154714 12867 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:05.204576  9853 connection.cc:256] RPC call timeout handler was delayed by -1.1854740920002769s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2136s for a response
I20260709 12:27:05.174813 12854 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:05.213291  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.063755 12887 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.142s
W20260709 12:27:05.225746  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 50394.7us
W20260709 12:27:05.210598  9955 consensus_meta.cc:287] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.001s
I20260709 12:27:05.188566 12792 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:05.259884 12488 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:05.260406 12488 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.262450 12488 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:05.262867 12488 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.262900 12387 consensus_queue.cc:237] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.263417 12488 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.266608 12421 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:05.267642 12306 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:05.269991 12488 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:05.271003 12306 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:05.273468 12470 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.279436 10528 raft_consensus.cc:1240] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: []
W20260709 12:27:05.282130 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.174541 12852 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:05.189069 12845 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:05.205376 12533 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:05.236680  9853 connection.cc:256] RPC call timeout handler was delayed by -1.1755740920002609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
W20260709 12:27:05.288771  9853 connection.cc:256] RPC call timeout handler was delayed by -1.1494740920002187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
W20260709 12:27:05.289129  9853 connection.cc:256] RPC call timeout handler was delayed by -1.08064245200012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
I20260709 12:27:05.154422 12884 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.212317 12880 raft_consensus.cc:3055] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:05.293628  9853 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:05.295557  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:05.241536  9955 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:05.296583 12226 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.297351 12792 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.245793 12719 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:05.298061 12719 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:05.246383 12690 consensus_queue.cc:1048] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:05.246894 12861 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:05.298729 12533 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.247166 12691 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:05.248922 12881 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:05.299875 12881 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.300856 12533 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:05.302554  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:05.236865 12739 consensus_queue.cc:260] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.303206  9812 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.303550 12739 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.305439 12854 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:05.237109 12877 log.cc:927] Time spent T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 12:27:05.252671 12825 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:05.250674 12889 log.cc:927] Time spent T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:27:05.253604 12858 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:05.256546 12843 consensus_meta.cc:287] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.827s	user 0.009s	sys 0.003s
I20260709 12:27:05.307549 12854 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:05.307734 12843 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.310223 12843 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:05.282179  9883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 592) took 1073 ms. Trace:
I20260709 12:27:05.310874  9883 rpcz_store.cc:276] 0709 12:27:04.208857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.347759 (+138902us) service_pool.cc:224] Handling call
0709 12:27:04.348067 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.748483 (+400416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.281969 (+533486us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54003c6254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:05.282112 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":862368000}
I20260709 12:27:05.253122 12559 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.313076 12792 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:05.313258 12559 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:05.237252 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.284217 10528 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:05.252038 12834 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:05.293601 12880 raft_consensus.cc:740] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:05.240489 12816 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:05.319665  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:05.320293  9890 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.236609 12678 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.315745  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:05.291028  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:05.334327  9813 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:05.297070 12226 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.318507 12516 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:05.334868 12678 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:05.319825 12816 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.336081 12816 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:05.336480 12226 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:05.337724 12838 log.cc:927] Time spent T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 1.219s	user 0.003s	sys 0.000s
I20260709 12:27:05.338798 12880 consensus_queue.cc:260] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.320364  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:05.378612  9884 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:05.380213  9890 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:05.332216  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:05.382627  9882 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:05.387025 12880 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:05.387693 12834 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.388206 12834 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:05.302063 12850 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:05.315651 12862 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:05.390225 12834 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:05.340598 12892 log.cc:927] Time spent T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:27:05.296620  9853 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:05.391343  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 94782.3us
I20260709 12:27:05.392037  9853 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:05.393081 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.367882 10526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 601) took 1858 ms. Trace:
I20260709 12:27:05.393503 12862 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:05.368399  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:05.394259 12834 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:05.394577  9883 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:27:05.363934 12701 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.369010  9810 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:05.331290 12854 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:05.393635 10526 rpcz_store.cc:276] 0709 12:27:03.509525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.509630 (+   105us) service_pool.cc:224] Handling call
0709 12:27:03.529387 (+ 19757us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:03.532708 (+  3321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:03.532753 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:03.533243 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:27:03.687062 (+153819us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:03.687097 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.687166 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:05.336928 (+1649762us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:05.367589 (+ 30661us) raft_consensus.cc:1685] finished
0709 12:27:05.367610 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.367798 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70128000,"thread_start_us":101458,"threads_started":1,"wal-append.queue_time_us":221169}
I20260709 12:27:05.395686 12854 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.397696 12854 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:05.371501 12823 consensus_meta.cc:287] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 1.108s	user 0.008s	sys 0.005s
I20260709 12:27:05.371446  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:05.399299 12823 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:05.376113 12881 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.401391  9956 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:05.401788  9884 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:05.392990  9853 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:05.400702 12701 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:05.373513  9927 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:05.235448 12860 raft_consensus.cc:697] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:05.402801 12881 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:05.376541 12816 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:05.403404 12823 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:05.370657 12470 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:05.420560  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 221860us
I20260709 12:27:05.438848 10496 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:05.443579  9812 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
W20260709 12:27:05.445259  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 52330.8us
I20260709 12:27:05.451939  9928 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:05.452251  9853 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:05.446465  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 73023us
I20260709 12:27:05.447149  9882 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:27:05.454315  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:05.455050  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:05.447753 12818 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:05.460507  9853 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:05.457135  9927 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:05.448720 12911 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:05.456418 12771 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:27:05.467331 12905 consensus_queue.cc:1059] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:27:05.468644 12701 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.468954 12823 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:05.469637 12823 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:05.470095 12823 raft_consensus.cc:697] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:05.470956 12823 consensus_queue.cc:237] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.473155  9928 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:05.474061 12879 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:05.474969  9928 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:05.457082 12909 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:05.509508  9928 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:05.497377 12881 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:05.498584 12879 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.459821 12827 raft_consensus.cc:2804] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:05.508945 12897 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:27:05.465826 12818 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:05.512049  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:05.556425  9955 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:05.513057  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:05.559145  9961 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.514113  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:05.514994 12854 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.516149  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:05.562844  9958 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:27:05.519865 10496 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:05.563760 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 43965.6us
I20260709 12:27:05.520694  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:05.522233 12678 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.523886 12488 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:05.497824 12911 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.539441 12897 consensus_queue.cc:1048] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:05.552824 12701 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:05.510097 12825 consensus_queue.cc:1048] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:27:05.535044 12879 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:05.566012  9964 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:05.537781 12306 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:27:05.582952  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 80966.9us
I20260709 12:27:05.538353 12827 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:05.584534  9853 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:05.557233 12818 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:05.577603 12843 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.580257 12905 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:05.593465  9955 raft_consensus.cc:2410] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:05.579447 12488 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.665721 12488 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:05.579342 12678 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.580744 12911 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:05.561980 12860 consensus_queue.cc:237] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:05.583901 12306 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:05.672082  9712 catalog_manager.cc:5697] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 4 to 5, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 5 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:05.610463  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:05.676148  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.612651 12905 raft_consensus.cc:697] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:05.677096 12905 consensus_queue.cc:237] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.615033 12765 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
W20260709 12:27:05.680123  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.615810 12843 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.587039 12827 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:05.594324 12701 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:05.681669 12306 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:05.578351 12854 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.688920  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:05.691286  9810 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:05.691455 12854 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:05.623761 12909 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:05.692536 12529 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.624853  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54428 (request call id 609) took 1012 ms. Trace:
I20260709 12:27:05.588997  9853 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:05.627673 12818 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.694705  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:05.695267  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 106323us
I20260709 12:27:05.628314 12884 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:05.621011 12816 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:05.631398 12879 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:05.696269 12881 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:05.696879 12881 raft_consensus.cc:697] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:05.697983 12879 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:05.698652  9958 raft_consensus.cc:1240] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:05.698545 10497 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:05.700063  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:05.700598  9958 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:05.701347  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:05.701457 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:05.701727 12438 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.698666  9882 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:05.702575 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:05.703131 12822 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:05.639653 12836 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:05.703917 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:05.649127 12336 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:05.705425 12771 raft_consensus.cc:3055] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:05.705989 12771 raft_consensus.cc:740] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:27:05.706140  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 625075us
I20260709 12:27:05.644624  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:05.706866 12771 consensus_queue.cc:260] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.708102 12736 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.708280 12808 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:05.672050 12678 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:05.708602 12736 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:05.683446  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 1993) took 2476 ms. Trace:
I20260709 12:27:05.710484 12779 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:05.710690  9815 rpcz_store.cc:276] 0709 12:27:03.207186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.207409 (+   223us) service_pool.cc:224] Handling call
0709 12:27:04.428928 (+1221519us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:04.578428 (+149500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.683291 (+1104863us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540036c750. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:05.683395 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2767947520}
I20260709 12:27:05.682986  9881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 612) took 1069 ms. Trace:
I20260709 12:27:05.712167  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:05.712126  9881 rpcz_store.cc:276] 0709 12:27:04.614013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.663070 (+ 49057us) service_pool.cc:224] Handling call
0709 12:27:04.663406 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.176844 (+513438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.682778 (+505934us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54003f93d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:05.682931 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1126071552}
I20260709 12:27:05.712911  9811 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:05.642387  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2298) took 1053 ms. Trace:
I20260709 12:27:05.632036  9961 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:05.713403  9808 rpcz_store.cc:276] 0709 12:27:04.589079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.589231 (+   152us) service_pool.cc:224] Handling call
0709 12:27:04.589519 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.842895 (+253376us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:04.913233 (+ 70338us) log.cc:844] Serialized 14 byte log entry
0709 12:27:05.081811 (+168578us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.081875 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:05.081931 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.261440 (+179509us) spinlock_profiling.cc:243] Waited 7.83 ms on lock 0x7b48000d0a58. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f93445aa1 00007f2f9343cb37 00007f2f9343c9ca 00007f2f9353426f 00007f2f93533f37 00007f2f9354855c 00007f2f93548508 00007f2f93548488 00007f2f93548443 00007f2f935476ec 00007f2f92471a96
0709 12:27:05.642152 (+380712us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b540033ca54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:05.642195 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.642327 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38265,"prepare.queue_time_us":70488,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":10929,"raft.run_cpu_time_us":2646,"raft.run_wall_time_us":177813,"spinlock_wait_cycles":600161408,"thread_start_us":159295,"threads_started":1,"wal-append.queue_time_us":298374}
I20260709 12:27:05.682578  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:05.716507  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.686161  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:05.716995  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.685003  9964 raft_consensus.cc:1240] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:05.685833  9957 raft_consensus.cc:1240] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: []
W20260709 12:27:05.708921  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.694422  9886 rpcz_store.cc:276] 0709 12:27:04.612579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.612848 (+   269us) service_pool.cc:224] Handling call
0709 12:27:05.624641 (+1011793us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b540029a9d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:05.624771 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":494470016}
I20260709 12:27:05.685626  9962 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:05.695930  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:05.705482 12336 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.721988 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:05.703994  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:05.722237 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:05.695978  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:05.736974  9853 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:05.741566 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:05.742198  9927 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:05.745070 10497 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:05.747263  9853 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:05.748092  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:05.748730  9811 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:05.748929  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:05.749775  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:05.751636 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:05.753602 10497 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:05.697786 12881 consensus_queue.cc:237] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.758090 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:05.683569 12843 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:05.762221  9778 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:05.765092  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:05.679492 12488 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:05.730013  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:05.682014  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:05.696290 12818 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:05.730870 12808 raft_consensus.cc:697] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:05.731345 12836 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:05.664717  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 137730us
W20260709 12:27:05.765914 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.766651  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:05.779541  9815 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:27:05.740955 12701 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:05.772828 10497 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:05.773540  9853 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:05.785797 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:05.786422  9853 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:05.727927  9810 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:27:05.776687  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:05.777001  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:05.760298 12678 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:05.782817  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:05.797325  9957 raft_consensus.cc:2368] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 4. Current term is 5.
I20260709 12:27:05.783736  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:05.788070  9959 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:27:05.799103  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:05.764417 12855 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:27:05.780081  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.760358 12387 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.789749  9958 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:05.799391  9778 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:05.790654  9853 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:05.771009 12736 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:05.760111 12883 consensus_queue.cc:1059] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:27:05.771905 12863 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:05.761061 12834 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:27:05.803798 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 231573us
I20260709 12:27:05.789214 12862 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:05.804538  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.812475 12808 consensus_queue.cc:237] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.814155  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:05.814872  9887 raft_consensus.cc:2393] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 5: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:05.767097 12774 consensus_queue.cc:1059] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:27:05.815838  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:05.800657 12739 consensus_queue.cc:1059] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
W20260709 12:27:05.816912  9853 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.686s (SENT) [suppressed 29 similar messages]
I20260709 12:27:05.775449 12909 consensus_queue.cc:1059] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:27:05.817889 12774 consensus_queue.cc:1243] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer b011791796d1457284b857d7d3422195 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:27:05.792834  9809 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:05.801160 12855 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.774972 12843 consensus_queue.cc:1059] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:27:05.811126 12863 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.802901 10497 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:05.791268 12852 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:05.816984 12739 raft_consensus.cc:3055] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:05.841789 12852 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:05.775061 12864 consensus_queue.cc:1059] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:27:05.808403 12516 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.808050 12845 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:05.805747 10526 raft_consensus.cc:1240] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:27:05.845455 10531 raft_consensus.cc:1240] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:05.775174 12470 consensus_queue.cc:1059] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:27:05.809100 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:05.819311  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:05.849126  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:05.802680 12678 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:05.823248 12761 raft_consensus.cc:3055] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:05.803526 12866 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:05.802232 12818 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:05.787763  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 80085.3us
I20260709 12:27:05.911526 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:05.823446 12855 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:05.841981 12739 raft_consensus.cc:740] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:05.818575  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:05.916339  9885 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:27:05.816447  9881 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:05.846138 10533 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:27:05.824800  9928 connection.cc:256] RPC call timeout handler was delayed by -1.1290132510002877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
I20260709 12:27:05.806830 12911 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:05.848434 12488 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:05.849316 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:05.849541 10527 raft_consensus.cc:2393] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 5: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:05.789444 12836 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:05.854161 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 51331.1us
I20260709 12:27:05.854223  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:05.855644  9889 raft_consensus.cc:1240] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:27:05.861116  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:05.824227  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:05.928910  9887 raft_consensus.cc:2393] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:05.909518 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:05.912410 12885 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:05.894795  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:05.914774 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:05.918391  9928 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:27:05.891470 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 44457.7us
I20260709 12:27:05.919499 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:05.845296 12845 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.921991 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:05.938532  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:05.949276  9888 raft_consensus.cc:2393] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:05.943805  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:05.950912  9928 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:05.948082 10533 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:05.948568  9960 raft_consensus.cc:2368] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8.
I20260709 12:27:05.891068 12678 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:05.843482 12863 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:05.923846  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:05.926342 10497 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:05.914361  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:05.960654  9890 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.919852 12866 raft_consensus.cc:697] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:05.895689 12761 raft_consensus.cc:740] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:05.932334  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:05.955742  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 138841us
I20260709 12:27:05.957569  9959 raft_consensus.cc:2393] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:05.948235 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:05.963198  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:05.963837  9955 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:05.961387 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:05.842620 12852 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:05.967214 10497 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:05.968730 10532 raft_consensus.cc:1240] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:05.978202  9964 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:27:05.948328 12885 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.928577 12736 consensus_queue.cc:1059] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:27:05.933660 12306 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:05.980621  9928 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:05.966328 12883 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:05.955374 12845 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:06.007431  9890 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:05.981950  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:05.976172 12438 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:05.966020 12908 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:05.988603  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:05.987121 12909 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:05.963198 12884 raft_consensus.cc:2804] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:05.999346 10527 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:05.979023  9889 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:06.006109  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:06.017014 10526 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:27:06.017410  9885 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:05.989449  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:06.007017 10528 raft_consensus.cc:1240] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:27:05.982566  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:06.008982  9963 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:05.981496 12822 raft_consensus.cc:2764] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:27:06.013361  9886 raft_consensus.cc:2393] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 8: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:05.982712 12808 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:06.014840  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:05.985576 12861 consensus_queue.cc:1059] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 12:27:06.095118 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:06.102588 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:27:05.985432  9853 leader_election.cc:336] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.860s (SENT)
I20260709 12:27:06.108016  9853 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:05.987355 12885 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:06.094702 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:05.976811 12864 consensus_queue.cc:1059] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:27:05.969122 12856 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:27:05.938218 12739 consensus_queue.cc:260] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:06.005863 12900 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:06.111270  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:06.197285  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:06.207496  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.201368  9808 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:06.210819  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:06.166239  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:06.018252  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:06.212074  9810 raft_consensus.cc:2410] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:27:06.212680  9888 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:06.159768  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:06.213568  9884 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:06.213994  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:06.112047  9961 raft_consensus.cc:1240] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:06.214627  9809 raft_consensus.cc:2410] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:06.109277  9962 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:06.111116  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:06.211395  9886 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:06.005646 12816 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.230s
I20260709 12:27:06.024029  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:06.239118  9890 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:06.214668  9959 raft_consensus.cc:2393] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:05.997004 12843 consensus_queue.cc:1059] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.209s
I20260709 12:27:06.255314  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:06.246898  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:06.264168  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:06.280159  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:06.155167 12909 raft_consensus.cc:697] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:06.245546 12881 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:06.145454 12920 raft_consensus.cc:3055] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:27:06.354030  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 377267us
I20260709 12:27:06.306737  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:06.006750 12827 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:06.097043 12836 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:06.355268  9853 leader_election.cc:336] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.990s (SENT)
I20260709 12:27:06.360566  9853 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:06.094368 12336 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:06.096273 12884 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:06.108302 12902 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.324466  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:06.007925 12484 consensus_queue.cc:1059] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.247s
I20260709 12:27:06.093880 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:06.332731  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:06.333389 12900 raft_consensus.cc:697] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:06.143146 12765 raft_consensus.cc:3055] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:06.094187 12905 consensus_queue.cc:1059] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.220s
W20260709 12:27:06.334991  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 320181us
I20260709 12:27:06.093636 12761 consensus_queue.cc:260] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:06.335378 12488 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:06.336181  9884 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:27:06.158632 12470 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.097914 12866 consensus_queue.cc:237] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:06.099515 12387 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:06.342612  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 133722us
I20260709 12:27:06.344076  9886 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:06.466974  9779 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:06.347479  9889 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:06.097711 12516 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:06.205615 12808 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:27:06.356762  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.361908  9963 raft_consensus.cc:1240] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:27:06.197293 12438 raft_consensus.cc:697] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:06.350657 12739 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:06.374414  9853 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:06.372753  9888 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:27:06.359474 12842 consensus_queue.cc:1059] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 12:27:06.017944 12908 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:06.357931 12920 raft_consensus.cc:740] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:27:06.388535 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.367975 12881 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:06.444483  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:06.371776 12884 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:06.356184 12845 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:06.460224  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:06.461232  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:06.468125 12470 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:06.473505  9886 raft_consensus.cc:1240] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:06.380923  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:06.391245 12911 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:06.469759 12808 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:06.393106 12883 consensus_queue.cc:1059] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:27:06.387646 12765 raft_consensus.cc:740] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:06.450424 10524 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:27:06.514042  9890 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:27:06.476300  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:06.514565  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:06.521202  9885 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:27:06.525645  9886 raft_consensus.cc:2410] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:27:06.523061  9958 raft_consensus.cc:2393] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:06.524124 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:06.526492 10526 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:06.472450 12860 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:27:06.480388 12387 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.480252 12908 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:06.536895  9886 raft_consensus.cc:1240] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:06.528367 10525 raft_consensus.cc:3055] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:06.544189  9886 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:06.543058 10525 raft_consensus.cc:740] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:06.386432 12902 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:06.487231 12516 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:06.539243  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:06.511852 12445 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:06.557725  9890 raft_consensus.cc:1240] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:06.540906 12883 consensus_queue.cc:1243] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer b011791796d1457284b857d7d3422195 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:27:06.541643 12306 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:06.575246 12754 raft_consensus.cc:3055] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:06.575774 12754 raft_consensus.cc:740] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:06.556952 12920 consensus_queue.cc:260] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:06.579298 12920 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:06.529289 12900 consensus_queue.cc:237] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:06.582259  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:06.561335 10525 consensus_queue.cc:260] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:06.583498 10525 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:06.588929  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:06.589807  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:06.591337 10526 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:06.593326  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:06.594079  9956 raft_consensus.cc:2368] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4.
I20260709 12:27:06.594971  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:06.596325  9956 raft_consensus.cc:3055] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:06.596688  9956 raft_consensus.cc:740] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:06.593321  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:06.597625  9808 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:06.621338  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:06.622201  9958 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:06.663868 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.486414 12842 consensus_queue.cc:1243] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer f5208640a51f493e930ce4f64ceeed0b log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:27:06.519837 12909 consensus_queue.cc:237] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:06.576851 12754 consensus_queue.cc:260] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:06.692348  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:06.549670 12387 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:06.674960 12925 log.cc:927] Time spent T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.436s	user 0.001s	sys 0.000s
W20260709 12:27:06.712680 12934 log.cc:927] Time spent T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 12:27:06.719125  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 460) took 1777 ms. Trace:
I20260709 12:27:06.719538  9814 rpcz_store.cc:276] 0709 12:27:04.941312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.941536 (+   224us) service_pool.cc:224] Handling call
0709 12:27:04.941911 (+   375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:04.966867 (+ 24956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:04.966895 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:05.002392 (+ 35497us) log.cc:844] Serialized 52 byte log entry
0709 12:27:05.059464 (+ 57072us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:05.091403 (+ 31939us) log.cc:844] Serialized 14 byte log entry
0709 12:27:05.689071 (+597668us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b18003fe320. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b3a9c0a 00007f2f94ae9219 00007f2f8b431a40 00007f2f8b42c4e4 00007f2f8b42c455 00007f2f8e514060 00007f2f8e526716 00007f2f8e537287 00007f2f8e537208
0709 12:27:05.803209 (+114138us) log.cc:844] Serialized 14 byte log entry
0709 12:27:05.822828 (+ 19619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.718751 (+895923us) spinlock_profiling.cc:243] Waited 7.3 ms on lock 0x7b5400252bd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:06.718813 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:06.718867 (+    54us) raft_consensus.cc:1685] finished
0709 12:27:06.718885 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:06.719055 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63402,"prepare.queue_time_us":266145,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":5212,"raft.queue_time_us":646328,"raft.run_cpu_time_us":367,"raft.run_wall_time_us":47033,"spinlock_wait_cycles":76587648,"thread_start_us":132166,"threads_started":2,"wal-append.queue_time_us":225984}
I20260709 12:27:06.721611  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:06.723137  9957 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:06.724875  9960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 487) took 1211 ms. Trace:
I20260709 12:27:06.725251  9960 rpcz_store.cc:276] 0709 12:27:05.513725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.513892 (+   167us) service_pool.cc:224] Handling call
0709 12:27:06.724714 (+1210822us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54000b45d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:06.724824 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":861467520}
I20260709 12:27:06.734632 12887 raft_consensus.cc:3055] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:06.735116 12887 raft_consensus.cc:740] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:06.736042 12887 consensus_queue.cc:260] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:06.740029 12778 raft_consensus.cc:3055] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:06.740528 12778 raft_consensus.cc:740] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:27:06.745319 12855 consensus_meta.cc:287] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.818s	user 0.009s	sys 0.000s
I20260709 12:27:06.751573  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:06.752965  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:06.755849 12387 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:06.757161 12845 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:06.759532  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:06.760998  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:06.761777  9810 raft_consensus.cc:2368] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4.
I20260709 12:27:06.763230 12470 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:06.764999 12692 raft_consensus.cc:3055] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:06.765496 12692 raft_consensus.cc:740] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:06.766530 12692 consensus_queue.cc:260] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:06.767869 12692 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:06.769127 12827 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:06.773308 12777 raft_consensus.cc:3055] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:06.773682 12777 raft_consensus.cc:740] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:06.675539 12765 consensus_queue.cc:260] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:06.775265 12765 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:06.779522 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.749720  9956 consensus_queue.cc:260] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:06.757923 12774 raft_consensus.cc:3055] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:06.775403  9884 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:27:06.815191  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:06.786526  9955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55952 (request call id 1348) took 1105 ms. Trace:
I20260709 12:27:06.817149  9955 rpcz_store.cc:276] 0709 12:27:05.681101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.681220 (+   119us) service_pool.cc:224] Handling call
0709 12:27:06.718205 (+1036985us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b5400088ed4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:06.786454 (+ 68249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":450307968}
W20260709 12:27:06.818261  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.788555  9888 raft_consensus.cc:1240] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:06.722159  9814 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:06.811379  9808 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:06.825739  9961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1357) took 1101 ms. Trace:
I20260709 12:27:06.826133  9961 rpcz_store.cc:276] 0709 12:27:05.686432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.713968 (+ 27536us) service_pool.cc:224] Handling call
0709 12:27:05.714252 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.214600 (+500348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.787898 (+573298us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54001dd654. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:06.788136 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914285440}
I20260709 12:27:06.815913  9884 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:06.828585 10497 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:06.830531  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:06.841496  9814 raft_consensus.cc:2410] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:27:06.572288 12438 consensus_queue.cc:237] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:06.745806 12855 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:06.709512 12754 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:06.850245 10526 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 12:27:06.852829 10526 pending_rounds.cc:85] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b: Aborting all ops after (but not including) 9
I20260709 12:27:06.853153 10526 pending_rounds.cc:107] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 12:27:06.853447 10526 raft_consensus.cc:2889] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:06.741501 12778 consensus_queue.cc:260] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:06.855356  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:06.737484 12887 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:06.863969  9888 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:27:06.873848  9884 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:06.823536 12896 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.814051 12774 raft_consensus.cc:740] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:06.887086 12527 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.887352 12701 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:06.887646 12527 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:06.889729 12527 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:06.894958 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 914510us
I20260709 12:27:06.896488  9811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 476) took 1147 ms. Trace:
I20260709 12:27:06.896770 10496 leader_election.cc:400] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8.
I20260709 12:27:06.897799 10496 leader_election.cc:403] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:27:06.896978  9811 rpcz_store.cc:276] 0709 12:27:05.749352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.768215 (+ 18863us) service_pool.cc:224] Handling call
0709 12:27:05.768567 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:05.768975 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.769015 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:05.769462 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 12:27:06.155614 (+386152us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b18003be540. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b411e07 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f8e0b620b 00007f2f8e0bbd23 00007f2f8e0bc0d1 00007f2f8e4d7a0f
0709 12:27:06.483269 (+327655us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:06.483305 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.483368 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:06.896139 (+412771us) raft_consensus.cc:1685] finished
0709 12:27:06.896173 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:06.896417 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2975,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":12778,"spinlock_wait_cycles":24844672,"thread_start_us":327493,"threads_started":1,"wal-append.queue_time_us":1076004}
I20260709 12:27:06.898610 12770 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8.
I20260709 12:27:06.902635  9928 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:06.903532  9955 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:06.905994  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:06.908377  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:06.908758  9956 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:06.911484 12771 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:06.912693  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:06.838819 12848 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.142405  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:06.914542  9955 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:06.916625  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:06.920327 10525 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:27:06.920843 10525 pending_rounds.cc:85] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: Aborting all ops after (but not including) 6
I20260709 12:27:06.921166 10525 pending_rounds.cc:107] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:27:06.921494 10525 raft_consensus.cc:2889] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:06.923511  9960 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:06.914026  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:06.917383  9811 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:06.926613 12306 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.923650 12818 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.931064 12306 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:06.931414 12818 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:06.932161  9960 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:27:06.933151 12306 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:06.933566 12818 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:06.931361  9964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1363) took 1156 ms. Trace:
I20260709 12:27:06.934837  9964 rpcz_store.cc:276] 0709 12:27:05.775169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.775283 (+   114us) service_pool.cc:224] Handling call
0709 12:27:05.775555 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.984421 (+208866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.931158 (+946737us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54001d3154. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:06.931308 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":461607296}
W20260709 12:27:06.937752 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.833638 12336 consensus_queue.cc:1059] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:27:06.939038 12770 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.859369 12854 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:06.933624 12827 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:06.941184  9928 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:06.946432  9928 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:06.949465  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:06.951297  9808 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:27:06.956593  9959 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.004s	sys 0.025s
W20260709 12:27:06.959169  9959 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.005s	sys 0.025s
I20260709 12:27:06.837606 12559 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.087s
W20260709 12:27:06.962890  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 495963us
I20260709 12:27:06.925091 12896 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:06.939483 12770 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:06.972312  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.924623 12806 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:06.944136 12778 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:06.981683  9964 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:27:06.960031 12306 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:06.964645 12678 consensus_meta.cc:287] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.987s	user 0.009s	sys 0.002s
I20260709 12:27:07.060392 12678 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:07.062603 12678 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:06.948546 12854 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:06.985882  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:07.063292 12854 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:06.947902 12823 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:27:06.967924 12917 log.cc:927] Time spent T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:27:06.996007 12761 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:07.058873 12806 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:07.068805 12806 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:06.998586  9710 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59992 (request call id 298) took 23506 ms (client timeout 15000 ms). Trace:
I20260709 12:27:07.001013  9884 raft_consensus.cc:1240] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:06.969372 12632 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:27:07.003026  9712 catalog_manager.cc:5697] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 1 to 5, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 5 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:06.861692 12777 consensus_queue.cc:260] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:06.989763  9927 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:07.078790  9881 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.012s	sys 0.021s
W20260709 12:27:07.079120  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 89454.7us
W20260709 12:27:07.079609  9881 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.012s	sys 0.021s
I20260709 12:27:07.012786 12902 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:07.015041  9812 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:07.015326 12773 raft_consensus.cc:3055] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:07.018898  9807 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:06.963822 12421 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:07.032563  9779 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:07.092244  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 59764.6us
W20260709 12:27:07.077389 12852 consensus_meta.cc:287] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 1.060s	user 0.005s	sys 0.007s
W20260709 12:27:07.055823 10527 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.008s	sys 0.010s
I20260709 12:27:06.941182 12848 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:07.059841 12770 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:07.075698  9712 catalog_manager.cc:5697] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 1 to 4, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 4 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:07.009436  9956 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:27:07.103499  9956 pending_rounds.cc:85] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 6
I20260709 12:27:07.103885  9956 pending_rounds.cc:107] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:27:07.104171  9956 raft_consensus.cc:2889] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:07.021786 12774 consensus_queue.cc:260] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:07.070473  9710 rpcz_store.cc:269] 0709 12:26:43.492595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:43.492744 (+   149us) service_pool.cc:224] Handling call
0709 12:27:06.998507 (+23505763us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:01.689161 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:01.842244 (+153083us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:01.842314 (+    70us) write_op.cc:435] Acquired schema lock
0709 12:27:01.842336 (+    22us) tablet.cc:662] Decoding operations
0709 12:27:01.843043 (+   707us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:01.843136 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:01.843177 (+    41us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:27:01.843678 (+   501us) tablet.cc:701] Row locks acquired
0709 12:27:01.843730 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:27:01.843898 (+   168us) write_op.cc:270] Start()
0709 12:27:01.844055 (+   157us) write_op.cc:276] Timestamp: P: 1783600021843842 usec, L: 0
0709 12:27:01.844079 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:27:01.903789 (+ 59710us) log.cc:844] Serialized 1355 byte log entry
0709 12:27:02.286778 (+382989us) op_driver.cc:464] REPLICATION: finished
0709 12:27:02.465819 (+179041us) write_op.cc:301] APPLY: starting
0709 12:27:02.465948 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:02.466143 (+   195us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:02.466317 (+   174us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:02.481343 (+ 15026us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:02.481637 (+   294us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:27:02.481694 (+    57us) write_op.cc:312] APPLY: finished
0709 12:27:02.481970 (+   276us) log.cc:844] Serialized 35 byte log entry
0709 12:27:02.485119 (+  3149us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:02.485238 (+   119us) write_op.cc:454] Released schema lock
0709 12:27:02.485307 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:02.485791 (+   484us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:02.485831 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":806863,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":143267,"apply.run_cpu_time_us":2942,"apply.run_wall_time_us":19964,"num_ops":3,"prepare.queue_time_us":134533,"prepare.run_cpu_time_us":18031,"prepare.run_wall_time_us":364356,"raft.queue_time_us":120589,"raft.run_cpu_time_us":22566,"raft.run_wall_time_us":59564,"replication_time_us":442482,"thread_start_us":133376,"threads_started":4,"wal-append.queue_time_us":91056,"wal-append.run_cpu_time_us":15109,"wal-append.run_wall_time_us":1452504}]]}
W20260709 12:27:07.084532 10531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.011s	sys 0.023s
W20260709 12:27:07.105340 10531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.012s	sys 0.023s
W20260709 12:27:07.084970  9889 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.005s	sys 0.025s
I20260709 12:27:07.093617  9779 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:07.107080  9779 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:07.108119  9779 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:07.091892 12773 raft_consensus.cc:740] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:27:07.101081 10527 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.008s	sys 0.010s
I20260709 12:27:07.081952 12306 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:07.097569 12842 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:07.111269 10531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 608) took 1113 ms. Trace:
I20260709 12:27:07.098860 12421 raft_consensus.cc:697] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:07.109553  9779 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:06.961635  9928 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:07.131584  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 170023us
I20260709 12:27:07.132267  9928 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:07.133916  9928 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:27:07.110497  9889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.005s	sys 0.025s
I20260709 12:27:07.104489 12777 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:07.139621  9958 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
W20260709 12:27:07.140954  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.143486 12842 raft_consensus.cc:2749] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:07.140892 12855 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:07.144129  9779 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:07.145721  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:07.099362 12852 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:07.165560 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.177013  9812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2014) took 1001 ms. Trace:
I20260709 12:27:07.177416  9812 rpcz_store.cc:276] 0709 12:27:06.175623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.752666 (+577043us) service_pool.cc:224] Handling call
0709 12:27:07.176841 (+424175us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54001842d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:07.176955 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601170688}
I20260709 12:27:07.131733  9712 catalog_manager.cc:5697] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 6 to 7, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 7 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:07.115099 12861 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:07.113215 12744 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:07.112511 12920 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:07.150454  9810 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
W20260709 12:27:07.102550  9853 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.024s	sys 0.010s
W20260709 12:27:07.198876  9853 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.024s	sys 0.010s
W20260709 12:27:07.199589  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 825221us
I20260709 12:27:07.125906 10531 rpcz_store.cc:276] 0709 12:27:05.997877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.997984 (+   107us) service_pool.cc:224] Handling call
0709 12:27:06.111636 (+113652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.111887 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:06.386480 (+274593us) log.cc:844] Serialized 14 byte log entry
0709 12:27:07.110911 (+724431us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.110958 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:07.110994 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.111062 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.111206 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4875,"prepare.queue_time_us":599865,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":9296,"thread_start_us":873768,"threads_started":2}
I20260709 12:27:07.113497 12306 raft_consensus.cc:697] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:27:07.146121 12808 consensus_meta.cc:287] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.612s	user 0.007s	sys 0.000s
W20260709 12:27:07.112041 12836 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:27:07.201879  9853 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:07.181496  9881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2170) took 1205 ms. Trace:
W20260709 12:27:07.202051  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.144631 12855 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:07.140177 12774 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:07.149233 12778 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:07.218858  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.149150 12848 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:07.142352 12880 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:07.195080 12861 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:07.195626  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 50020.9us
I20260709 12:27:07.198400 12744 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.142043 12911 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:27:07.215539 10529 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.013s	sys 0.024s
I20260709 12:27:07.223846  9888 raft_consensus.cc:1240] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:07.219296  9712 catalog_manager.cc:5697] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 3 to 4, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 4 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:07.219053  9778 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.013s	sys 0.010s
W20260709 12:27:07.234246  9890 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.005s	sys 0.013s
I20260709 12:27:07.140429 12527 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:07.223694 12866 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.009s	sys 0.029s
I20260709 12:27:07.220041 12887 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:07.247768 12744 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:07.250198  9886 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.014s	sys 0.012s
W20260709 12:27:07.252462  9886 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.014s	sys 0.012s
W20260709 12:27:07.253863  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 173564us
I20260709 12:27:07.255609  9927 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:07.259083  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.259450  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1295) took 1249 ms. Trace:
I20260709 12:27:07.259871  9886 rpcz_store.cc:276] 0709 12:27:06.010123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.545060 (+534937us) service_pool.cc:224] Handling call
0709 12:27:06.545372 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.545593 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:06.691189 (+145596us) log.cc:844] Serialized 14 byte log entry
0709 12:27:07.259148 (+567959us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.259196 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:07.259240 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.259299 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.259400 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44064,"prepare.queue_time_us":146216,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"thread_start_us":562917,"threads_started":1}
W20260709 12:27:07.238878 12908 consensus_meta.cc:287] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.678s	user 0.009s	sys 0.002s
W20260709 12:27:07.244024  9778 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.013s	sys 0.010s
W20260709 12:27:07.265106  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 612847us
I20260709 12:27:07.268198  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:07.268877  9958 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:07.244309 10529 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.013s	sys 0.024s
W20260709 12:27:07.246119  9882 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.000s	sys 0.019s
I20260709 12:27:07.222823 12516 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:07.283996  9961 raft_consensus.cc:1240] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:07.218510  9881 rpcz_store.cc:276] 0709 12:27:05.920703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.921047 (+   344us) service_pool.cc:224] Handling call
0709 12:27:05.921325 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:05.927062 (+  5737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.927092 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:05.931113 (+  4021us) log.cc:844] Serialized 26 byte log entry
0709 12:27:06.382012 (+450899us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:07.103455 (+721443us) log.cc:844] Serialized 14 byte log entry
0709 12:27:07.125591 (+ 22136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.125711 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.125771 (+    60us) raft_consensus.cc:1685] finished
0709 12:27:07.125789 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.125960 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160229,"prepare.queue_time_us":164501,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":2437,"raft.queue_time_us":21949,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":11563,"thread_start_us":1053691,"threads_started":2,"wal-append.queue_time_us":765986}
I20260709 12:27:07.288393  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:07.289094  9886 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:07.244108  9890 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.006s	sys 0.013s
W20260709 12:27:07.272670  9882 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.000s	sys 0.019s
I20260709 12:27:07.275621  9884 raft_consensus.cc:1240] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:27:07.281780  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:07.291801  9956 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:07.283011  9853 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:07.247589 12861 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:07.295270  9958 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:27:07.297128  9884 raft_consensus.cc:1240] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:07.302460  9956 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:07.309531  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:07.308851  9712 catalog_manager.cc:5697] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 1 to 2, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 2 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:07.146646 12773 consensus_queue.cc:260] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:07.310098  9956 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:07.315848  9958 raft_consensus.cc:1240] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:07.219307 12808 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:07.249238 12866 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.009s	sys 0.029s
W20260709 12:27:07.317349 12909 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.010s	sys 0.014s
W20260709 12:27:07.317394  9883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.011s	sys 0.015s
I20260709 12:27:07.318645 12306 consensus_queue.cc:237] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:07.316805 12765 consensus_meta.cc:287] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.004s
W20260709 12:27:07.321669 12881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.023s	sys 0.017s
I20260709 12:27:07.258656 12880 raft_consensus.cc:697] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:27:07.305313  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.328529  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 192992us
I20260709 12:27:07.330965 10531 raft_consensus.cc:1240] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:07.332810  9810 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:27:07.334185  9883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.011s	sys 0.015s
I20260709 12:27:07.319451  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:07.308218 12855 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:07.314677 12778 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:07.319552  9887 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.007s	sys 0.022s
I20260709 12:27:07.381201  9712 catalog_manager.cc:5697] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:07.382248  9887 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.007s	sys 0.023s
I20260709 12:27:07.382393  9881 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:07.284340 12845 consensus_queue.cc:1059] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:27:07.343755 10525 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 7. Current term is 8. Ops: []
W20260709 12:27:07.334640 12909 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.011s	sys 0.014s
I20260709 12:27:07.343501 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:07.380792 12881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.023s	sys 0.017s
I20260709 12:27:07.298094 12908 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:07.400799  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:07.391304 10532 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
W20260709 12:27:07.385576  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.408341  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.410986 12940 log.cc:927] Time spent T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 12:27:07.411757  9712 catalog_manager.cc:5697] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 1 to 2, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 2 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:07.413662  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:07.415824 12883 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:07.416481 12883 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:07.420060 12883 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:07.412616 12701 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:07.421451 12701 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:07.421988 12701 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:07.423234 12744 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:07.424325 12701 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:07.425333 12744 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:07.378683 12863 consensus_meta.cc:287] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 1.395s	user 0.012s	sys 0.001s
I20260709 12:27:07.425794  9889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1286) took 1430 ms. Trace:
I20260709 12:27:07.425812  9884 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:07.426169 12863 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:07.428210 12863 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:07.430568  9815 raft_consensus.cc:2368] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8.
I20260709 12:27:07.431586 12863 consensus_queue.cc:1059] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:07.432345 12883 consensus_queue.cc:1059] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:07.433228 12864 raft_consensus.cc:3055] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:07.433723 12864 raft_consensus.cc:740] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:07.426174  9889 rpcz_store.cc:276] 0709 12:27:05.994902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.473107 (+478205us) service_pool.cc:224] Handling call
0709 12:27:06.473359 (+   252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:06.473696 (+   337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.473723 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:06.474139 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 12:27:07.136080 (+661941us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:07.136116 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.136194 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.425596 (+289402us) raft_consensus.cc:1685] finished
0709 12:27:07.425616 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.425737 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":4798,"spinlock_wait_cycles":1792,"thread_start_us":602821,"threads_started":1,"wal-append.queue_time_us":893139}
I20260709 12:27:07.435122 12904 raft_consensus.cc:3055] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:07.435515 12904 raft_consensus.cc:740] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:07.435626  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:07.308746 12421 consensus_queue.cc:237] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:07.433943 12701 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:07.436348 12904 consensus_queue.cc:260] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:07.437497 12904 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:07.434733 12864 consensus_queue.cc:260] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:07.442056  9884 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:07.447794  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:07.413758  9712 catalog_manager.cc:5697] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 2 to 3, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 3 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:07.449432  9712 catalog_manager.cc:5697] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 3 to 5, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 5 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:07.450841  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.336798 12920 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:07.338510 12773 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:07.481360  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:07.483088 12864 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:07.463290 12827 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:07.485531  9955 raft_consensus.cc:1240] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:07.335511 12848 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:07.334708 12736 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.437211 12701 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:07.468441  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:07.434178 12692 consensus_meta.cc:287] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.666s	user 0.006s	sys 0.002s
I20260709 12:27:07.469311  9808 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:27:07.466873 12843 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.000s	sys 0.021s
I20260709 12:27:07.470763  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:07.559713  9881 raft_consensus.cc:2393] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:07.471012  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:07.560598  9812 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:07.472049  9957 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:07.473097 12908 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:07.338698 12943 consensus_queue.cc:1175] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "963185e117384b2085d7cea02a64478b" responder_term: 10 status { last_received { term: 7 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 9. Current term is 10. Ops: [9.6-9.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:07.474671  9888 raft_consensus.cc:1240] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:27:07.475442 12885 consensus_meta.cc:287] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 1.226s	user 0.011s	sys 0.000s
I20260709 12:27:07.464236  9884 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:27:07.381466 12896 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:07.494541  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:07.496610  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:07.587832  9956 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
W20260709 12:27:07.588202  9959 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.003s	sys 0.032s
W20260709 12:27:07.589243  9959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.003s	sys 0.032s
I20260709 12:27:07.590759  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1366) took 1734 ms. Trace:
W20260709 12:27:07.597115 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.593317  9959 rpcz_store.cc:276] 0709 12:27:05.856036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.370485 (+514449us) service_pool.cc:224] Handling call
0709 12:27:06.371211 (+   726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.371771 (+   560us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:27:07.027662 (+655891us) log.cc:844] Serialized 14 byte log entry
0709 12:27:07.590343 (+562681us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.590414 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:07.590475 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.590557 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.590699 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":969378,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"thread_start_us":1197931,"threads_started":2}
I20260709 12:27:07.402536 12778 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:07.494983  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:07.514940  9815 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2013) took 1339 ms (client timeout 1714 ms). Trace:
W20260709 12:27:07.614362  9815 rpcz_store.cc:269] 0709 12:27:06.175306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.380441 (+205135us) service_pool.cc:224] Handling call
0709 12:27:07.514685 (+1134244us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b54002b0054. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:07.514866 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2179540736}
I20260709 12:27:07.495965  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:07.615469  9958 raft_consensus.cc:2368] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 8. Current term is 9.
I20260709 12:27:07.513181 12827 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:07.521119  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:07.570834 12843 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.000s	sys 0.021s
W20260709 12:27:07.466349  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.555267 10497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.007s	sys 0.020s
W20260709 12:27:07.632057 10497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.008s	sys 0.020s
W20260709 12:27:07.632414 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 693690us
I20260709 12:27:07.562044  9779 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:07.462966 12845 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.573120  9813 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 6. Current term is 7. Ops: []
W20260709 12:27:07.644739  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 82788.2us
I20260709 12:27:07.502876 12920 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:07.584473 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:07.585475 10496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.016s	sys 0.016s
I20260709 12:27:07.656435  9807 raft_consensus.cc:2410] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:27:07.657418 10496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.016s	sys 0.016s
I20260709 12:27:07.654587  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:07.658146  9884 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:07.658677 10496 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:07.659637  9887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2181) took 1558 ms. Trace:
W20260709 12:27:07.555029 12850 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.047s	sys 0.078s
I20260709 12:27:07.513361 12836 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:07.606307 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:07.607811  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:07.513062 12823 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:07.543968  9712 catalog_manager.cc:5697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 3 to 4, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 4 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:07.652076 12774 consensus_queue.cc:1059] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:27:07.671459 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:07.673834 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:07.679178 10525 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:07.554077 12736 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:07.620738  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.627123  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:07.640165 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.681075 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.682040 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.640859  9961 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:07.643082  9881 raft_consensus.cc:1240] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:07.584326  9928 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:07.602888 12336 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.019s	sys 0.006s
I20260709 12:27:07.585937 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:07.644745 12827 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:07.667402 12771 consensus_meta.cc:287] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.755s	user 0.011s	sys 0.002s
I20260709 12:27:07.589357 12761 consensus_queue.cc:1059] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:27:07.669030 12920 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:07.669788  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:07.675112  9957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1369) took 1094 ms. Trace:
W20260709 12:27:07.684320 12336 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.020s	sys 0.006s
I20260709 12:27:07.722640  9809 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:07.682185 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:27:07.620312 12900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.022s	sys 0.043s
I20260709 12:27:07.501116  9886 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
W20260709 12:27:07.683162 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.555248 12848 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:07.684947  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 100674us
I20260709 12:27:07.646369 12842 consensus_queue.cc:1059] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:27:07.647588 12883 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
W20260709 12:27:07.670265 12854 consensus_meta.cc:287] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.606s	user 0.007s	sys 0.000s
I20260709 12:27:07.645627 12863 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.647408 12744 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:07.664366  9887 rpcz_store.cc:276] 0709 12:27:06.101394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.714479 (+613085us) service_pool.cc:224] Handling call
0709 12:27:06.714884 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.715129 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:27:06.715484 (+   355us) log.cc:844] Serialized 14 byte log entry
0709 12:27:07.658866 (+943382us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.659347 (+   481us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:07.659392 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.659453 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.659568 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1037,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":42517,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":70,"thread_start_us":942081,"threads_started":2}
W20260709 12:27:07.671548 12947 log.cc:927] Time spent T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.189s	user 0.002s	sys 0.000s
W20260709 12:27:07.670519 12850 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.048s	sys 0.079s
W20260709 12:27:07.670881 12949 log.cc:927] Time spent T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:27:07.713168  9957 rpcz_store.cc:276] 0709 12:27:06.580241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.723829 (+143588us) service_pool.cc:224] Handling call
0709 12:27:06.724067 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.571456 (+847389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.674869 (+103413us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b54001522d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:07.675055 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1719717248}
I20260709 12:27:07.713652 10530 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:07.680940  9811 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:07.801831 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:07.674412 12823 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:07.728678 10525 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:27:07.636601 12896 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:27:07.616218 12885 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:07.675436 12943 raft_consensus.cc:3055] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:07.666488  9778 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:07.811374  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 144990us
I20260709 12:27:07.811968  9888 raft_consensus.cc:1240] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:07.812012  9778 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:07.671594 12808 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:07.732564  9928 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:07.734934 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:07.815423 10531 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
W20260709 12:27:07.815627  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 83148.5us
W20260709 12:27:07.733052  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 473865us
I20260709 12:27:07.604311 12880 consensus_queue.cc:237] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:07.730715 12900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.023s	sys 0.043s
I20260709 12:27:07.649477 12845 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:07.684350 12765 consensus_queue.cc:1059] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 12:27:07.799553 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.798414 12438 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.011s	sys 0.010s
W20260709 12:27:07.803458 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 121350us
I20260709 12:27:07.832480 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:07.833514 10525 raft_consensus.cc:2393] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 8: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:07.716017  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:07.697407 12516 raft_consensus.cc:697] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:07.734464 12964 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:07.670882 12836 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:07.805895 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:07.775434 12911 raft_consensus.cc:697] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:07.819972 12904 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:07.734925 12920 raft_consensus.cc:3055] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:07.819043 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:07.794610 12744 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.816490  9927 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:07.820523  9928 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:07.772346 12818 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:07.868067 10529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 842) took 1383 ms. Trace:
I20260709 12:27:07.799029 12701 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:07.795745 12881 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:07.805480 12754 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.811070 12559 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:07.840694  9963 raft_consensus.cc:1240] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:27:07.842661 10497 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:07.846093 12855 raft_consensus.cc:697] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:27:07.798832  9853 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.000s	sys 0.013s
I20260709 12:27:07.735270 12843 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:07.817229 12943 raft_consensus.cc:740] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:07.822954 12908 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:27:07.856142  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.862696  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 46286.8us
W20260709 12:27:07.831912 12438 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.011s	sys 0.010s
I20260709 12:27:07.794579 12854 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:07.799741 12863 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:07.866573  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 220908us
I20260709 12:27:07.871676 10528 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:27:07.854561  9697 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d1e4bd6e7a424475b1d707bfa268d54e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader b011791796d1457284b857d7d3422195 (127.8.111.67:42253) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b011791796d1457284b857d7d3422195 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:07.830293 12842 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:07.868578 10529 rpcz_store.cc:276] 0709 12:27:06.484680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.484804 (+   124us) service_pool.cc:224] Handling call
0709 12:27:06.528914 (+ 44110us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:06.539087 (+ 10173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.539115 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:06.553772 (+ 14657us) log.cc:844] Serialized 26 byte log entry
0709 12:27:07.272160 (+718388us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:07.272212 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.277502 (+  5290us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.671032 (+393530us) spinlock_profiling.cc:243] Waited 55.8 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:07.852589 (+181557us) raft_consensus.cc:1685] finished
0709 12:27:07.852618 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.867986 (+ 15368us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45,"raft.queue_time_us":17054,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":3304,"spinlock_wait_cycles":130217472,"thread_start_us":694362,"threads_started":1,"wal-append.queue_time_us":915180}
W20260709 12:27:07.888044  9853 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.000s	sys 0.014s
W20260709 12:27:07.891618 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 49053.8us
W20260709 12:27:07.903358  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 620387us
I20260709 12:27:07.863251 12920 raft_consensus.cc:740] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:07.867128 12744 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:07.856845 12964 raft_consensus.cc:697] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:27:07.889218 12952 log.cc:927] Time spent T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
I20260709 12:27:07.875496 12904 raft_consensus.cc:697] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:07.904093  9853 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:07.906450  9697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 107386us
I20260709 12:27:07.907442 10533 raft_consensus.cc:1240] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 5. Current term is 6. Ops: []
W20260709 12:27:07.892712 12953 log.cc:927] Time spent T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.412s	user 0.004s	sys 0.001s
I20260709 12:27:07.887475 12306 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:27:07.892235  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 79350.5us
I20260709 12:27:07.910169  9885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1291) took 1900 ms. Trace:
I20260709 12:27:07.855914 12777 consensus_queue.cc:1059] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:27:07.976724  9960 raft_consensus.cc:1240] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:07.888674 12559 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:07.883121 12818 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:07.906057 12842 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.891300 12883 consensus_queue.cc:1059] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:27:07.918465  9885 rpcz_store.cc:276] 0709 12:27:06.009414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.531433 (+522019us) service_pool.cc:224] Handling call
0709 12:27:06.531788 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:06.532038 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.532076 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:06.548999 (+ 16923us) log.cc:844] Serialized 26 byte log entry
0709 12:27:07.057311 (+508312us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:07.057350 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.057413 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.909983 (+852570us) raft_consensus.cc:1685] finished
0709 12:27:07.910008 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.910119 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":472868,"threads_started":1,"wal-append.queue_time_us":835471}
W20260709 12:27:07.974845 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 59311.3us
I20260709 12:27:07.898973 12692 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:27:08.023504  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 119494us
W20260709 12:27:07.998667  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 92216.9us
I20260709 12:27:07.892228 12944 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.020758  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:08.044188  9853 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:08.050876  9881 raft_consensus.cc:2393] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:27:08.049901 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 75841.5us
I20260709 12:27:08.059343  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:07.918653 12778 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:07.887501 12881 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:07.889642 12754 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:07.972780 12306 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.915213 12984 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:07.999509 12864 consensus_meta.cc:287] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.002s
W20260709 12:27:08.070437  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 95797.7us
W20260709 12:27:08.082509 10530 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 835) took 2207 ms (client timeout 2022 ms). Trace:
I20260709 12:27:08.083648  9927 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:27:08.089632  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 45552.1us
I20260709 12:27:08.022316 12559 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:08.092685 10530 rpcz_store.cc:269] 0709 12:27:05.845019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.845218 (+   199us) service_pool.cc:224] Handling call
0709 12:27:08.051771 (+2206553us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54006801d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:08.051884 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4142733184}
I20260709 12:27:08.096902  9853 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:08.097205  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:08.097792  9961 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:08.098026  9853 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:08.096932  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:08.102845  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:08.103253  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:08.105103  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:08.039139 12842 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:08.049221 12692 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.184710  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:08.064635 12975 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:08.188329 12823 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:08.188262  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:08.072827 12827 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:08.059415 12976 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:08.092116 12306 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:08.096345 12974 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:08.093704 12884 consensus_meta.cc:287] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 1.568s	user 0.014s	sys 0.000s
I20260709 12:27:08.183807 12692 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:08.188871  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:08.092447 12977 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:07.996259 12516 consensus_queue.cc:237] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:08.095104 12920 consensus_queue.cc:260] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.190090 12970 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:08.220773 12952 log.cc:927] Time spent T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:27:08.192184 12978 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.193789  9963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1367) took 1703 ms. Trace:
I20260709 12:27:08.245824  9963 rpcz_store.cc:276] 0709 12:27:06.490046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.709810 (+219764us) service_pool.cc:224] Handling call
0709 12:27:06.839498 (+129688us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:07.886377 (+1046879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.193518 (+307141us) spinlock_profiling.cc:243] Waited 990 ms on lock 0x7b54000898d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:08.193725 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2276467968}
I20260709 12:27:08.062553 12911 consensus_queue.cc:237] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:08.108618 12972 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:08.094152 12739 consensus_meta.cc:287] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 1.610s	user 0.009s	sys 0.004s
I20260709 12:27:08.260936 12836 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:08.261881 12854 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:08.263590 12854 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:08.264416 12885 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:08.265039 12885 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.265489 12885 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.266623 12920 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:08.266109 12306 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.267645 12885 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:08.267819  9806 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:08.268280 12864 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.268905 12306 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:08.268739 12864 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:08.185595 12904 consensus_queue.cc:237] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:08.270905 12818 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:08.227051 12974 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:27:08.237476 12992 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:27:08.211481 12964 consensus_queue.cc:237] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:08.206014 12701 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:27:08.205818  9960 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:08.036765 12963 consensus_queue.cc:1059] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.203s
W20260709 12:27:08.189373  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 91412.6us
I20260709 12:27:08.286603  9853 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:08.288787  9853 leader_election.cc:400] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4.
I20260709 12:27:08.289176  9853 leader_election.cc:403] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:27:08.211097 12953 log.cc:927] Time spent T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:27:08.093279 12765 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
I20260709 12:27:08.184950 12896 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:08.108150 12736 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:08.187225  9961 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
W20260709 12:27:08.237927  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 236257us
I20260709 12:27:08.207088 12848 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:08.227150 12973 log.cc:927] Time spent T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.322s	user 0.000s	sys 0.000s
I20260709 12:27:08.055445 12943 consensus_queue.cc:260] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.071846 12944 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.253602  9964 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 12:27:08.255481  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.229712 12975 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:08.178077 12855 consensus_queue.cc:237] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.238447 12977 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:08.313109 12981 log.cc:927] Time spent T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 12:27:08.259402 12972 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:08.230593 12527 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:27:08.301077  9853 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:08.304023  9890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2178) took 2203 ms. Trace:
I20260709 12:27:08.337915  9890 rpcz_store.cc:276] 0709 12:27:06.100553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.560555 (+460002us) service_pool.cc:224] Handling call
0709 12:27:06.584735 (+ 24180us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:06.585069 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.585097 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:06.585564 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 12:27:07.290621 (+705057us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:07.329410 (+ 38789us) log.cc:844] Serialized 14 byte log entry
0709 12:27:07.808349 (+478939us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.808449 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:08.303754 (+495305us) raft_consensus.cc:1685] finished
0709 12:27:08.303784 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.303948 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32373,"prepare.queue_time_us":63405,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":4034,"raft.queue_time_us":96243,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":91771,"thread_start_us":1064429,"threads_started":2,"wal-append.queue_time_us":691247}
I20260709 12:27:08.230365 12884 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:08.315106  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.302584 12970 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4.
I20260709 12:27:08.321533  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:08.315567  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 211961us
I20260709 12:27:08.368854  9885 raft_consensus.cc:2393] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 5: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:08.299430 12818 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:08.313251 12984 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:27:08.313071 12960 log.cc:927] Time spent T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.446s	user 0.000s	sys 0.001s
I20260709 12:27:08.327291  9882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2176) took 2227 ms. Trace:
I20260709 12:27:08.222301 12976 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:08.291074 12994 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:08.348196  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 47235.5us
W20260709 12:27:08.368014  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 171646us
I20260709 12:27:08.369625  9778 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:08.370707  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:08.382443  9886 raft_consensus.cc:1275] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:08.418078  9884 raft_consensus.cc:2393] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 3: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:08.418246  9853 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:08.419878  9962 raft_consensus.cc:1240] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:08.380694  9882 rpcz_store.cc:276] 0709 12:27:06.099879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.561716 (+461837us) service_pool.cc:224] Handling call
0709 12:27:06.587797 (+ 26081us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:06.588105 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.588131 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:06.588507 (+   376us) log.cc:844] Serialized 26 byte log entry
0709 12:27:07.293392 (+704885us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:07.354252 (+ 60860us) log.cc:844] Serialized 14 byte log entry
0709 12:27:07.653106 (+298854us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b18004a9920. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b3fd2a6 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db
0709 12:27:07.734617 (+ 81511us) spinlock_profiling.cc:243] Waited 57.9 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:07.810462 (+ 75845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.810548 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:08.326878 (+516330us) raft_consensus.cc:1685] finished
0709 12:27:08.326907 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.327195 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36353,"prepare.queue_time_us":160752,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":69886,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":94916,"spinlock_wait_cycles":182162048,"thread_start_us":1046787,"threads_started":2,"wal-append.queue_time_us":792955}
I20260709 12:27:08.385829 12995 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.315512 12739 consensus_queue.cc:1059] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:27:08.344053 12975 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.421648  9853 leader_election.cc:400] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8.
I20260709 12:27:08.258174 12978 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:08.437636  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 68079.3us
I20260709 12:27:08.438602  9778 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:08.420462 12701 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.442637 12701 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.444367 12881 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:08.444785 12701 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:08.444947 12881 raft_consensus.cc:2764] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:27:08.445358 12701 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:08.446652 12761 raft_consensus.cc:3055] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:08.447072 12761 raft_consensus.cc:740] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:08.451056 12754 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:08.452072 12990 log.cc:927] Time spent T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 12:27:08.459623 12976 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:08.459992 12977 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:08.461190 12944 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:08.461251  9807 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
W20260709 12:27:08.461632 12773 consensus_meta.cc:287] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.983s	user 0.006s	sys 0.003s
I20260709 12:27:08.463162 12972 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:08.464804 13005 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:08.465370 13005 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:08.467533 12739 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:08.467633 13005 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:08.471618 12884 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:08.431888 12982 log.cc:927] Time spent T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.409s	user 0.001s	sys 0.000s
I20260709 12:27:08.390869 12984 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:08.476047 12984 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:08.323808 12985 consensus_queue.cc:1059] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 12:27:08.488174  9964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1372) took 1205 ms. Trace:
I20260709 12:27:08.478484  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 477) took 1068 ms. Trace:
I20260709 12:27:08.488579  9964 rpcz_store.cc:276] 0709 12:27:07.282946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.283113 (+   167us) service_pool.cc:224] Handling call
0709 12:27:07.283487 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:08.317195 (+1033708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.487900 (+170705us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b54001d3b54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:08.488105 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2208753024}
I20260709 12:27:08.489092  9810 rpcz_store.cc:276] 0709 12:27:07.410506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.437087 (+ 26581us) service_pool.cc:224] Handling call
0709 12:27:07.437380 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:07.437852 (+   472us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.437884 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:07.438710 (+   826us) log.cc:844] Serialized 26 byte log entry
0709 12:27:07.736601 (+297891us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:07.736659 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.736749 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:08.478251 (+741502us) raft_consensus.cc:1685] finished
0709 12:27:08.478288 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.478426 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":693,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"thread_start_us":297477,"threads_started":1,"wal-append.queue_time_us":443668}
I20260709 12:27:08.490988 10533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 607) took 2494 ms. Trace:
I20260709 12:27:08.491422 10533 rpcz_store.cc:276] 0709 12:27:05.996827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.996931 (+   104us) service_pool.cc:224] Handling call
0709 12:27:05.997195 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.918056 (+1920861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.490722 (+572666us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b54000c9254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:08.490888 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4392500480}
W20260709 12:27:08.491972  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 53472us
I20260709 12:27:08.437659 12975 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:08.485486 12956 log.cc:927] Time spent T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.755s	user 0.001s	sys 0.002s
I20260709 12:27:08.485903 12978 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:08.486678 12948 log.cc:927] Time spent T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.812s	user 0.000s	sys 0.002s
I20260709 12:27:08.421689 12970 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:08.505613 12970 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:08.505694  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:08.506059 12970 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:08.493849  9778 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:08.507800 12951 log.cc:927] Time spent T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.862s	user 0.001s	sys 0.001s
I20260709 12:27:08.511896 12559 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.436143 12995 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.515892 12692 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.518697 13004 raft_consensus.cc:3055] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:08.503602 12848 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:08.478655 12850 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.522753  9884 raft_consensus.cc:2393] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 7: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
W20260709 12:27:08.522943  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 101534us
W20260709 12:27:08.523041 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 343497us
W20260709 12:27:08.560391  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 318922us
W20260709 12:27:08.564297  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 70520.5us
W20260709 12:27:08.568418 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 492500us
I20260709 12:27:08.434147 12994 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:08.584084  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:08.570555  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 469572us
I20260709 12:27:08.587543  9927 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:08.587744  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:08.588543  9958 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 2.
I20260709 12:27:08.579182  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:08.594076  9853 connection.cc:256] RPC call timeout handler was delayed by -1.1776179100002082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
I20260709 12:27:08.593915  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:08.595422  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:08.597355  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:08.599462  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:08.602233  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:08.602876  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:08.614262  9964 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:08.614889  9958 raft_consensus.cc:2393] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:08.615969  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:08.618798  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:08.616400  9810 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:08.621191  9888 raft_consensus.cc:1275] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:27:08.603854  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:08.622740  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:08.624074  9890 raft_consensus.cc:2410] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:27:08.621045  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:08.622884  9809 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:27:08.596123  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:08.626704  9959 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:27:08.607854  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:08.625949  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:08.627579  9960 raft_consensus.cc:1240] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:08.628185  9809 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:08.635442  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:08.569293 12904 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:08.641160  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:08.641283  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:08.637212  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:08.642901 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 51425.9us
I20260709 12:27:08.568146 13004 raft_consensus.cc:740] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:08.642206  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:08.652268  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:08.579813 12883 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.651492  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:08.653487  9812 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:27:08.606117 12773 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.626085 12845 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:08.662348  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:08.671384  9888 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:08.610405 12985 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:08.598111 13001 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:08.645334 12861 consensus_meta.cc:287] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 1.330s	user 0.007s	sys 0.005s
I20260709 12:27:08.629300 12964 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:08.661163  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:08.651906 12754 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.625128 12701 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.624737 12632 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.618571 13003 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:08.713392  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:08.665784  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:08.722016  9890 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:08.659104 12904 raft_consensus.cc:697] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:08.560366 12842 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.707631 13006 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.595008 12850 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:08.719019  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 88249.7us
I20260709 12:27:08.708784 12900 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:27:08.763554  9853 connection.cc:256] RPC call timeout handler was delayed by -1.082217910000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 12:27:08.764055  9853 connection.cc:256] RPC call timeout handler was delayed by -1.0282179099999667s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
I20260709 12:27:08.659529 12883 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:08.727231  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:08.766841  9853 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:08.769438  9888 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:08.726895 13000 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.773492  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:08.779894  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:08.782083  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:08.774323  9853 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:08.786589  9958 raft_consensus.cc:2393] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 8: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:08.672300 12848 consensus_queue.cc:1059] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 12:27:08.694717 12773 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.787873  9853 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:08.788800  9810 raft_consensus.cc:2410] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:27:08.789141  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:08.794059  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:08.790046  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:08.791064  9890 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:08.794931  9956 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:08.771921 12902 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.023s	sys 0.042s
I20260709 12:27:08.795385  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:08.726070 12632 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.770541 12765 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.715171 12964 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.802059  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:08.806927  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:08.807291  9853 leader_election.cc:400] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 3 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 3. Current term is 4.
I20260709 12:27:08.807369  9963 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:08.802142  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:08.798032  9814 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:08.721599 12754 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.726538 12701 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.806030  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:08.772681 12944 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:08.773005 12972 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:08.803105 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:08.808279  9853 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:08.800808 12902 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.024s	sys 0.042s
I20260709 12:27:08.755641 13003 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.833863 13007 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:08.810525 12881 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:08.810948 13005 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.812193  9807 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:08.836254  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:08.836364 10496 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:08.807560  9958 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:08.836781  9927 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:08.809720 12744 consensus_meta.cc:287] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.886s	user 0.011s	sys 0.000s
I20260709 12:27:08.821419  9956 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:08.770712 13006 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.773154 12900 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.812947 12964 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:08.717756 12985 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:08.829142 12761 consensus_queue.cc:260] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:08.830668 12963 raft_consensus.cc:3055] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:27:08.831766 13014 log.cc:927] Time spent T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 12:27:08.831959 12967 log.cc:927] Time spent T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195: Append to log took a long time: real 1.014s	user 0.001s	sys 0.001s
W20260709 12:27:08.832585 13012 log.cc:927] Time spent T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:27:08.832873 13011 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:08.833289 13008 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:08.833945 12946 log.cc:927] Time spent T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.645s	user 0.001s	sys 0.001s
I20260709 12:27:08.837646 10496 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:08.796872 12880 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:08.713852 12861 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:08.792171 12977 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:08.836793  9807 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:08.823046 13002 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:08.824308 12754 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:08.715457 13001 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:08.840068 12836 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:08.876998 13016 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:27:08.877624 12969 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:08.878044 13013 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:08.879375 12985 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:08.879848 12852 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:08.879388  9889 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1303) took 1446 ms (client timeout 1691 ms). Trace:
I20260709 12:27:08.883733  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:08.928131  9889 rpcz_store.cc:269] 0709 12:27:07.432596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.435373 (+  2777us) service_pool.cc:224] Handling call
0709 12:27:08.879191 (+1443818us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540027a454. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:08.879328 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2842882304}
I20260709 12:27:08.812515 12765 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.847517 12978 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:08.848098 12692 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:08.891098 12880 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.894752 12761 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:08.841465 12972 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.835428 12944 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.896070 12861 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:08.897089 10527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 844) took 2385 ms. Trace:
I20260709 12:27:08.790150 13000 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.851342 12559 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
W20260709 12:27:08.898312 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 60721.5us
I20260709 12:27:08.901166  9807 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:08.871197 12963 raft_consensus.cc:740] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:08.904002  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:08.947292  9955 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:08.901535 12848 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.927335 12632 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:08.929543  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:08.936234 12994 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:08.875102 12975 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:08.786059 13004 consensus_queue.cc:260] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:08.933126  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.934018  9815 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:27:08.924526 12754 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:08.948325 13003 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:08.873997 12904 consensus_queue.cc:237] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:08.938665  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:08.834710 13007 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:08.943476  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 135257us
I20260709 12:27:08.982888  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:08.984503  9853 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:08.890106 12902 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:08.845989 13005 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.892933 13008 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:09.010226 12852 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:08.951476 12848 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:09.013756 12852 raft_consensus.cc:697] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:09.014779 13008 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:08.942662 10527 rpcz_store.cc:276] 0709 12:27:06.513833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.524164 (+ 10331us) service_pool.cc:224] Handling call
0709 12:27:06.524425 (+   261us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:06.530880 (+  6455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.530930 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:06.532555 (+  1625us) log.cc:844] Serialized 52 byte log entry
0709 12:27:07.110927 (+578372us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:07.126878 (+ 15951us) log.cc:844] Serialized 14 byte log entry
0709 12:27:07.251839 (+124961us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b4800180258. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f93445aa1 00007f2f9343cb37 00007f2f9343c9ca 00007f2f9353426f 00007f2f93533f37 00007f2f9354855c 00007f2f93548508 00007f2f93548488 00007f2f93548443 00007f2f935476ec 00007f2f92471a96
0709 12:27:07.421274 (+169435us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b180043efa0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b3a9c0a 00007f2f94ae9219 00007f2f8b431a40 00007f2f8b42c4e4 00007f2f8b42c455 00007f2f91f143c7 00007f2f8e5269a7 00007f2f8e5360bf 00007f2f8e536038
0709 12:27:07.421449 (+   175us) log.cc:844] Serialized 14 byte log entry
0709 12:27:07.421623 (+   174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.421689 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.482757 (+ 61068us) spinlock_profiling.cc:243] Waited 7.49 ms on lock 0x7b180043efa0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f3f3 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:27:07.673070 (+190313us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x7b180043efa0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f522 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:27:08.091194 (+418124us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b180043efa0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f3f3 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:27:08.833239 (+742045us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:08.896776 (+ 63537us) raft_consensus.cc:1685] finished
0709 12:27:08.896798 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.897016 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12556,"prepare.queue_time_us":562706,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":62,"raft.queue_time_us":36025,"raft.run_cpu_time_us":2728,"raft.run_wall_time_us":129827,"spinlock_wait_cycles":214419968,"thread_start_us":557969,"threads_started":1,"wal-append.queue_time_us":934003}
I20260709 12:27:09.015187 12848 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:08.924847 12836 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:08.948853  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:09.019409 13020 log.cc:927] Time spent T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:27:09.019564  9807 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:27:09.020453  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:08.985474 12975 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:09.020753 12836 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:08.949404 10496 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:08.889899 12995 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:08.941059 12777 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.000s	sys 0.008s
W20260709 12:27:09.021677 12777 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.001s	sys 0.008s
I20260709 12:27:09.022013  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:09.022529  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:09.022699  9882 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 3.
I20260709 12:27:09.023336  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:09.023623  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:09.024199 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 74840.1us
I20260709 12:27:09.024451 12842 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:09.024642  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:09.025008 12842 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:09.025293 13016 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:08.987442 12978 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:27:09.025373 10496 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:09.025461 12842 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:09.025467  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:09.023562  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:08.982124 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.930419 12969 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:08.985662  9853 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:09.028560 13024 log.cc:927] Time spent T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:27:09.029249 12842 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:09.029222  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 43642.9us
I20260709 12:27:09.030362  9853 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:09.031536  9853 leader_election.cc:400] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 8. Current term is 9.
I20260709 12:27:09.031793  9853 leader_election.cc:403] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:27:08.989336  9964 raft_consensus.cc:1240] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:08.994518 12984 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.036648 12984 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:09.039655 12984 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:08.996605 12739 consensus_meta.cc:287] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.528s	user 0.010s	sys 0.000s
I20260709 12:27:08.997431 12900 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:08.999377 12972 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:09.005165 12843 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:09.006906  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:09.084767  9814 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:09.008651  9962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1365) took 3188 ms. Trace:
I20260709 12:27:09.008947 12778 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.984691 12773 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:09.010553  9884 raft_consensus.cc:2393] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:08.985720 13006 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:09.012640  9955 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:09.013486 12808 raft_consensus.cc:3055] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:08.948815  9889 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:08.846055 12744 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:09.081646 12739 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:09.018604 13004 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:09.113204  9809 raft_consensus.cc:2393] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 9: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:09.021136  9807 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:27:09.021191 13005 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:09.027906  9882 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:09.026885 12770 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:27:09.033859 12965 log.cc:927] Time spent T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 1.259s	user 0.002s	sys 0.000s
I20260709 12:27:09.033790 12975 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:09.034533 12978 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:09.057665  9853 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:09.067667  9957 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:09.012880 12902 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:27:09.071223 12941 log.cc:927] Time spent T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 1.574s	user 0.003s	sys 0.006s
I20260709 12:27:09.073932 12863 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:09.074607 12818 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 8. Current term is 9.
I20260709 12:27:09.073987 13000 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:09.076195 12765 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:09.077057 12944 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:09.079905  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 46384us
I20260709 12:27:09.028574 12969 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:09.080422 12842 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:09.080953 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 53372.5us
I20260709 12:27:09.077975 13007 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:09.090843  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:09.087997  9962 rpcz_store.cc:276] 0709 12:27:05.820230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.248743 (+428513us) service_pool.cc:224] Handling call
0709 12:27:06.249177 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.420418 (+2171241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.008433 (+588015us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b54000b36d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:09.008597 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4991454976}
I20260709 12:27:09.137884 10496 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:09.138922 10496 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:08.892308 13011 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:09.015101  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.103955 12808 raft_consensus.cc:740] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:09.108672 12744 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:09.093617 12777 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.083215 12974 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:09.091665 12843 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:09.014708 12852 consensus_queue.cc:237] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:09.155079  9811 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:09.126528  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:09.121321  9889 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:09.126819  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:09.157739  9882 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:09.078408 12963 consensus_queue.cc:260] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:09.131985  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 74411.6us
I20260709 12:27:09.161264  9853 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:09.149585 13013 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:09.118480 12739 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:09.100690 12778 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:09.122828 12978 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:09.126430 12902 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:09.124853 12770 raft_consensus.cc:697] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:09.142503 10496 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:09.182235  9957 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:09.131659 13005 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:09.146420 13026 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:09.133198  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:09.185925  9955 raft_consensus.cc:2393] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:09.141171 12842 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:09.151319 12692 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:09.171893 13007 raft_consensus.cc:2764] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:27:09.184262  9882 raft_consensus.cc:1240] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:27:09.167191  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:09.178587 13013 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.176995  9889 raft_consensus.cc:1275] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:27:09.180498 12978 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:09.154446 12777 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:09.183385 12963 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:09.186968 13006 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:09.188046 13026 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.209203  9807 raft_consensus.cc:1275] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:27:09.212404  9885 raft_consensus.cc:1275] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:09.214759  9807 pending_rounds.cc:85] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71: Aborting all ops after (but not including) 3
I20260709 12:27:09.215140  9807 pending_rounds.cc:107] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:27:09.215824  9807 raft_consensus.cc:2889] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:09.215950  9885 raft_consensus.cc:1240] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:09.155210 12974 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:09.224941 12974 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:09.232584 12883 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:09.225052 12955 log.cc:927] Time spent T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 1.552s	user 0.004s	sys 0.004s
I20260709 12:27:09.227145  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:09.227427 13011 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:09.202373 12818 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:09.239630  9811 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 8: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
W20260709 12:27:09.242654  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 75581.9us
I20260709 12:27:09.183532 12739 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:09.244782  9853 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:09.245536  9811 raft_consensus.cc:1275] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:27:09.202127 12970 consensus_meta.cc:287] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.633s	user 0.005s	sys 0.004s
I20260709 12:27:09.213836 13013 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:09.187271 12765 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:27:09.249845  9811 raft_consensus.cc:1240] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:09.188666 12438 consensus_queue.cc:1059] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:27:09.220340 13006 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.253942  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:09.188282 13005 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:09.256819  9955 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:09.242079 12855 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.218042 13026 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:09.251832  9853 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:09.246570 12818 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:09.279824  9806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2015) took 3090 ms (client timeout 1619 ms). Trace:
W20260709 12:27:09.281044  9806 rpcz_store.cc:269] 0709 12:27:06.175879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.263168 (+ 87289us) service_pool.cc:224] Handling call
0709 12:27:09.266082 (+3002914us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54002530d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:09.266206 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4380683648}
W20260709 12:27:09.281306 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 97431.7us
I20260709 12:27:09.268837  9853 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:09.282374 10496 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:09.250329 13011 consensus_queue.cc:1048] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:27:09.252921 13007 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:09.283915 10496 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:09.261309 13006 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:09.287658  9853 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:09.202589 12770 consensus_queue.cc:237] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:09.217610 12808 consensus_queue.cc:260] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:09.281325 12964 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:09.290431  9811 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:09.362939  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:09.378268  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 95200.6us
I20260709 12:27:09.361521  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:09.329072  9883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2173) took 3363 ms. Trace:
W20260709 12:27:09.354777  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.361420  9806 pending_rounds.cc:85] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: Aborting all ops after (but not including) 7
I20260709 12:27:09.381528  9806 pending_rounds.cc:107] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:27:09.381801  9806 raft_consensus.cc:2889] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:09.361153  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:09.264755 12970 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:09.359536 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 75690us
I20260709 12:27:09.392143 10496 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:09.270450 12974 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:09.284793 12438 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:09.283608 12818 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:09.318486 12916 raft_consensus.cc:3055] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:09.327229 12842 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:09.389307 12972 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.396700  9811 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:09.398021 12970 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:09.398207 12739 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:09.398850 13034 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:09.389128 12975 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.401324 12771 raft_consensus.cc:3055] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:09.402426 12778 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:09.403218 12777 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:09.405081 12887 raft_consensus.cc:3055] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:09.406785 13001 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:09.379532  9883 rpcz_store.cc:276] 0709 12:27:05.969718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.969872 (+   154us) service_pool.cc:224] Handling call
0709 12:27:05.970160 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:05.970570 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:27:06.016379 (+ 45809us) log.cc:844] Serialized 14 byte log entry
0709 12:27:07.711056 (+1694677us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:07.732575 (+ 21519us) log.cc:844] Serialized 26 byte log entry
0709 12:27:07.732721 (+   146us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:07.776782 (+ 44061us) log.cc:844] Serialized 14 byte log entry
0709 12:27:07.779065 (+  2283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.779135 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:09.224406 (+1445271us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:09.328792 (+104386us) raft_consensus.cc:1685] finished
0709 12:27:09.328821 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:09.328977 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27359,"prepare.queue_time_us":504749,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":16522,"raft.queue_time_us":94016,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":19030,"spinlock_wait_cycles":359088384,"thread_start_us":1376487,"threads_started":3,"wal-append.queue_time_us":1439330}
I20260709 12:27:09.285887 12944 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:09.417825 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.418383 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.455709 10526 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 3.
I20260709 12:27:09.456694 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.420204  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:09.420424 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:09.454780 12944 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:09.457566 10531 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:09.457675 12944 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:09.421711 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.422745  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:09.423484  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:09.459563  9955 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 2.
I20260709 12:27:09.459638 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.458097  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:09.378381 12692 raft_consensus.cc:697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:09.434708  9960 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:27:09.286309 13007 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:09.432420 12854 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.437316 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.270946 12855 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:09.471367 10529 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 3.
I20260709 12:27:09.472431 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.441394 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:09.472932 12855 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:09.473315 10530 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:09.440492 13034 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:09.442917  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 319539us
I20260709 12:27:09.444051 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.444185 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.446964  9882 raft_consensus.cc:1240] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:09.444459 12438 consensus_queue.cc:1048] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:27:09.449498 12887 raft_consensus.cc:740] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:09.431174  9959 pending_rounds.cc:85] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 5
I20260709 12:27:09.440901 12916 raft_consensus.cc:740] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:09.484697 10530 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:27:09.526685  9959 pending_rounds.cc:107] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:27:09.527132  9959 raft_consensus.cc:2889] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:09.467028  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:09.529683  9811 raft_consensus.cc:2393] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 6: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
W20260709 12:27:09.451373 13036 log.cc:927] Time spent T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:27:09.377956 13005 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:09.444041 12771 raft_consensus.cc:740] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:09.440879  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:09.535705  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:09.536119  9963 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:09.444595 12972 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:09.442983 12808 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:09.498728 10532 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:09.501511  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:09.502334  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:09.495641  9853 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:09.543728  9885 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 3.
W20260709 12:27:09.544224  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 48679us
I20260709 12:27:09.544952  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:09.545079  9853 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:27:09.510566 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 44212.1us
W20260709 12:27:09.496330 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 76366.1us
I20260709 12:27:09.501914  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:09.481742 10531 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:09.546612 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.547350 10530 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:09.547477 10497 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:09.548276 10497 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:09.459806 12765 consensus_queue.cc:1059] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:27:09.536485  9883 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:09.539777  9779 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:09.550616  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:09.549381 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.484232 13007 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:09.554520  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:09.556897 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.553934 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.560528 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:09.560909 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:09.564606 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.576730 10532 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:09.565503  9881 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:09.567374 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:09.491947 13034 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:09.571967  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:09.573933  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:09.585354  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:09.585532  9887 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:09.585969  9811 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:09.482540 12854 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:09.594009  9697 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d1e4bd6e7a424475b1d707bfa268d54e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader b011791796d1457284b857d7d3422195 (127.8.111.67:42253) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b011791796d1457284b857d7d3422195 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:09.584568  9888 raft_consensus.cc:1240] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:09.483325 13038 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:09.586900  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:09.563853 12765 consensus_queue.cc:1243] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer 4104e34a61b7448281d6d91ce23ebf71 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:27:09.588582 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.556819 12974 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:09.558323 12970 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:09.484879 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.554252 12336 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:09.602363  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:09.602756 12336 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.603179 12336 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:09.603878  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:09.604084 12969 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:09.604558  9883 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:27:09.605402  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:09.606583 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.607376 12438 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:09.607659 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.608112 12765 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:09.608527 12765 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.608876 12765 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:09.609211 13038 raft_consensus.cc:697] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:09.587903 10531 raft_consensus.cc:2393] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:09.590647 12916 consensus_queue.cc:260] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:09.610132 13038 consensus_queue.cc:237] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:09.610982 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.611336 12916 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:09.596004  9887 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:09.483189 12692 consensus_queue.cc:237] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:09.595968 12771 consensus_queue.cc:260] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:09.615020 12771 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:09.614465 12336 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:09.617763 13037 log.cc:927] Time spent T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:27:09.601908 12974 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:09.618486 12974 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:09.620765 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.621117 12336 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:09.621903  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:09.622478  9811 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:09.628545  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:09.629163  9883 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:09.630432 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.631551 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.632098 12864 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:09.632040 13006 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:09.632682 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:09.633857 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.634683 10533 raft_consensus.cc:2368] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 9. Current term is 10.
I20260709 12:27:09.637545  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2031) took 1028 ms. Trace:
I20260709 12:27:09.637867  9810 rpcz_store.cc:276] 0709 12:27:08.609274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.620778 (+ 11504us) service_pool.cc:224] Handling call
0709 12:27:09.637366 (+1016588us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b540033f754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:09.637491 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375653632}
I20260709 12:27:09.638865  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:09.639796  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:09.639926 12972 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:09.640300  9810 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:09.641062  9807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2353) took 1026 ms. Trace:
I20260709 12:27:09.641438  9807 rpcz_store.cc:276] 0709 12:27:08.615531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.133868 (+518337us) service_pool.cc:224] Handling call
0709 12:27:09.134230 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:09.216692 (+ 82462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.640833 (+424141us) spinlock_profiling.cc:243] Waited 74.5 ms on lock 0x7b54001833d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:09.641001 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171389184}
I20260709 12:27:09.641959  9809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46504 (request call id 2350) took 1028 ms. Trace:
I20260709 12:27:09.642381  9809 rpcz_store.cc:276] 0709 12:27:08.613390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.641056 (+ 27666us) service_pool.cc:224] Handling call
0709 12:27:09.641795 (+1000739us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b5400183dd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:09.641908 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1074204416}
I20260709 12:27:09.643865  9962 raft_consensus.cc:1240] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:27:09.644937 12880 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:09.630458 10524 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:27:09.645918 12701 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:09.647055 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.648250 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.649245 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.647082  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1307) took 1067 ms. Trace:
I20260709 12:27:09.650900  9884 rpcz_store.cc:276] 0709 12:27:08.579407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.579957 (+   550us) service_pool.cc:224] Handling call
0709 12:27:09.646911 (+1066954us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b540003d254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:09.647031 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":837311744}
W20260709 12:27:09.597708 12954 log.cc:927] Time spent T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 1.924s	user 0.004s	sys 0.003s
I20260709 12:27:09.655782  9928 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:09.664966 12984 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.665020 12855 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.665417 12943 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:09.692337 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 144105us
I20260709 12:27:09.693704  9928 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:09.696107  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 143461us
I20260709 12:27:09.693285 10497 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:09.771733  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 68166us
I20260709 12:27:09.606212 12969 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:09.778452 10497 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:09.779435 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 75370.6us
I20260709 12:27:09.656250 13006 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:09.812573 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 251702us
I20260709 12:27:09.815454  9928 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:09.817823  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:09.818602  9962 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:09.823940  9928 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:27:09.825521 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.826812 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.705335 12908 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:27:09.807543 13036 log.cc:927] Time spent T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:27:09.770466 12880 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:09.775529 12777 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:09.843457  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:09.845571  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:09.846312  9887 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:09.848202 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.811408 12961 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:09.683080 12984 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:09.702903 12855 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:09.927597  9884 raft_consensus.cc:1240] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:09.811103 12754 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
W20260709 12:27:09.891558 12978 consensus_meta.cc:287] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.001s
I20260709 12:27:09.950232  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 2032) took 1340 ms. Trace:
I20260709 12:27:10.056058  9813 rpcz_store.cc:276] 0709 12:27:08.609560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.031422 (+421862us) service_pool.cc:224] Handling call
0709 12:27:09.031678 (+   256us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:09.031985 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:09.032010 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:09.078565 (+ 46555us) log.cc:844] Serialized 52 byte log entry
0709 12:27:09.269139 (+190574us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:09.284938 (+ 15799us) log.cc:844] Serialized 14 byte log entry
0709 12:27:09.359413 (+ 74475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.359517 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:09.415947 (+ 56430us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:09.935740 (+519793us) raft_consensus.cc:1685] finished
0709 12:27:09.949962 (+ 14222us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:09.950157 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15871,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":129756,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":16142,"spinlock_wait_cycles":116641152,"thread_start_us":188262,"threads_started":1,"wal-append.queue_time_us":238435}
W20260709 12:27:09.962198 13041 log.cc:927] Time spent T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:27:09.963989 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:10.066929 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:10.068410 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:09.868552 12961 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.069526 12961 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:09.972663  9960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 515) took 1177 ms. Trace:
I20260709 12:27:10.070556  9960 rpcz_store.cc:276] 0709 12:27:08.794915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.795400 (+   485us) service_pool.cc:224] Handling call
0709 12:27:08.795708 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:09.470670 (+674962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.972350 (+501680us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b5400242554. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:09.972593 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1468882176}
I20260709 12:27:09.924280 12968 raft_consensus.cc:2804] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:27:09.831760 13026 consensus_meta.cc:287] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.552s	user 0.008s	sys 0.001s
I20260709 12:27:09.703910 13013 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.077099  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:10.083017  9888 raft_consensus.cc:2393] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 7: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:10.065303 12978 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.110736  9811 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:10.152765  9962 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:27:10.119096  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:10.115787 10525 raft_consensus.cc:2368] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10.
I20260709 12:27:10.133126  9887 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:10.164755  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:10.086759  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:10.159134 13049 log.cc:927] Time spent T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:27:10.207476  9889 raft_consensus.cc:1240] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10. Ops: []
W20260709 12:27:10.158705 13045 log.cc:927] Time spent T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:27:10.206295 10497 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:10.084287 12968 raft_consensus.cc:697] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:10.164258 12969 raft_consensus.cc:2764] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:27:10.204324 13048 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:10.216135 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 396215us
I20260709 12:27:10.231884  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:10.242951  9888 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:27:10.237053 12777 raft_consensus.cc:697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:10.083544 13026 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.244297  9883 raft_consensus.cc:2393] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 4: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:10.217549 12770 consensus_queue.cc:1059] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260709 12:27:10.216609 12843 consensus_meta.cc:287] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 1.060s	user 0.018s	sys 0.002s
W20260709 12:27:10.273283  9881 consensus_meta.cc:287] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.696s	user 0.012s	sys 0.005s
I20260709 12:27:10.275795  9881 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:10.205365 12880 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.298398  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2351) took 1684 ms. Trace:
I20260709 12:27:10.287209 12843 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:10.176120  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 352232us
I20260709 12:27:10.259752  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2025) took 1655 ms. Trace:
I20260709 12:27:10.251757  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:10.276607 13053 log.cc:927] Time spent T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:27:10.276863 12968 consensus_queue.cc:237] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.278664  9962 raft_consensus.cc:1240] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
W20260709 12:27:10.279462 13057 log.cc:927] Time spent T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:27:10.270946 13063 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:10.250449  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:10.303112  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:10.316817  9955 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 4.
I20260709 12:27:10.305051  9815 rpcz_store.cc:276] 0709 12:27:08.604448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.604553 (+   105us) service_pool.cc:224] Handling call
0709 12:27:10.259565 (+1655012us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54002d6254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:10.259692 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":662608256}
I20260709 12:27:10.309970 10496 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:10.320263 13064 consensus_queue.cc:1059] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:27:10.321545 13006 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:10.299716  9814 rpcz_store.cc:276] 0709 12:27:08.613741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.088891 (+475150us) service_pool.cc:224] Handling call
0709 12:27:09.089250 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:09.089683 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:09.104221 (+ 14538us) log.cc:844] Serialized 14 byte log entry
0709 12:27:09.377014 (+272793us) log.cc:844] Serialized 14 byte log entry
0709 12:27:09.958856 (+581842us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b18001f2be0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f3f3 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:27:10.261555 (+302699us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b18001f2be0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b3a9c0a 00007f2f94ae9219 00007f2f8b431a40 00007f2f8b42c4e4 00007f2f8b42c455 00007f2f8e514060 00007f2f8e526716 00007f2f8e537287 00007f2f8e537208
0709 12:27:10.261703 (+   148us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:10.262218 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 12:27:10.267105 (+  4887us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:10.267141 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:10.267220 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:10.297230 (+ 30010us) raft_consensus.cc:1685] finished
0709 12:27:10.297257 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:10.298108 (+   851us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":914655,"prepare.queue_time_us":596686,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":959885,"raft.run_cpu_time_us":380,"raft.run_wall_time_us":57827,"spinlock_wait_cycles":25120896,"thread_start_us":190536,"threads_started":1,"wal-append.queue_time_us":352264}
W20260709 12:27:10.308791  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 769048us
I20260709 12:27:10.306445  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:10.245707 12777 consensus_queue.cc:237] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.229810 12984 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:10.316969  9888 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:10.302700 12855 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:10.315618 13034 consensus_meta.cc:287] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.000s
I20260709 12:27:10.305110 13047 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:10.314882 12818 consensus_meta.cc:287] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.873s	user 0.022s	sys 0.015s
I20260709 12:27:10.266108 13048 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.312882 12773 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:27:10.312104 12916 consensus_meta.cc:287] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.011s
I20260709 12:27:10.312498 12692 consensus_queue.cc:1059] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:27:10.350311  9807 raft_consensus.cc:1275] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:10.343386  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:10.351580  9810 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:27:10.326107  9928 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:10.354672  9888 raft_consensus.cc:1275] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:10.355813  9928 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:10.341750 12765 consensus_meta.cc:287] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.732s	user 0.024s	sys 0.013s
I20260709 12:27:10.395197 12765 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.351889  9779 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:10.400619  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 48791.5us
I20260709 12:27:10.340731 12999 raft_consensus.cc:3055] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:10.401209 12999 raft_consensus.cc:740] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:10.401618  9779 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:10.402374 12773 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:10.339130 13063 raft_consensus.cc:697] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:10.402853 12773 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.403275 12773 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:10.361295 12974 consensus_meta.cc:287] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.742s	user 0.009s	sys 0.000s
I20260709 12:27:10.338963 13034 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.339185 13006 raft_consensus.cc:697] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:10.403525 13063 consensus_queue.cc:237] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.415236 13006 consensus_queue.cc:237] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.363755  9890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 652) took 1771 ms. Trace:
I20260709 12:27:10.417994  9890 rpcz_store.cc:276] 0709 12:27:08.592693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.806581 (+213888us) service_pool.cc:224] Handling call
0709 12:27:08.851195 (+ 44614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.950461 (+ 99266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:08.950489 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:08.950530 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:08.950557 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:10.363553 (+1412996us) spinlock_profiling.cc:243] Waited 99.1 ms on lock 0x7b5400218754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:10.363594 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:10.363706 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227839872}
I20260709 12:27:10.403321 12843 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:10.366562 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.367632  9889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 660) took 1520 ms. Trace:
I20260709 12:27:10.420481  9889 rpcz_store.cc:276] 0709 12:27:08.847219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.211611 (+364392us) service_pool.cc:224] Handling call
0709 12:27:09.211948 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:10.217172 (+1005224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:10.367421 (+150249us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b540029a9d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:10.367574 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2288972544}
W20260709 12:27:10.368882 12808 consensus_meta.cc:287] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.817s	user 0.007s	sys 0.002s
I20260709 12:27:10.421185 13034 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:10.369452 10525 raft_consensus.cc:1240] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:10.384567 12961 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:10.359329 12944 consensus_meta.cc:287] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.901s	user 0.010s	sys 0.000s
W20260709 12:27:10.371272 13061 log.cc:927] Time spent T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:27:10.371935 13054 log.cc:927] Time spent T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:27:10.372622 13052 log.cc:927] Time spent T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:27:10.398095 12765 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:10.373983 13001 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.375411 10529 raft_consensus.cc:1240] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
W20260709 12:27:10.376093 12975 consensus_meta.cc:287] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.929s	user 0.010s	sys 0.008s
I20260709 12:27:10.377562 13048 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:10.340816 13047 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:10.378590 13075 log.cc:927] Time spent T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:27:10.342585 12902 consensus_meta.cc:287] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 1.154s	user 0.004s	sys 0.008s
I20260709 12:27:10.342828 12818 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:10.300935 12880 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:10.345955 12963 consensus_meta.cc:287] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 1.109s	user 0.011s	sys 0.002s
I20260709 12:27:10.432626 12850 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:10.394425 12559 raft_consensus.cc:3055] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:10.400722 12987 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:10.422070 12974 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:10.453253 10531 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:10.342983 13005 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:27:10.359309 12771 consensus_meta.cc:287] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.744s	user 0.002s	sys 0.007s
I20260709 12:27:10.407428  9779 leader_election.cc:400] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 9. Current term is 10.
I20260709 12:27:10.454905  9779 leader_election.cc:403] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:27:10.455410  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 48169us
I20260709 12:27:10.456254  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:10.364286 13007 consensus_meta.cc:287] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.793s	user 0.006s	sys 0.001s
I20260709 12:27:10.422359 10528 raft_consensus.cc:1240] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:27:10.370604  9812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2354) took 1746 ms. Trace:
I20260709 12:27:10.423862 10525 raft_consensus.cc:1240] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:10.428897  9810 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:10.458690  9812 rpcz_store.cc:276] 0709 12:27:08.615887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.230147 (+614260us) service_pool.cc:224] Handling call
0709 12:27:10.259708 (+1029561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:10.259884 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:10.259908 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:10.259950 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:10.259978 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:10.260025 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:10.362142 (+102117us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002d6250. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:10.362246 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2353598336}
W20260709 12:27:10.430163  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 74475.3us
I20260709 12:27:10.422458 10524 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:27:10.421257 12773 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.373317 12978 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:10.391506 12908 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:10.467123 12861 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:10.467384 12908 raft_consensus.cc:697] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:10.468395 12908 consensus_queue.cc:237] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.439617 12900 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:10.470494 12900 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:10.471004 12900 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:10.402010 12999 consensus_queue.cc:260] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.474797 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:10.460713  9928 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:10.445350 12975 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:10.462606  9779 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:10.464855 10532 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:10.432407 12944 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:10.445293 13001 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:10.466804 10529 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:10.451228 12902 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.479168  9779 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:10.479379 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:10.453963 12754 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.453148 12559 raft_consensus.cc:740] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:10.454087 12987 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.488097  9928 leader_election.cc:400] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10.
I20260709 12:27:10.493777  9928 leader_election.cc:403] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:10.481812 12861 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:10.489388  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:10.496270  9959 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:10.463819 12850 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 9. Current term is 10.
I20260709 12:27:10.502571  9959 raft_consensus.cc:1275] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:10.501924  9958 raft_consensus.cc:1275] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:10.501672  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:10.510687  9928 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:10.472532 12887 consensus_queue.cc:260] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.484951 12963 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:10.512517 10527 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:10.490389 12999 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:10.465448 13005 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.465333 13007 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:10.527189 13062 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:10.534298 13068 log.cc:927] Time spent T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.232s	user 0.003s	sys 0.000s
I20260709 12:27:10.512125 12984 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:27:10.497151 12987 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:10.535116 12970 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:10.497731 12771 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:10.502872 10496 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:10.585891 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 83103.1us
I20260709 12:27:10.493892 12855 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:10.558954 10526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 624) took 1107 ms. Trace:
I20260709 12:27:10.499897 12559 consensus_queue.cc:260] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.509820 13066 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:27:10.518357 12998 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:10.582948 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:10.516243  9779 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:10.587054 10526 rpcz_store.cc:276] 0709 12:27:09.438429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.456463 (+ 18034us) service_pool.cc:224] Handling call
0709 12:27:10.545780 (+1089317us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b5400556254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:10.545949 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1437011712}
I20260709 12:27:10.582857 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:27:10.601758  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 85604.5us
I20260709 12:27:10.529569 12902 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:10.531648 13001 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:10.536118 12836 consensus_queue.cc:1048] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:27:10.532896 12944 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:10.498956 12754 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.602121 10525 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:10.603387  9779 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:10.540688 13034 consensus_queue.cc:1059] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:27:10.638003 12887 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:10.638759  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 110837us
I20260709 12:27:10.583366 12852 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.514555 13071 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 12:27:10.528729 12774 consensus_queue.cc:1048] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
W20260709 12:27:10.648765  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 62025.5us
I20260709 12:27:10.659343  9887 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:10.593004 12771 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.585713 12975 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.606659 12559 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:10.586457 12970 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:10.592617 12978 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:10.663177  9889 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:10.634445 12861 raft_consensus.cc:2804] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:10.685019  9890 raft_consensus.cc:1240] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:10.646776  9779 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:10.652261 13001 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:27:10.673136  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 165692us
I20260709 12:27:10.608399 13023 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:10.686174  9779 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:10.710562  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 58873.1us
I20260709 12:27:10.710740  9779 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:10.711669  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:10.713436  9779 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:10.672014  9887 raft_consensus.cc:1275] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:10.692055  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:10.696633 10531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 861) took 1103 ms. Trace:
I20260709 12:27:10.715975 10531 rpcz_store.cc:276] 0709 12:27:09.593282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.610755 (+ 17473us) service_pool.cc:224] Handling call
0709 12:27:10.696404 (+1085649us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b540031b0d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:10.696551 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1935519488}
I20260709 12:27:10.675109 12771 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:10.664744 12961 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:10.722704  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:10.658460 12944 consensus_queue.cc:1059] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:27:10.711795  9928 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:10.725876  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:10.690310 12998 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:10.727247  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:10.729094  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:10.689236 13001 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.730701  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:10.733166  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:10.733444  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:10.733702  9810 raft_consensus.cc:2376] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9. Re-sending same reply.
I20260709 12:27:10.734113  9811 raft_consensus.cc:2393] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 8: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:10.709837 13023 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.658229 12852 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.682147 12975 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:10.732340  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:10.732646  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:10.687170 12861 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:10.740720  9807 raft_consensus.cc:2393] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:10.707304 12974 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:10.723364 12864 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:10.733104  9814 raft_consensus.cc:1240] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:10.740861  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:10.724884 12818 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:10.743937  9810 raft_consensus.cc:2410] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:27:10.744657  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:10.747915  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:10.727604 12773 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:10.748330  9886 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:10.749154  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:10.749760  9812 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:10.752342  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:10.754045 13079 log.cc:927] Time spent T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:27:10.756507 12852 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:10.687011 13076 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:27:10.762533 10528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36672 (request call id 798) took 1320 ms. Trace:
I20260709 12:27:10.762918 10528 rpcz_store.cc:276] 0709 12:27:09.442225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.080060 (+637835us) service_pool.cc:224] Handling call
0709 12:27:10.114533 (+ 34473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:10.458415 (+343882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:10.762236 (+303821us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54005e92d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:10.762463 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":707290496}
I20260709 12:27:10.763504  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:10.764127  9884 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:10.765002  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:10.767654 12975 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:10.770776 10532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 635) took 1206 ms (client timeout 1581 ms). Trace:
W20260709 12:27:10.770992 13081 log.cc:927] Time spent T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.112s	user 0.003s	sys 0.000s
W20260709 12:27:10.771222 10532 rpcz_store.cc:269] 0709 12:27:09.564532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.607402 (+ 42870us) service_pool.cc:224] Handling call
0709 12:27:10.770591 (+1163189us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b5400690354. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:10.770714 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1969898240}
I20260709 12:27:10.772485 13005 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:10.730604 12998 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.772854  9885 raft_consensus.cc:1275] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:10.773113 12998 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:10.773604 13047 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:10.774156 13047 consensus_queue.cc:1059] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:10.774955 13047 raft_consensus.cc:3055] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:10.775283 13047 raft_consensus.cc:740] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:10.776026 13047 consensus_queue.cc:260] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.777175 13047 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:10.729609 12778 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:10.778566 12778 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:10.778963 12778 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:10.776407 13038 raft_consensus.cc:3055] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:10.779352 13038 raft_consensus.cc:740] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:10.690467 12978 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.746968 12880 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:10.780218 13038 consensus_queue.cc:260] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.740047 13023 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:10.781088 12943 consensus_meta.cc:287] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 1.078s	user 0.013s	sys 0.011s
I20260709 12:27:10.729666 12991 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:10.783092 12991 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:10.783527 12991 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:10.784412  9881 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1316) took 1284 ms (client timeout 1690 ms). Trace:
I20260709 12:27:10.729775 12984 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:10.792155  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 66375.1us
I20260709 12:27:10.792667 12984 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:10.735566 13001 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:10.742709 12861 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:10.795408  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:10.796156  9955 raft_consensus.cc:2393] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:27:10.784782  9881 rpcz_store.cc:269] 0709 12:27:09.499678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.501664 (+  1986us) service_pool.cc:224] Handling call
0709 12:27:10.784250 (+1282586us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b54002c51d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:10.784358 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44337024}
I20260709 12:27:10.728410 12850 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:10.800571  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:10.801076 12818 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.801568 12818 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:10.755643 13007 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:10.786634  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.792167  9885 raft_consensus.cc:3055] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:27:10.797621  9853 leader_election.cc:336] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.582s (SENT)
I20260709 12:27:10.803047  9885 raft_consensus.cc:740] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:10.803205  9853 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:10.797035  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:10.806576  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:10.780308 13042 log.cc:927] Time spent T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 1.098s	user 0.003s	sys 0.000s
I20260709 12:27:10.809861  9958 raft_consensus.cc:1240] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:10.815302  9961 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:27:10.816171 12754 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:10.816749 12900 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:10.820220 13078 log.cc:927] Time spent T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:27:10.822685  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:10.824014  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:10.824980  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:10.825215  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:10.825489  9964 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:27:10.826399  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:10.832036 13062 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:10.834036 12978 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:10.822613  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:10.830116 12854 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:10.835561 10527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36672 (request call id 800) took 1372 ms. Trace:
I20260709 12:27:10.835748 13066 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10.
I20260709 12:27:10.835953 10527 rpcz_store.cc:276] 0709 12:27:09.462993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.259062 (+796069us) service_pool.cc:224] Handling call
0709 12:27:10.259338 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:10.515381 (+256043us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:10.835325 (+319944us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54006702d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:10.835496 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581839744}
W20260709 12:27:10.839644 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 292681us
W20260709 12:27:10.841267 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.842041  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:10.842634  9883 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:10.804056  9885 consensus_queue.cc:260] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:10.844811  9885 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:10.847281 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:10.848918  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:10.846179  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:10.852463  9961 raft_consensus.cc:2393] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 8: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:10.812068 13038 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:10.859113  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:10.840499 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:10.862906 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:10.863720 10532 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:10.865831  9956 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:10.867827  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:10.870082 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:10.868221 12978 consensus_queue.cc:1059] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:27:10.872834 12978 raft_consensus.cc:3055] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:10.873258 12978 raft_consensus.cc:740] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:10.875303 12970 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:10.877749 12818 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:10.883102  9888 raft_consensus.cc:1240] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:10.883917 10529 raft_consensus.cc:2410] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:27:10.884433  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:10.885226  9888 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:10.873279 12987 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.889087 12987 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:10.894815 13066 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:10.895805 12771 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.903414 12843 raft_consensus.cc:3055] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:10.912091 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:10.912659 13013 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:10.912756 12961 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:10.913415 10528 raft_consensus.cc:1240] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:10.912285 12843 raft_consensus.cc:740] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:27:10.915530  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 230318us
I20260709 12:27:10.914624 12754 consensus_queue.cc:1059] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
W20260709 12:27:10.900373 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.921200 10524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 804) took 1336 ms. Trace:
I20260709 12:27:10.922179  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:10.866887 12777 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.921692 10524 rpcz_store.cc:276] 0709 12:27:09.584373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.648998 (+ 64625us) service_pool.cc:224] Handling call
0709 12:27:10.921044 (+1272046us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b540052bcd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:10.921138 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1776894336}
I20260709 12:27:10.878183 12970 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:10.926949 10531 raft_consensus.cc:1240] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:27:10.926012  9959 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:10.900874 13011 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.910590 13066 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:10.929153 12527 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.930785 12998 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:10.869352 13001 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:10.928754 12777 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.894106 12991 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:10.933491 13066 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:10.900484 12978 consensus_queue.cc:260] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.935621 12527 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.930078 12843 consensus_queue.cc:260] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.933091 13011 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:10.941998 12900 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:10.946892 13026 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:10.947671 12972 raft_consensus.cc:3055] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:10.948082 12972 raft_consensus.cc:740] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:10.948838 12972 consensus_queue.cc:260] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.949574 12972 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:10.950976 13034 raft_consensus.cc:3055] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:10.951364 13034 raft_consensus.cc:740] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:10.951548 12998 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:10.946360 12978 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:10.952329 13034 consensus_queue.cc:260] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.953488 13034 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:10.958884 12964 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:10.961179 13023 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:10.962937 13023 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:10.964717 13001 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:10.965502 13011 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:11.000029  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 278757us
I20260709 12:27:11.001227  9813 raft_consensus.cc:2393] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 6: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:11.003410  9806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2363) took 2104 ms. Trace:
I20260709 12:27:11.004652  9854 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:11.003994  9806 rpcz_store.cc:276] 0709 12:27:08.898355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.360987 (+462632us) service_pool.cc:224] Handling call
0709 12:27:09.361275 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:09.382297 (+ 21022us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:09.382325 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:09.388898 (+  6573us) log.cc:844] Serialized 26 byte log entry
0709 12:27:09.463821 (+ 74923us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:09.463871 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.463957 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:10.779795 (+1315838us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:11.002532 (+222737us) raft_consensus.cc:1685] finished
0709 12:27:11.002598 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:11.003065 (+   467us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44160256,"thread_start_us":74599,"threads_started":1,"wal-append.queue_time_us":207150}
I20260709 12:27:11.008307  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:11.010175  9881 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:27:11.011310  9809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 501) took 1587 ms. Trace:
I20260709 12:27:11.011955  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:11.012959  9881 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:11.011806  9809 rpcz_store.cc:276] 0709 12:27:09.424080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.643080 (+219000us) service_pool.cc:224] Handling call
0709 12:27:09.643336 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:10.321072 (+677736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:10.321102 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:10.321581 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 12:27:10.445884 (+124303us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:10.445941 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:10.446022 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:10.819679 (+373657us) spinlock_profiling.cc:243] Waited 6.75 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:11.010514 (+190835us) raft_consensus.cc:1685] finished
0709 12:27:11.010569 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:11.011043 (+   474us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":671124,"raft.queue_time_us":677640,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":15528320,"thread_start_us":123906,"threads_started":1,"wal-append.queue_time_us":241860}
I20260709 12:27:10.811123  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:11.015754  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:11.016546  9778 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:11.017132  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 205923us
I20260709 12:27:11.019382  9888 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:11.019757  9778 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:11.019845  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:11.024124  9881 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
W20260709 12:27:11.034979  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 165284us
I20260709 12:27:11.036715  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:11.037982  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.049700  9890 raft_consensus.cc:1240] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:11.052166  9890 raft_consensus.cc:1240] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:11.048684  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:11.058804  9778 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:11.067845  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.067600  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:11.068791  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:11.068998  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:11.071205  9961 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:27:11.071295  9887 raft_consensus.cc:1240] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:11.071854  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:11.072922  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:11.102308  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:11.075269  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:11.070168  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:11.103174  9960 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:11.103879  9962 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:11.106580  9853 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.616s (SENT) [suppressed 17 similar messages]
I20260709 12:27:11.108177  9961 raft_consensus.cc:1240] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
W20260709 12:27:11.108419  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 69334.2us
W20260709 12:27:11.085436 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:11.111469 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.112365  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:11.113590  9928 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:11.089020 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:11.078769  9963 raft_consensus.cc:1240] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:27:11.113845 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:11.086992 10530 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:27:11.116739 12421 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:11.117441  9885 raft_consensus.cc:1275] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:27:11.118050  9958 raft_consensus.cc:2393] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 4: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:27:11.169713  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 123418us
I20260709 12:27:11.172736 10533 raft_consensus.cc:2393] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:11.098090  9883 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:11.177289 12843 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:11.183133 12991 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:11.183813 12754 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:11.184707 12754 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:11.186178 13006 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:11.189044 13006 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:11.148871  9885 pending_rounds.cc:85] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 4
I20260709 12:27:11.191406  9885 pending_rounds.cc:107] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:27:11.191759  9885 raft_consensus.cc:2889] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:11.185240  9960 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:11.194746 12963 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:11.197791 12963 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.202203 12976 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:11.202796 12976 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:11.202951 10496 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:11.203229 13047 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.203699 12773 consensus_queue.cc:1059] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:11.203895 13047 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:11.205549 12773 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:11.203249 12976 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:11.206722 13071 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:11.207113 12842 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.207655 12771 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:11.207834 12842 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:11.210644  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.211181 12850 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:11.210662 12845 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.212193 12850 raft_consensus.cc:3055] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:11.212677 12850 raft_consensus.cc:740] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:11.212779 12845 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:11.205948 10496 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:11.215178 12908 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:11.215679 12770 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:11.216321 12770 raft_consensus.cc:697] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:27:11.216213  9853 leader_election.cc:336] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.619s (SENT)
I20260709 12:27:11.217263 12908 consensus_queue.cc:1048] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:11.220603  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:11.223222 13011 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:11.223644 12995 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:11.224120 12995 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.224540 12995 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:11.215109 12900 consensus_queue.cc:1059] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:11.225693 12777 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:11.226027 12968 raft_consensus.cc:3055] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:11.226699 12968 raft_consensus.cc:740] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:11.227270 12998 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:11.228174 13005 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.227905 12968 consensus_queue.cc:260] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:11.228781 13005 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:11.229426 12968 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:11.231065  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:11.231788  9806 raft_consensus.cc:1275] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:11.231853  9815 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:11.193953 12887 consensus_meta.cc:287] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.540s	user 0.008s	sys 0.000s
I20260709 12:27:11.238066  9962 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
W20260709 12:27:11.217309  9853 leader_election.cc:336] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 1.619s (SENT)
I20260709 12:27:11.239940  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:11.242471  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:11.244580  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 131150us
I20260709 12:27:11.247177 12845 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:11.247673 12754 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:11.248596 10497 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:11.217742 12770 consensus_queue.cc:237] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:11.250067  9806 raft_consensus.cc:1240] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:27:11.250483 10524 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:11.251396 12972 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:11.251845 12972 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:11.252276 12972 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:11.253412  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.148566 12421 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.270857  9955 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:11.206676 12774 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:11.283026  9806 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:11.283236 12774 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:11.284694  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 67427.1us
W20260709 12:27:11.285585  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.286607  9853 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:11.286067  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:11.277829  9808 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
W20260709 12:27:11.289376  9808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 491) took 3186 ms (client timeout 1517 ms). Trace:
W20260709 12:27:11.289801  9808 rpcz_store.cc:269] 0709 12:27:08.103354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.104783 (+  1429us) service_pool.cc:224] Handling call
0709 12:27:11.289096 (+3184313us) spinlock_profiling.cc:243] Waited 2.68 s on lock 0x7b540002e4d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:11.289248 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6154294144}
I20260709 12:27:11.278532 12843 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:11.279556 13066 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:11.290601 13005 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:11.290930 12843 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.291373 12843 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:11.292514 13066 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:11.286098 12774 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:11.293294  9956 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:11.275883 12527 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:11.281985 12978 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:11.282374 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:11.282434 12984 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:11.287483  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:11.295717  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.281423 10524 raft_consensus.cc:1240] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:11.296581  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:11.299952  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:11.253198 12842 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:11.295043  9853 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:11.304456  9815 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:11.269115 12421 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:11.213833 12850 consensus_queue.cc:260] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:11.264134 12773 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:27:11.299137 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.227916 12998 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:11.262667 12963 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:11.327514  9955 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
W20260709 12:27:11.324623  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 272996us
W20260709 12:27:11.331337 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.333717 10496 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:11.334661 10528 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:11.329567  9813 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:11.350881  9778 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:11.349022  9962 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:27:11.352792 10497 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:11.337783 12978 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:11.360217 12778 consensus_meta.cc:287] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.581s	user 0.016s	sys 0.001s
I20260709 12:27:11.360785 12778 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:11.363082  9812 raft_consensus.cc:1240] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:11.366725  9808 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:11.366484 13006 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:11.367610 13006 raft_consensus.cc:697] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:11.368785 13006 consensus_queue.cc:237] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:11.371978 12963 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:27:11.374382 12998 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:11.376937  9928 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:11.349144 13011 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:27:11.378477 13066 consensus_queue.cc:1059] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:11.378986 12969 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:11.379462 12969 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.379827 12969 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:11.380306 12850 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:11.391721  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.391516  9806 raft_consensus.cc:1240] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:11.358263  9854 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:11.417295  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:11.384810  9712 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56416 (request call id 248) took 22381 ms (client timeout 15000 ms). Trace:
W20260709 12:27:11.419545 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 91276.4us
I20260709 12:27:11.387727  9778 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:11.351539 13047 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:11.423233  9813 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
W20260709 12:27:11.424510  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 75111.4us
W20260709 12:27:11.349100 12887 consensus_queue.cc:1175] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f5208640a51f493e930ce4f64ceeed0b" responder_term: 5 status { last_received { term: 4 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:11.393639  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:11.394243  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:11.379835 13066 raft_consensus.cc:3055] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:11.390331 13026 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:11.440765  9810 raft_consensus.cc:2393] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 9: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:11.443778 10496 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:11.447073 12861 consensus_meta.cc:287] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.652s	user 0.012s	sys 0.001s
I20260709 12:27:11.447544 12861 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:11.449743 12861 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:11.437816 12773 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:11.450568  9814 raft_consensus.cc:1240] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:11.385673  9711 catalog_manager.cc:5697] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 4 to 7, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 7 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:11.452844  9711 catalog_manager.cc:5697] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.454681  9711 catalog_manager.cc:5697] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index 2 to 4, term changed from 2 to 4, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:11.456787  9711 catalog_manager.cc:5697] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 4 to 7, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 7 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.459031  9711 catalog_manager.cc:5697] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 3 to 6, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 6 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.460582  9779 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:11.461030 12559 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:11.461696 12559 raft_consensus.cc:697] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:11.462618  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:11.462911 12559 consensus_queue.cc:237] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:11.466553 12887 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:11.467378 12887 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:11.467757 12887 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:11.468093 12976 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:11.468133 12887 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:11.435540  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:11.502192  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 207465us
W20260709 12:27:11.515255 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.439455 12998 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:11.439579 13066 raft_consensus.cc:740] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:11.526146 12770 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:11.527020 12770 raft_consensus.cc:697] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:11.527952 12421 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:11.528141 12770 consensus_queue.cc:237] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:11.510600 12968 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:11.530819 12968 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.531170 12843 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:11.531385 12968 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:11.533516 12968 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:11.535939 13066 consensus_queue.cc:260] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:11.537662  9813 raft_consensus.cc:1240] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:27:11.538944  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 118208us
I20260709 12:27:11.540302 12984 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:11.542023 12984 consensus_queue.cc:1059] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:11.543581 12855 consensus_queue.cc:1059] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:11.544663 12855 raft_consensus.cc:3055] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:11.545001 12855 raft_consensus.cc:740] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:11.545709 12911 raft_consensus.cc:3055] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:11.546113 12911 raft_consensus.cc:740] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:11.545960 12855 consensus_queue.cc:260] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:11.547778 12911 consensus_queue.cc:260] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:11.548563 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:11.549095 12911 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:11.549347 10525 raft_consensus.cc:2393] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:27:11.523142 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 102619us
I20260709 12:27:11.511921 12976 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:11.560451  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 172872us
I20260709 12:27:11.562433 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:11.520622  9711 catalog_manager.cc:5697] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.580423 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:11.582566  9814 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:27:11.551994 12421 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:11.579943 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:11.584765 12843 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:11.597616  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 256516us
I20260709 12:27:11.586580 12855 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:11.559315 12984 consensus_queue.cc:1059] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:27:11.604907 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:11.608769  9779 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
W20260709 12:27:11.611824  9886 consensus_meta.cc:287] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.846s	user 0.016s	sys 0.012s
I20260709 12:27:11.612233  9886 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:11.612859 13073 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:11.613525 12976 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.615746  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:11.616395  9888 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:11.618706  9890 raft_consensus.cc:1275] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:11.619740  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:11.623103 12976 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:11.607214  9853 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:11.601866 13026 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:11.653616 12972 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:11.655745 12995 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:11.657205  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:11.673652  9882 raft_consensus.cc:2393] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 8: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:11.674438  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:11.674929  9882 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:11.659586  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:11.418845  9712 rpcz_store.cc:269] 0709 12:26:49.003600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.003848 (+   248us) service_pool.cc:224] Handling call
0709 12:27:11.384535 (+22380687us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:08.279627 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:08.294007 (+ 14380us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:08.294054 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:27:08.294076 (+    22us) tablet.cc:662] Decoding operations
0709 12:27:08.295392 (+  1316us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:08.295462 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:08.295497 (+    35us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:27:08.296632 (+  1135us) tablet.cc:701] Row locks acquired
0709 12:27:08.296652 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:27:08.296814 (+   162us) write_op.cc:270] Start()
0709 12:27:08.296953 (+   139us) write_op.cc:276] Timestamp: P: 1783600028296761 usec, L: 0
0709 12:27:08.296974 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:27:08.297715 (+   741us) log.cc:844] Serialized 4334 byte log entry
0709 12:27:09.009654 (+711939us) op_driver.cc:464] REPLICATION: finished
0709 12:27:09.230491 (+220837us) write_op.cc:301] APPLY: starting
0709 12:27:09.230576 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:09.230798 (+   222us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:09.230915 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:09.232257 (+  1342us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:09.232504 (+   247us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:27:09.232544 (+    40us) write_op.cc:312] APPLY: finished
0709 12:27:09.232905 (+   361us) log.cc:844] Serialized 83 byte log entry
0709 12:27:09.233847 (+   942us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:09.234035 (+   188us) write_op.cc:454] Released schema lock
0709 12:27:09.234105 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:09.258533 (+ 24428us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:09.260731 (+  2198us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1342201,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":220603,"apply.run_cpu_time_us":3406,"apply.run_wall_time_us":13425,"num_ops":11,"prepare.queue_time_us":354676,"prepare.run_cpu_time_us":42187,"prepare.run_wall_time_us":429999,"raft.queue_time_us":178314,"raft.run_cpu_time_us":57542,"raft.run_wall_time_us":175725,"replication_time_us":712511,"thread_start_us":729217,"threads_started":4,"wal-append.queue_time_us":531122,"wal-append.run_cpu_time_us":55520,"wal-append.run_wall_time_us":1408000}]]}
I20260709 12:27:11.603485 12970 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.678928  9809 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:11.600446  9711 catalog_manager.cc:5697] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:27:11.611618 12559 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:27:11.670756  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 81835.4us
I20260709 12:27:11.671922  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:11.691859  9887 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:27:11.688195 12900 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:27:11.694083  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:11.694989  9887 raft_consensus.cc:2393] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 8: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:11.695494 12701 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.673102 13026 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.696758 13026 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:11.695770  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:11.697893  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:11.703192  9883 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:11.708258 12995 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:11.712558  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 105005us
I20260709 12:27:11.713670 12861 consensus_queue.cc:1048] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:11.718451 12421 raft_consensus.cc:3055] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:11.718848 12421 raft_consensus.cc:740] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:11.719520  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:11.719748 12421 consensus_queue.cc:260] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:11.720196  9960 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:11.683321 12998 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:11.721171 12998 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:11.716471  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 124982us
I20260709 12:27:11.721952 12850 consensus_queue.cc:1048] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:27:11.724397 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.698577  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:11.699146 12970 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:11.696041 12701 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:11.732164  9779 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:11.730353  9882 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:11.735693  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:11.738137  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:11.686765 12559 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:11.738629  9778 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:11.721686 12998 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:11.702205 12778 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:11.749711  9882 raft_consensus.cc:2393] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 7: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:11.754999  9886 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:27:11.738735  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:11.755751  9711 catalog_manager.cc:5697] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 8 to 10, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 10 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:27:11.762997  9779 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:11.750576 12559 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:11.779871  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:11.781440  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.766469 12842 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:11.797319 13066 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:11.802892  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:11.803858  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 74019.9us
W20260709 12:27:11.822898  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 83597.8us
I20260709 12:27:11.823688  9779 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:11.781160 12773 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:11.807842  9711 catalog_manager.cc:5697] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.834928  9883 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
W20260709 12:27:11.848440  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 114654us
I20260709 12:27:11.856940 12944 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:11.856588  9711 catalog_manager.cc:5697] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 3 to 6, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 6 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.857709 12854 consensus_queue.cc:1048] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:27:11.858412  9711 catalog_manager.cc:5697] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 4 to 6, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65), now has a pending config: VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65), VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66), VOTER b011791796d1457284b857d7d3422195 (127.8.111.67), VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 6 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:11.861009  9711 catalog_manager.cc:5697] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 5 to 6, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 6 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.862121 12421 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:11.862329  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:11.863098  9889 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:11.853966 12978 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:11.863878 12978 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:11.865867 12978 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:11.867265  9853 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:11.867699 12850 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:11.868507  9853 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:11.868299 12850 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:11.868526 12978 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:11.869783 12978 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:11.870337 12978 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:11.870373 12773 raft_consensus.cc:697] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:27:11.871064  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.871553 12773 consensus_queue.cc:237] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:11.872056 12850 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:11.872699 13082 log.cc:927] Time spent T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:27:11.874028 12701 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:11.872756 12978 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:11.874444  9697 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d1e4bd6e7a424475b1d707bfa268d54e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader b011791796d1457284b857d7d3422195 (127.8.111.67:42253) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b011791796d1457284b857d7d3422195 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:11.875151 12972 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:11.848516 12969 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:11.868860  9711 catalog_manager.cc:5697] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 3 to 5, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 5 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:11.876437 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:11.877064  9711 catalog_manager.cc:5697] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:27:11.877620 12969 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:11.879000  9711 catalog_manager.cc:5697] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:27:11.880300  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:11.882290 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:11.882815  9711 catalog_manager.cc:5697] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 4 to 5, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 5 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:11.883764 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:11.884356  9711 catalog_manager.cc:5697] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 5 to 6, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 6 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:27:11.885140 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:11.885933 10524 raft_consensus.cc:2368] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8.
I20260709 12:27:11.885792  9711 catalog_manager.cc:5697] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.886893 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:11.887293  9711 catalog_manager.cc:5697] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:11.889325 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 64326.4us
I20260709 12:27:11.888828  9711 catalog_manager.cc:5697] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 4 to 5, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 5 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.892978 12887 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:11.893636 10530 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:27:11.894450 12818 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:11.895064 12818 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:11.897311 12818 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:11.898679 13116 log.cc:927] Time spent T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:27:11.898553  9711 catalog_manager.cc:5697] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:11.900218 12778 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:11.900434  9711 catalog_manager.cc:5697] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:11.900859 12778 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:11.902503  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.903195 12778 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:11.906517 13005 raft_consensus.cc:2804] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:11.906960 13005 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.907338 13005 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:11.911238  9854 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:11.910697  9711 catalog_manager.cc:5697] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 6 to 9, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 9 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.913650  9711 catalog_manager.cc:5697] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:11.914846 12976 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:11.915416 12976 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:11.915926 12976 raft_consensus.cc:697] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 6 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:11.916770 12976 consensus_queue.cc:237] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:11.918876 12970 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:11.920167  9887 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:11.921152  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:11.844622 12842 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:11.915241  9711 catalog_manager.cc:5697] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 5 to 7, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 7 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:27:11.923502  9888 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:11.924307  9883 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:11.925190  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:11.925853  9888 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:11.926458  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:11.922119  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:11.928897 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:11.930994 10530 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
W20260709 12:27:11.931843  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 63463.9us
I20260709 12:27:11.931483  9711 catalog_manager.cc:5697] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:11.931980 12978 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:11.933416  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:11.933001  9711 catalog_manager.cc:5697] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 4, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 4 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.934096  9889 raft_consensus.cc:2368] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6.
I20260709 12:27:11.934671  9882 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:11.935194  9889 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:11.934916  9711 catalog_manager.cc:5697] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
W20260709 12:27:11.941264  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.941928  9886 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:11.947162 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:27:11.947381  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 77283.5us
I20260709 12:27:11.943120  9854 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:11.949399  9927 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:11.951490 10497 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:11.934121 12978 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:11.978878  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:11.961304 12944 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:27:11.982429  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 158794us
W20260709 12:27:12.002556  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.969062 12818 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.004345  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:12.008508  9962 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:12.006623  9960 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 8: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:11.949744 12421 consensus_queue.cc:1059] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
W20260709 12:27:12.012915 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.995918 12944 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.978211 12911 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:12.021054  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:11.980098 12854 raft_consensus.cc:2804] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:27:12.021857 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 44197.6us
I20260709 12:27:11.977823 12998 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:12.027417  9962 raft_consensus.cc:1240] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 8. Current term is 9. Ops: []
W20260709 12:27:12.021342  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 72006.4us
I20260709 12:27:12.005368 12842 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.033772  9955 raft_consensus.cc:2393] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:12.037557  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:12.040364  9779 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:12.042376 12754 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.042888 12754 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:12.045341 12754 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:12.047685 12998 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:12.038568 12911 raft_consensus.cc:697] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:12.047947 13043 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:12.049238 12911 consensus_queue.cc:237] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:12.051302  9883 raft_consensus.cc:1240] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:12.018678 12861 consensus_queue.cc:1048] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:27:12.053947  9888 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:12.054397 12765 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:27:12.055940  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:12.060763  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:12.061276  9963 raft_consensus.cc:2376] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8. Re-sending same reply.
I20260709 12:27:12.062021  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:12.063073 12998 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:12.063175  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:12.063776  9958 raft_consensus.cc:2376] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8. Re-sending same reply.
I20260709 12:27:12.063651 12998 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:12.064812  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:12.065682 12998 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:12.065961  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:12.067049  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:12.067408  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:12.067795  9807 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:12.029351 13006 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:27:12.067076  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:12.073863  9959 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:12.021073 12944 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:12.028451 12854 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.080049  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:12.085474  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 60494.1us
I20260709 12:27:12.019747 12818 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:12.092808  9887 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:12.087229  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:12.088689  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:12.096104  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:12.096191  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:12.096314  9809 raft_consensus.cc:1275] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:12.096774  9956 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:27:12.097617  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:12.098708  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:12.099627  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:12.101136  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:12.100136  9961 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:27:12.094818  9814 raft_consensus.cc:2376] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8. Re-sending same reply.
I20260709 12:27:12.104296  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:12.098326  9779 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:12.105295  9964 raft_consensus.cc:2393] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:12.084879 13006 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:27:12.106217  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:12.106858  9955 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:27:12.076272 12887 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:12.083127 12854 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:12.101914  9957 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:12.039738 12842 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:12.111780  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:12.104943  9958 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
W20260709 12:27:12.108345  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 73134.2us
W20260709 12:27:12.114624 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.119091  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:12.120092  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 43580.5us
I20260709 12:27:12.097172 12770 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.113507 12843 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:27:12.084676 12765 consensus_queue.cc:1059] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:27:12.125473  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:12.111455 13047 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:12.128773  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:12.121737  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:12.111466 12861 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:12.111691 12998 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:12.133690  9853 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:12.147243  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:12.148011  9812 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:12.154676 12998 raft_consensus.cc:697] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:12.155807 12998 consensus_queue.cc:237] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:12.141415 13066 raft_consensus.cc:3055] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:12.160481  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:12.157406 12978 raft_consensus.cc:2749] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:12.126191 12770 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:12.162097 12968 consensus_queue.cc:1059] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:27:12.166872  9928 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:12.152720 12861 raft_consensus.cc:697] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:12.171614  9962 raft_consensus.cc:1240] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:27:12.159768 13066 raft_consensus.cc:740] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:12.149981 13026 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:12.169505 12968 raft_consensus.cc:3055] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:12.177292  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:12.180837  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 64811.1us
I20260709 12:27:12.186389  9779 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:12.182147  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:12.163108 12421 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:27:12.173137 12887 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:12.198197  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.208734  9814 raft_consensus.cc:2393] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 8: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:12.210713  9890 raft_consensus.cc:2393] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 8: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:12.212841 12818 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:12.212757 12861 consensus_queue.cc:237] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:12.205201 12778 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:12.222769 12778 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:12.223383 12778 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:12.212260  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:12.226753 12964 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:12.229252 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:12.222839 12842 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:12.227387 12855 consensus_meta.cc:287] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.624s	user 0.008s	sys 0.001s
I20260709 12:27:12.182528 12968 raft_consensus.cc:740] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:12.191424 12850 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:12.239383  9959 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:12.235939  9928 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:12.240409  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:12.217983 13005 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:12.248175  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:12.245468  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 57655.9us
I20260709 12:27:12.257793  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:12.207804 12421 consensus_queue.cc:1243] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Peer 4104e34a61b7448281d6d91ce23ebf71 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:27:12.262404  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:12.242456 12850 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:12.270774  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.272119  9853 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:12.268265  9813 raft_consensus.cc:1217] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 4.4->[4.5-7.6]   Dedup: 4.5->[7.6-7.6]
I20260709 12:27:12.273427  9813 raft_consensus.cc:1240] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: [4.5-7.6]
I20260709 12:27:12.275187  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:12.259251 12984 raft_consensus.cc:2804] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:12.239885 12964 consensus_queue.cc:1059] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:27:12.239113 12887 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:12.275892 12968 consensus_queue.cc:260] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:12.271243 12850 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:12.286784 12968 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:12.290509  9928 leader_election.cc:400] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8.
I20260709 12:27:12.290977  9928 leader_election.cc:403] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:27:12.290582  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:12.278328 12984 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.301748  9815 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 8: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:12.306813  9807 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:12.287473 12818 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:12.336107 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:12.339099 10530 raft_consensus.cc:2393] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 8: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:12.339663  9853 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:12.346134  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:12.301335 12984 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:12.327355 12995 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:12.380805  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:12.384155  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:12.384933  9808 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:27:12.385988  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:12.386626  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:12.387053  9808 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:12.387267  9811 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
W20260709 12:27:12.387645  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 53411.2us
I20260709 12:27:12.388271  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:12.389319  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:12.338207 12970 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.388914  9811 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:12.392659 10530 raft_consensus.cc:1275] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:27:12.400642  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:12.402065  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:12.415437  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:12.414557 10524 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:27:12.420150  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:12.423053  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:12.423297  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.424088  9807 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:12.424826  9808 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:12.433576  9814 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:27:12.434628  9813 raft_consensus.cc:2393] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 9: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:12.402153 13047 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:12.414321 13006 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:12.441812  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 114049us
I20260709 12:27:12.447552  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:12.450888 12818 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:12.451624 13123 log.cc:927] Time spent T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:27:12.451534 12818 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:12.453811 12818 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:12.456331 12559 consensus_meta.cc:287] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.001s
I20260709 12:27:12.456862 12559 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:12.458977  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:12.459753  9814 raft_consensus.cc:2393] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 4: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:12.460526  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:12.461119  9814 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:12.461964  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:12.462376  9811 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:12.462556 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:12.411826 12421 consensus_queue.cc:1059] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:27:12.463807  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:12.464807  9807 raft_consensus.cc:2393] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 6: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:12.434371 12770 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:12.472558  9813 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:12.471168 13006 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:12.479559 13066 consensus_queue.cc:260] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:12.480283 13006 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:12.480580 13066 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:12.483177 12855 raft_consensus.cc:3055] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:12.483551 12855 raft_consensus.cc:740] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:12.484364 12855 consensus_queue.cc:260] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:12.485469 12855 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:12.486622 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:12.486909  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:12.488948  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 87685.1us
W20260709 12:27:12.451558 13122 log.cc:927] Time spent T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:27:12.491878  9778 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:12.493377  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:12.493736  9853 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:12.475973  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:12.515205  9815 raft_consensus.cc:2393] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:12.424947 12765 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:27:12.430723 12854 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:12.495412 12559 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:12.496299 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:12.473181 13005 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:12.503554  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:12.504385  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:12.505389  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.475090 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:12.525852 10530 raft_consensus.cc:2393] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:12.507771 12850 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:12.508924  9812 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:12.510654 12963 raft_consensus.cc:3055] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:12.514011 13026 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:12.526805  9810 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:12.524706  9890 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:12.559048  9778 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:12.559686  9881 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:12.559885  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 86310us
I20260709 12:27:12.561633  9853 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:12.564164 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:12.565132 10524 raft_consensus.cc:2410] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:27:12.568252 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.519771 12773 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:12.449059 12970 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:12.581710  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:12.582355  9890 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:12.583262  9808 raft_consensus.cc:2393] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:12.584301  9779 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:12.518855 12976 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:12.523514 12968 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:12.522125 12964 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:12.594441 10530 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:27:12.610308  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.527894 12963 raft_consensus.cc:740] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:12.618978 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:12.621567  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:12.622121  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 233410us
I20260709 12:27:12.570398 12770 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:12.625955  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 64380.7us
I20260709 12:27:12.619673 10524 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:12.628171  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:12.628975  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 59836us
I20260709 12:27:12.629860  9779 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:12.572856 13073 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:12.560115 13047 consensus_queue.cc:1059] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 12:27:12.608315 12887 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:12.650974  9854 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:12.644028 13026 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:27:12.623171 13005 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:27:12.659960  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 133297us
I20260709 12:27:12.635732 12998 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:12.657116  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 237051us
I20260709 12:27:12.662582  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:12.663888  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.664423  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:12.615481 12964 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:12.665210  9959 raft_consensus.cc:2393] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:12.666040  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:12.665931 13126 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:12.666025  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:12.677815  9958 raft_consensus.cc:2410] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:27:12.667466 12854 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:12.669920  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:12.671365  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:12.674822 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 285090us
I20260709 12:27:12.686304  9778 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:12.665395  9928 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:12.680521 10528 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:12.648890 12818 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:27:12.652894 12944 consensus_meta.cc:287] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.551s	user 0.006s	sys 0.003s
I20260709 12:27:12.658614 13047 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:12.642305 12770 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:12.705658  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.690104 12818 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.690399 13047 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.693856 13125 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:12.710583 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:12.676365 12778 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:12.725556  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 92613.9us
I20260709 12:27:12.726593  9779 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:12.728230  9779 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:12.740211  9889 raft_consensus.cc:1240] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:12.716876 12818 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:12.677038 12963 consensus_queue.cc:260] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:12.716320 13047 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:12.692130 12944 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:12.717224 13125 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:12.753496  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:12.754395  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 78954.3us
W20260709 12:27:12.755393  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 89828.5us
I20260709 12:27:12.759972  9778 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:12.739363 12861 raft_consensus.cc:2764] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:27:12.767266  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:12.776939  9778 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:12.767751  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 102432us
I20260709 12:27:12.778992 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:12.780179  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:12.780608  9778 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:12.781435 10528 raft_consensus.cc:1240] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:12.776865  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:12.789470  9928 leader_election.cc:400] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6.
I20260709 12:27:12.789760  9882 raft_consensus.cc:2368] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9.
I20260709 12:27:12.789935  9928 leader_election.cc:403] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:27:12.780761  9808 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:12.792126  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:12.792877  9889 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:12.744555 12850 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:12.796856  9778 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:12.738101 12421 consensus_queue.cc:1059] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:27:12.757704 13005 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:12.757846 12854 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:12.762822 13125 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:12.763821 12998 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:12.789086 12842 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:12.794157 12963 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:12.795360 13026 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:12.789145 12970 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:12.816262  9853 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:12.818683  9809 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
W20260709 12:27:12.844049  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:12.846755 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 147027us
W20260709 12:27:12.848165  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 77574.7us
I20260709 12:27:12.811940 13152 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:12.839216 12854 raft_consensus.cc:697] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:12.882782  9853 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:12.854751 13132 log.cc:927] Time spent T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260709 12:27:12.854751 13135 log.cc:927] Time spent T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 12:27:12.888175  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 109467us
I20260709 12:27:12.865780 13026 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:27:12.854609 13131 log.cc:927] Time spent T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 12:27:12.847682 12998 raft_consensus.cc:697] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:12.904186  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:12.905555  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:12.884668 10496 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:12.892762 12978 raft_consensus.cc:3055] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:12.880169 12421 raft_consensus.cc:3055] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:27:12.891690 13140 log.cc:927] Time spent T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:27:12.881234 12969 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6.
I20260709 12:27:12.884862 12861 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:12.909741 13146 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:27:12.916638 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 60616.9us
I20260709 12:27:12.909389  9928 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:12.933847 12854 consensus_queue.cc:237] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:12.937021 13138 log.cc:927] Time spent T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.243s	user 0.005s	sys 0.000s
I20260709 12:27:12.910174 13161 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.123s
I20260709 12:27:12.889690 12964 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:12.942579  9853 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:12.913517 13136 log.cc:927] Time spent T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
W20260709 12:27:12.939376  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.908113 13162 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:27:12.917943 13149 log.cc:927] Time spent T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:27:12.909062 12421 raft_consensus.cc:740] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:12.908736 13153 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:12.908178 12978 raft_consensus.cc:740] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
W20260709 12:27:12.947607 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.913530 12770 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:12.915412 13006 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:12.915773 12861 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:12.931180 13146 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.951730  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 709) took 1022 ms. Trace:
I20260709 12:27:12.952438 12970 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:12.951397 13005 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:12.955276 13155 log.cc:927] Time spent T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:27:12.956499 10496 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:12.920758  9881 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:12.948186 12969 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:12.948530 13162 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:12.959286  9886 rpcz_store.cc:276] 0709 12:27:11.929486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.962241 (+ 32755us) service_pool.cc:224] Handling call
0709 12:27:11.977205 (+ 14964us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:12.003941 (+ 26736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:12.003978 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:12.033031 (+ 29053us) log.cc:844] Serialized 26 byte log entry
0709 12:27:12.427742 (+394711us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:12.427794 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.427870 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:12.951486 (+523616us) raft_consensus.cc:1685] finished
0709 12:27:12.951514 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.951660 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24700,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":10818,"thread_start_us":322754,"threads_started":1,"wal-append.queue_time_us":531805}
W20260709 12:27:12.966236  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 169534us
W20260709 12:27:12.966641  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 57428.5us
I20260709 12:27:12.969573  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:12.966747  9853 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:12.971460  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:12.972247  9808 raft_consensus.cc:2393] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 10: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:12.953084 12944 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:12.999997  9881 raft_consensus.cc:1240] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:12.960479 12861 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:13.011159  9853 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:13.000900  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:13.001241 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:13.012490 10530 raft_consensus.cc:2393] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 8: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:27:13.001463 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 49243.1us
I20260709 12:27:13.015323 10524 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:27:12.974253  9697 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d1e4bd6e7a424475b1d707bfa268d54e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader b011791796d1457284b857d7d3422195 (127.8.111.67:42253) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b011791796d1457284b857d7d3422195 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:12.961707 13146 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:13.006341  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:13.018836 12964 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:13.019363  9815 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:27:12.999250 12995 consensus_meta.cc:287] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.618s	user 0.011s	sys 0.000s
I20260709 12:27:12.971683 13153 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:12.967835 12969 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:27:13.023370  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 48400.3us
I20260709 12:27:13.020507 13163 consensus_queue.cc:1048] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:27:13.024688  9886 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:13.025012 13151 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:13.025115 12978 consensus_queue.cc:260] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.025997  9813 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:13.046868  9882 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:27:13.047573  9890 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:13.047927  9853 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:12.998579 13168 consensus_queue.cc:1059] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:27:12.973372 13005 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:13.026705 12968 raft_consensus.cc:3055] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:13.055963  9889 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:13.055963  9778 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:13.058434  9853 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:13.030380 13156 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:13.030783 13165 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.031404 13145 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:13.031844  9812 raft_consensus.cc:1275] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:27:13.032203  9884 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:13.032287  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:13.032691  9811 pending_rounds.cc:85] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71: Aborting all ops after (but not including) 5
I20260709 12:27:13.032925 12421 consensus_queue.cc:260] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:13.033604 12995 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8.
I20260709 12:27:13.034003 12970 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:13.008463 13006 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:13.008755 12887 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:12.977468 13162 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:13.068776  9811 pending_rounds.cc:107] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:27:13.069056  9888 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:13.095738  9811 raft_consensus.cc:2889] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:13.037160 12969 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:13.056320 12968 raft_consensus.cc:740] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:12.959383 12998 consensus_queue.cc:237] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.084081 12850 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:13.115988  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 44556.1us
I20260709 12:27:13.103058 13157 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:13.123570 12976 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:13.130740  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.094946 12818 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:13.132061 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.101559 12887 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:13.118891 13163 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.116546 13169 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.076632 13145 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.147753 12778 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:13.148675  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:13.147753 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:13.153560  9959 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:13.153839 10496 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:13.074450 13165 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.118027 13170 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:13.155190  9885 raft_consensus.cc:2393] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 7: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:13.155121  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:13.155643  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.156380  9960 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:13.164611  9779 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:13.156121 10496 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:13.082103 13156 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:13.161023  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 102676us
W20260709 12:27:13.171078  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.171757  9853 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:13.175189 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:13.179152 10531 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:13.163177 12963 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:13.188405 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:13.189152 10530 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:13.170734 12770 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:13.178603 12754 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:13.196786  9854 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:13.196550  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:13.181391 13167 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:13.183907 13073 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:13.153539 13163 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:13.196046 12855 consensus_meta.cc:287] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.710s	user 0.009s	sys 0.005s
I20260709 12:27:13.192534 12963 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.213505  9964 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:27:13.213737 12818 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:13.215953 13005 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:13.216485 13005 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.217085 13156 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:13.216898 13005 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.218449 12850 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.218956 12850 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.220474 12970 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:13.221688 12850 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:13.197712 12944 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:13.222790 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:13.223528 10532 raft_consensus.cc:2393] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:13.213795 12963 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:13.163543 13157 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.251385 10530 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:13.154770 12968 consensus_queue.cc:260] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:13.230611  9853 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:13.242478  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:13.225579 13172 log.cc:927] Time spent T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:27:13.252732  9854 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:13.205788 13066 consensus_meta.cc:287] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.725s	user 0.014s	sys 0.000s
I20260709 12:27:13.202622 12976 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:13.197775 12754 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:13.250023 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 45154.3us
I20260709 12:27:13.213426 12855 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:13.262432  9959 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:13.265177  9853 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:13.197978 12559 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:27:13.275249  9853 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:27:13.261768  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 97229us
I20260709 12:27:13.178516 13169 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.278584  9853 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:13.216495 13047 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.271082 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:13.181600 13170 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.211411 12998 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:13.271662 12754 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:13.254611 13073 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:13.207193 13125 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:13.211746 13006 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:27:13.291314  9779 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:13.263042 12976 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.293491 13163 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:13.294649 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:13.295617 10530 raft_consensus.cc:2410] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:27:13.293484 12976 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:13.298425 13179 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:13.298858 13179 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:13.299208 13179 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:13.300256 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:13.301697 12969 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:13.304404 12969 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:13.277892 12818 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:13.290997  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:13.308727  9888 raft_consensus.cc:2410] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:27:13.200497 12770 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.251847 13156 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.310968 13165 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:13.263913 13167 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.312867  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:13.313781 12818 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:13.316519 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:13.276491 13178 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:13.277012 12855 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.279207 12970 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:13.292634 13174 log.cc:927] Time spent T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 12:27:13.293198 13175 log.cc:927] Time spent T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:27:13.332702 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:13.345991  9927 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:13.350231 13163 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:13.350921 13163 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:13.333828  9963 raft_consensus.cc:1275] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:27:13.339076  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 48444.9us
I20260709 12:27:13.355336 12978 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:13.355181  9779 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:13.310159 13145 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:13.314266 12944 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:13.315729 13125 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:13.369491 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 195134us
W20260709 12:27:13.370566 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.341897  9881 raft_consensus.cc:2393] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 4: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
W20260709 12:27:13.372021 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 105187us
I20260709 12:27:13.332368 13188 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.375039  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:13.297947 13146 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:13.377434  9779 leader_election.cc:400] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9.
I20260709 12:27:13.377374  9806 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:13.374637  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:13.378458  9779 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:13.378849  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:13.362550 12998 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:27:13.379628  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 102055us
I20260709 12:27:13.389837  9853 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:13.336428 13156 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:13.370347 13005 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:13.393076  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:13.371450 12765 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:13.369161 13178 raft_consensus.cc:697] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:13.433588  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:13.436658  9779 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:13.437656  9962 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:13.439741  9964 raft_consensus.cc:2393] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:27:13.442730 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 72388.1us
I20260709 12:27:13.443498 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:13.389441 13125 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:27:13.432929 12984 consensus_meta.cc:287] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 1.021s	user 0.013s	sys 0.000s
W20260709 12:27:13.444692  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 45758.1us
I20260709 12:27:13.449230  9927 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:13.400058 13073 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:13.451992 12770 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:13.452911 13047 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:13.454456 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:13.454818 13005 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:13.394799 13187 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:13.457150  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:13.458390 10532 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:13.462769 13197 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:13.389266 12861 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:13.401445 13145 consensus_queue.cc:1048] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:27:13.472704 10496 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:13.453883 12976 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.455377 13156 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:13.469375 13192 log.cc:927] Time spent T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:27:13.378957 13188 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:13.488876 13160 log.cc:927] Time spent T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.541s	user 0.000s	sys 0.002s
I20260709 12:27:13.472136 12770 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:13.483705 12421 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:13.458617 13073 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:13.472594  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:13.505132  9883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 722) took 1101 ms. Trace:
I20260709 12:27:13.489899  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:13.516991  9812 raft_consensus.cc:2393] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:13.495609  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:13.517249  9809 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:13.516639  9883 rpcz_store.cc:276] 0709 12:27:12.403628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.756731 (+353103us) service_pool.cc:224] Handling call
0709 12:27:12.779500 (+ 22769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.175733 (+396233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:13.175763 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:13.175800 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:13.175829 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.504907 (+329078us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b5400218754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:13.504947 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:13.505077 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":910819200}
I20260709 12:27:13.525807  9779 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:13.525245  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 76171.3us
W20260709 12:27:13.501425 13190 log.cc:927] Time spent T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 12:27:13.498226 13191 log.cc:927] Time spent T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:27:13.465518 13125 raft_consensus.cc:697] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:13.489481 12818 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:13.530789  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.495587 13189 raft_consensus.cc:2804] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:27:13.531188 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 158452us
I20260709 12:27:13.496024 13164 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:13.463932 12984 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.475355 13047 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:13.541580  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:13.523203 13073 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:13.487183 13170 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:13.539453  9883 raft_consensus.cc:1240] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:13.540346  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:13.516049 13151 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:13.532920 13157 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:13.467499 13183 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:27:13.555234 10525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 883) took 1169 ms. Trace:
I20260709 12:27:13.543362  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:13.541425  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:13.486549 13181 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 12:27:13.542374  9885 raft_consensus.cc:2368] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 8. Current term is 9.
I20260709 12:27:13.544656  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:13.495340 12963 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.535380 13152 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:13.566680  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:13.653443  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:13.604738 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 67830.4us
I20260709 12:27:13.528028 13168 consensus_queue.cc:1059] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:27:13.553833 13043 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:13.555650 10525 rpcz_store.cc:276] 0709 12:27:12.382880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.383030 (+   150us) service_pool.cc:224] Handling call
0709 12:27:12.383290 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:12.383514 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:27:12.625633 (+242119us) log.cc:844] Serialized 14 byte log entry
0709 12:27:13.502400 (+876767us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b1800079c60. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8e0c44bc 00007f2f8b41248b 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f8e0b620b 00007f2f8e0bbd23 00007f2f8e0bc23a
0709 12:27:13.551798 (+ 49398us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:13.551853 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:13.551897 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.551962 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:13.552086 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49177,"prepare.queue_time_us":336306,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":1502,"raft.queue_time_us":51245,"spinlock_wait_cycles":25188736,"thread_start_us":333463,"threads_started":2,"wal-append.queue_time_us":215194}
I20260709 12:27:13.541328 13189 raft_consensus.cc:697] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:13.635396 12855 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:13.636514 13201 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.120s
W20260709 12:27:13.640214 13199 log.cc:927] Time spent T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:27:13.640589 13209 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.555256 13047 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.646555 13125 consensus_queue.cc:237] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:13.648563 12976 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:13.544596 12765 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:13.552302 13151 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.654832 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:13.772044 10524 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:13.606509 13191 log.cc:927] Time spent T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:27:13.655800 10532 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:13.551647 13164 raft_consensus.cc:697] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:13.602845 13146 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:13.782562  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.658746 13043 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.659188 12754 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.660459 13167 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:13.686337 13169 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:13.538199 13162 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:13.632370 13170 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.773887 13197 raft_consensus.cc:2764] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
W20260709 12:27:13.770313 13206 log.cc:927] Time spent T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:27:13.770718 12968 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:13.771081 12765 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:13.771541 13151 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:13.823854 13047 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:13.780427 12963 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:27:13.780202 13164 consensus_queue.cc:237] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.782545 13187 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.835386 12887 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:13.835665 13187 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.837678 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:13.837927 13187 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:13.784118  9854 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:13.851994  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 67961.5us
I20260709 12:27:13.852198 10524 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:13.853466 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:13.855769  9958 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
W20260709 12:27:13.784736  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.491398 13178 consensus_queue.cc:237] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.776588 12855 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.773550 12970 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:13.793592 12976 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:13.803699 13170 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.794027 13153 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.826881 12984 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:13.659514 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 188331us
I20260709 12:27:13.839746 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:13.840797 10527 raft_consensus.cc:1240] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:13.841842 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:13.843034 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:13.777736 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 121154us
I20260709 12:27:13.858407  9854 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:13.862006  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:13.867692  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:13.868384  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:13.826118 12754 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:13.867101  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:13.877388  9883 raft_consensus.cc:2393] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 4: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:13.872669 10525 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:13.876283 13047 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:13.768736 13209 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:13.890735  9809 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:13.863587 12978 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:13.863279 13026 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:13.865005 12818 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.875980 13153 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:13.889736 12778 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:13.870128 12855 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:13.899588 13183 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:13.949075  9889 raft_consensus.cc:2393] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 7: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:13.900995 12970 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:27:13.943042 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 64073us
I20260709 12:27:13.876727 12976 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.952940 13208 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:13.910355 13189 consensus_queue.cc:237] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:13.953809 13208 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.955999 13208 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:13.905893 13026 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.958098 13026 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:13.958328 13204 log.cc:927] Time spent T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.129s	user 0.003s	sys 0.000s
I20260709 12:27:13.960721 13209 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:13.961771 13210 log.cc:927] Time spent T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259: Append to log took a long time: real 0.090s	user 0.001s	sys 0.001s
W20260709 12:27:13.962953 13179 consensus_meta.cc:287] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.663s	user 0.007s	sys 0.006s
I20260709 12:27:13.963225 13066 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.963371 13179 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:13.963735 13066 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:13.964110 13170 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:13.965392 13179 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:13.965755 13066 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:13.966039  9888 raft_consensus.cc:1240] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:13.967168  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:13.967754  9955 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:13.969244  9964 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:27:13.970229  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:13.970484  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:13.970842  9964 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:27:13.971660  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:13.975382  9962 raft_consensus.cc:1240] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:27:13.977775  9778 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:13.980501  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:13.981540  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:13.981604  9778 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:13.982568  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:13.987541  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:13.989133  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:13.990612  9960 raft_consensus.cc:2393] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:13.991919  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:13.992911  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:13.995440  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:13.989547  9810 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:14.002439  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:14.003300  9956 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:13.916693 12818 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:14.005527  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:13.996131  9811 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:14.009176  9809 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:14.009719  9778 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:13.976188 13200 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:13.990780 13164 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:14.013706  9778 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:13.951678 12778 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:13.986387 13047 raft_consensus.cc:697] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:13.987114 12887 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:14.018075  9778 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:14.046051  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:14.015380 13005 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:14.048666 13202 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:14.049238  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:14.049575  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:14.049827  9813 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:14.050136  9810 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:14.051321 13047 consensus_queue.cc:237] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:14.007314 12770 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.045162  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:14.011289 13153 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:14.061717  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:14.062414  9806 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:13.987283 13170 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:27:13.990679 13187 consensus_queue.cc:1059] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:27:14.012274 12911 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.022982 13181 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:14.016713 13164 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:14.070593  9955 raft_consensus.cc:2410] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:27:14.096258 13152 raft_consensus.cc:3055] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:14.108690  9958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55946 (request call id 2022) took 1098 ms. Trace:
I20260709 12:27:13.999277 13183 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:14.109247  9958 rpcz_store.cc:276] 0709 12:27:12.999481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.999631 (+   150us) service_pool.cc:224] Handling call
0709 12:27:14.097588 (+1097957us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b5400114754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:14.097718 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1858678528}
I20260709 12:27:14.154529 13211 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.155200  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:14.070007 13170 consensus_queue.cc:1243] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer b011791796d1457284b857d7d3422195 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:27:14.096760 13164 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:14.076251 13218 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:14.026168 13200 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:14.103180 12843 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.111874 13221 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.108451 13152 raft_consensus.cc:740] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:14.080432 12911 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:14.070770 12770 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:14.293291  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:14.354385 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 207659us
I20260709 12:27:14.525182  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:14.555778  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:14.556517  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:14.399299 13225 log.cc:927] Time spent T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:27:14.643920 10496 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:14.644603  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:14.353051 13217 log.cc:927] Time spent T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
W20260709 12:27:14.353762 13216 log.cc:927] Time spent T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.281s	user 0.000s	sys 0.000s
I20260709 12:27:14.396250 13183 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:14.350198 13219 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:14.667886  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:14.669438  9958 raft_consensus.cc:2393] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:27:14.649402  9956 consensus_meta.cc:287] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.588s	user 0.007s	sys 0.003s
W20260709 12:27:14.653666  9964 consensus_meta.cc:287] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.667s	user 0.014s	sys 0.009s
W20260709 12:27:14.656128  9885 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.017s	sys 0.030s
I20260709 12:27:14.661243 12754 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:27:14.642998 13150 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.643133 13153 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:14.189239 13211 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:14.642923 12855 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:14.679435  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:14.721350 13125 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.011s	sys 0.031s
W20260709 12:27:14.669130 12978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.022s	sys 0.010s
I20260709 12:27:14.698077 12778 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:14.289372 13218 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:14.690902  9808 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.009s	sys 0.033s
I20260709 12:27:14.690897 13148 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:27:14.770745  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 564) took 1602 ms. Trace:
I20260709 12:27:14.770735  9961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 561) took 1603 ms. Trace:
W20260709 12:27:14.777673  9808 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.018s	sys 0.037s
I20260709 12:27:14.716369  9958 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:27:14.664179 13193 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:27:14.662194 13210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.012s	sys 0.019s
W20260709 12:27:14.717746  9885 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.017s	sys 0.030s
I20260709 12:27:14.717670  9964 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:27:14.718344  9956 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:14.655253 12843 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:14.671229 13151 consensus_meta.cc:287] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.861s	user 0.015s	sys 0.003s
I20260709 12:27:14.650852 13202 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:14.682385 12765 consensus_meta.cc:287] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.876s	user 0.010s	sys 0.001s
I20260709 12:27:14.672495 12976 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:14.818912 12976 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:14.818717 12765 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:14.819155  9928 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:14.819438 12976 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:14.820742 12765 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:14.727348  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:14.656416 13221 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:14.821552  9890 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:14.823114 13221 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:14.703136 12984 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.652419 13005 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:14.690357 12818 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:14.737991  9955 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 6: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:14.824134 12984 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:14.738133  9806 consensus_meta.cc:287] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.675s	user 0.004s	sys 0.005s
I20260709 12:27:14.660938 13179 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:14.824301 13005 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:14.825127  9806 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:14.779621  9958 pending_rounds.cc:85] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 4
I20260709 12:27:14.777065  9961 rpcz_store.cc:276] 0709 12:27:13.143215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.145720 (+  2505us) service_pool.cc:224] Handling call
0709 12:27:13.146015 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.289784 (+143769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:13.289823 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:13.289872 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:13.289904 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.746482 (+1456578us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540014e6d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:14.746551 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.746693 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300590464}
I20260709 12:27:14.825927  9958 pending_rounds.cc:107] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:27:14.776387  9959 rpcz_store.cc:276] 0709 12:27:13.145109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.181507 (+ 36398us) service_pool.cc:224] Handling call
0709 12:27:13.184831 (+  3324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.272553 (+ 87722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.747032 (+1474479us) spinlock_profiling.cc:243] Waited 73.7 ms on lock 0x7b54000889d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:14.747229 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169403776}
W20260709 12:27:14.771643 13223 log.cc:927] Time spent T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:27:14.731736 13026 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:27:14.741801 13125 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.011s	sys 0.031s
W20260709 12:27:14.741852 12978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.022s	sys 0.011s
I20260709 12:27:14.835291  9956 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:14.778803 12911 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:14.814334  9964 raft_consensus.cc:1240] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:14.816057 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:14.818204 13197 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:14.737892 12968 consensus_meta.cc:287] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.917s	user 0.011s	sys 0.001s
I20260709 12:27:14.821517  9928 leader_election.cc:400] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 8. Current term is 9.
I20260709 12:27:14.826263  9958 raft_consensus.cc:2889] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:14.753767 12855 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:14.784144  9886 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.026s	sys 0.049s
W20260709 12:27:14.868342  9886 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.852s	user 0.027s	sys 0.049s
I20260709 12:27:14.837581 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:14.861838 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:14.810503 13171 raft_consensus.cc:3055] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:14.689572 13219 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:14.825310 13179 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:14.731667 13150 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:14.867290  9928 leader_election.cc:403] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:14.774581 13230 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:14.786093 13210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.012s	sys 0.020s
I20260709 12:27:14.684255 13152 consensus_queue.cc:260] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:14.793308 13153 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:14.800639 13151 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:14.833554 12976 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:15.189826  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 2068) took 1404 ms. Trace:
W20260709 12:27:15.441566  9930 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.008s	sys 0.028s
I20260709 12:27:15.765978 13218 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:15.796990  9930 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.106s	user 0.015s	sys 0.038s
W20260709 12:27:15.267158  9856 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.008s	sys 0.020s
W20260709 12:27:15.300160  9929 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.013s	sys 0.008s
I20260709 12:27:15.798003 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:15.798821  9929 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.019s	sys 0.017s
I20260709 12:27:15.798861 13171 raft_consensus.cc:740] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:27:15.638796 13228 log.cc:927] Time spent T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.704s	user 0.000s	sys 0.001s
I20260709 12:27:15.733953 13005 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:15.296494  9855 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.029s	sys 0.055s
W20260709 12:27:15.800717  9855 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.150s	user 0.029s	sys 0.077s
I20260709 12:27:15.800107 13171 consensus_queue.cc:260] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:15.801091 13236 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:15.296736  9778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.016s	sys 0.070s
W20260709 12:27:15.801863  9778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.250s	user 0.016s	sys 0.091s
I20260709 12:27:15.801647 13236 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:15.284914 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:15.802708 13230 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:15.803213 13237 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:27:15.185952 10496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.014s	sys 0.003s
W20260709 12:27:15.804049 10496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.018s	sys 0.026s
W20260709 12:27:15.804337  9853 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.146s	user 0.021s	sys 0.031s
W20260709 12:27:15.804693  9853 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.146s	user 0.021s	sys 0.031s
I20260709 12:27:15.804149 13237 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:14.836898 12978 raft_consensus.cc:697] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:15.805207 13236 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:15.805855 13236 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.806111 12978 consensus_queue.cc:237] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:15.806365 13236 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:15.810542  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 989048us
I20260709 12:27:15.796458  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1366) took 1939 ms. Trace:
I20260709 12:27:15.815394  9886 rpcz_store.cc:276] 0709 12:27:13.856936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.857762 (+   826us) service_pool.cc:224] Handling call
0709 12:27:13.867064 (+  9302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:13.926306 (+ 59242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:13.952406 (+ 26100us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:13.976705 (+ 24299us) log.cc:844] Serialized 26 byte log entry
0709 12:27:15.795901 (+1819196us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:15.796009 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.796088 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:15.796138 (+    50us) raft_consensus.cc:1685] finished
0709 12:27:15.796221 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:15.796380 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8677,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":56,"thread_start_us":1827370,"threads_started":2,"wal-append.queue_time_us":1093564}
W20260709 12:27:15.820001 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 1.15496e+06us
I20260709 12:27:14.983640 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:15.823755 10528 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:15.948508 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:15.798144  9856 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.138s	user 0.013s	sys 0.040s
I20260709 12:27:15.084617 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:15.655282  9927 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.021s	sys 0.032s
W20260709 12:27:15.951869  9927 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.270s	user 0.025s	sys 0.042s
W20260709 12:27:15.824535  9890 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.000s	user 0.008s	sys 0.002s
W20260709 12:27:15.952687  9890 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.129s	user 0.011s	sys 0.005s
I20260709 12:27:15.799044 10524 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
W20260709 12:27:15.824792  9808 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.000s	sys 0.010s
W20260709 12:27:15.954504  9808 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.005s	sys 0.011s
W20260709 12:27:15.825969 10498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.012s	user 0.001s	sys 0.009s
W20260709 12:27:15.955785 10498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.142s	user 0.001s	sys 0.015s
I20260709 12:27:15.796401  9815 rpcz_store.cc:276] 0709 12:27:13.785301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.785495 (+   194us) service_pool.cc:224] Handling call
0709 12:27:13.785892 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:13.786114 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:13.786138 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:13.797990 (+ 11852us) log.cc:844] Serialized 26 byte log entry
0709 12:27:13.999318 (+201328us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:13.999355 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.999423 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:15.189525 (+1190102us) raft_consensus.cc:1685] finished
0709 12:27:15.189555 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:15.189746 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":155451,"threads_started":1,"wal-append.queue_time_us":417838}
I20260709 12:27:15.960480  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:15.961465  9964 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:15.947346  9780 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.006s	sys 0.009s
W20260709 12:27:15.963100 10525 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.051s	user 0.004s	sys 0.024s
W20260709 12:27:15.963786  9780 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.007s	sys 0.009s
W20260709 12:27:15.963976 10525 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.061s	user 0.005s	sys 0.025s
I20260709 12:27:15.965762 10524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 836) took 1050 ms. Trace:
W20260709 12:27:15.968827  9854 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.008s	sys 0.006s
W20260709 12:27:15.969245  9854 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.008s	sys 0.006s
I20260709 12:27:15.970921 10528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 834) took 1090 ms. Trace:
I20260709 12:27:15.972071 10527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 835) took 1094 ms. Trace:
I20260709 12:27:15.967619 10529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 831) took 1154 ms. Trace:
I20260709 12:27:15.973939 10529 rpcz_store.cc:276] 0709 12:27:14.813401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.813646 (+   245us) service_pool.cc:224] Handling call
0709 12:27:15.967537 (+1153891us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:15.639492 13232 log.cc:927] Time spent T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.426s	user 0.000s	sys 0.000s
I20260709 12:27:14.873677 12855 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:15.801674 13171 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:15.950201 13200 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:16.178326  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:16.179219  9961 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:15.977202 10530 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:27:15.966638 10524 rpcz_store.cc:276] 0709 12:27:14.903962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.904137 (+   175us) service_pool.cc:224] Handling call
0709 12:27:15.954519 (+1050382us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:15.979167  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:14.863905 12911 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:27:15.416371 13047 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.011s	sys 0.015s
W20260709 12:27:15.950548 12559 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.005s	sys 0.005s
W20260709 12:27:15.270699 13229 log.cc:927] Time spent T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.397s	user 0.001s	sys 0.000s
W20260709 12:27:15.194190 13073 consensus_meta.cc:287] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 1.584s	user 0.004s	sys 0.013s
W20260709 12:27:15.086196 13224 log.cc:927] Time spent T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.314s	user 0.000s	sys 0.000s
W20260709 12:27:15.428105 13222 log.cc:927] Time spent T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.261s	user 0.000s	sys 0.000s
W20260709 12:27:15.095058 13227 log.cc:927] Time spent T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.361s	user 0.000s	sys 0.001s
I20260709 12:27:14.913677 12968 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:16.166424 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:15.805155 13230 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:15.971478 10528 rpcz_store.cc:276] 0709 12:27:14.861336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.861550 (+   214us) service_pool.cc:224] Handling call
0709 12:27:15.951980 (+1090430us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:15.948673 12984 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:15.144306 13221 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:15.972573 10527 rpcz_store.cc:276] 0709 12:27:14.868490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.868792 (+   302us) service_pool.cc:224] Handling call
0709 12:27:15.963095 (+1094303us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:15.663247 12843 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:16.182801  9958 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:15.283577 13211 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:16.185022  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:16.254552 13237 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:14.982992 12818 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:16.272094 13219 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:16.271667 12818 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.273304 13179 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:16.273618 12861 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:16.188402  9959 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:16.274573 13151 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:16.275450 12818 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:16.239732 13235 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:16.125278 13238 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:27:16.234115  9964 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:14.865350 13026 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:16.186638 12559 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.005s	sys 0.005s
W20260709 12:27:16.186383 13047 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.411s	user 0.015s	sys 0.027s
I20260709 12:27:14.867595 13197 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.167884 13218 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:16.279093 13150 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:16.168927 12976 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:14.859858 13202 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:16.250049 12770 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:16.249557  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 536) took 2202 ms. Trace:
I20260709 12:27:16.319590 12976 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:16.251792 13153 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:16.255437 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 307000us
I20260709 12:27:16.321272 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:16.321744 12976 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:16.191653 13239 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.322564 13239 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:16.323946 13202 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:16.324272 12770 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:16.324463 13202 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:16.324642 13239 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:16.322160 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:16.327646 10496 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.761s (SENT)
I20260709 12:27:16.240052 13244 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:16.165369 13236 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:16.237215 12911 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.274169 12861 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.340121 12861 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:16.237215 13073 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.240269 12944 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.343708 13073 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:16.343353 12944 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:16.346555  9883 raft_consensus.cc:1240] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:16.348094  9883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 732) took 2376 ms. Trace:
I20260709 12:27:16.348562  9883 rpcz_store.cc:276] 0709 12:27:13.971317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.829669 (+858352us) service_pool.cc:224] Handling call
0709 12:27:14.847275 (+ 17606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.347077 (+1499802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.347801 (+   724us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400217d54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:16.348020 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3447282944}
I20260709 12:27:16.351604 12911 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:16.283366 13235 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.267068 13200 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.354357 13235 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:16.353874 13200 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.279193 13221 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.264804 13240 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.280133 13230 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.280987 13234 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.298705 13026 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:16.283782 13254 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:16.288589 13219 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:16.284533 12968 consensus_queue.cc:1059] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:27:16.309998  9958 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:16.293860  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1362) took 2439 ms. Trace:
I20260709 12:27:16.281841 13188 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:16.319144 13255 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.288529 13246 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.283186 12984 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:16.324950 12770 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:16.306152 13218 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:16.346213 12944 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:16.285418 13237 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.287552 13250 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:27:16.336309 13164 consensus_meta.cc:287] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 2.047s	user 0.008s	sys 0.005s
I20260709 12:27:16.297006 13179 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:16.296810 13197 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:16.338750 13251 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.334606 13253 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:16.370460  9884 rpcz_store.cc:276] 0709 12:27:13.854032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.854198 (+   166us) service_pool.cc:224] Handling call
0709 12:27:13.863231 (+  9033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:13.949874 (+ 86643us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:27:13.949958 (+    84us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:13.977272 (+ 27314us) log.cc:844] Serialized 26 byte log entry
0709 12:27:14.350126 (+372854us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:14.350172 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.350247 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:16.293570 (+1943323us) raft_consensus.cc:1685] finished
0709 12:27:16.293593 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.293766 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7531,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":79,"thread_start_us":410094,"threads_started":2,"wal-append.queue_time_us":668339}
I20260709 12:27:16.361075 12861 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:16.367259 13073 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.325057 13202 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.377413 12770 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:16.427735  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:16.430928  9884 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:27:16.375689 13255 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.432273  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:16.368702 13230 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:16.373229 13219 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:16.390875 13164 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:16.422448 13253 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.460440  9890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 735) took 2488 ms. Trace:
I20260709 12:27:16.428251 12855 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:16.460903  9890 rpcz_store.cc:276] 0709 12:27:13.972083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.823313 (+851230us) service_pool.cc:224] Handling call
0709 12:27:14.823573 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.823785 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:27:15.953323 (+1129538us) log.cc:844] Serialized 14 byte log entry
0709 12:27:16.460115 (+506792us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:16.460163 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:16.460203 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.460264 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.460382 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19869,"prepare.queue_time_us":975177,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"thread_start_us":1615680,"threads_started":2}
I20260709 12:27:16.460460  9883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 737) took 2487 ms. Trace:
I20260709 12:27:16.464912  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:16.465704  9806 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:27:16.381697 12984 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.464627  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:16.473186  9884 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:27:16.479089 12861 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:16.479677 12861 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:16.483827 13219 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:16.423288 13179 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.374872 13234 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.486335 13179 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:16.487475 13234 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:16.488416 13164 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:16.481964 12861 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:16.494587 13234 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.495077 13221 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:16.495373  9853 connection.cc:256] RPC call timeout handler was delayed by -1.3399598440000773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
W20260709 12:27:16.497013  9853 connection.cc:256] RPC call timeout handler was delayed by -1.0014126780001789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
I20260709 12:27:16.377947 13246 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.373416 13240 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.372699 13254 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.472720 13171 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.459371 13253 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:16.506460 13230 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:16.506559  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 736) took 2534 ms. Trace:
I20260709 12:27:16.527158  9886 rpcz_store.cc:276] 0709 12:27:13.972384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.949248 (+1976864us) service_pool.cc:224] Handling call
0709 12:27:16.125020 (+175772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.297605 (+172585us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:16.297875 (+   270us) log.cc:844] Serialized 14 byte log entry
0709 12:27:16.468104 (+170229us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:16.468168 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:16.468227 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.506242 (+ 38015us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54001e3554. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:16.506321 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.506489 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":448,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":787,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":396402560,"thread_start_us":168845,"threads_started":1,"wal-append.queue_time_us":169746}
I20260709 12:27:16.425391 13237 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.428584 13073 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:16.499105  9928 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.002s	sys 0.005s
I20260709 12:27:16.390435 13250 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:16.530640  9928 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.003s	sys 0.005s
I20260709 12:27:16.500504  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:16.531584  9890 raft_consensus.cc:2393] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 10: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:16.424715 13251 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.532480 13250 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:16.532872 13200 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:16.538695 13218 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:16.534726 13254 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:16.536432 12984 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:16.495103 13234 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:16.555383 13234 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:16.556365 13213 log.cc:927] Time spent T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 2.685s	user 0.007s	sys 0.019s
I20260709 12:27:16.559634 13246 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:16.562556  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:16.540643  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:16.564260  9890 raft_consensus.cc:2410] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:27:16.566464  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:16.564947 13255 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:16.563427  9886 raft_consensus.cc:2393] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 8: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:16.567243 13257 raft_consensus.cc:3055] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:27:16.532887  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 565442us
W20260709 12:27:16.610898 10525 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.000s	sys 0.034s
W20260709 12:27:16.617892 10525 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.001s	sys 0.036s
I20260709 12:27:16.618891 10525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36672 (request call id 832) took 1788 ms. Trace:
I20260709 12:27:16.617131  9890 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:16.619519  9964 raft_consensus.cc:1240] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:27:16.615311  9963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 560) took 3466 ms. Trace:
I20260709 12:27:16.584739  9956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1441) took 2619 ms. Trace:
I20260709 12:27:16.619783  9928 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:16.611168  9853 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:16.624929  9958 raft_consensus.cc:1217] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 4.3->[6.4-10.6]   Dedup: 6.4->[8.5-10.6]
I20260709 12:27:16.625622  9958 pending_rounds.cc:85] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 4
I20260709 12:27:16.621953  9963 rpcz_store.cc:276] 0709 12:27:13.142951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.143061 (+   110us) service_pool.cc:224] Handling call
0709 12:27:13.152928 (+  9867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.354585 (+201657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.608833 (+3254248us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54001d2c54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:16.609080 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356219264}
I20260709 12:27:16.625823  9958 pending_rounds.cc:107] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:27:16.626120  9958 raft_consensus.cc:2889] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:16.621721 10499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.003s	sys 0.007s
I20260709 12:27:16.626889  9807 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:27:16.626986 10499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.003s	sys 0.007s
I20260709 12:27:16.627818  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:16.628381  9807 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:16.622473  9956 rpcz_store.cc:276] 0709 12:27:13.964925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.811422 (+846497us) service_pool.cc:224] Handling call
0709 12:27:14.811874 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.835759 (+ 23885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.584465 (+1748706us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b5400088ed4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:16.584670 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31878016}
I20260709 12:27:16.496444  9806 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:16.643340  9928 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:16.619298 10525 rpcz_store.cc:276] 0709 12:27:14.830661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.830797 (+   136us) service_pool.cc:224] Handling call
0709 12:27:14.860418 (+ 29621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.860733 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:15.964716 (+1103983us) log.cc:844] Serialized 14 byte log entry
0709 12:27:16.618578 (+653862us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:16.618630 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:16.618677 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.618744 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.618842 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":935580,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":3752,"thread_start_us":1711512,"threads_started":2}
I20260709 12:27:16.653824  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:16.655932  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:16.656080  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:16.666702 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:16.612437  9927 connection.cc:256] RPC call timeout handler was delayed by -1.1598365410000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
I20260709 12:27:16.650453  9853 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:16.670825 10528 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:16.665328  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:16.667845 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:16.650561  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:16.668756 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:16.672698  9806 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:16.671537  9853 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:16.675498  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:16.676164  9814 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:16.609699 13240 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:16.758718 10529 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:16.759011  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:16.763226  9964 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:16.758787  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:16.758703  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 87240.5us
I20260709 12:27:16.764454  9955 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:27:16.765805  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:16.768373  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:16.769279  9886 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:16.617831 13257 raft_consensus.cc:740] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:27:16.776580  9856 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.007s	sys 0.007s
I20260709 12:27:16.776419 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:16.530685 13171 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:16.780464  9856 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.007s	sys 0.007s
I20260709 12:27:16.770175  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:16.777282  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:16.781193  9890 raft_consensus.cc:2393] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 7: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:16.626654 13237 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:16.765187  9853 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:16.783671 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:16.782867 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 455190us
I20260709 12:27:16.653496 13186 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.650370 12984 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:16.653347 13254 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:16.795795  9886 raft_consensus.cc:2410] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:27:16.664897 12963 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:16.804358  9780 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.000s	sys 0.015s
W20260709 12:27:16.818550  9780 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.001s	sys 0.016s
I20260709 12:27:16.665130 13143 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:16.760650 13246 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:16.827011 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:16.669369 12559 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:16.675616 12911 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.676837 13150 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.689218 12861 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:16.823321  9890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 739) took 2634 ms. Trace:
I20260709 12:27:16.832780  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:16.758901 13239 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.666663 13271 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:16.840875  9815 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:16.843050 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:16.784808 13234 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:16.837841 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:16.897024 10529 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:16.789994 13200 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.666173 13188 consensus_queue.cc:1059] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.154s
I20260709 12:27:16.790201 13250 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:16.883780 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 57953.6us
I20260709 12:27:16.888331  9890 rpcz_store.cc:276] 0709 12:27:14.188933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.781840 (+2592907us) service_pool.cc:224] Handling call
0709 12:27:16.822861 (+ 41021us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.823023 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:16.823046 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:16.823085 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:16.823117 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.823166 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.823270 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:16.850011  9806 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:16.890691  9886 raft_consensus.cc:2410] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:27:16.911273 10496 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:16.840138 13251 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:16.869179  9959 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
W20260709 12:27:16.828338 12978 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.008s	sys 0.015s
I20260709 12:27:16.796540 13255 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:16.786824 13164 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:16.903337 13238 consensus_meta.cc:287] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.620s	user 0.005s	sys 0.006s
I20260709 12:27:16.896821 12984 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.906549  9779 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:16.836655 13246 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.824174 13258 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:16.863699 13263 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.994796 13258 raft_consensus.cc:697] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:16.994983 13246 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:16.904438 13234 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:16.919039  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:16.800053 13237 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.002396 13234 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:17.002326 13237 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:17.004724 13237 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:16.800297 12770 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.913749 13254 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.893337 13271 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:16.844512 12963 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.996081  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:16.910545 13200 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:17.000011  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 93576.3us
I20260709 12:27:17.028131  9779 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:16.915199  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 119456us
I20260709 12:27:17.005483  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:16.885313 12559 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.922700 13250 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:17.009331  9928 connection.cc:256] RPC call timeout handler was delayed by -2.0513171200000215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
I20260709 12:27:16.891027 13150 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:16.999795 13202 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:16.994733 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:16.996614 13164 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:16.890646 12911 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.993055 12843 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:16.816385 13186 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.845669 13143 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.993438 13238 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 8. Current term is 9.
I20260709 12:27:16.896467 13239 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:16.902612 13256 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 12:27:17.022918  9815 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:16.999639 13221 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.024644  9890 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:17.006379 13261 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.006139 13278 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:17.033025  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 318653us
I20260709 12:27:16.984773 13255 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:16.991609 13197 consensus_queue.cc:1059] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:27:17.030861  9886 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:27:17.125975  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:17.052883 13202 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.055578 12843 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:16.926472 12978 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.010s	sys 0.016s
W20260709 12:27:17.039454  9928 connection.cc:256] RPC call timeout handler was delayed by -1.8275741539996488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
I20260709 12:27:17.013366 13073 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:16.895669 12861 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:16.998075 12984 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:17.043916 10532 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:17.025517 13271 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:17.018992 12854 consensus_queue.cc:1048] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:27:17.019080 13254 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:17.127131  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:17.035512 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 72662us
I20260709 12:27:17.144999 10496 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:17.146013 13270 raft_consensus.cc:2804] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:17.126211 10526 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:17.099434 13262 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:17.135505  9928 connection.cc:256] RPC call timeout handler was delayed by -1.789492927000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
W20260709 12:27:17.151798  9928 connection.cc:256] RPC call timeout handler was delayed by -1.7363929269999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
W20260709 12:27:17.152163  9928 connection.cc:256] RPC call timeout handler was delayed by -1.7363929269999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
W20260709 12:27:17.152465  9928 connection.cc:256] RPC call timeout handler was delayed by -1.7102929269999549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
I20260709 12:27:17.142469  9886 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
W20260709 12:27:17.152766  9928 connection.cc:256] RPC call timeout handler was delayed by -1.6193929270002627s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260709 12:27:17.153059  9928 connection.cc:256] RPC call timeout handler was delayed by -1.6193929270002627s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260709 12:27:17.153368  9928 connection.cc:256] RPC call timeout handler was delayed by -1.443892926999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1952s for a response
W20260709 12:27:17.153687  9928 connection.cc:256] RPC call timeout handler was delayed by -1.3898929269998916s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
W20260709 12:27:17.154002  9928 connection.cc:256] RPC call timeout handler was delayed by -1.3711670069997126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2242s for a response
I20260709 12:27:16.995064 13263 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:17.128473  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:17.154881  9890 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:17.135031 12843 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:17.155812  9928 connection.cc:256] RPC call timeout handler was delayed by -1.2476929270001165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
W20260709 12:27:17.161629  9928 connection.cc:256] RPC call timeout handler was delayed by -1.1963929270000335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
W20260709 12:27:17.161957  9928 connection.cc:256] RPC call timeout handler was delayed by -1.1963929270000335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
W20260709 12:27:17.163586  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 374442us
I20260709 12:27:17.158106 13281 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:17.138489 13202 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:17.127275 13278 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:17.160954 13164 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:17.165455  9778 connection.cc:256] RPC call timeout handler was delayed by -1.2902573559999837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21789999999999998s for a response
I20260709 12:27:17.134537 13285 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:17.104101 13221 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:17.171586  9778 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:17.146684 13270 raft_consensus.cc:697] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:17.125885 13261 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:17.167479 13281 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:17.186259 10496 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:17.170048 13171 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:17.190339 10496 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:17.187439 13164 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:17.124722 13258 consensus_queue.cc:237] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:17.211035  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 183012us
I20260709 12:27:17.213474  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.218777  9814 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:27:17.225420 13263 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:17.198815 13290 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:17.226541 13290 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:17.226940 13290 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:17.228575 13277 log.cc:927] Time spent T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:27:17.208809 13253 consensus_meta.cc:287] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.656s	user 0.011s	sys 0.000s
I20260709 12:27:17.229563 13043 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:17.230036 13253 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:17.230983 13279 log.cc:927] Time spent T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:27:17.232342 13253 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:17.201635 13171 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:17.232956 13186 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:17.178377 13285 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:17.233801 12861 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:17.235369 13250 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:17.235822 13285 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:17.236742 13221 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:17.236865 12770 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:17.237768 13143 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:17.238514 12559 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:17.239658 13200 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:17.240384 13254 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:17.241178 12911 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:17.241308 13278 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:17.262074 13285 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.243624  9962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 579) took 1071 ms. Trace:
I20260709 12:27:17.256501  9963 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:17.168926 13262 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:17.257651  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.189529 13282 consensus_queue.cc:1059] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 12:27:17.265296 13043 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:17.190651 13281 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:17.260028 12887 consensus_queue.cc:1059] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:27:17.310429  9962 rpcz_store.cc:276] 0709 12:27:16.171930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.172078 (+   148us) service_pool.cc:224] Handling call
0709 12:27:16.172356 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:16.609437 (+437081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:16.609485 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:16.610013 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 12:27:16.840599 (+230586us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:16.840639 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.840750 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:17.243328 (+402578us) raft_consensus.cc:1685] finished
0709 12:27:17.243346 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.243562 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9827,"raft.queue_time_us":97580,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":2201,"thread_start_us":650754,"threads_started":2,"wal-append.queue_time_us":430640}
I20260709 12:27:17.263159 12861 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:17.319916  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:17.321702  9809 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.020s	sys 0.014s
I20260709 12:27:17.322868  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:17.323119  9809 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.020s	sys 0.014s
I20260709 12:27:17.323562  9962 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:17.324429  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:17.210561  9806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:27:17.261096 13164 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:27:17.326661  9806 raft_consensus.cc:606] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:27:17.329717  9806 raft_consensus.cc:614] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:17.330710  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.331357  9962 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:27:17.340289  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:17.341825  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.342741  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.343325  9814 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:17.319667 12855 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:17.348063  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:17.346617 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 156359us
W20260709 12:27:17.333071 13266 log.cc:927] Time spent T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.197s	user 0.001s	sys 0.001s
I20260709 12:27:17.367527  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:17.377135  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.365321 12855 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:17.383328  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.352442 12984 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:17.351505 13203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.402s	user 0.014s	sys 0.081s
I20260709 12:27:17.389396  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:17.390193  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:17.390203 10496 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:17.328989 13043 raft_consensus.cc:697] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:27:17.402005  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 180913us
I20260709 12:27:17.326685 12861 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:17.356612  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.321892 13285 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:17.328410 13270 consensus_queue.cc:237] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:17.778577  9806 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:17.563252  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:17.523080  9889 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1364) took 3666 ms (client timeout 1525 ms). Trace:
I20260709 12:27:17.778887  9958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1447) took 1160 ms. Trace:
I20260709 12:27:17.605756  9882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 738) took 3581 ms. Trace:
I20260709 12:27:17.780757  9814 raft_consensus.cc:2376] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9. Re-sending same reply.
W20260709 12:27:17.782393 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 392238us
I20260709 12:27:17.521950  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.785691  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.779727  9964 raft_consensus.cc:2376] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7. Re-sending same reply.
I20260709 12:27:17.572583  9963 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:17.781309  9882 rpcz_store.cc:276] 0709 12:27:14.024795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.789435 (+2764640us) service_pool.cc:224] Handling call
0709 12:27:17.604984 (+815549us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b5800043598. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:27:17.605210 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:17.605415 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:17.605443 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:17.605485 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:17.605518 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.605574 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.605696 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73709824}
I20260709 12:27:17.789242  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.794492  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.795881  9963 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:17.797259  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.797755  9960 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
W20260709 12:27:17.780146  9889 rpcz_store.cc:269] 0709 12:27:13.856393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.856493 (+   100us) service_pool.cc:224] Handling call
0709 12:27:17.522787 (+3666294us) spinlock_profiling.cc:243] Waited 74.2 ms on lock 0x7b54003c5354. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:17.522964 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170594176}
I20260709 12:27:17.798419  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:17.781126  9958 rpcz_store.cc:276] 0709 12:27:16.618261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.618430 (+   169us) service_pool.cc:224] Handling call
0709 12:27:16.618904 (+   474us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:27:16.819040 (+200136us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:27:17.138188 (+319148us) log.cc:844] Serialized 14 byte log entry
0709 12:27:17.316750 (+178562us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:17.317758 (+  1008us) log.cc:844] Serialized 52 byte log entry
0709 12:27:17.317953 (+   195us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:17.318006 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.318106 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:17.490466 (+172360us) raft_consensus.cc:1685] finished
0709 12:27:17.490486 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.778828 (+288342us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72240,"prepare.queue_time_us":327815,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":124847,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":10126,"thread_start_us":418842,"threads_started":2,"wal-append.queue_time_us":341617}
I20260709 12:27:17.799189  9960 raft_consensus.cc:2376] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9. Re-sending same reply.
I20260709 12:27:17.799974  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.800405  9960 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:17.801021  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:17.488653 13289 log.cc:927] Time spent T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
W20260709 12:27:17.783583 13234 consensus_meta.cc:287] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.781s	user 0.013s	sys 0.000s
W20260709 12:27:17.818578 10497 connection.cc:256] RPC call timeout handler was delayed by -1.8720598119998613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21250000000000002s for a response
I20260709 12:27:17.811790  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:17.784113 13203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.863s	user 0.035s	sys 0.096s
I20260709 12:27:17.710088 13162 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:17.809818  9806 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
W20260709 12:27:17.805145 13246 consensus_meta.cc:287] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.796s	user 0.010s	sys 0.014s
I20260709 12:27:17.366652 13171 raft_consensus.cc:697] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:17.819320  9962 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:17.764909 13221 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.856827 13221 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:17.854842  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.858891 13221 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:17.812356  9960 raft_consensus.cc:2393] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:17.521138 13262 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:17.604220 13261 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:17.820832  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.864166  9814 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:27:17.456761 13202 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:17.865429  9890 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.003s	sys 0.025s
I20260709 12:27:17.711985 12855 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:17.823189  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.867012  9963 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:27:17.396907 13194 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.418s
I20260709 12:27:17.818478  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.826359 13043 consensus_queue.cc:237] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:17.834772 13285 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:17.869611  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.836248 12861 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:17.839285 13281 consensus_meta.cc:287] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.000s
I20260709 12:27:17.839879  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:17.845906 13271 consensus_meta.cc:287] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.692s	user 0.008s	sys 0.000s
I20260709 12:27:17.846429  9812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 542) took 1328 ms. Trace:
I20260709 12:27:17.824003 13234 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:17.890969  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.891613  9963 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:17.492583 13290 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:17.846984  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.792387 13201 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:17.892699  9961 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:17.848658  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.888293  9812 rpcz_store.cc:276] 0709 12:27:16.518418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.518578 (+   160us) service_pool.cc:224] Handling call
0709 12:27:16.611867 (+ 93289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:16.633143 (+ 21276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:16.633188 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:16.633758 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 12:27:17.062137 (+428379us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:17.310026 (+247889us) log.cc:844] Serialized 14 byte log entry
0709 12:27:17.318421 (+  8395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.318509 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:17.846194 (+527685us) raft_consensus.cc:1685] finished
0709 12:27:17.846214 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.846364 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142446,"prepare.queue_time_us":98307,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":236400,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":35022,"spinlock_wait_cycles":5376,"thread_start_us":404514,"threads_started":2,"wal-append.queue_time_us":479678}
I20260709 12:27:17.894549  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.895236  9961 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:27:17.852128  9885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 731) took 3902 ms. Trace:
I20260709 12:27:17.852913 13246 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:17.859702  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 541) took 1359 ms. Trace:
I20260709 12:27:17.863299  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.819327 10497 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:27:17.865867  9890 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.003s	sys 0.025s
I20260709 12:27:17.868841  9964 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:17.901544  9960 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
W20260709 12:27:17.902181 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 82937.9us
I20260709 12:27:17.870529  9958 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
W20260709 12:27:17.849310 12843 consensus_meta.cc:287] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.678s	user 0.007s	sys 0.002s
I20260709 12:27:17.854557  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.898408  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.899297  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.896032  9885 rpcz_store.cc:276] 0709 12:27:13.950231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.950545 (+   314us) service_pool.cc:224] Handling call
0709 12:27:13.958861 (+  8316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.991492 (+ 32631us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:13.991818 (+   326us) log.cc:844] Serialized 14 byte log entry
0709 12:27:14.784571 (+792753us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:14.784636 (+    65us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:14.784674 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.851918 (+3067244us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b54003c78d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:17.851959 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.852072 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":698,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":1457,"raft.queue_time_us":39128,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":74454784,"thread_start_us":792426,"threads_started":1,"wal-append.queue_time_us":742010,"wal-append.run_cpu_time_us":16565,"wal-append.run_wall_time_us":2568664}
I20260709 12:27:17.904717  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.905333  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.902447  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.907478  9814 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:17.907703  9962 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:17.906427  9961 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:17.908944  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.909518  9956 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:17.907704  9960 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:17.907011  9812 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:17.911473  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.911926  9812 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:17.912503  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.912914  9812 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:17.913759  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.894007 13201 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:17.900097  9810 rpcz_store.cc:276] 0709 12:27:16.500263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.500425 (+   162us) service_pool.cc:224] Handling call
0709 12:27:16.652150 (+151725us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:16.934527 (+282377us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:17.323354 (+388827us) log.cc:844] Serialized 14 byte log entry
0709 12:27:17.574751 (+251397us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:17.803234 (+228483us) log.cc:844] Serialized 52 byte log entry
0709 12:27:17.803400 (+   166us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:17.803621 (+   221us) log.cc:844] Serialized 14 byte log entry
0709 12:27:17.803910 (+   289us) log.cc:844] Serialized 14 byte log entry
0709 12:27:17.817577 (+ 13667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.817657 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:17.859518 (+ 41861us) raft_consensus.cc:1685] finished
0709 12:27:17.859536 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.859652 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129976,"prepare.queue_time_us":247977,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":102,"raft.queue_time_us":430712,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":20578,"thread_start_us":665216,"threads_started":3,"wal-append.queue_time_us":510893}
I20260709 12:27:17.916806  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.917519  9961 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:17.917804  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.918242  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:17.919552  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.920156  9812 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:17.918380  9964 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:27:17.920902  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.921482  9958 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:27:17.906693 13193 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:17.895056 13281 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:17.929690  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:17.929769  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.930871  9812 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:27:17.933218  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.933800  9810 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:17.920079 13201 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:17.897898 13271 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:17.937117  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.937057  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.937589  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:17.938153  9814 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:27:17.910742 12843 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:17.941412  9806 raft_consensus.cc:2393] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 9: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:17.926589 13193 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:17.942229  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.943560  9958 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:17.944372  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.944376  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.945104  9961 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:17.945118  9956 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:27:17.946121  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.921929 13171 consensus_queue.cc:237] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:16.320055  9808 rpcz_store.cc:276] 0709 12:27:14.046534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.047089 (+   555us) service_pool.cc:224] Handling call
0709 12:27:14.068976 (+ 21887us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:14.069309 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:14.069350 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:14.097075 (+ 27725us) log.cc:844] Serialized 26 byte log entry
0709 12:27:14.778143 (+681068us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:15.954944 (+1176801us) log.cc:844] Serialized 14 byte log entry
0709 12:27:16.240957 (+286013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.241069 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:16.248858 (+  7789us) raft_consensus.cc:1685] finished
0709 12:27:16.248888 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.249290 (+   402us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1022040,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":336032,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":59690,"thread_start_us":2067435,"threads_started":3,"wal-append.queue_time_us":719507}
I20260709 12:27:17.946874  9886 raft_consensus.cc:1240] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:17.947641  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.948032  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.949115  9812 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:17.950008  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:16.465284  9883 rpcz_store.cc:276] 0709 12:27:13.972667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.349798 (+2377131us) service_pool.cc:224] Handling call
0709 12:27:16.350212 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.355946 (+  5734us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:27:16.367684 (+ 11738us) log.cc:844] Serialized 14 byte log entry
0709 12:27:16.459994 (+ 92310us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:16.460099 (+   105us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:16.460159 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.460243 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.460395 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24230,"prepare.queue_time_us":11567,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":2017,"raft.queue_time_us":24529,"thread_start_us":67658,"threads_started":1}
I20260709 12:27:17.950577  9814 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:27:17.954697  9958 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:27:17.954929  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.955493  9808 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:27:17.945422 13193 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:17.956462  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.957517 12887 raft_consensus.cc:3055] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:17.957819 12984 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:17.962929  9963 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:17.968186  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:17.968818  9964 raft_consensus.cc:2410] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:27:17.971371  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.975281  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.976130  9814 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:17.978334  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.983335  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.964093 12887 raft_consensus.cc:740] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:17.985510 12887 consensus_queue.cc:260] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:17.986754 12887 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:17.987731 13296 raft_consensus.cc:3055] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:17.988130 13296 raft_consensus.cc:740] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:17.988967 13296 consensus_queue.cc:260] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:17.990605  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.970081 13282 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.998477  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.990111 13296 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:18.000248  9807 raft_consensus.cc:2393] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 11: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:18.000242  9812 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:18.002930  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.001199  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:17.973721 13285 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:18.004024  9814 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:18.004815  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.009083  9808 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:18.012451  9887 raft_consensus.cc:1240] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: []
W20260709 12:27:18.011699  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 52768us
I20260709 12:27:18.013325  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:18.016719  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.017540  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.018267  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.018901  9812 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:18.021257  9928 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:18.023418  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:18.024168  9807 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:18.026496  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.024904  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:18.012555 13285 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:18.032042  9815 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 538) took 1567 ms (client timeout 1778 ms). Trace:
W20260709 12:27:18.032622  9815 rpcz_store.cc:269] 0709 12:27:16.464198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.464331 (+   133us) service_pool.cc:224] Handling call
0709 12:27:18.031805 (+1567474us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54001f4854. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:18.031932 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841862528}
I20260709 12:27:18.035573 13260 raft_consensus.cc:3055] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:18.036099 13260 raft_consensus.cc:740] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:18.037120 13260 consensus_queue.cc:260] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:18.048626 13178 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:18.026891 13290 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:18.049612 10532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 659) took 1262 ms. Trace:
I20260709 12:27:18.050014 10532 rpcz_store.cc:276] 0709 12:27:16.787372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.787597 (+   225us) service_pool.cc:224] Handling call
0709 12:27:18.049441 (+1261844us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b5400705154. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:18.049554 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475584384}
I20260709 12:27:18.051505  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 740) took 3862 ms. Trace:
I20260709 12:27:18.051883  9886 rpcz_store.cc:276] 0709 12:27:14.189203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.157414 (+2968211us) service_pool.cc:224] Handling call
0709 12:27:17.157689 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:17.951120 (+793431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.051295 (+100175us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b540043bcd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:18.051451 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814520192}
I20260709 12:27:18.007622 13234 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:18.041371  9890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2251) took 1372 ms. Trace:
I20260709 12:27:18.034116  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:18.063787  9815 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:18.064543  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:18.065562  9812 raft_consensus.cc:2393] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 7: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:18.056849  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:18.066821  9958 raft_consensus.cc:2393] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 7: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:18.057119  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:18.049229 13178 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:18.032191 13285 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:18.072723  9963 raft_consensus.cc:1275] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:18.072794  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:18.058729  9807 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:18.069602  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.070784  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:18.071539  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:18.062853  9890 rpcz_store.cc:276] 0709 12:27:16.669442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.159089 (+489647us) service_pool.cc:224] Handling call
0709 12:27:17.159352 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:17.159533 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:17.345910 (+186377us) log.cc:844] Serialized 14 byte log entry
0709 12:27:17.903190 (+557280us) log.cc:844] Serialized 14 byte log entry
0709 12:27:18.040715 (+137525us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b180049bf40. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b3a9c0a 00007f2f94ae9219 00007f2f8b431a40 00007f2f8b42c4e4 00007f2f8b42c455 00007f2f8e514060 00007f2f8e526716 00007f2f8e537287 00007f2f8e537208
0709 12:27:18.040907 (+   192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:18.040978 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:18.041053 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.041143 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.041300 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2916,"prepare.queue_time_us":329399,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":144044,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":7204,"spinlock_wait_cycles":28888960,"thread_start_us":742811,"threads_started":2,"wal-append.queue_time_us":567679}
I20260709 12:27:18.073778  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:18.074631  9808 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:18.084744  9815 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:18.085965  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.087247  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.087936  9815 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:27:18.089416  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.090139  9815 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:18.058463 13246 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:18.095124  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.102294  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:18.063305 13271 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:18.106539  9808 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:18.102872  9956 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:27:18.110973  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.111950  9815 raft_consensus.cc:2410] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 9 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:27:18.112514  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:18.113286  9964 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:18.113747  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.114674  9815 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:27:18.115779  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.117668  9815 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:27:18.004343 13282 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:18.111603  9812 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:18.119941  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:18.120541  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 126007us
W20260709 12:27:18.122709  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 101504us
W20260709 12:27:18.124022  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.125324  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:18.127985  9807 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
W20260709 12:27:18.129868  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 81791.8us
I20260709 12:27:18.130898  9854 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:18.131176  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.109879 13201 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:18.142766 13321 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:18.135962  9808 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:18.132047  9854 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:18.131695  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.145501  9812 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:18.145545  9814 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:18.147513 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.147665 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.144865 13322 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:18.149997 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.121609 13281 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:18.094916 13234 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:27:18.154502 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.155128 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.156848 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:18.144698 13271 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:18.154466  9808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f93660c342af47199c6cec5c0424043a"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:27:18.160213 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.160634  9808 raft_consensus.cc:606] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:27:18.160987  9808 raft_consensus.cc:614] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:18.151093 13322 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.149433 12843 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:18.166425 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.167037 10530 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:18.161115 13271 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.170047 13271 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:18.169504 13322 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:18.151088 13290 consensus_queue.cc:1059] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:27:18.198920 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.199944 13257 consensus_queue.cc:260] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:18.165963 13148 consensus_queue.cc:1059] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:27:18.201339 13193 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:18.207903 10526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 657) took 1540 ms. Trace:
I20260709 12:27:18.220412  9960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 589) took 1056 ms. Trace:
I20260709 12:27:18.223392 12984 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:18.234391 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.237999 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.238504 13257 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:18.238682 10530 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:18.242687 13201 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:18.247874 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.248627 10532 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:18.249876 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:18.251734 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:18.252619 13193 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:18.255194  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 128396us
I20260709 12:27:18.267498 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.268250  9928 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:18.269183 10530 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:18.253698  9960 rpcz_store.cc:276] 0709 12:27:17.163719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.910298 (+746579us) service_pool.cc:224] Handling call
0709 12:27:17.910582 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:17.915758 (+  5176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:17.915789 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:17.929981 (+ 14192us) log.cc:844] Serialized 26 byte log entry
0709 12:27:18.108449 (+178468us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:18.149297 (+ 40848us) log.cc:844] Serialized 14 byte log entry
0709 12:27:18.209618 (+ 60321us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b1800439240. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f3f3 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:27:18.219985 (+ 10367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.220079 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:18.220118 (+    39us) raft_consensus.cc:1685] finished
0709 12:27:18.220211 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.220353 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40180,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":20699,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":35246,"spinlock_wait_cycles":6515968,"thread_start_us":237153,"threads_started":2,"wal-append.queue_time_us":221083}
I20260709 12:27:18.227777 10526 rpcz_store.cc:276] 0709 12:27:16.667489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.789755 (+122266us) service_pool.cc:224] Handling call
0709 12:27:18.207726 (+1417971us) spinlock_profiling.cc:243] Waited 62.3 ms on lock 0x7b540002fdd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:18.207844 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143342464}
I20260709 12:27:18.280781  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.281612  9886 raft_consensus.cc:2410] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:27:18.283141  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.283712  9886 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
W20260709 12:27:18.289471  9697 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d1e4bd6e7a424475b1d707bfa268d54e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader b011791796d1457284b857d7d3422195 (127.8.111.67:42253) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b011791796d1457284b857d7d3422195 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
W20260709 12:27:18.305656  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.279274 12968 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:27:18.326994 13323 log.cc:927] Time spent T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:27:18.328913  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.329538  9885 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
W20260709 12:27:18.330750 13300 log.cc:927] Time spent T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.858s	user 0.000s	sys 0.008s
I20260709 12:27:18.335013  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.335635  9883 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:18.326908 12968 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:18.340411  9890 raft_consensus.cc:1240] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:18.345950  9885 raft_consensus.cc:1240] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:18.291152 13234 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:18.342787 12968 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:18.376955 12963 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:18.378199 12968 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:18.379531  9887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1363) took 4525 ms. Trace:
I20260709 12:27:18.379909  9887 rpcz_store.cc:276] 0709 12:27:13.856072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.863719 (+  7647us) service_pool.cc:224] Handling call
0709 12:27:13.876280 (+ 12561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:18.017492 (+4141212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.379290 (+361798us) spinlock_profiling.cc:243] Waited 4.14 s on lock 0x7b54002e7554. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:18.379448 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9511639808}
I20260709 12:27:18.380851 12968 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:18.381589 13150 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:18.384665 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 166725us
I20260709 12:27:18.368631 13178 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:18.394377  9884 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 2241) took 2025 ms (client timeout 1656 ms). Trace:
I20260709 12:27:18.395857  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.396394  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:18.395922  9884 rpcz_store.cc:269] 0709 12:27:16.365980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.431992 (+ 66012us) service_pool.cc:224] Handling call
0709 12:27:18.390954 (+1958962us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b54000ba4d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:18.391047 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87124352}
I20260709 12:27:18.386369 13256 raft_consensus.cc:3055] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:27:18.398093  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 234091us
W20260709 12:27:18.402055  9779 connection.cc:256] RPC call timeout handler was delayed by -1.7534124779995182s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25670000000000004s for a response
W20260709 12:27:18.402629  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.406179  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.406494  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.406826  9881 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:18.409180  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.383428 13234 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:18.393782 13282 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:18.417524  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:18.445827  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 100171us
I20260709 12:27:18.399170 13256 raft_consensus.cc:740] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:18.451505  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:18.453862  9962 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:18.464690  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:18.467694  9928 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:18.469791  9928 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:18.470873  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:18.434078 13271 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:18.471194  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:18.472355  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:18.430032 13322 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:18.473456  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.476704  9881 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:18.475337  9928 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:18.494532  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.497347  9928 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:18.471855 13257 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:18.511896  9889 raft_consensus.cc:2393] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:18.512524  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2415) took 1301 ms. Trace:
I20260709 12:27:18.512930  9813 rpcz_store.cc:276] 0709 12:27:17.211333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.492204 (+1280871us) service_pool.cc:224] Handling call
0709 12:27:18.512064 (+ 19860us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:18.512223 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:18.512246 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:18.512288 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:18.512330 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.512378 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.512474 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:18.509356  9928 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:18.515259  9882 raft_consensus.cc:2393] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 11: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
W20260709 12:27:18.516367  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.480811 13265 raft_consensus.cc:2804] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:18.515424  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:18.520349  9884 raft_consensus.cc:2393] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 8: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:18.521610  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.528507  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.529250  9888 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:18.497426 12964 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:18.492580 13325 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:18.534008  9883 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:18.514544  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:18.516976 13257 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.518229 13142 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:18.535691  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2416) took 1324 ms. Trace:
I20260709 12:27:18.519754 13265 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.539431  9813 rpcz_store.cc:276] 0709 12:27:17.211540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.513879 (+1302339us) service_pool.cc:224] Handling call
0709 12:27:18.535353 (+ 21474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:18.535488 (+   135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:18.535503 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:18.535529 (+    26us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:18.535547 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.535578 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.535649 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:18.540809  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:18.532763 13316 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:18.543777  9960 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:18.544199 13265 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:18.544597  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:18.553679  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.539216 13142 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:18.547873  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.555080  9888 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:27:18.539834 13257 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:18.533573 12964 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:18.536813 13325 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:18.520996 13256 consensus_queue.cc:260] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:18.555886 13142 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:18.556492  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.559942 13234 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:18.562153  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.579874  9886 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 4.
I20260709 12:27:18.542214  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:18.580753  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.581059  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.581741  9883 raft_consensus.cc:2393] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 8: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
W20260709 12:27:18.562783  9959 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55952 (request call id 1449) took 1941 ms (client timeout 2044 ms). Trace:
I20260709 12:27:18.563359  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2412) took 1352 ms. Trace:
I20260709 12:27:18.546602 13316 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:18.582142  9959 rpcz_store.cc:269] 0709 12:27:16.621212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.621394 (+   182us) service_pool.cc:224] Handling call
0709 12:27:18.562642 (+1941248us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b5400150ed4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:18.562733 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454534400}
I20260709 12:27:18.583185  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.572692  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.583984  9886 raft_consensus.cc:2410] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:27:18.568014 13322 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:18.586239 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.576390  9960 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:18.547246 13150 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:18.590010 13150 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.590939 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.579066 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:18.582209  9815 rpcz_store.cc:276] 0709 12:27:17.210520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.150406 (+939886us) service_pool.cc:224] Handling call
0709 12:27:18.150684 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:18.154676 (+  3992us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:18.154708 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:18.160792 (+  6084us) log.cc:844] Serialized 26 byte log entry
0709 12:27:18.398203 (+237411us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:18.398256 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.398792 (+   536us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:18.563142 (+164350us) raft_consensus.cc:1685] finished
0709 12:27:18.563167 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.563299 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":4227,"thread_start_us":177306,"threads_started":1,"wal-append.queue_time_us":298725}
I20260709 12:27:18.584079  9884 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:27:18.593034  9815 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:18.593321  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:18.575150 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.595453 10524 raft_consensus.cc:2393] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 7: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:18.590423 13150 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:18.554955 13148 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.586727  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.606568  9883 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:18.607645  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.608551  9883 raft_consensus.cc:2393] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:18.587041 10530 raft_consensus.cc:2410] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:27:18.610594  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.611466  9886 raft_consensus.cc:2410] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:27:18.587803  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.588835 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.579773 13325 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:18.577498 12964 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:18.586120 13316 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:18.597673  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2422) took 1384 ms. Trace:
I20260709 12:27:18.626173  9815 rpcz_store.cc:276] 0709 12:27:17.212894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.592623 (+1379729us) service_pool.cc:224] Handling call
0709 12:27:18.592874 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:18.597382 (+  4508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.597609 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:18.628153  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 551) took 1382 ms. Trace:
I20260709 12:27:18.628552  9815 rpcz_store.cc:276] 0709 12:27:17.245732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.627168 (+1381436us) service_pool.cc:224] Handling call
0709 12:27:18.627541 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:18.627750 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:18.627789 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:18.627845 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:18.627891 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.627960 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.628090 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:18.594708  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:18.581825  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2420) took 1369 ms. Trace:
I20260709 12:27:18.599089 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.630412  9884 raft_consensus.cc:2393] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 7: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:18.630081  9813 rpcz_store.cc:276] 0709 12:27:17.212445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.550373 (+1337928us) service_pool.cc:224] Handling call
0709 12:27:18.581353 (+ 30980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:18.581514 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:18.581537 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:18.581575 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:18.581604 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.581653 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.581776 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:18.601771 13152 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:18.617789 10530 raft_consensus.cc:1240] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:27:18.655171  9809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 537) took 2191 ms. Trace:
I20260709 12:27:18.617879 13255 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:18.656297  9888 raft_consensus.cc:1275] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:18.657290  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.658558  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.659673  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.660507  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:18.661214  9888 raft_consensus.cc:2393] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 4: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:18.663357  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.655611  9809 rpcz_store.cc:276] 0709 12:27:16.463834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.463963 (+   129us) service_pool.cc:224] Handling call
0709 12:27:16.470916 (+  6953us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:16.539662 (+ 68746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:16.539689 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:16.540236 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 12:27:17.323650 (+783414us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:17.323733 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.267687 (+943954us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:18.654862 (+387175us) spinlock_profiling.cc:243] Waited 68.3 ms on lock 0x7b54002d6c54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:18.654922 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:18.654968 (+    46us) raft_consensus.cc:1685] finished
0709 12:27:18.654982 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.655106 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":174918656,"thread_start_us":782959,"threads_started":1,"wal-append.queue_time_us":932352}
I20260709 12:27:18.619834  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.610129  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.668618  9890 raft_consensus.cc:2393] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 7: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:18.623435 13148 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:18.646302 12843 raft_consensus.cc:3055] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:18.686764 12843 raft_consensus.cc:740] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:18.687220 13148 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:18.687773 12843 consensus_queue.cc:260] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:18.646533 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.689479 10532 raft_consensus.cc:2410] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:27:18.647039 13253 raft_consensus.cc:3055] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:18.668527  9883 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:18.690250 13253 raft_consensus.cc:740] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:18.690917  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.691053 13253 consensus_queue.cc:260] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:18.691854 13275 log.cc:927] Time spent T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 1.588s	user 0.004s	sys 0.007s
I20260709 12:27:18.692005  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:18.692196 13253 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:18.692726  9883 raft_consensus.cc:2393] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 8: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:18.693336 10524 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:18.693440  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.639274 13256 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:18.675668  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:18.696230 13271 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:18.675567 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:18.697708 10530 raft_consensus.cc:2368] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11.
I20260709 12:27:18.698576 13247 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:18.699318 13247 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:18.631476  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.702196  9884 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:18.703014  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.704048  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.705246  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.705834  9884 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:18.676889  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.706697  9886 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:18.707648  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.708161  9886 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:18.698544 13255 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:18.709519  9886 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:18.709431 13255 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:18.696337  9957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 578) took 2529 ms. Trace:
I20260709 12:27:18.714991 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:18.716543 10496 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:18.694157  9883 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:18.683065  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:18.685408 10531 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:27:18.723531  9890 raft_consensus.cc:2368] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 7. Current term is 8.
W20260709 12:27:18.729856  9927 connection.cc:256] RPC call timeout handler was delayed by -1.1324811710001086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
I20260709 12:27:18.733918  9779 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:18.740578  9890 raft_consensus.cc:1275] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:18.740960 10528 raft_consensus.cc:1240] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:18.744318 13326 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.744828 13326 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:18.745180 13150 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:18.746981 13326 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:18.747658 13150 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:18.750937  9927 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:18.751888  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.754755  9888 raft_consensus.cc:2393] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 11: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:18.752795  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.755786  9890 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:18.758098  9927 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:18.753118  9854 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:18.711185  9957 rpcz_store.cc:276] 0709 12:27:16.167508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.167661 (+   153us) service_pool.cc:224] Handling call
0709 12:27:16.226634 (+ 58973us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:16.279362 (+ 52728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:16.279393 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:16.284980 (+  5587us) log.cc:844] Serialized 26 byte log entry
0709 12:27:16.790803 (+505823us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:17.020127 (+229324us) log.cc:844] Serialized 14 byte log entry
0709 12:27:17.022453 (+  2326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.022555 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:18.691277 (+1668722us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:18.696079 (+  4802us) raft_consensus.cc:1685] finished
0709 12:27:18.696167 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.696282 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2002,"prepare.queue_time_us":336825,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":3547,"raft.queue_time_us":104171,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":21652,"spinlock_wait_cycles":60353792,"thread_start_us":691697,"threads_started":3,"wal-append.queue_time_us":736152}
I20260709 12:27:18.763500 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:18.764741 10532 raft_consensus.cc:1240] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:18.768610  9928 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:18.770798  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:18.771796 10529 raft_consensus.cc:2393] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 11: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:18.772331  9928 leader_election.cc:400] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11.
I20260709 12:27:18.773533 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.776000 13326 consensus_queue.cc:1059] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:18.777343 13193 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.791791  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:18.793741  9962 raft_consensus.cc:2376] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8. Re-sending same reply.
I20260709 12:27:18.794059 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:18.752391 13251 raft_consensus.cc:2804] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:18.738830 13006 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:27:18.778909  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.806257  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:18.751281 13311 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.023s	sys 0.008s
I20260709 12:27:18.810105  9778 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:18.806632  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:18.811215  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:18.812126  9959 raft_consensus.cc:2393] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:18.738499 13194 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:18.779352  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:18.785861  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:18.812960  9960 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:18.813424  9961 raft_consensus.cc:1240] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:18.681999 12964 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:18.816543  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:18.800691  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:18.770071 13150 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:18.772748  9928 leader_election.cc:403] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:27:18.809130  9956 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:27:18.813697  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2413) took 1603 ms. Trace:
I20260709 12:27:18.823032  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:18.820456  9808 rpcz_store.cc:276] 0709 12:27:17.210783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.230114 (+1019331us) service_pool.cc:224] Handling call
0709 12:27:18.253574 (+ 23460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:18.253763 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:18.278083 (+ 24320us) log.cc:844] Serialized 14 byte log entry
0709 12:27:18.570632 (+292549us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b18003e0e60. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b411e07 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f8e0b620b 00007f2f8e0bbd23 00007f2f8e0bc23a 00007f2f8e526a2a
0709 12:27:18.795631 (+224999us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b18003e0e60. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8e0c44bc 00007f2f8b41248b 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42c455 00007f2f91f143c7 00007f2f8e5269a7 00007f2f8e5360bf
0709 12:27:18.809467 (+ 13836us) log.cc:844] Serialized 14 byte log entry
0709 12:27:18.813376 (+  3909us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:18.813438 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:18.813483 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.813540 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.813648 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39770,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":11266,"raft.queue_time_us":14425,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":14491,"spinlock_wait_cycles":94855808,"thread_start_us":172739,"threads_started":2,"wal-append.queue_time_us":474349}
I20260709 12:27:18.814443  9778 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:18.781154 13271 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:18.805239 13251 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.777858 12911 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:18.765413 13309 consensus_queue.cc:1048] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:27:18.774996  9854 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:18.778090 13335 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:18.841265  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 66317.8us
I20260709 12:27:18.814888 13239 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:18.826196  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:18.818607 13006 raft_consensus.cc:697] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:18.806056 13307 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 12:27:18.790001 13270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.962s	user 0.010s	sys 0.009s
I20260709 12:27:18.850656 12911 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:18.815101 13311 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.023s	sys 0.008s
I20260709 12:27:18.826095  9778 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:18.842756  9854 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:18.852432 13325 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:18.853735 13200 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:18.819415 13171 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:18.853978  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.854168 13200 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.854576 13200 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:18.854627  9808 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:27:18.855686  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.856683  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.836587  9964 raft_consensus.cc:1240] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:18.858920  9957 raft_consensus.cc:1275] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:18.819448 13201 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:18.859683  9779 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:18.860013 13201 raft_consensus.cc:697] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:18.781327 12968 raft_consensus.cc:2764] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:27:18.845857  9956 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:18.847522  9810 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:18.829311 13005 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:18.846185 13221 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:27:18.850777 13270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.010s	sys 0.009s
I20260709 12:27:18.787087 13193 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:18.831271 13271 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.884598 13193 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:18.884795 13171 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:18.875711 13221 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.880427 13152 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:18.885761 13221 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:18.886179 13152 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:18.888309 13152 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:18.880681 12778 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:18.888898  9806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 560) took 1508 ms (client timeout 1720 ms). Trace:
I20260709 12:27:18.889128 12778 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:18.889328  9806 rpcz_store.cc:269] 0709 12:27:17.380370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.839604 (+459234us) service_pool.cc:224] Handling call
0709 12:27:18.888709 (+1049105us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b54002526d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:18.888842 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121865984}
I20260709 12:27:18.880398 13271 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:18.891194 12778 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:18.892731 12887 consensus_queue.cc:1048] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:18.893091 12911 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11.
W20260709 12:27:18.893684  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.866338  9779 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:18.836052 13251 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:18.894797  9779 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:18.895972  9779 leader_election.cc:400] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 7. Current term is 8.
I20260709 12:27:18.896723  9779 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:18.897713 10497 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:18.875942 13005 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.898883 13005 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:18.900331 13293 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:18.900750 13293 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:18.901029  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.901225 13168 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:18.901609 13168 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.874742 13201 consensus_queue.cc:237] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:18.901901 13168 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:18.876637  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 100809us
I20260709 12:27:18.875602 13309 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:18.890450  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.904194  9812 raft_consensus.cc:1240] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:27:18.824316 13316 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:18.837253 13194 raft_consensus.cc:697] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:18.906563 13309 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.865283 13181 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.864085  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:18.916378 13309 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:18.916968  9883 raft_consensus.cc:2393] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:18.910876 10497 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:18.911600 13296 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:18.912258 13311 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:18.912818  9890 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:18.912995  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.931744  9806 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:18.918742  9927 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:18.878036 13307 raft_consensus.cc:2764] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:27:18.901070 13293 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:18.934700  9962 raft_consensus.cc:2368] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9.
I20260709 12:27:18.937724  9927 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:18.933555 13311 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.939374 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.939651  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.943264 10525 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:18.944059  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2431) took 1443 ms. Trace:
I20260709 12:27:18.938968  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.944730  9815 rpcz_store.cc:276] 0709 12:27:17.500919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.662118 (+1161199us) service_pool.cc:224] Handling call
0709 12:27:18.943401 (+281283us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b5800010e98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:27:18.943579 (+   178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:18.943742 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:18.943764 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:18.943801 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:18.943830 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.943877 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.943994 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15934848}
I20260709 12:27:18.946206  9809 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:18.941847 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.940474 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.947721 10528 raft_consensus.cc:2393] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 8: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:18.946593 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.916530 13181 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:18.949421 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.950170 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.949156 13311 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:18.954685 12964 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:18.957396 13251 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:18.959728 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.960024 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.939702 13150 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:18.845966  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:18.941589 13321 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:18.976101 10524 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:18.926517 13152 consensus_queue.cc:1048] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:27:18.940538 13255 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:18.968752 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:19.025996 10528 raft_consensus.cc:2393] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:27:18.970328  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 72081.5us
I20260709 12:27:18.972046  9927 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:18.975536 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:19.026656  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:18.977119  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 204959us
I20260709 12:27:19.018952 10532 raft_consensus.cc:1240] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:19.019088 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:18.957696 13271 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.024083 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:18.957759 13221 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:19.032465  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 60474.6us
W20260709 12:27:19.035897 13345 log.cc:927] Time spent T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:27:19.036185 13351 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:19.037407  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:19.036847 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 237660us
I20260709 12:27:19.039295 10496 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:19.041335  9779 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:19.045095  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:19.045935  9806 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 6: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:19.048444  9928 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:19.051236 10531 raft_consensus.cc:2393] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:19.051682  9779 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:19.054813  9928 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:19.053475 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:19.056066  9927 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:18.938655 13142 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:19.055747 10524 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:19.058113  9779 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:19.053426  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:19.059827 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:19.061115 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 150318us
I20260709 12:27:19.059652 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:19.063635 10528 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:19.063825 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:19.064128  9779 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:19.065411  9928 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:19.064436 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:19.062654  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:19.066394 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:19.067011  9779 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:19.067023 10524 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:19.033876 13150 raft_consensus.cc:697] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:18.962750 13349 consensus_queue.cc:1059] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 12:27:19.064391 10527 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:19.047119 12911 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:19.070292  9928 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:18.975104 13234 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 12:27:19.071480 10532 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:19.093194 13150 consensus_queue.cc:237] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.093858 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:19.095316  9928 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:19.095963 13326 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:19.096493  9928 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:19.096711 13326 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:19.097152 13326 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.097491 13326 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:19.072605  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:19.077587 10496 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:19.073258  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:19.057472 13321 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:19.101575  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:19.070643  9779 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:19.073669  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:19.104928  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:19.071545  9811 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 555) took 1693 ms (client timeout 1674 ms). Trace:
I20260709 12:27:19.075573  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:19.078720  9958 raft_consensus.cc:1240] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
W20260709 12:27:19.075202 13340 log.cc:927] Time spent T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:27:19.079814 13316 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:19.081064 13251 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:19.084594  9815 raft_consensus.cc:1240] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:19.068187 13355 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:27:19.180289  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 75437.3us
I20260709 12:27:19.085610 12911 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.068553 13335 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:27:19.087203  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.068411 13171 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:19.071772 13282 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:19.071883 12887 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:19.063488 13307 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:19.088682 13260 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:19.060925 13296 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:19.065049 13353 consensus_queue.cc:1059] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:27:19.090109 13005 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:18.958534 13006 consensus_queue.cc:237] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:19.092343 13265 consensus_meta.cc:287] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.001s
W20260709 12:27:19.105722  9811 rpcz_store.cc:269] 0709 12:27:17.378509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:19.071349 (+1692840us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:19.071460 (+   111us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:19.179287  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:19.180536 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:19.184273 13335 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.072062 13356 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:19.183622 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 120704us
I20260709 12:27:19.182483 13125 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:19.061589 13257 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:19.185475  9779 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:19.187253  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:19.237323  9963 raft_consensus.cc:2393] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:19.188454  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:19.088721 13168 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:19.101701 13321 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.238689 13321 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:19.239650 13168 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:19.243713  9807 raft_consensus.cc:2368] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8.
I20260709 12:27:19.191632 13351 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:19.181174 13355 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.180826 13255 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:19.184486 12911 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:19.230981  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:19.048103 13194 consensus_queue.cc:237] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.234640  9806 raft_consensus.cc:1240] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:19.180269 13298 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:19.247794  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 62470.2us
I20260709 12:27:19.275573  9779 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:19.276736  9779 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:19.250679  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:19.294314 13168 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:19.294677 10497 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:19.295071 13168 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:19.295511 13168 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.295851 13168 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:19.295943 13193 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:27:19.252123  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 1.12272e+06us
I20260709 12:27:19.252571  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:19.252943  9808 raft_consensus.cc:2393] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 12: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:19.190953 13296 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:19.261459 13282 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:19.187358 13152 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:27:19.263796 13271 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:19.264262 13005 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:19.265547  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:19.266546  9960 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:19.272729  9958 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:19.231923 13201 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:19.264694 13142 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:19.235899 13335 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:19.278771  9963 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
W20260709 12:27:19.345899  9853 connection.cc:256] RPC call timeout handler was delayed by -1.1168704249998882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
I20260709 12:27:19.255966 13351 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:19.233206 13311 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:19.296437 13193 raft_consensus.cc:697] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:27:19.346992  9853 connection.cc:256] RPC call timeout handler was delayed by -1.1168704249998882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
I20260709 12:27:19.235543 13265 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:19.329972 13296 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:19.357035  9853 connection.cc:256] RPC call timeout handler was delayed by -1.091003498000191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
I20260709 12:27:19.278131  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:19.331259 13255 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:19.262328 13355 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:19.336504 13201 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:19.361976  9853 connection.cc:256] RPC call timeout handler was delayed by -1.091003498000191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
I20260709 12:27:19.352450 13351 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:19.369195  9853 connection.cc:256] RPC call timeout handler was delayed by -1.0874034980001852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
W20260709 12:27:19.372155  9853 connection.cc:256] RPC call timeout handler was delayed by -1.0874034980001852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
W20260709 12:27:19.370842  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 92814.1us
W20260709 12:27:19.374429  9853 connection.cc:256] RPC call timeout handler was delayed by -1.0253034980000848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
W20260709 12:27:19.385366 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 88878.9us
I20260709 12:27:19.365597 13221 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:19.379640  9853 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:19.275940 13356 consensus_queue.cc:1059] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 12:27:19.388245  9853 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:19.370481 13201 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:19.376772 13200 consensus_meta.cc:287] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
I20260709 12:27:19.375905 13152 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:19.327042 13298 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:19.395934  9853 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:19.398319  9853 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:19.402118  9853 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:19.405690 12944 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:19.406095 12944 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.406229 13311 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:19.406471  9853 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:19.370999 13255 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.406497 12944 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:19.425117  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:19.470268  9927 leader_election.cc:336] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 2.170s (SENT)
I20260709 12:27:19.410210 13246 raft_consensus.cc:2804] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:19.390697 13271 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:27:19.413931 13361 log.cc:927] Time spent T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:27:19.416965  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:19.478585  9808 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:19.479686  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:19.481047  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:19.481681  9808 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:19.448282 13325 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:19.450048 13265 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:19.453783  9810 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46504 (request call id 2429) took 2042 ms (client timeout 2119 ms). Trace:
I20260709 12:27:19.419013 13234 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:19.396927 13221 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:19.460207 13257 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:19.395540 13152 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:27:19.461786 13293 consensus_meta.cc:287] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.522s	user 0.008s	sys 0.001s
I20260709 12:27:19.396770 13200 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.469631  9811 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
W20260709 12:27:19.477005 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 399453us
W20260709 12:27:19.486771  9810 rpcz_store.cc:269] 0709 12:27:17.411470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.938452 (+526982us) service_pool.cc:224] Handling call
0709 12:27:19.453615 (+1515163us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b540002dad4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:19.453719 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2066624384}
I20260709 12:27:19.392740 13352 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:19.474079 13246 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.474308 13258 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:19.476518 13271 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:19.489761 13234 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:19.494396 13221 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:19.521106 12855 raft_consensus.cc:3055] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:19.400925 13193 consensus_queue.cc:237] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:19.535496 13338 log.cc:927] Time spent T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.792s	user 0.001s	sys 0.005s
W20260709 12:27:19.546293 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.565842 13246 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:19.518810 10496 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:19.557109  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:19.578682  9815 raft_consensus.cc:2393] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 5: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:19.579443  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:19.579983  9815 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:19.580739  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:19.581632  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:19.516296  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 418330us
I20260709 12:27:19.508335 13152 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:19.471556 13356 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:19.569958  9882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54428 (request call id 746) took 1174 ms. Trace:
I20260709 12:27:19.528189  9812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2411) took 2318 ms. Trace:
I20260709 12:27:19.571386  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:19.573264  9808 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:19.588598  9882 rpcz_store.cc:276] 0709 12:27:18.395530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.395633 (+   103us) service_pool.cc:224] Handling call
0709 12:27:19.569756 (+1174123us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540029a9d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:19.569884 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":263050496}
I20260709 12:27:19.549136  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:19.588835  9812 rpcz_store.cc:276] 0709 12:27:17.210231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.149620 (+939389us) service_pool.cc:224] Handling call
0709 12:27:18.903978 (+754358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:18.904547 (+   569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:19.527929 (+623382us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54002526d0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:19.528109 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1713393024}
I20260709 12:27:19.566785 13271 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:19.568966 13234 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:19.586571 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 67836.6us
I20260709 12:27:19.582662  9928 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:19.597329 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:19.565853 13258 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:19.514735 13293 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:19.590457  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:19.606688  9812 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:27:19.606736  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:19.604185  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:19.593955 12964 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:19.570534 13221 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:19.569785 12855 raft_consensus.cc:740] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:19.589572  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:19.584474  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:19.612702  9958 raft_consensus.cc:1240] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 6. Current term is 7. Ops: []
W20260709 12:27:19.613562 13365 log.cc:927] Time spent T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
W20260709 12:27:19.615135 13256 consensus_meta.cc:287] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.921s	user 0.007s	sys 0.003s
I20260709 12:27:19.616382 13201 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.625698 12855 consensus_queue.cc:260] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.652462 12855 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:19.653506 13201 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:19.608845 12968 consensus_queue.cc:1059] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:27:19.654616 12968 consensus_queue.cc:1243] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Peer f5208640a51f493e930ce4f64ceeed0b log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:27:19.655505 13322 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:19.655953 13322 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.656340 13322 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:19.656843 10526 raft_consensus.cc:2410] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:27:19.613577  9956 raft_consensus.cc:1275] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:27:19.658447 10526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 899) took 1104 ms. Trace:
I20260709 12:27:19.658838 10526 rpcz_store.cc:276] 0709 12:27:18.554350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.554473 (+   123us) service_pool.cc:224] Handling call
0709 12:27:19.658221 (+1103748us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400670f54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:19.658386 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2446918528}
I20260709 12:27:19.651249 13260 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:19.660014  9960 raft_consensus.cc:3055] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:19.660373  9960 raft_consensus.cc:740] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:19.660729 13321 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:19.661128  9960 consensus_queue.cc:260] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.661662  9811 raft_consensus.cc:1240] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
W20260709 12:27:19.633131  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.606415 13325 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:19.596731 13356 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.599351 13258 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:19.606501 13376 raft_consensus.cc:2804] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:19.651779 13255 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:19.663086 13325 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.678524 13325 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:19.657955 13335 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:19.679347  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.679703  9959 raft_consensus.cc:2393] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:27:19.651383  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 44705.4us
I20260709 12:27:19.680567 13335 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:19.682114 13321 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:19.662243  9960 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:19.663607  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.663833 13200 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:19.649827  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 224798us
I20260709 12:27:19.686853  9853 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:19.664938 13355 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.687891  9815 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:19.672358  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:19.692541  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:19.700403  9882 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 11: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:19.702301  9853 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:19.610538 13368 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:19.704279  9812 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:19.705955  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:19.724851  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:19.728820  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:19.723215 13385 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:19.671584 13356 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:19.667779 13293 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:19.727290  9928 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:19.672784 13376 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:19.733745  9960 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:27:19.742751  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:19.743564  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:19.744969 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:19.745172  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:19.745731  9881 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:19.746594 10524 raft_consensus.cc:1240] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:19.748549 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:19.748864 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:19.750717  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:19.750799 13142 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.751708 13142 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.752597  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:19.753230  9957 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:19.754812  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:19.755514  9957 raft_consensus.cc:2393] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 11: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:19.755537  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:19.756382  9811 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:19.757022  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:19.757769  9957 raft_consensus.cc:2393] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 11: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:19.758176  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:19.759475 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:19.759537  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:19.760336  9883 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:19.761978 13150 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.762552 13150 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.764305 13321 consensus_queue.cc:1059] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:19.764946 13150 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:19.767524  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:19.768503  9811 raft_consensus.cc:2410] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:27:19.765300  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:19.770382 13142 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:19.729420 12963 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.006s	sys 0.009s
I20260709 12:27:19.723579 13368 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.772231  9928 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:19.665757 13181 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:19.781510 13376 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:19.789665  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 60898.4us
I20260709 12:27:19.789893 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:19.790381  9853 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:19.675017 13271 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:19.770777 13150 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:19.795652 10526 raft_consensus.cc:1240] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:27:19.789376  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:19.736794 13385 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.736955 13200 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:19.731206 13335 consensus_queue.cc:1059] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:27:19.790030 13368 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:19.810521 13335 consensus_queue.cc:1243] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Peer f5208640a51f493e930ce4f64ceeed0b log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:27:19.812204 13309 consensus_meta.cc:287] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.875s	user 0.005s	sys 0.004s
I20260709 12:27:19.812731 13309 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:19.797922 13168 consensus_meta.cc:287] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.502s	user 0.011s	sys 0.000s
I20260709 12:27:19.814848 13168 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.816009  9815 raft_consensus.cc:2393] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 10: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:19.798525 12855 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:19.818547  9810 raft_consensus.cc:2393] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 8: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
W20260709 12:27:19.791546 12963 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.006s	sys 0.009s
I20260709 12:27:19.708281 12944 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:19.821733  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:19.733048 13382 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:19.825618  9883 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:27:19.785583 13356 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:19.826581  9881 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:19.818611 13168 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:19.840142 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 56071us
I20260709 12:27:19.839973  9960 raft_consensus.cc:2393] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 8: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:19.841519  9928 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:19.845358  9928 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:19.849119 13321 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:19.849287 12944 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:19.849701 13321 raft_consensus.cc:697] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:19.849982 12944 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:19.850526 12944 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.850891 12944 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:19.850703 13321 consensus_queue.cc:237] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:19.853283 12911 consensus_meta.cc:287] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.000s
I20260709 12:27:19.809794 13200 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.863899 13200 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:19.864110 13355 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:19.838971 13385 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:19.820544 13326 consensus_meta.cc:287] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.723s	user 0.004s	sys 0.007s
I20260709 12:27:19.866636 13326 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:19.868517 13364 raft_consensus.cc:3055] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:19.868460 13325 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:19.869021 13364 raft_consensus.cc:740] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:19.869781  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:19.870558  9807 raft_consensus.cc:2393] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 12: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
W20260709 12:27:19.871531  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 989397us
I20260709 12:27:19.872375  9778 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:19.872828 13256 consensus_queue.cc:1059] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:19.873451  9778 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:19.819162 13150 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.874197 10496 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:19.876194 13200 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.878191 13150 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:19.878646 13006 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:19.879148 13006 raft_consensus.cc:697] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:27:19.867223 13354 log.cc:927] Time spent T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.845s	user 0.003s	sys 0.000s
I20260709 12:27:19.838878 13367 consensus_queue.cc:1059] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:27:19.866569 10526 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:27:19.880288 13150 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:19.883163 13181 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:19.881937  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:19.884053  9807 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:19.884249 13200 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:19.879451 10496 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:19.873986 13392 raft_consensus.cc:3055] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:19.891323  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:19.857776 13390 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:19.854264 13351 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.886955 10526 pending_rounds.cc:85] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: Aborting all ops after (but not including) 7
I20260709 12:27:19.903220 10526 pending_rounds.cc:107] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:27:19.903476 10526 raft_consensus.cc:2889] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:19.871608 13326 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:19.877519 13221 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.890883  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:19.791448 13296 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.861181 13335 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:19.885648 13304 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:19.905087  9881 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:19.892098  9883 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:19.891132 13168 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:19.840319 13234 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:19.907332  9778 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:19.875036 13309 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:19.842334 13382 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:19.869885 13364 consensus_queue.cc:260] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.891680 13392 raft_consensus.cc:740] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:27:19.921007  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 130709us
I20260709 12:27:19.901638 13390 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.914466  9928 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:19.919632  9887 raft_consensus.cc:1240] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:19.919601  9881 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:27:19.921777  9778 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:19.924078 13322 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:19.927505  9928 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:19.924656  9853 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:19.929284  9853 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:19.909982 13304 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.929916  9778 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:19.921337 13168 raft_consensus.cc:697] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:19.932578 13311 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:19.933250 13356 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:19.932844 13168 consensus_queue.cc:237] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:19.915194 13335 raft_consensus.cc:697] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:19.934264  9778 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:19.935384 13255 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:19.930701 13200 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:19.936425 13356 raft_consensus.cc:697] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:19.941759 13351 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:19.943085 13181 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:19.926687 13381 consensus_queue.cc:1059] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:27:19.944049 13392 consensus_queue.cc:260] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.945439  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:19.927035 13309 consensus_queue.cc:1059] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:27:19.948377 13221 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:19.921252 13293 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:19.930342 13326 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:19.951198 13152 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.954711  9882 raft_consensus.cc:2393] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:19.955435 13322 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:19.956687 12944 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:19.911445 13150 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:27:19.921089 13382 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:19.921502 13256 consensus_queue.cc:1048] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:27:19.965786  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:19.892283 12911 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:19.969653  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.971468  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.014919  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:20.015648  9961 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:19.970058  9853 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:20.016817  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 46840.4us
I20260709 12:27:20.017773  9853 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:19.928239 13390 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:19.934180 13304 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:19.925443 13258 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:19.982726  9807 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:19.947094 13271 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:19.989630  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:19.990312  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:19.962872 13311 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:19.981277 13246 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:19.991508 13392 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:19.953902 13368 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:20.007102  9812 raft_consensus.cc:2393] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:19.969962 13307 consensus_queue.cc:1048] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:27:20.021311  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:20.021358  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:19.991899 13326 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:20.025935  9808 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:19.972599 13006 consensus_queue.cc:237] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:20.022522  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:20.030545  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:20.041877  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:20.032087  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:20.042663  9811 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:20.042876  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:20.043394  9964 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:20.032330  9890 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:20.033275  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:20.032107  9961 raft_consensus.cc:1240] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:20.018965 13322 raft_consensus.cc:2764] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:27:20.025197 13221 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:20.038945  9958 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:20.038959  9812 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:27:20.008735 13325 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:19.996054 13393 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:20.049278  9807 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:20.045531  9853 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:20.031167 13234 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:20.068862  9778 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:20.051229  9955 raft_consensus.cc:2393] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:20.052333  9808 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:20.052891  9886 raft_consensus.cc:2393] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 5: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:20.072296 10530 raft_consensus.cc:2393] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 10: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:27:20.058524  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.059677  9964 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:20.063778  9958 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:20.064597 12855 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:20.065445  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:20.065917  9807 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:20.076524  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:20.069352  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.056074  9812 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:27:20.075423 12855 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:20.041605 13326 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:20.083066  9778 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:20.084136 13309 consensus_queue.cc:1059] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:20.084452 13152 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:20.085243 13152 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:20.085793 13152 raft_consensus.cc:697] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:20.086390  9778 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:20.086694 13152 consensus_queue.cc:237] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:20.088124 13311 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:20.088812 13311 raft_consensus.cc:697] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:20.051129 13271 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:27:20.094905  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 49443.8us
I20260709 12:27:20.078668 13322 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:20.094841  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:20.094544 13271 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:20.027160 13335 consensus_queue.cc:237] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:20.106629 13397 log.cc:927] Time spent T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:27:20.082795 13296 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:20.110204 13258 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:20.112810  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.097385  9853 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:20.081856 13168 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:20.050995 13200 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:27:20.117859  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:20.118402 13200 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:20.118891 13200 raft_consensus.cc:697] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:20.119751 13200 consensus_queue.cc:237] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:20.125303  9853 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:20.036151 13356 consensus_queue.cc:237] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:20.127764  9853 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:20.128880 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.129751  9853 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:27:20.131870  9814 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2077) took 2345 ms (client timeout 2158 ms). Trace:
W20260709 12:27:20.132400  9814 rpcz_store.cc:269] 0709 12:27:17.785931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.012205 (+226274us) service_pool.cc:224] Handling call
0709 12:27:20.131655 (+2119450us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400451fd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:20.131783 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292906752}
I20260709 12:27:20.135239  9853 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:20.140039  9853 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:20.125365 13271 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:20.131418 13394 log.cc:927] Time spent T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:27:20.143003  9853 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:20.133780 13322 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:20.135794 13258 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:20.138567 13234 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:20.136382 13401 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:20.142513 13393 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:20.141984 13221 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:20.155647 13234 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:20.133358 13385 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:20.160562 13234 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:20.152190 13322 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:20.153867 13258 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:20.178840  9814 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:27:20.141991 13311 consensus_queue.cc:237] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:20.169190 13401 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:20.171296 13322 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:20.191722 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 278445us
I20260709 12:27:20.181924 12944 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:20.180580 13258 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:20.252319 13376 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:20.254043 13376 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:20.255185 13385 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:20.202250 13401 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:20.262861 13401 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:20.263268  9779 leader_election.cc:336] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Timed out: RequestConsensusVote RPC to 127.8.111.68:37417 timed out after 1.647s (SENT)
I20260709 12:27:20.263718  9779 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:20.264267 13382 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:20.260191 13271 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:20.264425 13390 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:20.276808 13390 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:20.270898 13393 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:20.272585 13382 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:20.211678 13381 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:27:20.273451 13401 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:20.267349 13271 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:20.279117 13401 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:20.501329 13258 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:20.503676 13258 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:20.520777  9927 leader_election.cc:336] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 3.020s (SENT)
I20260709 12:27:20.521207  9927 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:20.523368 13385 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:20.524987 13407 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:20.529687 13399 log.cc:927] Time spent T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.455s	user 0.000s	sys 0.003s
I20260709 12:27:20.532869 13386 raft_consensus.cc:3055] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:20.533296 13386 raft_consensus.cc:740] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:20.534144 13386 consensus_queue.cc:260] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:20.535465 13386 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:20.545706  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 402749us
I20260709 12:27:20.547001  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:20.547765 12944 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:20.548171 12944 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:20.548421  9853 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:20.548514 12944 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:20.549008 13258 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:20.550554  9853 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:20.551189 13258 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:20.552479  9853 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:20.553115 13258 raft_consensus.cc:2804] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:20.553527 13258 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:20.553929 13258 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:20.554490  9853 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:20.555672 13401 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:20.555495 12944 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:20.556854  9853 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:20.557600 13401 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:20.557657 12944 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:20.558207 13401 raft_consensus.cc:697] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:20.559175 13401 consensus_queue.cc:237] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:20.561542 13258 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:20.564419 13258 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:20.565999  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:20.568320  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.568795  9814 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:20.577126  9814 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:20.577606 13385 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:20.578138 13385 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:20.579057  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:20.579428 13181 raft_consensus.cc:3055] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:20.579648  9814 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:27:20.579780 13181 raft_consensus.cc:740] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:20.580188 13385 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:20.581058 13181 consensus_queue.cc:260] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:20.582226 13181 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:20.586608  9927 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:20.587749  9927 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:20.588789  9927 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:20.589875  9927 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:20.590569 13385 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:20.590972 13385 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:20.591676 13385 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:20.592475 13349 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:20.593182 13349 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:20.593755 13349 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:20.594233 13349 raft_consensus.cc:697] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:20.595297 13349 consensus_queue.cc:237] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:20.597536  9962 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55952 (request call id 1468) took 1797 ms (client timeout 1786 ms). Trace:
W20260709 12:27:20.597935  9962 rpcz_store.cc:269] 0709 12:27:18.800123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.800391 (+   268us) service_pool.cc:224] Handling call
0709 12:27:20.597349 (+1796958us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400241b54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:20.597472 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269773568}
W20260709 12:27:20.600369 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.603287  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.605383  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.605875  9806 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:20.608812 13385 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:20.610859 13385 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:20.613602  9806 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:20.616506  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.617215  9806 raft_consensus.cc:2368] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12.
I20260709 12:27:20.617641  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.618377  9815 raft_consensus.cc:2393] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:20.620143  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.622466  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.626453  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.627148  9815 raft_consensus.cc:2393] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:20.633069  9927 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:20.634380  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.635198  9815 raft_consensus.cc:2410] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:27:20.634929 13349 consensus_queue.cc:1059] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:20.636013 13349 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:20.636368 13349 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:20.636701 13349 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:20.637032  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.202593 13368 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:20.641777 13293 raft_consensus.cc:3055] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:20.645696 13293 raft_consensus.cc:740] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:27:20.646042 13255 consensus_meta.cc:287] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.005s
I20260709 12:27:20.647186 13322 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:20.644626 13304 consensus_meta.cc:287] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.000s
I20260709 12:27:20.637806  9927 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:20.647718 13255 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:20.648964 13304 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:20.654181  9927 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:20.663133 13304 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:20.645241 13349 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:20.648380  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.646549 13293 consensus_queue.cc:260] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:20.665055 13293 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:20.665531 13349 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:20.660285 13321 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:20.651780 13322 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:20.668912 13352 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:20.668967 13349 consensus_queue.cc:1059] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:20.669616 13352 raft_consensus.cc:697] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:20.672014  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.672896 13321 raft_consensus.cc:3055] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:20.674312 13321 raft_consensus.cc:740] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:20.678730  9887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 769) took 1209 ms. Trace:
I20260709 12:27:20.673492 13352 consensus_queue.cc:237] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:20.679149  9887 rpcz_store.cc:276] 0709 12:27:19.469727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:19.471399 (+  1672us) service_pool.cc:224] Handling call
0709 12:27:19.483692 (+ 12293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:19.927070 (+443378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:20.678498 (+751428us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54003f93d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:20.678671 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1002108160}
I20260709 12:27:20.675299  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 2074) took 2890 ms. Trace:
I20260709 12:27:20.675205  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.681203  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.680984  9813 rpcz_store.cc:276] 0709 12:27:17.785231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.631397 (+846166us) service_pool.cc:224] Handling call
0709 12:27:20.674270 (+2042873us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b5800010e98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:27:20.674534 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:20.674934 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:20.674975 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:20.675032 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:20.675080 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:20.675144 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:20.675247 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42454400}
I20260709 12:27:20.686443  9815 raft_consensus.cc:2393] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 11: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:20.691016  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:20.692131  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:20.693194  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.693759  9815 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:20.678928 13321 consensus_queue.cc:260] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:20.708528  9815 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:20.710220 13298 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:20.714623  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:20.715257  9887 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:20.717765  9884 raft_consensus.cc:1240] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:20.721670 13168 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:20.722143 13168 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:20.748963  9806 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:20.750242  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.752699  9887 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:20.750578  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.755223  9814 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:20.758692 13304 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.759465  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.759258 13304 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:20.192786 13246 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:20.760998  9814 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:20.762594  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.763278  9814 raft_consensus.cc:2393] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
W20260709 12:27:20.764384  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 101230us
I20260709 12:27:20.768730  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.769268  9806 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:20.769889  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:20.771335  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.761785 13168 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:20.784103  9962 raft_consensus.cc:3055] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:20.787563  9962 raft_consensus.cc:740] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:20.763875 13304 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:20.809141  9956 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:20.788592  9962 consensus_queue.cc:260] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:20.813568  9962 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:20.824674  9806 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:20.830142  9814 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:20.831498  9962 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:27:20.851212  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.774914 13325 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:27:20.863672  9927 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:20.864956  9927 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:20.865922 13352 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:20.866451 13352 raft_consensus.cc:697] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:20.867326 13352 consensus_queue.cc:237] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:20.870465 12964 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:20.870990 12964 raft_consensus.cc:697] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:20.871258  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:20.871833 12964 consensus_queue.cc:237] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:20.872690 10529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 674) took 1854 ms (client timeout 1647 ms). Trace:
W20260709 12:27:20.873086 10529 rpcz_store.cc:269] 0709 12:27:19.017935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:20.872453 (+1854518us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:20.872567 (+   114us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:20.886157 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 134534us
I20260709 12:27:20.883630 12984 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:20.888316 12984 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:20.888983 10496 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:20.889837 13368 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:20.891172 10496 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:20.892103 13368 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:20.892517 13304 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.893326 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:20.893141 13304 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:20.883374 13412 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:20.899775  9853 leader_election.cc:336] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 1.566s (SENT)
I20260709 12:27:20.900322  9853 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:20.902447 13246 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:20.903097 10496 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:20.905646 10496 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:20.906883 13403 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:20.906883 13253 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:20.898536 13368 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:20.908733 13368 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:20.909153 13368 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:20.903972 13392 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:27:20.915820 12984 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:20.918077  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:20.918522 10496 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:20.918860  9806 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:27:20.921826 12963 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:20.925118  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.927166 13168 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:20.928720 13304 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:20.923859 13392 consensus_queue.cc:1059] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:27:20.904573 13412 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:20.932024 13412 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:20.921348 13253 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:20.934517  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:20.935734  9806 raft_consensus.cc:2393] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 8: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:20.936393  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:20.941042  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:20.941269  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:20.941747  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:20.942524  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:20.943056  9964 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:20.944227  9956 raft_consensus.cc:1275] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:20.944510  9957 raft_consensus.cc:1240] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:20.934695 13352 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.946233  9813 raft_consensus.cc:2393] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 12: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:20.946197 13352 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:20.943953 13168 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:20.947896 13168 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:20.949025  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:20.949712  9807 raft_consensus.cc:2393] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 9: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:20.952378  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:20.953161 13168 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:20.954522 12911 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:20.952668  9807 raft_consensus.cc:1240] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:27:20.954474  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:20.958180 10496 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:20.959227  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:20.959740  9964 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:20.959863  9807 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:20.960407  9957 raft_consensus.cc:1240] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:27:20.961248  9927 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:20.961867  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:20.964268 13247 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:20.964982  9956 raft_consensus.cc:2393] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:20.966456  9956 raft_consensus.cc:1240] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 6. Current term is 7. Ops: []
W20260709 12:27:20.967289  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.998373 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:21.008189  9964 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:27:21.009765 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 51643us
I20260709 12:27:21.011401  9956 raft_consensus.cc:1240] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:21.016110  9853 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:21.017761  9853 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:21.019580 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:21.020563 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:21.021397 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:21.022233 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:21.022790 10529 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:21.023880 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:21.024380 10525 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:20.959975 13352 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:21.025905 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:21.027892 10533 raft_consensus.cc:2393] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:21.026583 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:21.026598 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:21.028558 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:21.025604 13246 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:21.029309 10532 raft_consensus.cc:2368] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11.
I20260709 12:27:21.030045 13322 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:21.030573 13322 raft_consensus.cc:697] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:21.031399 13322 consensus_queue.cc:237] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.026908  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:21.036165  9853 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:21.037156  9853 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:21.040294  9853 leader_election.cc:400] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12.
I20260709 12:27:21.040647  9853 leader_election.cc:403] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:27:21.042732 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:21.043339 12963 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:21.045817 13362 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:21.012380 13419 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:21.018923 13304 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:21.046384 13401 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12.
I20260709 12:27:21.052284  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 2286) took 1308 ms. Trace:
I20260709 12:27:21.052574  9886 rpcz_store.cc:276] 0709 12:27:19.744232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:19.750462 (+  6230us) service_pool.cc:224] Handling call
0709 12:27:21.052074 (+1301612us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54002c60d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:21.052228 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679951744}
I20260709 12:27:21.043746 13246 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:21.050514  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:21.054946 13246 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:21.055439 13246 raft_consensus.cc:697] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:21.049080 13168 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.049783 13419 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.068863 13419 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:21.047889 13258 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:21.059473 12963 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:21.061360  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:21.062055 10496 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:21.034498 13350 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
W20260709 12:27:21.063853  9810 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46504 (request call id 2453) took 1576 ms (client timeout 1527 ms). Trace:
I20260709 12:27:21.079524 10496 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:27:21.079687  9810 rpcz_store.cc:269] 0709 12:27:19.487311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:19.564648 (+ 77337us) service_pool.cc:224] Handling call
0709 12:27:21.063677 (+1499029us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b540036c754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:21.063789 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":527457536}
W20260709 12:27:21.080581  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.066767  9815 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:27:21.066931  9813 pending_rounds.cc:85] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: Aborting all ops after (but not including) 7
W20260709 12:27:21.080269 13152 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.005s	sys 0.014s
I20260709 12:27:21.081290 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:21.086367 12944 consensus_queue.cc:1059] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:27:21.087332 13401 raft_consensus.cc:3055] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:21.087689 13401 raft_consensus.cc:740] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:21.087785 13253 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:21.084177  9813 pending_rounds.cc:107] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:27:21.077095  9811 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:21.088815  9813 raft_consensus.cc:2889] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:21.085382 13152 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.005s	sys 0.015s
I20260709 12:27:21.088563 13401 consensus_queue.cc:260] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.079537 13350 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:21.085697 13368 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.120846 13368 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:21.123060 10531 raft_consensus.cc:2393] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 8: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:21.088392 13253 consensus_queue.cc:1059] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:27:21.084970 13258 raft_consensus.cc:697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:21.135118 10525 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:21.074607 13168 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.140599 13168 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:21.142297  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:21.145766  9811 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:27:21.166563  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.157189  9964 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:21.136512 13401 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:21.148283 13392 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:21.142267 13326 consensus_meta.cc:287] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 1.046s	user 0.006s	sys 0.007s
W20260709 12:27:21.204452 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 117034us
I20260709 12:27:21.166867 13350 raft_consensus.cc:3055] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:21.200359 13253 raft_consensus.cc:3055] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:21.212507  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:21.215950  9811 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:21.214884  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:21.198004 13362 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:27:21.220489  9815 raft_consensus.cc:1275] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:21.169092 13246 consensus_queue.cc:237] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:21.214021 13350 raft_consensus.cc:740] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:21.215517 13253 raft_consensus.cc:740] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:21.229000 13311 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.243847 13253 consensus_queue.cc:260] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.239100 13006 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:21.232203 12984 consensus_queue.cc:1048] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:27:21.211074 13258 consensus_queue.cc:237] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.255970 13350 consensus_queue.cc:260] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.210119 13326 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:21.252632 10496 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:21.251291 13253 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:21.248476 13311 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:21.270398 13200 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.147s	user 0.038s	sys 0.048s
W20260709 12:27:21.270768 13200 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.038s	sys 0.048s
I20260709 12:27:21.265743 13368 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:21.274884 13368 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.275480 13368 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:21.272214 13350 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:21.284106 13418 log.cc:927] Time spent T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.392s	user 0.000s	sys 0.004s
I20260709 12:27:21.288000 13326 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:21.258088 13006 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.290409 13006 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:21.299789 13311 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:21.302543 13316 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 11 is higher.
I20260709 12:27:21.304057 13321 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:21.295429 13396 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.219s	user 0.011s	sys 0.010s
I20260709 12:27:21.296079 13419 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:21.309564 13419 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:21.306253 13396 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.231s	user 0.012s	sys 0.010s
I20260709 12:27:21.311681 13368 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.313854 13368 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:21.315809 13422 log.cc:927] Time spent T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.418s	user 0.002s	sys 0.000s
W20260709 12:27:21.319953 13420 log.cc:927] Time spent T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.423s	user 0.003s	sys 0.000s
W20260709 12:27:21.346566  9744 debug-util.cc:398] Leaking SignalData structure 0x7b080003f200 after lost signal to thread 8640
W20260709 12:27:21.353788  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.360790  9962 raft_consensus.cc:1240] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:27:21.380599  9778 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:21.382453 13247 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:27:21.383173  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:21.394126  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.402213  9812 raft_consensus.cc:1275] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:21.405869 13152 consensus_queue.cc:1048] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:27:21.409107  9882 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 2283) took 1667 ms (client timeout 1724 ms). Trace:
W20260709 12:27:21.409652  9882 rpcz_store.cc:269] 0709 12:27:19.741619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:19.741754 (+   135us) service_pool.cc:224] Handling call
0709 12:27:21.408585 (+1666831us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54001e3054. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:21.408866 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":358902656}
I20260709 12:27:21.410399  9778 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:21.421075 13168 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:21.421368 13247 consensus_queue.cc:1059] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:21.413306  9890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 779) took 1314 ms. Trace:
I20260709 12:27:21.423087  9890 rpcz_store.cc:276] 0709 12:27:20.098661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:20.098932 (+   271us) service_pool.cc:224] Handling call
0709 12:27:20.099312 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:20.118635 (+ 19323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:20.118694 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:20.118735 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:20.118770 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:21.412679 (+1293909us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b54001bc454. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:21.412754 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:21.413034 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44009344}
I20260709 12:27:21.421921 13168 raft_consensus.cc:697] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:21.427536 13432 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.428582 13432 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.426309 13168 consensus_queue.cc:237] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.434552 13432 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:21.416590 13234 consensus_meta.cc:287] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 1.238s	user 0.003s	sys 0.011s
I20260709 12:27:21.436970 13395 consensus_queue.cc:1059] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:21.421115  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:21.417961  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 593) took 2355 ms. Trace:
I20260709 12:27:21.464293 13247 raft_consensus.cc:3055] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:21.464944 13247 raft_consensus.cc:740] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:21.466415 13247 consensus_queue.cc:260] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:21.468228 13247 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:21.441430  9959 rpcz_store.cc:276] 0709 12:27:19.062468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:19.062996 (+   528us) service_pool.cc:224] Handling call
0709 12:27:21.417330 (+2354334us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b54000b45d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:21.417697 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1318976256}
I20260709 12:27:21.478719 13366 raft_consensus.cc:3055] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:21.479337 13366 raft_consensus.cc:740] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:21.480937 13366 consensus_queue.cc:260] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.482868 12984 consensus_queue.cc:1048] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:21.487634 13411 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:21.488423 13411 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:21.435580 13234 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:21.496518  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:21.497678  9882 raft_consensus.cc:2393] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 8: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:21.498783  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:21.499461  9961 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:21.499724  9884 raft_consensus.cc:2393] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 5: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
W20260709 12:27:21.500375 13239 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:27:21.492457  9778 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:21.502161 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.504022 13311 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:21.504547 13311 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.504942 13311 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:21.506951  9779 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:21.510602  9744 debug-util.cc:398] Leaking SignalData structure 0x7b08001a79e0 after lost signal to thread 9747
I20260709 12:27:21.512130  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:21.514635  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:21.515799  9884 raft_consensus.cc:2393] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 5: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:21.516091  9885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 781) took 1349 ms. Trace:
I20260709 12:27:21.516916  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:21.519349  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:21.519889 13450 consensus_queue.cc:1059] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:21.520489  9958 raft_consensus.cc:2393] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:27:21.512157  9744 debug-util.cc:398] Leaking SignalData structure 0x7b08001a79a0 after lost signal to thread 9839
I20260709 12:27:21.516623  9885 rpcz_store.cc:276] 0709 12:27:20.166684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:20.166828 (+   144us) service_pool.cc:224] Handling call
0709 12:27:20.167145 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:20.170170 (+  3025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:20.170201 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:20.170241 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:20.170268 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:21.515519 (+1345251us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b540043b2d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:21.515602 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:21.515870 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6534912}
I20260709 12:27:21.521402 13234 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:21.531334 13152 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:21.533687  9883 raft_consensus.cc:1240] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:27:21.535081 13298 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.535859 13298 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:21.539340  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:21.540315  9885 raft_consensus.cc:2393] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 8: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:21.544361 13364 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:21.545982 13298 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:21.552845 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.548177  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:21.548470  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:21.520999 13366 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:21.560726 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:21.563484  9958 raft_consensus.cc:2393] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 11: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:21.567008  9886 raft_consensus.cc:1240] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:21.578920  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:21.580884  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:21.582697  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:21.583066 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:21.583349  9883 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:27:21.583839 10531 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
W20260709 12:27:21.584205  9744 debug-util.cc:398] Leaking SignalData structure 0x7b080034cc80 after lost signal to thread 9914
I20260709 12:27:21.583612  9884 raft_consensus.cc:2393] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 12: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:21.592754  9961 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:21.598382 13411 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:21.598855  9812 raft_consensus.cc:1275] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:27:21.607687  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.607472  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:21.606606  9710 catalog_manager.cc:5697] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:21.609930 12984 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.610819 12984 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.622922  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:21.642585  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:21.648093  9884 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 8: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:21.590021 13450 consensus_queue.cc:1243] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer b011791796d1457284b857d7d3422195 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:27:21.650552  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:21.651079  9888 raft_consensus.cc:1240] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:27:21.614614  9710 catalog_manager.cc:5697] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 6 to 8, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 8 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:21.652149  9811 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:21.652565  9961 raft_consensus.cc:1275] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:27:21.663671  9881 raft_consensus.cc:1240] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:21.663942  9779 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:21.666635  9928 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:21.667011 12843 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:21.650177  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:21.671005  9808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2111) took 2286 ms (client timeout 2483 ms). Trace:
I20260709 12:27:21.674120 12855 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:21.665479  9810 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:27:21.690447  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.694717  9883 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:21.694584  9808 rpcz_store.cc:269] 0709 12:27:19.384971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:19.589340 (+204369us) service_pool.cc:224] Handling call
0709 12:27:21.670654 (+2081314us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54002512d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:21.670811 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":919213952}
W20260709 12:27:21.706401 13451 log.cc:927] Time spent T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:27:21.707834  9885 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:21.708865  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:21.709965  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:21.710662 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.710744 13234 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:21.711014 13401 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:21.711529 13234 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.712262 13168 raft_consensus.cc:2764] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:27:21.711687 13401 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.713469  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:21.714320  9889 raft_consensus.cc:2393] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:21.710760  9885 raft_consensus.cc:2368] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11.
I20260709 12:27:21.717638  9886 raft_consensus.cc:1275] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:21.722766  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:21.696929 13411 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.724507  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:21.728471  9884 raft_consensus.cc:2393] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 8: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:21.729758  9882 raft_consensus.cc:2393] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
W20260709 12:27:21.730051  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 66239.5us
I20260709 12:27:21.730511  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:21.731899  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:21.732501  9889 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:27:21.733709  9888 raft_consensus.cc:2393] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 11: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:21.733952 10533 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:21.734308 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:21.734876  9888 raft_consensus.cc:1240] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:21.735049 10524 raft_consensus.cc:2368] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8.
I20260709 12:27:21.735235 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:21.736135  9888 raft_consensus.cc:1240] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:21.736519 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:21.711426 13246 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:21.737768 13258 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:21.738206 13246 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.740880 13246 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:21.738785 13258 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.743251 13258 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:21.746821  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:21.747641  9885 raft_consensus.cc:2410] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:27:21.749300  9888 raft_consensus.cc:1275] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:27:21.750825 13411 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.752976  9811 raft_consensus.cc:1240] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:21.756796  9887 raft_consensus.cc:1240] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:27:21.762804 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:21.763715 10529 raft_consensus.cc:2393] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:21.764773 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:21.767544  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:21.767838  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 157738us
W20260709 12:27:21.782446  9744 debug-util.cc:398] Leaking SignalData structure 0x7b080036f580 after lost signal to thread 9988
I20260709 12:27:21.779743  9888 raft_consensus.cc:1240] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 8. Current term is 9. Ops: []
W20260709 12:27:21.818214  9744 debug-util.cc:398] Leaking SignalData structure 0x7b08002d1300 after lost signal to thread 9989
I20260709 12:27:21.780573  9882 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11. Ops: []
W20260709 12:27:21.801492  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 70411.8us
I20260709 12:27:21.777863  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:21.775386  9889 raft_consensus.cc:1240] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:21.801366  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:21.783538 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.777396  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:21.778950  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:21.847285  9814 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:21.714362 13401 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:21.850463  9886 raft_consensus.cc:2393] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:21.851657  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:21.770227  9928 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:21.776304 13290 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:21.856559 13290 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.772269 13152 raft_consensus.cc:3055] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:21.826042  9883 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:21.781950 12984 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:21.770875 13168 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:21.775820 13364 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:21.782505 13234 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:21.877300  9779 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:21.888377 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.873227 13152 raft_consensus.cc:740] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:21.784325 13311 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:21.892815  9853 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 2.483s (SENT) [suppressed 60 similar messages]
I20260709 12:27:21.892594  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:21.893492 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:21.898830  9957 raft_consensus.cc:1240] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:21.900117  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:21.788275 13412 consensus_queue.cc:1059] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:27:21.783119 13362 consensus_queue.cc:1048] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.163s
I20260709 12:27:21.790436 13454 consensus_queue.cc:1048] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 12:27:21.892681  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:21.908314  9815 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:21.883247 12855 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.907516  9884 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
W20260709 12:27:21.918292  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 148170us
I20260709 12:27:21.920331  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:21.920507  9928 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:21.921352 13247 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:21.926347 10525 raft_consensus.cc:1240] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 8. Current term is 9. Ops: []
W20260709 12:27:21.933527  9744 debug-util.cc:398] Leaking SignalData structure 0x7b08003ae4a0 after lost signal to thread 10557
W20260709 12:27:21.935101 13452 log.cc:927] Time spent T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.063s	user 0.003s	sys 0.000s
I20260709 12:27:21.935827  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:21.941128 13385 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:21.943418 13455 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.944146 13455 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:21.947624 10528 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:21.948915 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:21.950724 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:21.951932 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:21.952883 10531 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:27:21.953285  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.953766 13260 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.954722 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:21.956322 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:21.956827 12984 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:21.960587  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:21.961300  9806 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:21.965993 13411 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:21.969058 13364 raft_consensus.cc:3055] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:21.969612 13364 raft_consensus.cc:740] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:21.930074 13168 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.970866 13364 consensus_queue.cc:260] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:21.972579 13364 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:21.972692 13168 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:21.953697 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:21.979303 10527 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:21.981793 13386 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.984856  9884 raft_consensus.cc:1240] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:21.986478  9886 raft_consensus.cc:1240] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:21.986891  9889 raft_consensus.cc:1240] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:21.987695  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:21.954444 13260 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.994419 10529 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:27:21.994597 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:21.995409 10525 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 11: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:21.928732 13290 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:21.996245 13260 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:21.996814  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 147945us
I20260709 12:27:21.997745  9779 leader_election.cc:400] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11.
I20260709 12:27:21.998029  9779 leader_election.cc:403] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:27:21.999125 13311 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:22.000109 13311 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11.
I20260709 12:27:21.999346  9710 catalog_manager.cc:5697] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 1 to 4, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 4 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:22.004144  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:22.006924 10528 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:27:22.007678  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:22.007128  9744 debug-util.cc:398] Leaking SignalData structure 0x7b08001dda40 after lost signal to thread 10558
I20260709 12:27:22.007431 12855 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.982250 13386 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:21.999217  9779 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:22.009989  9815 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
W20260709 12:27:22.016546  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 62679.4us
I20260709 12:27:22.001559  9710 catalog_manager.cc:5697] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:22.024825 10524 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
W20260709 12:27:22.026153  9744 debug-util.cc:398] Leaking SignalData structure 0x7b080029dec0 after lost signal to thread 12968
W20260709 12:27:22.028719 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:22.035161  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:22.041807 10528 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:27:22.036233  9960 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
W20260709 12:27:22.044620  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 45610.5us
W20260709 12:27:22.083527 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 79732.5us
I20260709 12:27:22.087626  9814 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:22.049016 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:22.106532 13260 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:22.113278 13260 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:22.115712 13260 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:22.117901  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 197556us
I20260709 12:27:22.120441 13298 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:22.173804  9779 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:22.179039 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:22.152132 13152 consensus_queue.cc:260] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:22.180974 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:22.181592 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:22.179250  9928 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:22.185963  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 315289us
I20260709 12:27:22.186612 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:22.190059 13239 raft_consensus.cc:2804] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:22.190248  9928 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:22.190567 13239 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:22.187549 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:22.157671 13455 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:22.191004 13239 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:22.201236  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:22.203867  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:22.182668 13298 raft_consensus.cc:697] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 12 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:22.214969  9928 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:22.216985  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:22.215164 10525 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:22.205607 13311 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:22.204433 13366 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:22.225181  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:22.216717 13260 consensus_queue.cc:1048] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:27:22.231313  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:22.218669 12984 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:22.232851  9815 raft_consensus.cc:1240] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
W20260709 12:27:22.236673  9711 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59972 (request call id 304) took 16123 ms (client timeout 15000 ms). Trace:
W20260709 12:27:22.238580  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 110855us
I20260709 12:27:22.229740 13450 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.240046 13412 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:22.246737  9811 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:22.247460 13450 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:22.240213 13239 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:22.251130  9814 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:22.221860 13455 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:27:22.249271 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 215344us
W20260709 12:27:22.241986 13463 log.cc:927] Time spent T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:27:22.255981  9710 catalog_manager.cc:5697] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:22.242313 12855 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:22.274866  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:22.274760 13321 consensus_queue.cc:1059] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:27:22.261296  9779 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:22.246850 13412 raft_consensus.cc:697] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:22.291580 13412 consensus_queue.cc:237] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:22.296514 13465 log.cc:927] Time spent T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:27:22.297508 13461 log.cc:927] Time spent T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:27:22.299741 10497 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:22.299901  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:22.300546  9958 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:22.287700  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:22.287473 13298 consensus_queue.cc:237] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:22.289729 13239 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:22.285617 13455 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:22.290598 13321 raft_consensus.cc:3055] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:22.319380 13321 raft_consensus.cc:740] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:22.319622 12843 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:22.320482 13321 consensus_queue.cc:260] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:22.321939 13321 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:22.322535  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:22.322759  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:22.323308  9962 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:22.323496  9960 raft_consensus.cc:2393] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 8: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:22.323841  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:22.324110  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:22.324587  9960 raft_consensus.cc:1240] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:27:22.325644  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:22.326517  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:22.327430  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:22.328032 13386 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:22.313175 13411 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:22.325835  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:22.329016  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 72583.1us
I20260709 12:27:22.301745 10497 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:22.329285 13411 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:22.330937  9854 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:22.332571 13234 consensus_queue.cc:1059] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:22.333477  9779 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:22.334322 13411 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:22.335026 13392 consensus_queue.cc:1059] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:27:22.339318  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 60813.3us
I20260709 12:27:22.341526  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:22.342463  9778 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:22.345372  9927 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:22.313735 13247 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:22.335628 13401 consensus_queue.cc:1059] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
W20260709 12:27:22.376191 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 74506.7us
I20260709 12:27:22.369107  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:22.378242  9956 raft_consensus.cc:2393] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:22.345141 13362 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:22.375558  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:22.386638  9710 catalog_manager.cc:5697] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:22.405017 10497 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:22.372030 13247 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:22.416777  9710 catalog_manager.cc:5697] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:22.374755 13168 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:27:22.413741  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 73771.8us
I20260709 12:27:22.391496  9807 raft_consensus.cc:1240] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:27:22.418262  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:22.380807 13454 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:22.413147  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:22.389467 13366 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:22.420620  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:22.439949  9887 raft_consensus.cc:2393] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:22.432641  9779 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:22.423364 13376 raft_consensus.cc:3055] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:22.442113  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:22.442406 13376 raft_consensus.cc:740] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:22.442838  9889 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:22.443619  9813 raft_consensus.cc:1275] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:22.443435 13376 consensus_queue.cc:260] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:22.424646  9890 raft_consensus.cc:1275] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:22.425839  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:22.426724  9927 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:22.413040 13450 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:22.430927 13152 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:22.433079 13471 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.421911 13247 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:22.420707 13168 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:22.412468 13464 log.cc:927] Time spent T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:27:22.441820  9956 raft_consensus.cc:2393] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:22.442011  9883 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:27:22.445767  9927 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:22.387153 13470 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.436161 13454 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:22.450940  9710 catalog_manager.cc:5697] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 1 to 2, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 2 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:22.459426  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:22.447844 13411 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:22.452714 13168 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:22.469506  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:22.453430 13260 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:22.470150  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:22.478993  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:22.472656  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:22.460399 13239 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:27:22.480969  9853 leader_election.cc:336] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.664s (SENT)
I20260709 12:27:22.481212  9962 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:22.483186  9889 raft_consensus.cc:1275] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:22.467500 13450 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:22.489455 13473 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:27:22.491357  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 58841.5us
I20260709 12:27:22.494036 13247 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:22.465508 13454 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:22.478251 13260 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.500063  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:22.496376  9853 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:22.245918  9711 rpcz_store.cc:269] 0709 12:27:06.094198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.158380 (+ 64182us) service_pool.cc:224] Handling call
0709 12:27:22.212122 (+16053742us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:12.745098 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:12.941610 (+196512us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:12.948295 (+  6685us) write_op.cc:435] Acquired schema lock
0709 12:27:12.949567 (+  1272us) tablet.cc:662] Decoding operations
0709 12:27:13.302615 (+353048us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:13.302711 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:13.302740 (+    29us) tablet.cc:685] Acquiring locks for 28 operations
0709 12:27:13.305132 (+  2392us) tablet.cc:701] Row locks acquired
0709 12:27:13.305205 (+    73us) write_op.cc:260] PREPARE: finished
0709 12:27:13.305385 (+   180us) write_op.cc:270] Start()
0709 12:27:13.305530 (+   145us) write_op.cc:276] Timestamp: P: 1783600033305322 usec, L: 0
0709 12:27:13.305548 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:27:13.442584 (+137036us) log.cc:844] Serialized 11289 byte log entry
0709 12:27:15.212995 (+1770411us) op_driver.cc:464] REPLICATION: finished
0709 12:27:15.806245 (+593250us) write_op.cc:301] APPLY: starting
0709 12:27:15.806379 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:15.806904 (+   525us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:15.807049 (+   145us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:16.340579 (+533530us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:16.341236 (+   657us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0709 12:27:16.341305 (+    69us) write_op.cc:312] APPLY: finished
0709 12:27:16.342091 (+   786us) log.cc:844] Serialized 188 byte log entry
0709 12:27:16.368361 (+ 26270us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:16.386777 (+ 18416us) write_op.cc:454] Released schema lock
0709 12:27:16.429525 (+ 42748us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:16.552782 (+123257us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:16.553788 (+  1006us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":555107,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":513886,"apply.run_cpu_time_us":8871,"apply.run_wall_time_us":713545,"num_ops":28,"prepare.queue_time_us":324328,"prepare.run_cpu_time_us":22639,"prepare.run_wall_time_us":941157,"raft.queue_time_us":791635,"raft.run_cpu_time_us":11096,"raft.run_wall_time_us":1084103,"replication_time_us":1682277,"thread_start_us":2505912,"threads_started":4,"wal-append.queue_time_us":319163,"wal-append.run_cpu_time_us":53458,"wal-append.run_wall_time_us":3565531}]]}
I20260709 12:27:22.479946  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:22.499850  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:22.502908  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:22.496263 13239 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.519356 13239 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:22.531984  9813 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:22.536147  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:22.538584 13455 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:22.538882  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:22.539345 13304 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:22.539644  9958 raft_consensus.cc:2393] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 11: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:22.539784 13304 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.524415 13260 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:22.540241 13304 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:22.540618  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:22.542315  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:22.543105  9960 raft_consensus.cc:2393] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:22.543816  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:22.545100  9779 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:22.546873  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:22.546680  9779 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:22.548476  9854 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:22.550971 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:22.551479 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:22.503894 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 227077us
I20260709 12:27:22.485136  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:22.462044 13385 consensus_queue.cc:1059] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:27:22.552624  9887 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
W20260709 12:27:22.546650 13458 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 12:27:21.637655 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:58762 (local address 127.8.111.68:37417)
0709 12:27:21.922946 (+285291us) server_negotiation.cc:207] Beginning negotiation
0709 12:27:21.922979 (+    33us) server_negotiation.cc:400] Waiting for connection header
0709 12:27:21.923056 (+    77us) server_negotiation.cc:408] Connection header received
0709 12:27:21.923388 (+   332us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0709 12:27:21.923417 (+    29us) server_negotiation.cc:462] Received NEGOTIATE request from client
0709 12:27:21.923747 (+   330us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0709 12:27:21.923960 (+   213us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0709 12:27:22.241776 (+317816us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0709 12:27:22.474114 (+232338us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0709 12:27:22.544979 (+ 70865us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58762: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":284349,"thread_start_us":64274,"threads_started":1}
I20260709 12:27:22.539513 13247 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:22.575316  9806 consensus_meta.cc:287] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.614s	user 0.011s	sys 0.000s
I20260709 12:27:22.556800  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:22.575703  9806 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:22.557376  9956 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:27:22.576581  9814 raft_consensus.cc:1240] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:22.537899  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:22.476681 13471 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:22.578804 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:22.581014  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:22.582573 10525 raft_consensus.cc:1240] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:22.585144 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:22.585595 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:22.587314  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:22.528659 13411 raft_consensus.cc:697] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:22.557083 13455 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:22.596935 10524 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:22.530803 12855 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.479058 13470 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:22.596395  9883 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 7: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:22.584429 13362 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:27:22.600111 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:22.608750 10525 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:22.606022 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:22.611505 10528 raft_consensus.cc:2410] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:27:22.609910 10529 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:22.584889 13450 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:22.622509 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:22.618561 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:22.629496 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:22.542402 13473 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:22.631888  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 85356.4us
I20260709 12:27:22.632495 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:22.622022 13392 consensus_queue.cc:1059] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
W20260709 12:27:22.679365  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:22.685711 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:27:22.695041  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 218098us
W20260709 12:27:22.695851  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 191164us
I20260709 12:27:22.624562 13481 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:22.763929  9958 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:22.710680 10532 raft_consensus.cc:1240] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:22.773598 10528 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:27:22.774012 10528 pending_rounds.cc:85] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: Aborting all ops after (but not including) 10
I20260709 12:27:22.703182 13322 raft_consensus.cc:3055] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:27:22.714663  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 76594.8us
I20260709 12:27:22.757498  9964 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:22.636055 12855 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:22.769310  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 222088us
I20260709 12:27:22.705065  9854 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:22.726823 13362 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:27:22.784365  9853 leader_election.cc:336] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.747s (SENT)
I20260709 12:27:22.774315 10528 pending_rounds.cc:107] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:27:22.787137 10528 raft_consensus.cc:2889] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:22.783427 13475 log.cc:927] Time spent T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 12:27:22.776567 13298 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:22.795634  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 94864.5us
I20260709 12:27:22.796763  9853 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:22.799717  9958 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:27:22.781119 13322 raft_consensus.cc:740] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:22.804680  9928 leader_election.cc:400] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8.
I20260709 12:27:22.799417 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:22.806779 10532 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:22.714498 13411 consensus_queue.cc:237] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:22.812800 10529 raft_consensus.cc:1240] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:22.802130 13481 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.831470 13470 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:22.892818 13485 raft_consensus.cc:3055] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:22.893147 13491 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:22.893311 13485 raft_consensus.cc:740] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:22.894299 13485 consensus_queue.cc:260] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:22.895104 13492 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:22.895802 13485 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:22.895901 13492 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:22.896651 13481 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:22.897255 13474 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:22.805706 13412 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:22.841455  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:22.904897  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:22.906617  9884 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:22.830883 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:22.908849 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:27:22.910383 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 110889us
W20260709 12:27:22.911192 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:22.812036 13372 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 12:27:19.399618 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.8.111.68:37417 (local address 127.0.0.1:58762)
0709 12:27:19.523621 (+124003us) negotiation.cc:107] Waiting for socket to connect
0709 12:27:19.523742 (+   121us) client_negotiation.cc:175] Beginning negotiation
0709 12:27:19.524318 (+   576us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0709 12:27:21.928002 (+2403684us) client_negotiation.cc:281] Received NEGOTIATE NegotiatePB response
0709 12:27:21.928078 (+    76us) client_negotiation.cc:404] Received NEGOTIATE response from server
0709 12:27:21.928192 (+   114us) client_negotiation.cc:190] Negotiated authn=CERTIFICATE
0709 12:27:22.222174 (+293982us) client_negotiation.cc:530] Sending TLS_HANDSHAKE message to server
0709 12:27:22.241018 (+ 18844us) client_negotiation.cc:262] Sending TLS_HANDSHAKE NegotiatePB request
0709 12:27:22.499052 (+258034us) negotiation.cc:326] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.8.111.68:37417: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":122800,"thread_start_us":89367,"threads_started":1}
W20260709 12:27:22.914960 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 155271us
W20260709 12:27:22.891484 13475 log.cc:927] Time spent T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:27:22.799166 13234 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.107s
I20260709 12:27:22.808764 13362 raft_consensus.cc:697] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:22.929397  9779 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:22.892818 13484 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.805823 13298 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:22.936707 13200 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:22.897828 13474 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:22.939328  9854 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:22.915563 13470 consensus_queue.cc:1059] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 12:27:22.948060  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 151692us
I20260709 12:27:22.960698  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:22.938315 13200 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:27:22.947952 12984 consensus_meta.cc:287] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.693s	user 0.015s	sys 0.001s
I20260709 12:27:22.969570  9779 leader_election.cc:400] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11.
I20260709 12:27:22.974350 13403 consensus_queue.cc:1059] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 12:27:22.975088 13478 log.cc:927] Time spent T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
I20260709 12:27:22.975345 13270 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.975762 13496 consensus_queue.cc:1059] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 12:27:22.978406  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 205450us
I20260709 12:27:22.940701 13412 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:22.956236 13491 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.004540 13492 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:23.004592 13491 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:23.007076 13491 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:22.979828 13474 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:22.980548 13471 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:22.981346 13499 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.983011 13504 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.978416 13490 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:27:22.988409 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 75339.7us
I20260709 12:27:22.962260 13455 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:22.956363 13489 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.002767 13486 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:23.003863  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:22.984748 13200 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:22.987313 13194 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.995522 12984 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:22.984467 13473 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:23.049731 13194 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:23.021271  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 85204.7us
I20260709 12:27:23.050575 13376 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:22.967015 13322 consensus_queue.cc:260] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.052280 13194 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:23.052407 13322 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:23.027449 13499 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.052872 13194 consensus_queue.cc:1059] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:23.054919 13499 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:23.055701 13412 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:23.027565 13504 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.031991  9814 raft_consensus.cc:1275] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:27:23.060397 13504 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:22.938747 13484 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.061057 13504 raft_consensus.cc:3055] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:23.061409 13298 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:23.062711 13484 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:23.063640  9890 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
W20260709 12:27:23.064534 13152 consensus_meta.cc:287] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.612s	user 0.007s	sys 0.002s
I20260709 12:27:23.032676  9815 raft_consensus.cc:1275] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:27:23.033424 13479 raft_consensus.cc:3055] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:23.018167 13362 consensus_queue.cc:237] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.030441 12855 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:23.061450 13504 raft_consensus.cc:740] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:23.021888 13481 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:23.033964 13489 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.013135 13304 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.069514 13489 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:23.036731 13482 log.cc:927] Time spent T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.358s	user 0.001s	sys 0.000s
I20260709 12:27:23.037479 13311 raft_consensus.cc:3055] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:23.070231 13304 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:23.070464 13311 raft_consensus.cc:740] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:23.071225 10527 raft_consensus.cc:2393] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:23.071691  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:23.071990 13476 log.cc:927] Time spent T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.528s	user 0.002s	sys 0.000s
I20260709 12:27:23.071571 13311 consensus_queue.cc:260] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:23.072381  9959 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:23.073010 13311 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:23.073427  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:23.074205 13168 consensus_meta.cc:287] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.572s	user 0.007s	sys 0.009s
W20260709 12:27:23.074903  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:23.044579  9779 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:23.029971  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:23.053854 13194 consensus_queue.cc:1059] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:23.075708  9810 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:23.071242  9809 raft_consensus.cc:1275] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
W20260709 12:27:23.075673  9813 consensus_meta.cc:287] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.008s
I20260709 12:27:23.078845  9957 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:23.085789  9813 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:23.088493  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:23.085280  9809 pending_rounds.cc:85] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71: Aborting all ops after (but not including) 2
I20260709 12:27:23.087991  9778 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:23.090720  9809 pending_rounds.cc:107] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:27:23.091035  9809 raft_consensus.cc:2889] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:23.093781 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:23.094008  9956 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
W20260709 12:27:23.095889  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 92091.9us
I20260709 12:27:23.066687 13479 raft_consensus.cc:740] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:23.104049  9778 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:23.089390 13239 consensus_meta.cc:287] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.528s	user 0.000s	sys 0.017s
W20260709 12:27:23.077916 13260 consensus_meta.cc:287] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.537s	user 0.015s	sys 0.002s
I20260709 12:27:23.101922 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:23.094472 10533 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:23.042495 13403 raft_consensus.cc:3055] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:23.014166 13270 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.106372  9810 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:23.101203 13473 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:23.103948 13321 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:23.088538 13152 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:27:23.092617  9927 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:23.107534 13474 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:27:23.115242 13483 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:27:23.087507 13366 consensus_meta.cc:287] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.646s	user 0.009s	sys 0.003s
I20260709 12:27:23.101312 10530 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 6. Current term is 7. Ops: []
W20260709 12:27:23.125955  9962 consensus_meta.cc:287] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.622s	user 0.017s	sys 0.000s
I20260709 12:27:23.123021 10531 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:23.145148  9962 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
W20260709 12:27:23.126498  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 105474us
W20260709 12:27:23.140177  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 47627.7us
I20260709 12:27:23.140281  9961 raft_consensus.cc:1275] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:23.140853 13260 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.148152 12984 consensus_queue.cc:1048] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:23.148676 13386 raft_consensus.cc:3055] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:23.149101 13386 raft_consensus.cc:740] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:23.084853 13489 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:23.106431 13479 consensus_queue.cc:260] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.087028 13168 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:23.105190 13455 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:27:23.164273 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:23.150815  9853 leader_election.cc:336] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.788s (SENT)
W20260709 12:27:23.151005  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 54206.4us
I20260709 12:27:23.187047  9928 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:23.151863  9698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 147290us
I20260709 12:27:23.158834  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:23.188568  9809 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:23.150535  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 140205us
I20260709 12:27:23.127030 13403 raft_consensus.cc:740] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:27:23.151714 13472 log.cc:927] Time spent T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.687s	user 0.004s	sys 0.012s
W20260709 12:27:23.193753 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 264213us
I20260709 12:27:23.190652  9853 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:23.199918  9854 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:23.143824 13503 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:27:23.152001 13494 log.cc:927] Time spent T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:27:23.150091 13260 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:23.203783 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 160383us
W20260709 12:27:23.236133  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 49171.1us
I20260709 12:27:23.140007 13473 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:23.169945 13486 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:23.150446 13483 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.233448  9854 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:23.253010 13481 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:23.253490 13481 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.253904 13481 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:23.253976  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:23.255131  9883 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:23.236299 13298 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:23.248982 13484 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:23.249121 13496 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:23.259804 13496 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.260250 13496 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:23.259868 13392 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.063s	sys 0.045s
I20260709 12:27:23.261013 13392 consensus_queue.cc:1243] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer b011791796d1457284b857d7d3422195 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:27:23.157306 12855 consensus_queue.cc:1048] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 12:27:23.263435 10497 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:23.263628 13270 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:23.127023 13239 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.249388  9955 raft_consensus.cc:1240] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:23.192113 13366 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:23.259047 13298 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.150247 13489 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:23.235647 13503 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:23.264737 13194 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:23.263676 13392 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.265472 13483 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:23.265929  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:23.266144  9963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1505) took 1269 ms. Trace:
W20260709 12:27:23.266345  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 68233.6us
I20260709 12:27:23.239254  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:23.246312 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:23.272500  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:23.167961 12984 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:27:23.278460  9882 raft_consensus.cc:1240] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
W20260709 12:27:23.323283  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 84088us
I20260709 12:27:23.280062  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:23.352504  9890 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:27:23.281939  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:23.353338  9884 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:23.353451  9928 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:23.233346 13385 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:23.122764 13504 consensus_queue.cc:260] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.246203 13473 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:23.294395  9809 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
W20260709 12:27:23.301374  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 150601us
I20260709 12:27:23.305050  9960 raft_consensus.cc:2393] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:23.150038 13386 consensus_queue.cc:260] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.366417  9927 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:23.277213 10497 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:23.326619 13364 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.020s	sys 0.035s
I20260709 12:27:23.302610 13194 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:23.350682  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:23.308229 10525 raft_consensus.cc:1240] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:23.282497 13508 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:23.367290 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 91904.1us
I20260709 12:27:23.367903  9779 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:23.303498 13503 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:23.371055 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 138617us
I20260709 12:27:23.305210 13152 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:23.368839 13260 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:23.374840 13194 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:23.377403 12855 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:23.350872 13392 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.377799 13508 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.379244 10497 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:23.379652 13489 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:23.380232 13499 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:23.381047 13200 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.371634 13511 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.368908 13497 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:23.372332 13366 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:23.415495 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:23.368999 13364 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.020s	sys 0.036s
W20260709 12:27:23.369729 13465 log.cc:927] Time spent T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:27:23.419979 13298 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:23.421275 13239 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:23.422225 13168 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:23.422308 13508 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:23.423028 13513 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:23.423424 13513 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.423868 13513 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:23.424033 10526 raft_consensus.cc:2410] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:27:23.389427  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:23.425282  9888 raft_consensus.cc:2393] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 5: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:23.426450  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:23.426649  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:23.427016  9813 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:23.427898  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:23.428261  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:23.428820  9956 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:23.415921 13152 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:23.429759  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:23.431005 13152 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:23.431178 10524 raft_consensus.cc:3055] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:23.431547 10524 raft_consensus.cc:740] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:23.417351 13499 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.434966 13497 raft_consensus.cc:697] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:23.322499  9963 rpcz_store.cc:276] 0709 12:27:21.997004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.020744 (+ 23740us) service_pool.cc:224] Handling call
0709 12:27:22.035686 (+ 14942us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:22.085481 (+ 49795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:22.085534 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:22.120883 (+ 35349us) log.cc:844] Serialized 26 byte log entry
0709 12:27:22.343954 (+223071us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:22.343996 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:22.344072 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:23.139019 (+794947us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:23.265729 (+126710us) raft_consensus.cc:1685] finished
0709 12:27:23.265757 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:23.265968 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9102,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":27036,"spinlock_wait_cycles":5279488,"thread_start_us":167059,"threads_started":1,"wal-append.queue_time_us":269529}
I20260709 12:27:23.436023 13497 consensus_queue.cc:237] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.391499 13471 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:23.437100 13471 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:23.437505 13471 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:23.365675 13485 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:23.414608  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:23.413687 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:23.413239  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:23.413117 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:23.416252  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 55911.8us
I20260709 12:27:23.416344  9887 raft_consensus.cc:1275] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:27:23.419174 12855 raft_consensus.cc:697] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:23.447355 12855 consensus_queue.cc:237] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.449098  9881 raft_consensus.cc:2393] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 10: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:23.443341 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:23.449795 10530 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:23.419195 13488 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:23.455006 13488 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.457326 13488 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:23.423468 13511 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:23.459859 13511 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:23.460345  9813 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:23.388502 12984 consensus_queue.cc:1059] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:27:23.462862  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:23.463667  9808 raft_consensus.cc:2393] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 10: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:23.464074 10530 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:23.415505  9885 raft_consensus.cc:1275] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:27:23.469117 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:27:23.373659 13454 consensus_meta.cc:287] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.830s	user 0.012s	sys 0.009s
I20260709 12:27:23.470933 13454 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.391942 13403 consensus_queue.cc:260] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.473973 13403 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:23.478996 13496 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.480213  9883 raft_consensus.cc:2393] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 13: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:23.436467 13200 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:23.482429 13304 consensus_queue.cc:1175] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "963185e117384b2085d7cea02a64478b" responder_term: 8 status { last_received { term: 7 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:23.444058 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:23.415776 13510 consensus_queue.cc:1059] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:27:23.394052 13504 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:23.484139 13481 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.418313 13366 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.445467  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:23.486125  9955 raft_consensus.cc:2393] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:23.464829 13486 raft_consensus.cc:3055] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:23.465427 13513 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.422341 13392 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:23.469288  9927 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:23.436203 13499 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:23.439692  9928 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:27:23.487133  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 72858.3us
I20260709 12:27:23.438315 13485 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:23.506433  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 88648.1us
W20260709 12:27:23.515892  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 89648.7us
I20260709 12:27:23.517771  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:23.530627 10530 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:23.532699  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:23.534081  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:23.534361  9963 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:23.522789  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 53570.1us
I20260709 12:27:23.536419  9779 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:23.533203 13479 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:23.537968  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:23.540103 13513 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:23.497989 13366 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:23.522464 13454 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:23.541862 13239 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.543372  9853 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:23.536020 13260 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:23.498232 13486 raft_consensus.cc:740] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:23.514014 13485 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:23.551112  9890 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:23.547511  9955 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:23.579418  9854 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:23.614830 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:23.623353  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 80069.9us
I20260709 12:27:23.622445 13489 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:23.534698 12984 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:23.627184 10529 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:23.581382 13152 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:27:23.612800 13517 log.cc:927] Time spent T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.234s	user 0.001s	sys 0.003s
W20260709 12:27:23.651857  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 72538.7us
W20260709 12:27:23.627876 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 209958us
I20260709 12:27:23.628533  9963 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:23.572461 10524 consensus_queue.cc:260] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:23.643923 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:23.634563  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:23.646070 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:23.550762 13511 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:23.646765  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 148563us
W20260709 12:27:23.652208  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 115214us
I20260709 12:27:23.544636 12855 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:23.659329  9778 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:23.660873  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 78244.3us
I20260709 12:27:23.656834  9928 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:23.571655 13194 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.643836 13385 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:23.650947 13412 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:27:23.669094  9778 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:23.632514 13239 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.671902 13194 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:23.672224  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:23.673424 13239 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:23.673529  9853 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:23.673972 13298 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:23.657616 13200 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:23.674381 13298 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:23.674675 13200 raft_consensus.cc:697] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:23.674901 13298 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:23.675812 13200 consensus_queue.cc:237] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.677145 13489 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:23.677774 13322 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:23.679088 10524 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:23.679277  9853 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:23.574116 13503 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.570746 13515 consensus_queue.cc:1048] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 12:27:23.688429 13321 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:23.688668  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:23.689456 13486 consensus_queue.cc:260] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.681972 13362 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:23.684896 13529 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:23.695855 13152 consensus_queue.cc:1059] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:23.666076 12855 raft_consensus.cc:697] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:23.705412  9853 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:23.706239 13484 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:23.707000 13455 consensus_queue.cc:1048] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:23.682545 13481 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:23.659866 12984 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.708858 13491 raft_consensus.cc:3055] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:23.660229 13511 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:23.734153  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 71672.7us
W20260709 12:27:23.735853  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 79134us
W20260709 12:27:23.744760 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:23.749624  9928 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:23.738541 13529 raft_consensus.cc:697] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 12 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:23.746994  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:23.755739  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:23.759114  9882 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:23.759368  9883 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:23.679440 13385 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:23.732317 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 339201us
I20260709 12:27:23.761863 10496 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:23.702740 13471 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.733068 10524 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:27:23.766353  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:23.767560 10524 pending_rounds.cc:85] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: Aborting all ops after (but not including) 7
I20260709 12:27:23.759240 10497 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:23.768182 10524 pending_rounds.cc:107] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:27:23.768601 10524 raft_consensus.cc:2889] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:23.766314 10531 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:27:23.741719 13491 raft_consensus.cc:740] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:23.755364 13260 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:23.748697 13484 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:23.778682 10524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 943) took 1176 ms. Trace:
I20260709 12:27:23.778926  9809 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:23.783187 10524 rpcz_store.cc:276] 0709 12:27:22.598015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.598434 (+   419us) service_pool.cc:224] Handling call
0709 12:27:22.598700 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:23.431066 (+832366us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b54005c3da0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e493dc0 00007f2f8e51e1c0 00007f2f8e51f231 00007f2f8e51bd8f 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c
0709 12:27:23.572110 (+141044us) spinlock_profiling.cc:243] Waited 51.9 ms on lock 0x7b54005c3da0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e49a06f 00007f2f8e512f60 00007f2f8e5147de 00007f2f8e51eb49 00007f2f8e51f416 00007f2f8e51bd8f 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62
0709 12:27:23.773772 (+201662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:23.774021 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1615342336}
I20260709 12:27:23.750149 13321 consensus_queue.cc:1048] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:27:23.774323 13486 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:23.769636 13510 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:23.778407 13373 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:27:23.787855  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:23.809188  9883 raft_consensus.cc:2393] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:23.794852 10496 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:23.780495 13504 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:27:23.813549  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 108211us
W20260709 12:27:23.815084  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 70651.4us
I20260709 12:27:23.815932  9928 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:23.816542  9779 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:23.812240 13540 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:23.815532 13505 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.836858  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:23.846333 13545 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.852907 13545 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:23.853300 13471 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:23.859825 13311 raft_consensus.cc:3055] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:23.860258 13311 raft_consensus.cc:740] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:23.861150 13311 consensus_queue.cc:260] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:23.862403 13544 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:23.861160 13298 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.866652 13311 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:23.820834 13152 consensus_queue.cc:1059] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:27:23.867619 13321 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:23.785319 12855 consensus_queue.cc:237] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.816381 13473 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.827858 13540 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.818459 13483 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:23.873162  9882 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
W20260709 12:27:23.898092 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 103304us
I20260709 12:27:23.903371  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:23.907905  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 85362.1us
I20260709 12:27:23.904583 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:23.904309  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:23.894335 13484 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:23.906021  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:23.886497 13503 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:23.910702  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:23.912041  9886 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:23.912182  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:23.912158 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:23.911056  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:23.913604  9889 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:23.914346 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:23.915647  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:23.916483  9883 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:23.911286 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:23.919009  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:23.919523  9955 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:23.913137  9885 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:23.919409  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:23.898239 12984 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:23.924942  9884 raft_consensus.cc:2368] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 9. Current term is 10.
I20260709 12:27:23.923271 10527 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:27:23.921838  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:23.927668  9958 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:23.932156  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:23.932156  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:23.896703 13366 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.907241 13540 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:23.932911  9809 raft_consensus.cc:2393] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 11: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:23.934790  9956 raft_consensus.cc:1240] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:23.841037 13505 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:23.950913  9955 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:23.935840  9853 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:23.935170 13298 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:23.922931 13484 raft_consensus.cc:697] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:23.937824  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:23.941171  9962 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:27:23.942358 13546 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:23.942541 13385 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:23.926699 13454 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.972342  9815 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
W20260709 12:27:23.937502 13535 log.cc:927] Time spent T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:27:23.936333 13168 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:27:23.950388 13537 log.cc:927] Time spent T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:27:23.963701 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:23.953716 13511 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:23.971519  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 72394.8us
I20260709 12:27:23.973086 10524 raft_consensus.cc:2368] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 7. Current term is 8.
I20260709 12:27:23.846570 13529 consensus_queue.cc:237] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:23.955789 13551 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.966159 13376 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:23.993155  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 175375us
I20260709 12:27:23.995160  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:23.996280  9962 raft_consensus.cc:2393] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 11: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:24.000123  9815 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:24.000968 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:24.005904  9815 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:24.006978  9928 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:24.008164  9809 raft_consensus.cc:1240] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:23.979308 13504 raft_consensus.cc:697] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:27:24.009483  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 80135.8us
I20260709 12:27:24.011283  9887 raft_consensus.cc:3055] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:24.011229  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:24.011729  9887 raft_consensus.cc:740] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:24.012367  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:23.978957 13546 raft_consensus.cc:697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:23.973037 13485 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:24.015363  9853 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:24.017015  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:23.977288 13454 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:24.018231  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:24.019694  9810 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:24.023102 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:24.026533 13543 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:24.027102 13362 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:27:24.027736 13547 log.cc:927] Time spent T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:27:24.018623 13473 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:24.001142 13298 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.031628  9889 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:23.992676 13168 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:24.042799  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:24.044888  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:23.999233 13376 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:24.047178 13298 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:24.027150 13552 consensus_queue.cc:1048] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:27:24.048569 13485 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:24.049193 13362 raft_consensus.cc:697] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:24.049273 13376 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:24.024744  9887 consensus_queue.cc:260] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:24.007221 12984 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:27:24.050717  9888 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:24.043560  9810 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:24.052078  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:24.051862 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:24.056550  9887 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:24.059270  9889 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:27:24.057052  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:24.061425  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:24.061710  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:24.066468 10525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 695) took 1295 ms. Trace:
I20260709 12:27:24.066885 10525 rpcz_store.cc:276] 0709 12:27:22.771205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.771503 (+   298us) service_pool.cc:224] Handling call
0709 12:27:22.782360 (+ 10857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:23.375069 (+592709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.066219 (+691150us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b540009f1d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:24.066410 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1204537728}
I20260709 12:27:24.068163 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:24.069319 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:24.069998 10525 raft_consensus.cc:2368] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 9. Current term is 10.
I20260709 12:27:24.055482 13473 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:24.070794 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:24.070675 13473 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:24.071372 10525 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:24.072234 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:24.072721 10525 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:24.072852 13473 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:24.050264 13362 consensus_queue.cc:237] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:24.067252  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:24.074262 13479 consensus_meta.cc:287] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.000s
I20260709 12:27:24.042944 13484 consensus_queue.cc:237] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:24.075577  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:24.060406 13200 consensus_queue.cc:1048] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:27:24.062216 13485 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:24.077589  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:24.077986  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:24.080518  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:24.080756 13366 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:24.081883  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:24.082791 13483 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:23.999737 13551 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:24.083607 13168 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:24.084275  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:24.049391 13552 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:24.084882  9808 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:24.081863  9779 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:24.084739 13504 consensus_queue.cc:237] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:24.062506 13152 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.043346 13543 raft_consensus.cc:697] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:24.069559 13546 consensus_queue.cc:237] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:24.169674 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:24.169576  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:24.170840  9809 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
W20260709 12:27:24.174602  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 92827.3us
I20260709 12:27:24.175626  9779 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:24.176025 10529 raft_consensus.cc:2393] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 8: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
W20260709 12:27:24.179955  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 122342us
I20260709 12:27:24.181108  9853 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:24.187323  9853 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:24.086526 13554 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.204499  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:24.214247  9958 raft_consensus.cc:1240] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:24.219861 13505 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:24.221081  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:24.222147  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:24.222617  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:24.222875  9955 raft_consensus.cc:1240] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:24.223034  9960 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:24.223758  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:24.223935  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:24.224159  9955 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 8 index: 10. (term mismatch)
I20260709 12:27:24.159904 13552 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.224511  9959 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:24.249060  9778 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:24.249372  9810 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:24.250177  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:24.251235 13454 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:24.251507 13543 consensus_queue.cc:237] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:24.248345  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:24.252779  9806 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:24.254863 13551 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:24.255441 13554 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:24.256551  9815 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:24.257560 13554 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:24.251796 13454 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:24.264146  9806 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:24.224485  9955 pending_rounds.cc:85] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 9
I20260709 12:27:24.280766  9955 pending_rounds.cc:107] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 7.10
I20260709 12:27:24.281205  9955 raft_consensus.cc:2889] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:24.296962  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:24.297783  9813 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:27:24.298903 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:24.300177  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:24.306602  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:24.258121 13554 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:24.224330  9964 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:24.218086 10525 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:24.222267  9927 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:24.354534  9887 raft_consensus.cc:1275] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:27:24.355008  9887 pending_rounds.cc:85] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 5
I20260709 12:27:24.355296  9887 pending_rounds.cc:107] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:27:24.355614  9887 raft_consensus.cc:2889] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:24.160235 13152 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:24.225051 13473 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:24.205610 13479 raft_consensus.cc:2764] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 12:27:24.364108  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 141901us
I20260709 12:27:24.392062  9927 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:24.225545 13483 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.322288 13481 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:24.362396 13554 raft_consensus.cc:697] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 9 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:24.384083 12984 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:24.386368 13411 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:27:24.389557 10526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 879) took 1587 ms (client timeout 1756 ms). Trace:
I20260709 12:27:24.214457 13471 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:24.414474 10526 rpcz_store.cc:269] 0709 12:27:22.802038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.802182 (+   144us) service_pool.cc:224] Handling call
0709 12:27:24.389322 (+1587140us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b54005208d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:24.389473 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1185856768}
I20260709 12:27:24.373872 13485 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:24.416787 13411 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:24.316877 13552 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:24.412863 13239 raft_consensus.cc:2804] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:24.414149 12984 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:24.428681 13311 consensus_meta.cc:287] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.561s	user 0.008s	sys 0.000s
W20260709 12:27:24.430487  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 181523us
I20260709 12:27:24.415695 13298 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:24.401635 13483 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:24.436190  9809 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:27:24.430214 13411 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:24.437708  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 425335us
W20260709 12:27:24.440081  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 48058.9us
W20260709 12:27:24.442544  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 255275us
I20260709 12:27:24.445794 13481 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:24.448849  9853 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:24.450508 13481 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:24.381790  9813 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:24.430797 13239 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.435565 12984 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:24.472324  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:24.473161  9957 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:27:24.475979  9813 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:24.439324 13152 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:24.489117  9808 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:27:24.491359  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:24.492496  9955 raft_consensus.cc:2393] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 5: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:24.472694 10496 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:24.485108  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:24.480423 13546 consensus_queue.cc:1059] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:27:24.496767  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:24.497426  9964 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:24.497838 13552 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:24.459311 13484 consensus_queue.cc:1059] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 12:27:24.501729 13486 consensus_meta.cc:287] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.683s	user 0.009s	sys 0.001s
I20260709 12:27:24.502503  9956 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:24.470904 13239 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:24.512722  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 303437us
I20260709 12:27:24.515448  9779 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:24.519762  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:24.522644  9964 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:24.523381  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:24.523590 13200 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.523926  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:24.524062 13200 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:24.524448  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:24.525418  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:24.525915  9957 raft_consensus.cc:2376] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7. Re-sending same reply.
I20260709 12:27:24.526175 13200 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:24.526577  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:24.527428  9958 raft_consensus.cc:2368] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8.
I20260709 12:27:24.528338  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:24.528950  9958 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:24.530680  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:24.531293  9960 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:24.533139  9964 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:24.534065  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:24.534550  9814 raft_consensus.cc:1275] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:24.534729  9964 raft_consensus.cc:2368] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12.
I20260709 12:27:24.536967  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:24.459062 13481 consensus_queue.cc:1048] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:27:24.537588  9959 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:24.541978  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:24.542641  9811 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:24.544534 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:24.545109 10528 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:24.545054  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:24.547641 10526 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:24.548308  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:24.536778 12855 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:24.551203 13566 log.cc:927] Time spent T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:27:24.551029 12855 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:24.553529 12855 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:24.538004 13471 raft_consensus.cc:2764] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:27:24.509591 13550 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:24.474877 13505 consensus_queue.cc:1059] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:27:24.554945  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:24.480859 13376 consensus_queue.cc:1059] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:27:24.563118 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:24.493124 13551 consensus_queue.cc:1059] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:27:24.565626  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:24.569069  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:24.564190  9853 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:24.564369 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:24.563679 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:24.593741 10530 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 12: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:24.510094 13564 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:27:24.569687  9811 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:27:24.593878 10525 raft_consensus.cc:2410] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:27:24.598644  9958 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:24.600510  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:24.601145  9964 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:24.602010 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:27:24.571842 13540 consensus_meta.cc:287] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.621s	user 0.011s	sys 0.000s
I20260709 12:27:24.607842 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:24.610426 10529 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:24.571272 13366 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:24.612360  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:24.481148 13554 consensus_queue.cc:237] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:24.612727 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 140132us
I20260709 12:27:24.615165  9927 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:24.615554 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:24.653812  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 89691us
I20260709 12:27:24.616256  9955 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:24.614820 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:24.557503 13486 consensus_queue.cc:1048] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:27:24.655325  9853 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:24.655735 10496 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:24.658042  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:24.687862 13484 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.613477 13200 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:24.592751 13552 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:27:24.565032 13550 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:24.689899  9886 raft_consensus.cc:2393] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
W20260709 12:27:24.701989  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 86004.9us
W20260709 12:27:24.704473  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 49216.1us
I20260709 12:27:24.708714  9962 raft_consensus.cc:1217] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Deduplicated request from leader. Original: 5.7->[7.8-7.8]   Dedup: 7.8->[]
I20260709 12:27:24.711634  9962 raft_consensus.cc:1240] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:27:24.708739  9853 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:24.693935 13534 log.cc:927] Time spent T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:27:24.703862 13504 raft_consensus.cc:3055] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:24.716192  9853 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:24.719224 13504 raft_consensus.cc:740] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:27:24.703287 13521 log.cc:927] Time spent T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.090s	user 0.005s	sys 0.010s
I20260709 12:27:24.616058 13540 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:24.700706 13481 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:24.720399 13561 raft_consensus.cc:2764] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:27:24.753104  9961 raft_consensus.cc:2393] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:24.738158 10528 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:24.755985  9960 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:24.733619  9853 leader_election.cc:400] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8.
I20260709 12:27:24.739573 13550 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:24.740497 13496 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:24.724339 13376 raft_consensus.cc:3055] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:24.744913 13582 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:24.730830  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:24.746784 13362 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:24.722657 13200 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:24.757653  9853 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:24.704284 13484 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:24.760257  9959 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:24.732098 13572 consensus_queue.cc:1048] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:27:24.774701 13540 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:24.728461 13483 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:24.759675 13376 raft_consensus.cc:740] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:27:24.794749 13500 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.531s	user 0.009s	sys 0.007s
I20260709 12:27:24.779847 13505 raft_consensus.cc:3055] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:27:24.799399 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:24.788218 13496 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:24.798132  9853 leader_election.cc:400] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12.
I20260709 12:27:24.814937  9853 leader_election.cc:403] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:27:24.788865 13582 raft_consensus.cc:697] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:24.820681 10496 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
W20260709 12:27:24.813619 13500 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.565s	user 0.009s	sys 0.008s
I20260709 12:27:24.797887 13584 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:27:24.824622 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:24.844439 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:24.827265 13584 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:24.845582 12843 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:27:24.846553 13484 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:24.847518 13584 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:24.825443 13376 consensus_queue.cc:260] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:24.849977 13376 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:24.802515 13504 consensus_queue.cc:260] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:24.851377 13504 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:24.853082 13239 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:24.854424 13373 consensus_queue.cc:1175] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b011791796d1457284b857d7d3422195" responder_term: 11 status { last_received { term: 10 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:24.866291 13590 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:24.867403 13582 consensus_queue.cc:237] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:24.819941 13496 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:24.878628 12984 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:24.880410 13496 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:24.880623 13558 log.cc:927] Time spent T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.655s	user 0.004s	sys 0.007s
W20260709 12:27:24.881242  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 83233.4us
I20260709 12:27:24.882942  9853 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:24.883116  9928 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:24.883955 13485 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:24.884325  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:24.885402  9928 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:24.886461 13385 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:24.888203 13540 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:24.825423 13270 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:24.920181  9928 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:24.921324 13540 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:24.928051 13540 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:24.931656  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:24.938856 13239 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:24.941738 13540 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:24.942431 13540 raft_consensus.cc:697] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:24.943599 13540 consensus_queue.cc:237] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:24.954990 12843 consensus_queue.cc:1175] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b011791796d1457284b857d7d3422195" responder_term: 9 status { last_received { term: 9 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 9 index: 9 } }
I20260709 12:27:24.984642 13239 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.985424 13239 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:24.988044 13239 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:24.814375 13505 raft_consensus.cc:740] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:24.990401 13505 consensus_queue.cc:260] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:24.992290 13505 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:25.041188 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:25.081017  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 465888us
W20260709 12:27:25.082484 13514 log.cc:927] Time spent T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 1.710s	user 0.007s	sys 0.020s
I20260709 12:27:25.088215 13491 consensus_queue.cc:260] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:25.145744 13491 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:25.100023 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:25.099982 13485 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:25.088043  9778 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:25.151405  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 63478.2us
I20260709 12:27:25.151911 13450 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:25.152282  9778 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:25.152456 13450 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:25.153105 13455 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:25.153656 13455 raft_consensus.cc:697] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:25.154618 13455 consensus_queue.cc:237] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:25.156213 13479 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.000s	sys 0.011s
W20260709 12:27:25.156545 13479 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.000s	sys 0.011s
I20260709 12:27:25.158511 13450 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:25.158612 13366 raft_consensus.cc:697] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:27:25.127053 13575 log.cc:927] Time spent T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.435s	user 0.003s	sys 0.008s
I20260709 12:27:25.160552  9888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2325) took 1161 ms. Trace:
I20260709 12:27:25.160991  9888 rpcz_store.cc:276] 0709 12:27:23.999472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.076495 (+ 77023us) service_pool.cc:224] Handling call
0709 12:27:24.076783 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:24.077111 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:24.077150 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:24.077590 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 12:27:24.400370 (+322780us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:24.555117 (+154747us) log.cc:844] Serialized 14 byte log entry
0709 12:27:24.558969 (+  3852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.559022 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:25.126365 (+567343us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:25.160237 (+ 33872us) raft_consensus.cc:1685] finished
0709 12:27:25.160359 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:25.160495 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20212,"prepare.queue_time_us":214732,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":2061,"raft.queue_time_us":12710,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":22908,"spinlock_wait_cycles":49504128,"thread_start_us":470772,"threads_started":2,"wal-append.queue_time_us":466949}
I20260709 12:27:25.159715 13366 consensus_queue.cc:237] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:25.166345 13543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.003s	sys 0.023s
W20260709 12:27:25.166795 13543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.003s	sys 0.023s
I20260709 12:27:25.140875 13386 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:25.170109  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:25.171381 12984 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:25.172941  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:25.174234  9809 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:25.175397 13200 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:25.178771 13590 raft_consensus.cc:697] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:25.179741 13590 consensus_queue.cc:237] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:25.182832  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 299943us
I20260709 12:27:25.183550  9853 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:25.183962 13582 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.184479 13582 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:25.185077  9853 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:25.187292 13200 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12.
W20260709 12:27:25.158757 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:25.188042 13200 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:25.188670 13200 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:25.179754  9779 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:25.189345 13200 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:25.189822 13200 raft_consensus.cc:697] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:25.190436  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:25.190649 13200 consensus_queue.cc:237] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:25.191190 13483 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:25.191807 13483 consensus_queue.cc:1059] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:27:25.192451 13483 consensus_queue.cc:1243] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer 963185e117384b2085d7cea02a64478b log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:27:25.192533 13554 raft_consensus.cc:2764] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:27:25.192948 13483 raft_consensus.cc:3055] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:25.193343 13483 raft_consensus.cc:740] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:25.194796  9779 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:25.195582 13554 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:25.196658  9779 leader_election.cc:400] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 9. Current term is 10.
I20260709 12:27:25.196972  9779 leader_election.cc:403] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:27:25.197863 13554 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 9. Current term is 10.
I20260709 12:27:25.194129 13483 consensus_queue.cc:260] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:25.199615 13483 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:25.188167  9853 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:25.210772 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:25.198046  9779 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:25.101259  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 601) took 1054 ms. Trace:
I20260709 12:27:25.226127  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:25.123049 10497 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:27:25.232028 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:25.233227  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:25.120152 10531 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 947) took 1731 ms (client timeout 1830 ms). Trace:
W20260709 12:27:25.234314 10531 rpcz_store.cc:269] 0709 12:27:23.388966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.389084 (+   118us) service_pool.cc:224] Handling call
0709 12:27:25.119983 (+1730899us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54004e3754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:25.120093 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":805152640}
I20260709 12:27:25.235782 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:25.221415  9815 rpcz_store.cc:276] 0709 12:27:24.047089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.056715 (+  9626us) service_pool.cc:224] Handling call
0709 12:27:25.100849 (+1044134us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54002512d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:25.101181 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445710592}
I20260709 12:27:25.239764 10528 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:27:25.239571  9813 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:27:25.240497 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 117565us
I20260709 12:27:25.251348 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:25.251938 10533 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:25.250556  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:25.241215 10497 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:25.118182 13562 log.cc:927] Time spent T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.731s	user 0.000s	sys 0.009s
I20260709 12:27:25.258028 10525 raft_consensus.cc:1240] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:27:25.256134  9807 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:25.256426  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:25.217630 13554 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.260984 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:25.262926  9814 raft_consensus.cc:2393] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 10: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:25.264343 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:25.123430 13392 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.126895 13373 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:25.255515  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:25.269919  9813 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:25.254832  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 51178.1us
I20260709 12:27:25.123277 13403 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.273684 10497 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:25.250878 13455 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:27:25.280615  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:25.251127 13454 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:25.260581 13386 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:25.286294 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 444386us
I20260709 12:27:25.289426 10496 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:25.292721 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:25.274621 12843 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:25.296710  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:25.311179 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:25.312927 10496 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:25.307552  9927 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:25.282997 13455 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:25.280630 13592 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:25.284752 13366 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:25.310124  9808 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:25.287374 13362 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:25.323074  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 106088us
I20260709 12:27:25.324308  9927 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:25.268754 13554 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:25.330367  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:25.319497 13551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.002s	sys 0.024s
I20260709 12:27:25.335562  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:25.283622 13484 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:27:25.297410 13543 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:25.327749  9778 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:25.275022 13392 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:25.324456 13455 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:25.281322 13373 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:25.308996 12843 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:25.293691 13479 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:25.345191  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:25.315773 13504 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:25.282747 13403 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:25.387501 10530 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
W20260709 12:27:25.346657  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 48686.5us
I20260709 12:27:25.318498 13270 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:25.356235  9962 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:27:25.343772 10496 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:25.326998 13592 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:25.342183 13551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.002s	sys 0.025s
I20260709 12:27:25.337841 13540 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:25.382167  9813 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:25.294137 13454 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:25.386533 12843 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:25.393154  9854 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:25.395486 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 51804.8us
I20260709 12:27:25.433120 10496 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:25.342242 13366 raft_consensus.cc:697] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:25.380810 13450 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:25.436213 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:25.422981 13599 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:25.410530 13376 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:27:25.442734  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 49686.6us
I20260709 12:27:25.342532 13362 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:25.407474 13592 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:25.372740 13543 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:25.390134 13479 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:25.445331 13599 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:25.442232 13588 consensus_queue.cc:1059] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:27:25.384783 13200 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:27:25.410893 13540 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:25.423197 13563 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:25.442852 13598 raft_consensus.cc:2804] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:25.463856 13376 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:25.439888 13504 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
W20260709 12:27:25.497810 13613 log.cc:927] Time spent T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
W20260709 12:27:25.499265 13616 log.cc:927] Time spent T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:27:25.502470 13376 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:25.490110 13540 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:25.485324 13599 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:25.522763 13554 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:25.524438 13620 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:25.495456 13598 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:25.493088 13563 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:25.533308  9957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 2117) took 1007 ms. Trace:
I20260709 12:27:25.533842  9957 rpcz_store.cc:276] 0709 12:27:24.526152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.598203 (+ 72051us) service_pool.cc:224] Handling call
0709 12:27:24.598583 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:24.598822 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:27:25.118493 (+519671us) log.cc:844] Serialized 14 byte log entry
0709 12:27:25.532786 (+414293us) log.cc:844] Serialized 14 byte log entry
0709 12:27:25.532971 (+   185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:25.533012 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:25.533048 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:25.533131 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:25.533252 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13064,"prepare.queue_time_us":96458,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":35407,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":6284,"thread_start_us":835371,"threads_started":3,"wal-append.queue_time_us":400573}
I20260709 12:27:25.520565 13239 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:25.533069 13598 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:25.539108 13563 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:25.532413 13554 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.592536 10533 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:25.527419 13551 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:27:25.563758 13590 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:25.602787 13373 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:25.538460 13450 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:25.603765 13450 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:25.604257 13450 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:25.602236 13618 log.cc:927] Time spent T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:27:25.507114 13366 consensus_queue.cc:237] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:25.580057 13611 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:25.597057 13362 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:25.642700  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 318421us
I20260709 12:27:25.593102 13385 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:27:25.628577  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 257496us
I20260709 12:27:25.584901 12984 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:25.644913  9927 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:25.538894 13620 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:25.664130 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:25.625360 13450 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:25.665506  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:25.673724 13481 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.674364 13481 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:25.673933 13617 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:25.677348 13617 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:25.586967 13239 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:25.682924  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:25.704954  9963 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:25.643338 13392 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:25.627051 13554 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:25.729164  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 264605us
I20260709 12:27:25.715572  9813 raft_consensus.cc:1240] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:25.730620  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:25.731477  9813 raft_consensus.cc:2393] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 12: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:25.732872  9813 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:25.716811  9814 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:27:25.724833  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:25.734781  9889 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:25.713274  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:25.759186  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 114134us
I20260709 12:27:25.657064 13385 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:25.764890  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:25.779430  9885 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:25.779896  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:25.783360  9779 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:25.703956 12984 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:25.771240  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:25.759124 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 131122us
I20260709 12:27:25.788856  9889 raft_consensus.cc:2393] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:25.786502  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:25.760274 13632 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.770612  9963 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
W20260709 12:27:25.761142 13625 log.cc:927] Time spent T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:27:25.785877  9928 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:25.706215 13630 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 12:27:25.760852 13617 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:25.768486  9927 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:25.816390  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:25.817173  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:25.817514  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:25.760542 13633 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:25.817772  9886 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
W20260709 12:27:25.823740 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:25.783696 13543 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:25.834887 13626 log.cc:927] Time spent T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:27:25.816192 13373 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:27:25.835654 13239 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:25.762269 13450 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:25.791545 13454 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:25.776317 13545 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:25.764932 13479 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:25.793879 13322 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.794080 13608 consensus_queue.cc:1059] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:27:25.855963 13322 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:25.856951 13608 raft_consensus.cc:3055] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:25.857296 13608 raft_consensus.cc:740] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:25.857726 12984 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:25.858341 12984 raft_consensus.cc:2804] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:25.858094 13608 consensus_queue.cc:260] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:25.858732 12984 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:25.859160 12984 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:25.859294 13608 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:25.861593 13454 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:25.863216 13239 raft_consensus.cc:2804] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:25.863747 13239 raft_consensus.cc:697] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:25.864619 13239 consensus_queue.cc:237] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:25.851382  9885 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:25.875584  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:25.875425 10497 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:25.882364  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:25.885696  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:25.886324  9885 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:25.883241  9886 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 5.
I20260709 12:27:25.836958 13554 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:25.894032 10497 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:25.796703 13392 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
W20260709 12:27:25.892186 13491 consensus_meta.cc:287] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.738s	user 0.007s	sys 0.004s
I20260709 12:27:25.912859  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:25.846396 13634 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:25.916782  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:25.917639  9889 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 12: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:27:25.921231  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 135420us
W20260709 12:27:25.923817  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 140524us
I20260709 12:27:25.924607  9779 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:25.925524  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:25.820407 13632 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:25.933197  9779 leader_election.cc:400] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 9. Current term is 10.
I20260709 12:27:25.865974 13450 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:25.933985  9779 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:25.926324  9808 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:25.900375 13270 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:25.916656 13634 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:25.929497 13386 consensus_meta.cc:287] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.636s	user 0.009s	sys 0.002s
I20260709 12:27:25.846830 13633 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:25.951418  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 182982us
I20260709 12:27:25.960718 13544 raft_consensus.cc:3055] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:25.929131 13545 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.958565  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:25.957481 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:25.950234 12843 consensus_meta.cc:287] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.506s	user 0.006s	sys 0.004s
I20260709 12:27:25.936964 13554 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:25.966799 10533 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
W20260709 12:27:25.964069 13483 consensus_meta.cc:287] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.764s	user 0.011s	sys 0.000s
I20260709 12:27:25.945617 13636 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:25.969605  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:25.949486 13505 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:25.969697  9779 leader_election.cc:400] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 7. Current term is 8.
I20260709 12:27:25.972193 10529 raft_consensus.cc:1240] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:25.976992  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:26.004624  9958 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:26.005982  9958 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:25.963356 13544 raft_consensus.cc:740] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:26.008833  9806 raft_consensus.cc:2410] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:27:26.010089  9958 raft_consensus.cc:1240] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:25.968838 13454 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:25.949676 13634 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:25.979321  9957 raft_consensus.cc:1275] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:27:26.018725  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:26.010308 13639 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.026677 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:26.007406 13592 consensus_meta.cc:287] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.000s
I20260709 12:27:25.981642 13630 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.982492 13649 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.983155  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:25.983541 13569 log.cc:927] Time spent T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195: Append to log took a long time: real 1.377s	user 0.007s	sys 0.006s
I20260709 12:27:25.984004 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:25.986518  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:25.963752 13373 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.963999 13386 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:25.992355  9884 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:25.977715 12843 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:25.977437 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 83481.4us
I20260709 12:27:25.978933 13646 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:27:25.980721 13557 log.cc:927] Time spent T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 1.806s	user 0.000s	sys 0.014s
I20260709 12:27:26.028970  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:25.952322 13637 consensus_queue.cc:1059] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:27:26.003115 13505 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.039506  9808 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:26.006678 13554 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:26.042043  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:25.972891 13545 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:26.015817  9853 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:26.045269  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:26.014623 13582 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:26.148641  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 132929us
I20260709 12:27:26.153618 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:26.153878  9853 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:26.155045  9853 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:26.144323  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:26.146062  9884 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:26.159402 13623 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:26.159994 13623 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.153200 13200 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:26.162775 13623 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:26.163311 13554 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.043717 13649 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:26.150467 13491 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:26.167374 13491 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:26.168026 13649 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:26.168932 13596 log.cc:927] Time spent T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 12:27:26.169889 13643 log.cc:927] Time spent T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 12:27:26.170457 13376 consensus_meta.cc:287] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.647s	user 0.010s	sys 0.000s
I20260709 12:27:26.170964 13376 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.173610 13376 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:26.176343 12843 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:26.180311 13450 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:26.180447  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:26.181216  9888 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 7: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:26.181913  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:26.182428  9888 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:26.183769 13642 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:26.184471 13642 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:26.185609 13651 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:26.184480  9853 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:26.186139 13651 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.187846  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:26.188369 13455 consensus_meta.cc:287] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.804s	user 0.008s	sys 0.001s
I20260709 12:27:26.188795 13455 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:26.189201  9881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1433) took 2282 ms. Trace:
I20260709 12:27:26.189236 13200 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:26.190039  9881 rpcz_store.cc:276] 0709 12:27:23.906802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.910663 (+  3861us) service_pool.cc:224] Handling call
0709 12:27:23.910968 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:23.911165 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:23.911188 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:23.927606 (+ 16418us) log.cc:844] Serialized 26 byte log entry
0709 12:27:23.996411 (+ 68805us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:24.348197 (+351786us) log.cc:844] Serialized 14 byte log entry
0709 12:27:24.348514 (+   317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.348621 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:25.966742 (+1618121us) spinlock_profiling.cc:243] Waited 8.94 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:26.188877 (+222135us) raft_consensus.cc:1685] finished
0709 12:27:26.188987 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.189113 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":560728,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":120,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":8688,"spinlock_wait_cycles":20561664,"thread_start_us":391520,"threads_started":2,"wal-append.queue_time_us":105149}
I20260709 12:27:26.188647  9886 raft_consensus.cc:2410] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:27:26.193897  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:26.193045  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:26.188583 13651 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:26.230477  9957 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:26.231097 13544 consensus_queue.cc:260] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.232353 13544 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:26.063663 13646 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:26.233384 13646 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:26.235371 13546 raft_consensus.cc:3055] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:26.235739 13546 raft_consensus.cc:740] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:26.236567 13546 consensus_queue.cc:260] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.237576 13546 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:26.042680 13627 consensus_queue.cc:1059] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.179s
I20260709 12:27:26.232313  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:26.214498  9961 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 656) took 2154 ms (client timeout 1698 ms). Trace:
I20260709 12:27:26.213856  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:26.047010 13620 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:26.254050 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:26.218433 13386 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.219486 13633 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:26.220177 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:26.220433 13540 consensus_meta.cc:287] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.001s
I20260709 12:27:26.119884 13505 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:26.046669 13373 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.120625 13655 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.276760  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:26.227696 13545 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:26.182411 13479 consensus_queue.cc:1059] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:27:26.165992 13554 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:26.193048  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:26.281428  9881 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:26.169785 13491 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:26.236956  9808 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:26.240758  9886 raft_consensus.cc:2410] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:27:26.242547  9779 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:26.026722 13639 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.274037 10525 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:27:26.248770 13627 raft_consensus.cc:3055] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:26.286312  9808 raft_consensus.cc:1240] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
W20260709 12:27:26.241019  9961 rpcz_store.cc:269] 0709 12:27:24.060459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.061198 (+   739us) service_pool.cc:224] Handling call
0709 12:27:26.198496 (+2137298us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b54001dd154. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:26.214429 (+ 15933us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1550821760}
I20260709 12:27:26.264946  9928 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:26.031739 13454 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:26.265924  9884 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:26.239351 13632 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:26.267151 10531 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:27:26.039052 13592 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.276970 13362 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:27:26.283797  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:26.275292 13637 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:26.239673 13411 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.284976  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:26.244328  9888 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:27:26.249151  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:26.286209  9958 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:27:26.269037 13598 consensus_meta.cc:287] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.000s
I20260709 12:27:26.290443  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:26.312144  9813 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
W20260709 12:27:26.287241  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 44803us
I20260709 12:27:26.313179  9888 raft_consensus.cc:1240] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:27:26.313735  9779 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:26.041549 13630 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:26.278991 13563 consensus_meta.cc:287] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.650s	user 0.011s	sys 0.000s
I20260709 12:27:26.296074  9806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2152) took 1070 ms. Trace:
I20260709 12:27:26.268639 13450 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:26.300483 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:26.324879  9806 rpcz_store.cc:276] 0709 12:27:25.225634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.225781 (+   147us) service_pool.cc:224] Handling call
0709 12:27:26.295878 (+1070097us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b540033de54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:26.296021 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1797549312}
I20260709 12:27:26.328166 10531 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:26.329257 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:26.276636 13376 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.279789 13620 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.276513  9778 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:26.333355  9963 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 7: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
W20260709 12:27:26.333438  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 56998.3us
I20260709 12:27:26.277069 13386 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.310647 10529 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
W20260709 12:27:26.300199 13599 consensus_meta.cc:287] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.764s	user 0.003s	sys 0.007s
I20260709 12:27:26.319913  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:26.320258  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:26.321861  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:26.292412 13554 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:26.326894  9927 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:26.289585 13627 raft_consensus.cc:740] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:26.276360 13540 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:26.304658 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:26.303943 13545 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:26.394814  9778 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:26.486887  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 92146.3us
I20260709 12:27:26.285862 13655 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.489526 13486 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.489694 13648 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.221s
I20260709 12:27:26.282217 13647 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 12:27:26.493664 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:26.329929 10531 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:27:26.495123 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:26.332139 13481 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:26.386348 13411 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.493333 13621 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:27:26.476578  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 149733us
I20260709 12:27:26.478967  9813 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:26.397095 13633 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 12:27:26.445627  9885 raft_consensus.cc:2393] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:26.319088 13362 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.395215 13620 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.503932 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:26.387082 13321 consensus_queue.cc:1059] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
W20260709 12:27:26.508332  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 319274us
I20260709 12:27:26.509876  9928 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:26.320828 13637 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:26.488169 13651 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:26.438349 13483 consensus_queue.cc:1048] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 12:27:26.548730 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:26.518821  9960 raft_consensus.cc:1240] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6. Ops: []
W20260709 12:27:26.472404  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 152247us
I20260709 12:27:26.490082 13486 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:26.552042 13661 log.cc:927] Time spent T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:27:26.502544 13545 raft_consensus.cc:697] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:26.559181 13639 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:26.558908 13545 consensus_queue.cc:237] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.559674 13362 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:26.561457 13373 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:26.478312 13376 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:26.449002 13629 log.cc:927] Time spent T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.665s	user 0.004s	sys 0.000s
I20260709 12:27:26.323786 13598 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.502375 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:26.598453 10533 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
W20260709 12:27:26.449266 12984 consensus_meta.cc:287] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.584s	user 0.007s	sys 0.003s
I20260709 12:27:26.363806 13563 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.472195  9964 raft_consensus.cc:2393] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 6: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:26.548614 13651 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.478152 13450 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:26.505323 13655 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:26.549360 10532 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:26.519400 13649 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.518939 13660 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:26.591641  9810 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.085s	sys 0.127s
W20260709 12:27:26.626950  9810 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.085s	sys 0.128s
I20260709 12:27:26.598856 13239 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:27:26.627362  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 138585us
I20260709 12:27:26.593474 10531 raft_consensus.cc:1240] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:27:26.599977  9853 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:26.628458  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 64393.1us
I20260709 12:27:26.629235  9853 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:26.449918 13455 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:26.615216  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:26.620052 10533 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:26.477753 13599 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.609874 13636 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:26.630419  9889 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:26.618592 13651 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:26.635372  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:26.642180 10532 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:27:26.644446  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 92181.5us
I20260709 12:27:26.640332 13455 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:26.615413 12984 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:26.647229  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:26.648965  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:26.631417 13239 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:26.631806 13621 raft_consensus.cc:697] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:26.649101 13455 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.653481 13455 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:26.653729 13621 consensus_queue.cc:237] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:26.655293 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:26.656005 13239 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:26.653530 13657 log.cc:927] Time spent T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 12:27:26.641429 13479 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:26.661260  9815 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:27:26.663573 10526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 711) took 1432 ms. Trace:
W20260709 12:27:26.663908 13658 log.cc:927] Time spent T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260709 12:27:26.664601 13624 log.cc:927] Time spent T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:27:26.666972  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:26.629096 13649 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.644261 13632 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.646001 13454 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:26.670176 10526 rpcz_store.cc:276] 0709 12:27:25.231498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.231699 (+   201us) service_pool.cc:224] Handling call
0709 12:27:25.232146 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:25.265553 (+ 33407us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:27:25.284140 (+ 18587us) log.cc:844] Serialized 14 byte log entry
0709 12:27:25.531426 (+247286us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:25.533740 (+  2314us) log.cc:844] Serialized 26 byte log entry
0709 12:27:25.533863 (+   123us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:25.560579 (+ 26716us) log.cc:844] Serialized 14 byte log entry
0709 12:27:25.560834 (+   255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:25.561825 (+   991us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:26.181721 (+619896us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b180047d940. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f522 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:27:26.268410 (+ 86689us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:26.663345 (+394935us) raft_consensus.cc:1685] finished
0709 12:27:26.663369 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.663511 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":713,"prepare.queue_time_us":56111,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":4773,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":73750,"spinlock_wait_cycles":59311488,"thread_start_us":203451,"threads_started":1,"wal-append.queue_time_us":410491}
I20260709 12:27:26.668357 13598 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:26.673092  9881 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:26.645669 13592 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:26.564451 13627 consensus_queue.cc:260] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.681650  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:26.682399  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:26.683580  9889 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:26.684568 13620 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:26.685906 13637 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:26.685889  9881 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:27:26.645725 13642 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:27:26.688265 13362 consensus_queue.cc:1059] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:27:26.702636 13362 consensus_queue.cc:1243] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Peer b011791796d1457284b857d7d3422195 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:27:26.705209 13563 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:26.706485 13599 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:26.707060 13385 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:26.708760 12984 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:26.709659 13630 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:26.689298  9888 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:27:26.687654 13386 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:26.718525  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:26.719103  9812 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:27:26.680451 13632 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.722411 13544 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:26.722694 13450 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:26.722939 13544 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:26.723481 13376 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:26.745168 13505 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.746565 13544 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:26.710335 13649 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:26.785694  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 162586us
I20260709 12:27:26.757788 13651 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:26.760391 13239 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:26.751013 13386 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:26.828066  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:26.927601  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:26.887257  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 85032.5us
W20260709 12:27:26.967489  9854 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.111.68:37417 timed out after 1.856s (SENT) [suppressed 18 similar messages]
I20260709 12:27:26.981966  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:26.982827  9806 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:27.004621  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:26.887073 13649 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.887048 13642 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.938522 13630 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.929726 13544 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:27.078734 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:27.099654  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:27.100523  9813 raft_consensus.cc:2410] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 10 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:27:27.103293  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:27.113713  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:27.103298 10496 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:27.121284  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:27.121927  9813 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:27.056560 13660 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:27.142637  9814 raft_consensus.cc:1275] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:27:27.063675 13563 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:27.177779 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:27.178085 13563 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:27.177800 13634 consensus_meta.cc:287] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 1.135s	user 0.009s	sys 0.001s
I20260709 12:27:27.179636 13634 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:27.180532 13563 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:27.143941  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:27.144400  9886 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:27:27.143028  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:27.150871  9888 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:26.975625 13386 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:27.155562  9698 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d1e4bd6e7a424475b1d707bfa268d54e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f5208640a51f493e930ce4f64ceeed0b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:27.156019  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:27.156598  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:27.140513 13637 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.159345  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:27.164706  9813 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:27.095492 13670 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.095602 13642 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:27.095657 13376 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.167224 13239 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:27.103293 13630 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:27.168125 13554 consensus_meta.cc:287] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.681s	user 0.008s	sys 0.001s
I20260709 12:27:27.169471 13505 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:27.172325  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:27.172966  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2541) took 1203 ms. Trace:
W20260709 12:27:27.173137 13455 consensus_meta.cc:287] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.519s	user 0.000s	sys 0.006s
W20260709 12:27:27.142329 13646 consensus_meta.cc:287] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.908s	user 0.012s	sys 0.000s
I20260709 12:27:27.174662 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:27.176046 13651 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:27.119505 13544 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:27.111430 13536 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:27.319001 10530 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 893) took 2083 ms (client timeout 1856 ms). Trace:
W20260709 12:27:27.361063  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 214884us
I20260709 12:27:27.198773 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:27.182221  9853 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:27.364399  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 182275us
I20260709 12:27:27.181841  9955 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:27.103657 13411 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:27.355309  9887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2331) took 2797 ms. Trace:
W20260709 12:27:27.361896 10530 rpcz_store.cc:269] 0709 12:27:25.235338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.235487 (+   149us) service_pool.cc:224] Handling call
0709 12:27:27.318819 (+2083332us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540031b0d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:27.318931 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347198208}
I20260709 12:27:27.112229 13598 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:27.374683 13670 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:27.374856 13598 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:27.376840 13670 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:27.085278 13649 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:27.378408  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:27.379207 13649 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:27.361207 13644 log.cc:927] Time spent T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 1.425s	user 0.003s	sys 0.013s
I20260709 12:27:27.114743 13674 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.364801  9886 pending_rounds.cc:85] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 9
I20260709 12:27:27.366214  9958 raft_consensus.cc:2393] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:27.372184 13484 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:27.369083 13634 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:27.369240 13637 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:27.281638 13676 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.373804 13544 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:27.263846 13563 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.368919  9887 rpcz_store.cc:276] 0709 12:27:24.558188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.793321 (+235133us) service_pool.cc:224] Handling call
0709 12:27:24.793997 (+   676us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:24.800023 (+  6026us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:24.818741 (+ 18718us) log.cc:844] Serialized 14 byte log entry
0709 12:27:25.175200 (+356459us) spinlock_profiling.cc:243] Waited 908 us on lock 0x7b180049b9a0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b3a9c0a 00007f2f94ae9219 00007f2f923f058f 00007f2f8b42f571 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd
0709 12:27:25.185857 (+ 10657us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:25.186363 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 12:27:25.186513 (+   150us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:25.186548 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:27.354990 (+2168442us) spinlock_profiling.cc:243] Waited 5.58 ms on lock 0x7b5400328a54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:27.355048 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:27.355090 (+    42us) raft_consensus.cc:1685] finished
0709 12:27:27.355101 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:27.355249 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129069,"prepare.queue_time_us":20656,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":31,"raft.queue_time_us":174313,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":36561,"spinlock_wait_cycles":14915200,"thread_start_us":202245,"threads_started":1,"wal-append.queue_time_us":231987,"wal-append.run_cpu_time_us":2254,"wal-append.run_wall_time_us":1133059}
I20260709 12:27:27.377346 13598 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:27:27.362010  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:27.215591 13621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.018s	sys 0.026s
I20260709 12:27:27.152705 13650 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.379596  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:27.432880  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:27.433403  9881 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:27.380240  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:27.380038 13646 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:27.365938 13536 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:27.199796  9779 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:27.468197  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 268477us
I20260709 12:27:27.469152  9779 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:27.333376 13546 consensus_meta.cc:287] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 1.095s	user 0.006s	sys 0.006s
I20260709 12:27:27.383870 10527 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
W20260709 12:27:27.362426  9698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 206901us
I20260709 12:27:27.362819  9810 rpcz_store.cc:276] 0709 12:27:25.969471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.969705 (+   234us) service_pool.cc:224] Handling call
0709 12:27:25.970058 (+   353us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:26.627303 (+657245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:26.627340 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:26.636470 (+  9130us) log.cc:844] Serialized 52 byte log entry
0709 12:27:26.761764 (+125294us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:26.761800 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.761871 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:27.172723 (+410852us) raft_consensus.cc:1685] finished
0709 12:27:27.172744 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:27.172876 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20279,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":14571,"thread_start_us":759648,"threads_started":2,"wal-append.queue_time_us":510995}
W20260709 12:27:27.384433  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:27.385265  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:27.150547 13373 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:27.368919 13376 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:27.395637  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:27.309607 13403 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:27.361232 13590 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:27.600003 10531 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:27.368736 13554 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:27.431836  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:27.434074  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:27.432086 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 291207us
I20260709 12:27:27.605046  9888 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:27.606173  9887 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:27:27.587425 13670 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:27.435454  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:27.433580  9809 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:27.366237 13455 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:27.436431  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:27.374056  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:27.612026  9962 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
W20260709 12:27:27.516425 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:27.612962  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:27.524044 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:27.562059  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:27.563199  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 94169.8us
W20260709 12:27:27.433454 13621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.020s	sys 0.031s
I20260709 12:27:27.386896  9886 pending_rounds.cc:107] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:27:27.616775  9886 raft_consensus.cc:2889] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:27.617347  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:27.586123 13450 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.589027  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:27.616122 13651 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:27.417420 13649 consensus_queue.cc:1048] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.144s
I20260709 12:27:27.602367  9815 raft_consensus.cc:1240] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:27.603857  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:27.418785 13674 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:27.607506  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:27.609254  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:27.627573  9887 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:27.417804 13484 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:27.561246 13544 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:27.614675  9884 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:27.615588  9808 raft_consensus.cc:2393] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 9: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:27.586933 13373 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.622103  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:27.641040  9881 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:27.644208  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:27.623026  9809 raft_consensus.cc:2393] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:27.428282 13676 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:27.431350 13563 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:27.623955  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:27.601024 13386 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:27.659904  9813 raft_consensus.cc:2410] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:27:27.629243 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:27.631105  9959 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.004s	sys 0.018s
W20260709 12:27:27.660782  9959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.004s	sys 0.018s
I20260709 12:27:27.662030 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:27.662113  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 312679us
I20260709 12:27:27.657513  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:27.631424  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:27.631855  9812 raft_consensus.cc:1275] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:27.634975  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:27.666980  9885 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:27.636356  9810 raft_consensus.cc:2410] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:27:27.658819  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:27.667919  9881 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:27.628623  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:27.669157  9807 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:27:27.667150  9886 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:27.445322 13650 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:27.691363  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:27.692042  9808 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:27.608781 13590 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:27.676273 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:27.716532 10524 raft_consensus.cc:2410] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:27:27.677817 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:27.655352 13373 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:27.695222  9814 raft_consensus.cc:2393] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 8: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:27.701687  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:27.720613  9962 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
W20260709 12:27:27.728571  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 362796us
I20260709 12:27:27.730551  9853 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:27.726907  9885 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:27.627233 13651 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:27.751583  9958 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:27.753574  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 138775us
I20260709 12:27:27.694690 13544 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.629220 13450 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:27.723733 13598 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:27.762413 13684 log.cc:927] Time spent T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:27:27.762316 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:27.674734  9884 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
W20260709 12:27:27.972569 10525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 894) took 2715 ms (client timeout 1686 ms). Trace:
I20260709 12:27:27.976908  9779 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:27.977679 10525 rpcz_store.cc:269] 0709 12:27:25.257337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.264034 (+  6697us) service_pool.cc:224] Handling call
0709 12:27:27.972306 (+2708272us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b54006702d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:27.972444 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2025720192}
I20260709 12:27:27.820056  9888 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:27.856405  9958 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:27.808924 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:27.791926  9887 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:27.987977 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:27.974896 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 345726us
I20260709 12:27:27.992756 10524 raft_consensus.cc:2368] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7.
I20260709 12:27:27.975342  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:27.994803 10496 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:27.996662 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:27.997418 10525 raft_consensus.cc:2376] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13. Re-sending same reply.
I20260709 12:27:28.002149  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:28.003144  9809 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:28.003417  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:28.004065  9806 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:28.006860  9806 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 9 LEADER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:28.008208  9806 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:28.010679  9806 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:27:28.019585  9881 raft_consensus.cc:1275] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:27:28.025539 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:28.029197  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:28.027242 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:27:27.796854 13682 log.cc:927] Time spent T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.414s	user 0.001s	sys 0.000s
I20260709 12:27:27.862161 13685 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.990801 13630 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:28.019881 13689 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:27:28.039038  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:28.039506 13689 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.040062 13689 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.040593 13632 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:27.794984 13670 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:27.767305 13676 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:27.971040 13455 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:27.935571 13599 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:27.979135 13637 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:28.034919 13563 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:28.035025 13685 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.036389 13651 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:28.037434 13450 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:27.990675 13642 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:28.039604  9957 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:28.030287  9808 raft_consensus.cc:2393] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 6: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:28.029922  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:28.085084  9962 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:28.043509  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:28.043265  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:28.043834  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:27.935905 13688 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:28.004817 13322 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:28.087747  9881 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:28.087982  9928 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:28.019258 13646 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:28.019119 13392 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:28.070420  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 2160) took 1378 ms. Trace:
I20260709 12:27:28.090584  9815 rpcz_store.cc:276] 0709 12:27:26.692199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.692311 (+   112us) service_pool.cc:224] Handling call
0709 12:27:26.692551 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:27.626163 (+933612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:28.070071 (+443908us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b54000307d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:28.070339 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077980928}
I20260709 12:27:28.024726 13540 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:27.993309 13590 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:28.031684 13536 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:28.081914 13637 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:27.768532 13674 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:27.785567 13544 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:28.088629  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 358164us
I20260709 12:27:28.092762  9811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 2157) took 1444 ms. Trace:
I20260709 12:27:28.042198 13689 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:28.111140  9853 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:28.093043 13392 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:28.092669 13484 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:28.094461  9808 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:28.094664  9815 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:28.093495 13691 raft_consensus.cc:2804] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:28.105177  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:28.116750  9853 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:28.119642  9962 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:28.087635 13650 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:28.068939 13670 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.068994 13599 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:28.110805  9811 rpcz_store.cc:276] 0709 12:27:26.648327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.648464 (+   137us) service_pool.cc:224] Handling call
0709 12:27:26.675167 (+ 26703us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:26.675545 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:26.675596 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:26.683988 (+  8392us) log.cc:844] Serialized 26 byte log entry
0709 12:27:27.115288 (+431300us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:27.115341 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:27.115413 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:28.092549 (+977136us) raft_consensus.cc:1685] finished
0709 12:27:28.092571 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:28.092707 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4295,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4042,"thread_start_us":424312,"threads_started":1,"wal-append.queue_time_us":646409}
I20260709 12:27:28.094421 13651 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:28.114712  9957 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:28.094029  9928 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:28.114985  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:28.087388  9884 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 10: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:27:28.116888  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 118159us
I20260709 12:27:28.140548  9888 raft_consensus.cc:2393] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 11: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:28.140952  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:28.142931  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:28.115875 13392 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:28.115612 13689 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:28.141381  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 47434.4us
I20260709 12:27:28.148833  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:28.148904  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:28.149032  9882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 821) took 2381 ms. Trace:
I20260709 12:27:28.149505  9957 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:28.119215 13691 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:28.150931  9928 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:28.156261  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:28.157631  9928 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:28.126317  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 149472us
I20260709 12:27:28.155009  9811 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:28.130896 13484 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:28.149709  9882 rpcz_store.cc:276] 0709 12:27:25.768019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.768125 (+   106us) service_pool.cc:224] Handling call
0709 12:27:25.774589 (+  6464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:25.774790 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:27:25.777295 (+  2505us) log.cc:844] Serialized 14 byte log entry
0709 12:27:27.436208 (+1658913us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b180049a4a0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b411e07 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f8e0b620b 00007f2f8e0bbd23 00007f2f8e0bc23a 00007f2f8e526a2a
0709 12:27:28.148467 (+712259us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:28.148546 (+    79us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:28.148649 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:28.148741 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:28.148926 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104071,"prepare.queue_time_us":1303,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":215572,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3996,"spinlock_wait_cycles":9040768,"thread_start_us":607790,"threads_started":2,"wal-append.queue_time_us":2315185}
I20260709 12:27:28.165176  9808 raft_consensus.cc:1275] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:28.172528  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 2165) took 1004 ms. Trace:
I20260709 12:27:28.166311  9928 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:28.128736 13642 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:27:28.167347 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 173429us
I20260709 12:27:28.169090  9811 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:27:28.172950  9808 rpcz_store.cc:276] 0709 12:27:27.167735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.084791 (+917056us) service_pool.cc:224] Handling call
0709 12:27:28.094343 (+  9552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:28.172286 (+ 77943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:28.172462 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13056}
I20260709 12:27:28.175041  9962 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:28.179267  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:28.140856 13322 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:28.184525  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:28.187419  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:28.154419 13650 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:28.142113 13546 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:28.154438 13200 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:28.160566 13651 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:28.170445 13484 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:28.194301  9779 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:28.196218  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:28.160374 13691 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:28.198457  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:28.177501 13630 raft_consensus.cc:2804] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:28.193674  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:28.199935  9854 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:28.182499 13649 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:28.181778 13681 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:28.247279  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 47408.9us
I20260709 12:27:28.248296  9854 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:28.208218  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:28.208573  9957 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:28.206375 13694 log.cc:927] Time spent T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:27:28.199360 13688 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:27:28.209836 13403 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:28.211797 13599 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:28.215071  9960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 2126) took 2204 ms. Trace:
I20260709 12:27:28.215909 13632 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:28.218072  9961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1555) took 1136 ms. Trace:
I20260709 12:27:28.199363 13546 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.239421 13630 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:28.201721 13450 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 12:27:28.223425 13692 log.cc:927] Time spent T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:27:28.194996 13322 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:28.224085  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:28.293534  9810 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:27:28.262215 13701 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:28.225121  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:28.225227  9779 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:28.225845  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:28.295630  9808 raft_consensus.cc:2393] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 10: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:28.296911  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:28.297621  9808 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:28.226045 13704 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:28.226480  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:28.310585  9811 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:28.192104 13650 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:28.267145 13636 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:28.312363  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 87287.6us
I20260709 12:27:28.278750 13706 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.281032 13386 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:27:28.230554  9963 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55952 (request call id 1543) took 2261 ms (client timeout 1619 ms). Trace:
I20260709 12:27:28.246703 13697 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:27:28.232415  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:28.281325 13703 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:28.234813  9887 raft_consensus.cc:1275] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:27:28.253218 13681 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.235821 13685 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:28.240453  9888 raft_consensus.cc:2393] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 5: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:28.241514 10497 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:28.249660  9854 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:28.285542 13630 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:28.203372 13484 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:28.246659 13698 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:28.327497 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 86072.5us
I20260709 12:27:28.325830 10531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 715) took 2056 ms. Trace:
I20260709 12:27:28.335058 10531 rpcz_store.cc:276] 0709 12:27:26.269853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.634862 (+365009us) service_pool.cc:224] Handling call
0709 12:27:26.635130 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:27.600605 (+965475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:28.325618 (+725013us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b54002ee0d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:28.325776 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2204005120}
I20260709 12:27:28.264252  9806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2563) took 1107 ms. Trace:
I20260709 12:27:28.186615 13642 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.267397  9960 rpcz_store.cc:276] 0709 12:27:26.011099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.143745 (+132646us) service_pool.cc:224] Handling call
0709 12:27:26.162598 (+ 18853us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:26.549375 (+386777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:28.214736 (+1665361us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b5400412b54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:28.214976 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818595712}
I20260709 12:27:28.275480  9961 rpcz_store.cc:276] 0709 12:27:27.081383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:27.082460 (+  1077us) service_pool.cc:224] Handling call
0709 12:27:27.123388 (+ 40928us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:27.368515 (+245127us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:27.861753 (+493238us) log.cc:844] Serialized 14 byte log entry
0709 12:27:28.115349 (+253596us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:28.118950 (+  3601us) log.cc:844] Serialized 52 byte log entry
0709 12:27:28.119094 (+   144us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:28.119131 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:28.119193 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:28.217860 (+ 98667us) raft_consensus.cc:1685] finished
0709 12:27:28.217878 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:28.218016 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":197982,"prepare.queue_time_us":350887,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":242217,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":8971,"thread_start_us":702438,"threads_started":2,"wal-append.queue_time_us":344796}
I20260709 12:27:28.199189 13689 consensus_queue.cc:1059] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:27:28.252573 13590 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:28.248343 13536 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:28.299665  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:28.294543  9807 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:28.346757  9807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 628) took 1248 ms. Trace:
I20260709 12:27:28.228379  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:28.313398  9779 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:28.229585 13670 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:28.313656 13650 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:28.282481 13632 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.331319  9962 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
W20260709 12:27:28.318431  9963 rpcz_store.cc:269] 0709 12:27:25.969246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.969362 (+   116us) service_pool.cc:224] Handling call
0709 12:27:28.230348 (+2260986us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54001de554. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:28.230480 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":773866368}
I20260709 12:27:28.320035  9812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 2162) took 1582 ms. Trace:
I20260709 12:27:28.325271  9955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 2127) took 2313 ms. Trace:
W20260709 12:27:28.327824  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 78232.5us
I20260709 12:27:28.273932  9957 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:28.336282  9884 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:28.336360  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 2170) took 1167 ms. Trace:
I20260709 12:27:28.329126  9810 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:28.354718  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 629) took 1255 ms. Trace:
I20260709 12:27:28.355160  9810 rpcz_store.cc:276] 0709 12:27:27.098992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.223845 (+1124853us) service_pool.cc:224] Handling call
0709 12:27:28.354660 (+130815us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:28.356952 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:28.357468 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:28.358346 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:28.358587 10497 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:28.330112  9928 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:28.336701  9811 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:27:28.324173 13546 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:28.359467 10497 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:28.341904  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 60919.6us
W20260709 12:27:28.314109 13373 consensus_meta.cc:287] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.000s
I20260709 12:27:28.347925  9881 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:28.348876  9808 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:28.361783  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:28.314416 13636 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:28.357831  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:28.363857  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:28.364214  9960 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:28.341820 13685 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:28.328975 13635 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:28.351300  9812 rpcz_store.cc:276] 0709 12:27:26.756900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:27.111363 (+354463us) service_pool.cc:224] Handling call
0709 12:27:27.159023 (+ 47660us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:27.666695 (+507672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:28.319816 (+653121us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b540036b854. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:28.319976 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1065373440}
I20260709 12:27:28.352178  9955 rpcz_store.cc:276] 0709 12:27:26.011351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.150749 (+139398us) service_pool.cc:224] Handling call
0709 12:27:26.166655 (+ 15906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:27.368338 (+1201683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:28.325069 (+956731us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001d3b54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:28.325216 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2334218112}
I20260709 12:27:28.347170  9807 rpcz_store.cc:276] 0709 12:27:27.098736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.224872 (+1126136us) service_pool.cc:224] Handling call
0709 12:27:28.346682 (+121810us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:28.367089 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:28.361259  9779 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:28.369634  9928 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
W20260709 12:27:28.379134 13686 log.cc:927] Time spent T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.400s	user 0.000s	sys 0.002s
W20260709 12:27:28.379485 13659 log.cc:927] Time spent T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 2.054s	user 0.011s	sys 0.015s
I20260709 12:27:28.367857 13373 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:28.380434 10529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 902) took 2406 ms (client timeout 1997 ms). Trace:
W20260709 12:27:28.380826 10529 rpcz_store.cc:269] 0709 12:27:25.974191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.051106 (+ 76915us) service_pool.cc:224] Handling call
0709 12:27:28.380275 (+2329169us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54000c9254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:28.380372 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359509248}
I20260709 12:27:28.382578 10525 raft_consensus.cc:2393] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 10: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:28.383808  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1553) took 1599 ms. Trace:
I20260709 12:27:28.383854  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:28.384547  9963 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:28.384297  9959 rpcz_store.cc:276] 0709 12:27:26.783916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.926970 (+143054us) service_pool.cc:224] Handling call
0709 12:27:27.025485 (+ 98515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:27.025996 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:27.026043 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:27.026675 (+   632us) log.cc:844] Serialized 26 byte log entry
0709 12:27:27.661244 (+634569us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:27.661299 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:27.661385 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:28.378637 (+717252us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:28.383513 (+  4876us) raft_consensus.cc:1685] finished
0709 12:27:28.383536 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:28.383751 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17030,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":93171968,"thread_start_us":578467,"threads_started":1,"wal-append.queue_time_us":785752}
I20260709 12:27:28.385624  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:28.385869 13544 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:28.386063 13638 raft_consensus.cc:3055] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:28.386490 13638 raft_consensus.cc:740] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:28.387064  9959 raft_consensus.cc:1275] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:28.387662  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1561) took 1226 ms. Trace:
I20260709 12:27:28.387346 13638 consensus_queue.cc:260] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.387991  9959 rpcz_store.cc:276] 0709 12:27:27.160810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.385985 (+1225175us) service_pool.cc:224] Handling call
0709 12:27:28.386267 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:28.387428 (+  1161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:28.387607 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:28.388609 13638 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:28.390786 10497 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:28.391613 10497 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:28.393383  9853 leader_election.cc:336] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 1.686s (SENT)
I20260709 12:27:28.394222  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:28.394714 10527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 716) took 1220 ms. Trace:
I20260709 12:27:28.394846  9887 raft_consensus.cc:2376] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8. Re-sending same reply.
I20260709 12:27:28.395066 10527 rpcz_store.cc:276] 0709 12:27:27.174199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:27.174369 (+   170us) service_pool.cc:224] Handling call
0709 12:27:28.394521 (+1220152us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b54005c35d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:28.394659 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52984704}
I20260709 12:27:26.221834  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:28.396121  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:28.390717 13695 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:27:28.370260  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:28.405460  9957 raft_consensus.cc:2410] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 12 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:27:28.315958 13620 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:28.406607 13620 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.407265 13711 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:28.407766 13711 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:28.408123 13711 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:28.390769  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2166) took 1222 ms. Trace:
I20260709 12:27:28.326957 13681 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:28.412985  9957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 676) took 1023 ms. Trace:
I20260709 12:27:28.315042 13554 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:28.353880 13536 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.375434 10526 raft_consensus.cc:2410] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 12 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:27:28.372256  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:28.315121 13706 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.386214  9963 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:28.437456  9959 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:28.425275  9853 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:28.431233  9960 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:28.418735  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:28.438253  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:28.408821  9814 rpcz_store.cc:276] 0709 12:27:27.168034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:27.378147 (+210113us) service_pool.cc:224] Handling call
0709 12:27:28.390510 (+1012363us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54002d6754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:28.390690 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645650304}
I20260709 12:27:28.442006  9810 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:28.441035  9808 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:28.440722  9957 rpcz_store.cc:276] 0709 12:27:27.389896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.406175 (+1016279us) service_pool.cc:224] Handling call
0709 12:27:28.412378 (+  6203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:28.412589 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:28.412626 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:28.412681 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:28.412726 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:28.412795 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:28.412919 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:28.443558  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 82370.9us
I20260709 12:27:28.444609  9807 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:27:28.382061 13373 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:28.447698  9884 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:28.444275  9779 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:28.449836  9810 raft_consensus.cc:1240] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:27:28.369138 13450 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:28.315428 13386 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.454461  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:28.459930  9955 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:27:28.375890 13697 raft_consensus.cc:2804] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:28.453822  9812 raft_consensus.cc:1240] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:28.363051 13670 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:28.370864 13688 raft_consensus.cc:3055] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:28.345520 13403 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 12:27:28.436663 13554 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:28.457371  9957 raft_consensus.cc:1240] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:27:28.470610  9957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 677) took 1080 ms. Trace:
I20260709 12:27:28.471441 10496 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:28.470969  9957 rpcz_store.cc:276] 0709 12:27:27.390227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.448889 (+1058662us) service_pool.cc:224] Handling call
0709 12:27:28.457171 (+  8282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:28.470372 (+ 13201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:28.470558 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:28.452716  9779 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:28.328598 13691 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.322870 13703 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:28.413905 13546 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:28.439209 13699 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:28.438306 13599 raft_consensus.cc:2804] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:28.467787  9888 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:27:28.344252 13698 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:28.475858  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:28.439059 13635 raft_consensus.cc:697] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 13 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:28.469645  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:28.449750 13505 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:28.454357 13544 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:28.478945 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:28.459296 13656 raft_consensus.cc:3055] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:28.458462 13647 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:28.507179  9957 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:28.462968 13590 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:28.467741 13697 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:28.448802 13649 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.213s
I20260709 12:27:28.469732 13688 raft_consensus.cc:740] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:28.462671 13200 consensus_queue.cc:1059] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.299s
I20260709 12:27:28.484400 13454 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:28.656006 13546 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:28.466068 13496 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.308s
I20260709 12:27:28.653631 13373 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:28.753037 13599 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:28.666908 13588 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:28.657239 13553 consensus_queue.cc:1048] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.183s
W20260709 12:27:28.833056  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 391609us
I20260709 12:27:28.666188 13704 consensus_queue.cc:1048] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.178s
I20260709 12:27:28.477705 13670 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.780040 13544 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:28.877518 13544 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:28.877665  9814 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:28.878818 13670 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:28.779453 13656 raft_consensus.cc:740] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:28.879940 13656 consensus_queue.cc:260] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:28.881281 13656 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:28.786855 13647 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:28.882583 13647 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:28.856456 13588 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:28.886721 13588 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:28.890151  9890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2340) took 3114 ms. Trace:
I20260709 12:27:28.890535  9890 rpcz_store.cc:276] 0709 12:27:25.775938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.308831 (+532893us) service_pool.cc:224] Handling call
0709 12:27:26.334568 (+ 25737us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:26.387413 (+ 52845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:26.387445 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:28.159940 (+1772495us) spinlock_profiling.cc:243] Waited 57.7 ms on lock 0x7b2c0005c2d8. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8ce15a11 00007f2f8ce25372 00007f2f8e557a01 00007f2f8e51c43a 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2
0709 12:27:28.160317 (+   377us) log.cc:844] Serialized 26 byte log entry
0709 12:27:28.361966 (+201649us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:28.362004 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:28.362068 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:28.889849 (+527781us) raft_consensus.cc:1685] finished
0709 12:27:28.889869 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:28.890091 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":461,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5165,"spinlock_wait_cycles":132733312,"thread_start_us":159744,"threads_started":1,"wal-append.queue_time_us":643237}
I20260709 12:27:28.891891 13691 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:28.892494  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:28.893728 13642 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:28.893764  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:28.894935  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:28.894506 13635 consensus_queue.cc:237] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.895464  9890 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:28.896216  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:28.897096  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:28.897560  9890 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:27:28.899186 13486 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:28.843807 13546 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:28.857204 13373 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.903239 13607 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:28.903650 13607 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:28.903976 13607 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:28.904961 13685 consensus_meta.cc:287] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.518s	user 0.004s	sys 0.002s
I20260709 12:27:28.905395 13685 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:28.871934 13403 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.907568 13703 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:28.898214 13688 consensus_queue.cc:260] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.490159 13554 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:28.832415 13646 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:28.465926 13689 consensus_queue.cc:1048] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.314s
I20260709 12:27:28.856165 13599 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:28.923264 13536 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:28.923422 13546 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.924446 13632 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:28.925554 13688 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:28.927711 13392 consensus_meta.cc:287] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.758s	user 0.010s	sys 0.002s
I20260709 12:27:28.928267 13392 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.929944 10532 raft_consensus.cc:2393] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 6: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:28.899428 13386 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:28.873813 13620 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:28.874177 13709 log.cc:927] Time spent T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.440s	user 0.001s	sys 0.000s
I20260709 12:27:28.874462 13715 consensus_queue.cc:1059] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:27:28.931445 13646 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.876456 13698 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:28.933658 13698 raft_consensus.cc:3055] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:28.933993 13698 raft_consensus.cc:740] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:28.934939  9778 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:28.934746 13698 consensus_queue.cc:260] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:28.906309 13322 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:28.935869 13674 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.936050  9778 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:28.936352 13674 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.939049 13450 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:28.907002 13403 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.941591 13403 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:28.796679 13455 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.925956 13706 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:28.902101 13373 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:28.942245 13455 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.833114 13697 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:28.335933  9806 rpcz_store.cc:276] 0709 12:27:27.157058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.031072 (+874014us) service_pool.cc:224] Handling call
0709 12:27:28.031337 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:28.031520 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:28.130095 (+ 98575us) log.cc:844] Serialized 14 byte log entry
0709 12:27:28.263989 (+133894us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:28.264028 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:28.264059 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:28.264106 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:28.264208 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155508,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":3491,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":6992,"thread_start_us":223828,"threads_started":2,"wal-append.queue_time_us":207448}
I20260709 12:27:28.871634 13651 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:27:28.946354 13484 consensus_meta.cc:287] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.618s	user 0.006s	sys 0.003s
I20260709 12:27:28.946816 13651 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:28.948770 13651 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:28.916203 13676 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.949579 13676 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:28.951567 13676 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:28.898237  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:28.852370 13454 raft_consensus.cc:697] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:28.936524 13392 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:28.857708  9881 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:28.947031 13484 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:28.981463 13630 consensus_meta.cc:287] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.654s	user 0.008s	sys 0.000s
W20260709 12:27:28.986696  9855 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.003s	sys 0.009s
W20260709 12:27:28.987068  9855 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.003s	sys 0.009s
W20260709 12:27:28.982852 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 503955us
I20260709 12:27:28.983114  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:28.976954  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:28.952498 13450 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:28.992383  9890 raft_consensus.cc:1275] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:28.997058  9885 raft_consensus.cc:1240] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 8. Current term is 9. Ops: []
W20260709 12:27:29.024981 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:29.027627 10525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 915) took 1019 ms. Trace:
I20260709 12:27:29.028141 10525 rpcz_store.cc:276] 0709 12:27:28.008701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.025293 (+ 16592us) service_pool.cc:224] Handling call
0709 12:27:29.027438 (+1002145us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b540031b0d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:29.027565 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":819345792}
I20260709 12:27:29.031204 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:29.031412 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:29.033378 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:29.034142 10524 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:29.036293 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:29.036949 10524 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:29.031829 10526 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:27:29.047477 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:29.049921 10532 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:29.051091 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:28.991731 13646 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:29.059278 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:29.060279 10525 raft_consensus.cc:2393] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 11: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:29.014901 13651 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.998236 13674 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:29.066975 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:29.074388 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:29.074971 10527 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:28.988847 13630 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:29.068693 13546 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:29.096753 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:29.097553 10527 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:29.086045 13699 raft_consensus.cc:697] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:29.073738 13455 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:29.095355  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:29.069115 13651 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:29.104700  9854 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.003s	sys 0.013s
W20260709 12:27:29.103641  9813 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2173) took 1933 ms (client timeout 1686 ms). Trace:
W20260709 12:27:29.114425 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 123899us
W20260709 12:27:29.118681  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 255005us
I20260709 12:27:29.086951 13505 raft_consensus.cc:697] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:29.101101 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:29.118911  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 675) took 1729 ms. Trace:
W20260709 12:27:29.120586 10531 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.008s	sys 0.013s
W20260709 12:27:29.122151  9853 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.019s	sys 0.002s
W20260709 12:27:29.122742  9813 rpcz_store.cc:269] 0709 12:27:27.169761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:27.379983 (+210222us) service_pool.cc:224] Handling call
0709 12:27:29.103443 (+1723460us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b540033de54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:29.103570 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518182272}
W20260709 12:27:29.130510 10531 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.008s	sys 0.013s
I20260709 12:27:29.183317  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 842) took 2030 ms. Trace:
I20260709 12:27:29.181619  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:29.184974  9888 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:29.180996 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:29.183736  9853 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.022s	sys 0.009s
I20260709 12:27:29.177762 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:29.180560 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:29.188535 10530 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:29.189867 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:29.190768 10530 raft_consensus.cc:2368] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6.
I20260709 12:27:29.184625  9886 rpcz_store.cc:276] 0709 12:27:27.153468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:27.670333 (+516865us) service_pool.cc:224] Handling call
0709 12:27:27.670667 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:27.724593 (+ 53926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:27.724650 (+    57us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:27.724715 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:27.724765 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:29.183018 (+1458253us) spinlock_profiling.cc:243] Waited 53.7 ms on lock 0x7b540043b2d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:29.183083 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:29.183246 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123441408}
I20260709 12:27:29.191524  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 2358) took 1078 ms. Trace:
I20260709 12:27:29.102218 13540 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:27:29.192462  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 737851us
W20260709 12:27:29.123428  9854 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.003s	sys 0.013s
I20260709 12:27:29.130359  9959 rpcz_store.cc:276] 0709 12:27:27.389623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.388733 (+999110us) service_pool.cc:224] Handling call
0709 12:27:28.437160 (+ 48427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:28.437790 (+   630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:29.118652 (+680862us) spinlock_profiling.cc:243] Waited 48.1 ms on lock 0x7b54001dd150. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:29.118832 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110712064}
W20260709 12:27:29.193724  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 751911us
I20260709 12:27:28.354566  9815 rpcz_store.cc:276] 0709 12:27:27.169020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.116950 (+947930us) service_pool.cc:224] Handling call
0709 12:27:28.117349 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:28.117583 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:27:28.268301 (+150718us) log.cc:844] Serialized 14 byte log entry
0709 12:27:28.336030 (+ 67729us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:28.336090 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:28.336134 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:28.336198 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:28.336305 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":94454,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":443,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":5531,"thread_start_us":197281,"threads_started":2}
I20260709 12:27:29.089507 13454 consensus_queue.cc:237] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:29.221005 13711 consensus_meta.cc:287] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.812s	user 0.013s	sys 0.000s
I20260709 12:27:29.704260 13630 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:29.210929  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:29.716162  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:29.716008 13711 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:29.717264  9883 raft_consensus.cc:2393] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:29.717712  9957 raft_consensus.cc:1240] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:29.201052 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:29.585986 13734 log.cc:927] Time spent T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:27:29.718712 10530 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:29.719707  9882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 852) took 1294 ms. Trace:
W20260709 12:27:29.375388 13636 consensus_meta.cc:287] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.963s	user 0.010s	sys 0.000s
I20260709 12:27:29.720484 13636 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:29.720165  9882 rpcz_store.cc:276] 0709 12:27:28.425221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.425358 (+   137us) service_pool.cc:224] Handling call
0709 12:27:28.450389 (+ 25031us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:28.835846 (+385457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:28.835877 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:28.836356 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 12:27:29.099932 (+263576us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:29.099980 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:29.100057 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:29.719504 (+619447us) raft_consensus.cc:1685] finished
0709 12:27:29.719528 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:29.719656 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10324,"raft.queue_time_us":443666,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":79,"thread_start_us":623926,"threads_started":2,"wal-append.queue_time_us":489891}
W20260709 12:27:29.369946 13650 consensus_meta.cc:287] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.999s	user 0.007s	sys 0.000s
I20260709 12:27:29.282933  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:29.663098 13544 consensus_meta.cc:287] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.785s	user 0.008s	sys 0.005s
W20260709 12:27:29.692354 13554 consensus_meta.cc:287] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.774s	user 0.009s	sys 0.000s
I20260709 12:27:29.270201 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:29.723150 13650 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:29.294713 13590 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:29.370893 13505 consensus_queue.cc:237] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:29.325802 13607 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:29.813964 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:29.814601 13607 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
W20260709 12:27:29.341271 13718 log.cc:927] Time spent T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 12:27:29.815243 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:29.816352 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:29.817210  9964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1556) took 2734 ms. Trace:
I20260709 12:27:29.818456 10525 raft_consensus.cc:1240] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:29.817564  9964 rpcz_store.cc:276] 0709 12:27:27.082887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:27.083003 (+   116us) service_pool.cc:224] Handling call
0709 12:27:27.121993 (+ 38990us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:27.227006 (+105013us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:27.602760 (+375754us) log.cc:844] Serialized 14 byte log entry
0709 12:27:28.406300 (+803540us) spinlock_profiling.cc:243] Waited 892 us on lock 0x7b1800116080. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b411e07 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f8e0b620b 00007f2f8e0bbd23 00007f2f8e0bc23a 00007f2f8e526a2a
0709 12:27:29.087241 (+680941us) log.cc:844] Serialized 14 byte log entry
0709 12:27:29.087429 (+   188us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:29.094657 (+  7228us) log.cc:844] Serialized 26 byte log entry
0709 12:27:29.095106 (+   449us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:29.095139 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:29.095798 (+   659us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:29.816979 (+721181us) raft_consensus.cc:1685] finished
0709 12:27:29.817004 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:29.817151 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":183544,"prepare.queue_time_us":882911,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":2491,"raft.queue_time_us":60842,"raft.run_cpu_time_us":492,"raft.run_wall_time_us":54999,"spinlock_wait_cycles":2051328,"thread_start_us":974182,"threads_started":3,"wal-append.queue_time_us":1388170}
I20260709 12:27:29.819658  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:29.820274  9964 raft_consensus.cc:2368] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 7. Current term is 8.
I20260709 12:27:29.222872  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:29.820729  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:29.821273  9882 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:29.821554  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:29.822098  9886 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:29.822890  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:29.823843  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:29.753854 13656 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:29.824357  9886 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:29.824405 13656 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:29.222005  9853 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:29.815286  9961 raft_consensus.cc:2393] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:27:29.826797  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 604864us
I20260709 12:27:29.826989 13590 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:29.827371 13590 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:29.827513  9853 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:29.827780 13590 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:29.828636  9853 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:29.829696  9853 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:29.830371 13639 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:29.196799  9958 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 673) took 1802 ms (client timeout 1745 ms). Trace:
I20260709 12:27:29.831058 13639 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:27:29.830865  9958 rpcz_store.cc:269] 0709 12:27:27.389043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:27.602910 (+213867us) service_pool.cc:224] Handling call
0709 12:27:29.190901 (+1587991us) spinlock_profiling.cc:243] Waited 96 ms on lock 0x7b54000889d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:29.191005 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220909440}
I20260709 12:27:29.831530 13639 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:29.832383  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:29.368486 13660 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.834519 13660 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:29.191919  9884 rpcz_store.cc:276] 0709 12:27:28.114565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.142519 (+ 27954us) service_pool.cc:224] Handling call
0709 12:27:29.191390 (+1048871us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54003facd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:29.191475 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":443326208}
I20260709 12:27:29.346181 13697 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:29.123517 10524 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:29.839490 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:29.839563 13554 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:29.840827 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:29.170419 13724 log.cc:927] Time spent T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:27:29.363952 13646 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:29.842680  9807 raft_consensus.cc:1240] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:29.842799 13646 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:29.292785 13484 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:29.363727 13450 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:29.589088 13730 log.cc:927] Time spent T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:27:29.340173 13699 consensus_queue.cc:237] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:29.832079 13639 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:29.846243  9890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1469) took 1418 ms. Trace:
W20260709 12:27:29.241462 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 117667us
I20260709 12:27:29.849836  9890 rpcz_store.cc:276] 0709 12:27:28.427902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.998480 (+570578us) service_pool.cc:224] Handling call
0709 12:27:28.998864 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:29.000123 (+  1259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:29.000163 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:29.017251 (+ 17088us) log.cc:844] Serialized 26 byte log entry
0709 12:27:29.236779 (+219528us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:29.236839 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:29.236937 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:29.845783 (+608846us) raft_consensus.cc:1685] finished
0709 12:27:29.846037 (+   254us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:29.846187 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":663,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":7862,"thread_start_us":170199,"threads_started":1,"wal-append.queue_time_us":787523}
I20260709 12:27:29.851270 13656 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:29.851349 10496 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:29.205185  9928 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:29.851922 13729 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:27:29.852501  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 647350us
I20260709 12:27:29.853359 13729 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:29.853612  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:29.855477  9964 raft_consensus.cc:2393] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:27:29.194334  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 189060us
W20260709 12:27:29.717828  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:29.754987  9885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2354) took 1711 ms. Trace:
I20260709 12:27:29.874481  9885 rpcz_store.cc:276] 0709 12:27:28.044045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.391263 (+347218us) service_pool.cc:224] Handling call
0709 12:27:28.391631 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:28.999452 (+607821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:29.754737 (+755285us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b5400328054. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:29.754925 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1391765888}
I20260709 12:27:29.800608  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:29.786542  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:29.777544  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:29.876448  9812 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:27:29.259868 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:29.879904  9882 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:29.804615 10526 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:27:29.804663  9811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2571) took 1582 ms. Trace:
I20260709 12:27:29.807655  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:29.881457 10532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.016s	sys 0.028s
W20260709 12:27:29.881862 10532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.016s	sys 0.028s
I20260709 12:27:29.808594  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 2139) took 1496 ms. Trace:
I20260709 12:27:29.882369  9959 rpcz_store.cc:276] 0709 12:27:28.312441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:29.803723 (+1491282us) service_pool.cc:224] Handling call
0709 12:27:29.807903 (+  4180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:29.808129 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:29.808173 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:29.808236 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:29.808286 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:29.808363 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:29.808519 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:29.807770  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:29.883215  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:29.884368  9813 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:29.195266 13719 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:29.195232 13651 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:29.810509 13711 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:29.812153 13650 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:29.845471 13646 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:29.730146 10531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36672 (request call id 920) took 1358 ms. Trace:
I20260709 12:27:29.846700 13450 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:29.407984  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 471898us
I20260709 12:27:29.903550  9778 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:29.904808  9778 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:29.906152 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:29.856086 13729 raft_consensus.cc:2804] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:29.856582  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:29.858698 10533 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:29.833954  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:29.387152 13638 consensus_meta.cc:287] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.998s	user 0.011s	sys 0.002s
I20260709 12:27:29.848899 10529 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 8: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:29.848340  9955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 2136) took 1536 ms. Trace:
I20260709 12:27:29.862761  9928 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:29.848627 13697 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:29.865289 10524 raft_consensus.cc:1240] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:29.866144 13660 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:29.866899 13620 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:29.841993 13554 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:29.772467  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:29.921171  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:29.921501 13650 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:29.921571 13638 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:29.803288  9960 raft_consensus.cc:1240] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:27:29.881739 10526 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:27:29.922070 13650 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:29.922519 13650 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:29.922238 13638 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:29.808666  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:29.880882  9811 rpcz_store.cc:276] 0709 12:27:28.221847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.368580 (+146733us) service_pool.cc:224] Handling call
0709 12:27:28.952816 (+584236us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b5800010e98. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7eee 000000000036eb39 00007f2f9346b1e0 00007f2f935340c4 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:27:29.049354 (+ 96538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:29.049561 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:29.049599 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:29.049655 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:29.049698 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:29.049769 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:29.804437 (+754668us) spinlock_profiling.cc:243] Waited 96.4 ms on lock 0x7b540033e350. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:29.804584 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227238656}
W20260709 12:27:29.893493  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:29.875941  9927 connection.cc:256] RPC call timeout handler was delayed by -1.1850438750002468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260709 12:27:29.924117  9927 connection.cc:256] RPC call timeout handler was delayed by -1.060843875000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
I20260709 12:27:29.924309 13638 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:29.924480  9927 connection.cc:256] RPC call timeout handler was delayed by -1.0554438750000372s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
W20260709 12:27:29.924810  9927 connection.cc:256] RPC call timeout handler was delayed by -1.0266438749999907s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
I20260709 12:27:29.912173 13706 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.925349  9927 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:29.894752  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:29.885355  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:29.574160 13588 consensus_meta.cc:287] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.002s
I20260709 12:27:29.123157 13721 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.933316 13721 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:29.898191  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:29.934506  9885 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 8: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:29.902298  9959 raft_consensus.cc:1240] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:29.912396  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:29.312085 13728 consensus_queue.cc:1059] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.646s
I20260709 12:27:29.876797 13376 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:29.916800  9881 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
W20260709 12:27:29.917477  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 54797.1us
I20260709 12:27:29.918376 13646 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:29.895321 13656 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:29.895682 13455 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:29.922590  9960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 2140) took 1609 ms. Trace:
I20260709 12:27:29.948184  9960 rpcz_store.cc:276] 0709 12:27:28.312673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:29.802325 (+1489652us) service_pool.cc:224] Handling call
0709 12:27:29.802936 (+   611us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:29.922349 (+119413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:29.922539 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:29.939188 13588 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:29.949086  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:29.949409  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:29.925663 13706 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:29.894130 13544 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:29.927527  9927 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
W20260709 12:27:29.534576 13599 consensus_meta.cc:287] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.611s	user 0.010s	sys 0.000s
I20260709 12:27:29.895092 13735 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:29.930776  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:29.959805  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:29.930160 13651 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:29.932629 13620 consensus_queue.cc:1048] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:29.912727  9955 rpcz_store.cc:276] 0709 12:27:28.311587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.475243 (+163656us) service_pool.cc:224] Handling call
0709 12:27:28.750525 (+275282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:28.750845 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:28.750883 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:28.751412 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 12:27:29.085769 (+334357us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:29.085822 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:29.085913 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:29.848153 (+762240us) raft_consensus.cc:1685] finished
0709 12:27:29.848173 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:29.848288 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":239842,"threads_started":1,"wal-append.queue_time_us":568910}
I20260709 12:27:29.936529  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:29.961191  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:29.961385  9813 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:27:29.912896 13674 raft_consensus.cc:2764] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:27:29.939294  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:29.939967 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:29.887042 13715 raft_consensus.cc:2764] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:27:29.917917 13711 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:29.966765  9882 raft_consensus.cc:2368] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6.
I20260709 12:27:29.966715 13711 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:29.967242 13721 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:29.312392 13647 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:29.969065 13647 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:29.946337  9884 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:27:29.946878  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:29.970074  9885 raft_consensus.cc:2376] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b011791796d1457284b857d7d3422195 in term 9. Re-sending same reply.
I20260709 12:27:29.971027  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:29.972064  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:29.972550  9885 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:27:29.973275  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:29.973776  9885 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:27:29.918882 13729 raft_consensus.cc:697] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:29.974473 13544 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:29.908231 13719 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:29.975095 13729 consensus_queue.cc:237] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:29.977079 13719 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:29.949198 13484 raft_consensus.cc:3055] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:29.899204 10531 rpcz_store.cc:276] 0709 12:27:28.371960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.372104 (+   144us) service_pool.cc:224] Handling call
0709 12:27:28.372518 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:28.373569 (+  1051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:28.373616 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:28.374511 (+   895us) log.cc:844] Serialized 26 byte log entry
0709 12:27:29.191474 (+816963us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:29.191513 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:29.192928 (+  1415us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:29.729929 (+537001us) raft_consensus.cc:1685] finished
0709 12:27:29.729952 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:29.730077 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":545,"raft.queue_time_us":17559,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":96,"thread_start_us":738142,"threads_started":1,"wal-append.queue_time_us":1296344}
I20260709 12:27:29.978355 13484 raft_consensus.cc:740] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:29.979187 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:29.979259 13484 consensus_queue.cc:260] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:29.980618 13484 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:29.980732 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:29.950186  9960 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 8: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:29.956539 13656 raft_consensus.cc:697] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:29.983100  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:29.983223 13656 consensus_queue.cc:237] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:29.983865  9960 raft_consensus.cc:2376] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10. Re-sending same reply.
I20260709 12:27:29.984926  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:29.952172  9962 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 684) took 2337 ms (client timeout 2177 ms). Trace:
I20260709 12:27:29.957463  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:29.952200  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:29.950224 13455 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:29.941854 13736 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.944761 13646 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:29.985571  9960 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 4.
I20260709 12:27:30.009824  9808 raft_consensus.cc:2393] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 8: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:30.010504  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:30.011482  9960 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:27:29.986459  9811 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:29.987438 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:30.013761 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:29.969002  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:29.982159 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:30.019662 10531 raft_consensus.cc:2393] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:30.006431 10527 raft_consensus.cc:2393] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 12: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:27:29.986023  9962 rpcz_store.cc:269] 0709 12:27:27.614511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.180278 (+565767us) service_pool.cc:224] Handling call
0709 12:27:29.951989 (+1771711us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400114254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:29.952099 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294908672}
I20260709 12:27:30.021488  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:30.022167 13540 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:30.022660 13540 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:30.023355 13588 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:30.025077  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:30.025959  9808 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:30.027578  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:30.027727  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:30.028378  9959 raft_consensus.cc:2393] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:30.028451  9885 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:29.965152 13630 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:30.040354  9957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 2138) took 1728 ms. Trace:
I20260709 12:27:30.041002  9957 rpcz_store.cc:276] 0709 12:27:28.312180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.787785 (+475605us) service_pool.cc:224] Handling call
0709 12:27:28.799177 (+ 11392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:29.718195 (+919018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.035556 (+317361us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b54003372d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:30.040286 (+  4730us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2111942528}
I20260709 12:27:30.047930  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:30.024502 13646 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:30.110072  9886 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:30.106324 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:30.111344 10532 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:30.115783  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:30.116526  9886 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:29.962668 13599 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:30.041879 13630 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:30.123039 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:30.123906 10532 raft_consensus.cc:2368] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6.
W20260709 12:27:30.129045  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 201605us
I20260709 12:27:30.131191  9927 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:30.188966  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:30.190373  9927 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:30.101559 13721 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:27:30.190896  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 297895us
I20260709 12:27:30.196779 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:29.963629 13735 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:30.214176 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 362860us
I20260709 12:27:30.201227 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:30.217193 10531 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:30.202785  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:30.200132  9810 raft_consensus.cc:2393] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
W20260709 12:27:30.223428  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 318642us
I20260709 12:27:30.024443 13736 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:30.220265  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:30.226728 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:30.191190 13630 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:30.187249 13632 raft_consensus.cc:2764] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:27:30.227233  9779 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:30.231153  9887 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:30.231709  9810 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:27:30.220522 10496 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:30.234081  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 333336us
I20260709 12:27:30.235037 10496 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:30.235256  9853 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:30.236670 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:30.242631  9779 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:30.230964 13454 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:30.262128 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:30.256094  9812 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:30.250991  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:30.266062  9779 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:30.266188  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 69966.4us
I20260709 12:27:30.268338  9887 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:30.214805 13721 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:30.285643  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:30.265579 13588 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:30.394843 10525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 979) took 1218 ms. Trace:
I20260709 12:27:30.396391 10525 rpcz_store.cc:276] 0709 12:27:29.176254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:29.188330 (+ 12076us) service_pool.cc:224] Handling call
0709 12:27:29.188638 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:29.818811 (+630173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.394489 (+575678us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b54005c35d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:30.394712 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1447968640}
I20260709 12:27:30.255743 13674 raft_consensus.cc:2804] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:30.261512 13647 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:30.406745 13647 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:30.406745 13674 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:30.407218 13647 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:30.407292 13674 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:30.238068 13699 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:30.265255 13632 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:27:30.324306 13745 log.cc:927] Time spent T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.366s	user 0.001s	sys 0.000s
I20260709 12:27:30.330367 13706 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:30.280139 13660 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:30.268070 13454 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:27:30.370788  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 180512us
I20260709 12:27:30.502993  9927 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:30.504027  9927 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:30.282662 13450 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:30.260991 13544 consensus_queue.cc:1048] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 12:27:30.244578 13691 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:30.401291 10496 connection.cc:256] RPC call timeout handler was delayed by -1.6373154180000711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
W20260709 12:27:30.511282 10496 connection.cc:256] RPC call timeout handler was delayed by -1.3043154179999874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
W20260709 12:27:30.511749 10496 connection.cc:256] RPC call timeout handler was delayed by -1.202615417999823s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
W20260709 12:27:30.404443  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:30.493113 13660 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:30.409578 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:30.417032 13747 log.cc:927] Time spent T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:27:30.427356 13762 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:30.372802 13540 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:30.285431 13758 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.135s
I20260709 12:27:30.430676  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:30.520429  9882 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 8: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:30.425896 10531 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:30.372383 13455 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:30.507213 13454 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:30.462518 13699 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:30.392405 13588 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:30.371179 13677 consensus_queue.cc:1059] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 12:27:30.474323 13632 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:30.492112 13621 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:30.508687  9927 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:30.300405 13729 consensus_queue.cc:1059] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
W20260709 12:27:30.512132 10496 connection.cc:256] RPC call timeout handler was delayed by -1.1999154179998186s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2231s for a response
I20260709 12:27:30.541724 10528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 984) took 1363 ms. Trace:
W20260709 12:27:30.516355  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 250357us
I20260709 12:27:30.545030  9779 leader_election.cc:400] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7.
I20260709 12:27:30.516373 10525 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
W20260709 12:27:30.518435 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 83262.8us
W20260709 12:27:30.469440  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 188527us
I20260709 12:27:30.547235  9778 leader_election.cc:400] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 7. Current term is 8.
I20260709 12:27:30.507225 13755 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.512107 13759 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:30.548527 13755 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:30.493606 13647 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:30.512910 13766 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:30.522343 13761 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.531515 13588 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:30.519236 13660 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:30.542142 10528 rpcz_store.cc:276] 0709 12:27:29.177835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:29.182523 (+  4688us) service_pool.cc:224] Handling call
0709 12:27:30.541528 (+1359005us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b5400690ad4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:30.541668 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":867390336}
I20260709 12:27:30.539162 13632 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:30.592386 13639 consensus_meta.cc:287] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.744s	user 0.006s	sys 0.003s
I20260709 12:27:30.592823 13639 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:30.596952 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 48806.5us
I20260709 12:27:30.553952  9779 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:30.528057 13699 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:30.549006 13759 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:30.547639  9778 leader_election.cc:403] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:27:30.638892  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 91834.2us
I20260709 12:27:30.639935  9778 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:30.568044 13723 raft_consensus.cc:3055] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:30.568717 13689 raft_consensus.cc:3055] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:30.568859 13735 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:30.560346 13761 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:30.594851 13766 raft_consensus.cc:697] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:27:30.578891 13763 log.cc:927] Time spent T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:27:30.582327 13770 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:27:30.582799  9809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 620) took 3486 ms. Trace:
W20260709 12:27:30.585718 13484 consensus_meta.cc:287] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.605s	user 0.007s	sys 0.003s
I20260709 12:27:30.587682 13647 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:30.541565 13719 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.525846 13749 consensus_queue.cc:1048] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
W20260709 12:27:30.635265  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 81412.6us
I20260709 12:27:30.651613 13721 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:30.568939 13751 log.cc:927] Time spent T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:27:30.569638 13776 log.cc:927] Time spent T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:27:30.643359 13729 consensus_queue.cc:1059] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:27:30.633284 13765 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:30.643901 13621 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:30.643548 13759 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:30.581979 13454 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:30.655185  9809 rpcz_store.cc:276] 0709 12:27:27.096537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.003753 (+907216us) service_pool.cc:224] Handling call
0709 12:27:28.394352 (+390599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:28.394735 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:28.394794 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:28.395419 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 12:27:28.772497 (+377078us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:28.772534 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:28.772599 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:28.981766 (+209167us) raft_consensus.cc:1685] finished
0709 12:27:28.981789 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:30.582472 (+1600683us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54002d6750. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:30.582698 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7771,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":127,"spinlock_wait_cycles":897595776,"thread_start_us":376626,"threads_started":1,"wal-append.queue_time_us":582093,"wal-append.run_cpu_time_us":1623,"wal-append.run_wall_time_us":1003541}
I20260709 12:27:30.643862 13723 raft_consensus.cc:740] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:27:30.652308 13590 consensus_meta.cc:287] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.824s	user 0.010s	sys 0.000s
W20260709 12:27:30.595409 13760 log.cc:927] Time spent T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:27:30.679315 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 125925us
W20260709 12:27:30.679386  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 170776us
I20260709 12:27:30.649223 13775 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:30.696424  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:30.697942  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:30.698724  9957 raft_consensus.cc:2410] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:27:30.698851  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:30.699599  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:30.700138  9957 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:30.700724  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:30.701618  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:30.701408 13632 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:30.702520  9957 raft_consensus.cc:2393] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:30.702744  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:30.703299  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:30.704310  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:30.705478  9809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:27:30.702527  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:30.714442 13639 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:30.714586  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:30.646818 13778 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 7. Current term is 8.
I20260709 12:27:30.667989  9779 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:30.715266 13540 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:30.693413 10497 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:30.715962  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:30.716219 10497 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:30.717859  9698 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d1e4bd6e7a424475b1d707bfa268d54e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f5208640a51f493e930ce4f64ceeed0b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:30.718498 13779 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:30.718784 13695 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:30.719039 13779 raft_consensus.cc:697] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:27:30.714882  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:30.647809 13689 raft_consensus.cc:740] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:30.684792 13599 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:30.724956  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 57107.2us
I20260709 12:27:30.703315  9960 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:30.725680  9779 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:30.725900  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:30.686262 13765 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:27:30.694238 13646 consensus_meta.cc:287] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.001s
I20260709 12:27:30.668744 13762 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:27:30.727816  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:30.729658 13779 consensus_queue.cc:237] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:30.732197 13744 log.cc:927] Time spent T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.812s	user 0.004s	sys 0.000s
I20260709 12:27:30.733274  9779 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:30.733345  9959 raft_consensus.cc:2393] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 11: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:30.734072  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:30.724283  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:30.720587  9809 raft_consensus.cc:606] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:27:30.701546  9955 raft_consensus.cc:2393] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:30.717226  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:30.743517  9809 raft_consensus.cc:614] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:30.744038  9962 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 8: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:27:30.726150 13650 consensus_meta.cc:287] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.803s	user 0.004s	sys 0.007s
I20260709 12:27:30.743546  9811 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:30.738580 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 45961.9us
I20260709 12:27:30.668903 13719 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:30.746694  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:30.747203  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:30.746321  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:30.751327 13775 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:30.751762 13775 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:30.752122 13775 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:30.733705 13554 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:30.740139 13765 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:30.775925  9811 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:30.741552 13647 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:30.721403 13590 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:30.710209 13630 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:30.822849 13761 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:30.819682 13755 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:30.823514 13630 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:30.744838 13766 consensus_queue.cc:237] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:30.825659 13719 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:30.784163  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:30.798722  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 46718.9us
I20260709 12:27:30.776780  9960 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:30.725242 13621 consensus_queue.cc:1059] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:27:30.779665 13455 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:30.861775  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:30.744185 13778 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.819553  9886 raft_consensus.cc:1240] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:30.766433 13695 raft_consensus.cc:697] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:30.847853  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:30.743093 13646 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:30.740988 13660 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:30.843662 13454 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:30.829933  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:30.778990 13554 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:30.807350  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:30.888319  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:30.888546  9779 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:30.848197  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:30.863090  9888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 856) took 1119 ms. Trace:
I20260709 12:27:30.784538 13728 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:30.896509  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:30.896682  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:30.896114  9778 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:30.897356  9807 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:30.889384  9888 rpcz_store.cc:276] 0709 12:27:29.743518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:29.745525 (+  2007us) service_pool.cc:224] Handling call
0709 12:27:29.819278 (+ 73753us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:29.834485 (+ 15207us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:27:30.128966 (+294481us) log.cc:844] Serialized 14 byte log entry
0709 12:27:30.510489 (+381523us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:30.513230 (+  2741us) log.cc:844] Serialized 26 byte log entry
0709 12:27:30.513408 (+   178us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:30.513837 (+   429us) log.cc:844] Serialized 14 byte log entry
0709 12:27:30.514031 (+   194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.514134 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:30.862740 (+348606us) raft_consensus.cc:1685] finished
0709 12:27:30.862773 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:30.863005 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34507,"prepare.queue_time_us":433245,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":76656,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":19796,"spinlock_wait_cycles":10696064,"thread_start_us":562046,"threads_started":2,"wal-append.queue_time_us":324232}
I20260709 12:27:30.873643 13778 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:30.763211 13650 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:30.766857 13599 consensus_queue.cc:1059] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:27:30.886423  9960 raft_consensus.cc:2393] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:30.901650  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:30.892053  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:30.902758  9813 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:27:30.902992  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:30.903010  9779 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:30.903635  9810 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:30.903802  9812 raft_consensus.cc:2393] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:30.784941 13689 consensus_queue.cc:260] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:30.847102 13647 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:30.891595 13554 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:30.890764  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:30.885160 13627 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:30.907771  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:30.906107  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:30.898501  9955 raft_consensus.cc:2393] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 6: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:30.778883 13723 consensus_queue.cc:260] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:30.914532  9811 raft_consensus.cc:2393] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:30.905108 13740 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:30.939469  9888 raft_consensus.cc:1240] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:30.913654  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:30.884670 13455 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:30.905582 13770 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:30.945479  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:30.937835  9812 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:30.954624  9960 raft_consensus.cc:2410] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:27:30.911811 13647 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:30.947269  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:30.968294 10527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 988) took 1161 ms. Trace:
I20260709 12:27:30.979250 10527 rpcz_store.cc:276] 0709 12:27:29.806991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:29.807189 (+   198us) service_pool.cc:224] Handling call
0709 12:27:30.968111 (+1160922us) spinlock_profiling.cc:243] Waited 58.8 ms on lock 0x7b54006801d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:30.968241 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135165696}
I20260709 12:27:30.973517  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 2369) took 1118 ms. Trace:
I20260709 12:27:30.980202  9807 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:30.980399  9884 rpcz_store.cc:276] 0709 12:27:29.854993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:29.856361 (+  1368us) service_pool.cc:224] Handling call
0709 12:27:30.973347 (+1116986us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b5400366854. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:30.973457 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83398912}
I20260709 12:27:30.905001 13621 raft_consensus.cc:3055] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:30.913302 13689 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:30.946403 13773 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:30.953542 13800 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:31.015218  9854 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:31.019168 10527 raft_consensus.cc:1240] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:31.019330 13800 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:31.019733 13800 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:30.899844 13728 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:30.974871  9964 raft_consensus.cc:1240] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:31.007227  9884 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:27:31.006342  9955 raft_consensus.cc:1240] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:31.017067  9806 raft_consensus.cc:1240] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:27:31.016831 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:31.021955  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:31.006418 10529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 981) took 1829 ms. Trace:
I20260709 12:27:31.024221 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:31.016691 13762 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.073066 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:31.073411  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:31.074295  9810 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 8: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:31.074441 13801 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:31.075170  9810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:27:31.075762  9810 raft_consensus.cc:606] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:27:31.076066  9810 raft_consensus.cc:614] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:31.078217 10529 rpcz_store.cc:276] 0709 12:27:29.176951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:29.180738 (+  3787us) service_pool.cc:224] Handling call
0709 12:27:31.006225 (+1825487us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b54008313d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:31.006363 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1521470208}
I20260709 12:27:31.080521  9810 raft_consensus.cc:1240] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:31.081346 13765 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:31.081897  9810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:27:30.952962 13740 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:31.028121 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:31.082047 13677 consensus_queue.cc:1059] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:31.028867 13755 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:31.083274 13677 raft_consensus.cc:3055] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:31.083690 13677 raft_consensus.cc:740] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:31.084187 13740 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:31.084494 13677 consensus_queue.cc:260] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:31.085659 13677 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:30.967552 13699 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:31.088385 10532 raft_consensus.cc:2393] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 11: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:30.961088 13711 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:31.090348 13761 consensus_queue.cc:1059] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:31.091441 13640 raft_consensus.cc:3055] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:31.091889  9810 raft_consensus.cc:606] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:27:31.096618  9810 raft_consensus.cc:614] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:31.024442  9812 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:27:31.090078 13699 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:30.948163 10496 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:31.098695 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 150810us
I20260709 12:27:31.100481 10496 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:30.952786 13802 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:30.963088 13660 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:31.002822 13639 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.004451 13770 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:31.005141 13698 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:31.124429  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 221482us
I20260709 12:27:31.018368 13650 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:31.022485 13621 raft_consensus.cc:740] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:30.962383 13651 raft_consensus.cc:3055] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:31.026837 13723 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:31.029942 13729 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:31.083201 13755 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:31.154843  9853 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:31.164834  9853 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:31.096464 13640 raft_consensus.cc:740] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:30.962659 13805 consensus_queue.cc:1059] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.166s
I20260709 12:27:31.089972 13759 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:31.031203 13715 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 12:27:31.165884  9853 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:31.160494  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:31.180847  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:31.181664  9890 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:31.073374 13762 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:31.160943 13699 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:31.167610 13755 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:31.183225  9853 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:31.162635 13651 raft_consensus.cc:740] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:31.182193  9807 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:31.195253  9887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1477) took 1317 ms. Trace:
W20260709 12:27:31.185835 13588 consensus_meta.cc:287] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.000s
I20260709 12:27:30.973904 13775 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:31.201565  9957 raft_consensus.cc:2393] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 12: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:31.179169 13484 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:31.205986  9853 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:31.207129 13674 consensus_meta.cc:287] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.733s	user 0.011s	sys 0.000s
I20260709 12:27:31.178646 13788 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:31.210793 13455 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:31.210472 13640 consensus_queue.cc:260] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:31.211658 13765 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:31.211127 13621 consensus_queue.cc:260] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:31.148150 13639 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:30.963006 13695 consensus_queue.cc:237] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:31.195834 13699 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:31.212586 13759 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:31.215698 13809 log.cc:927] Time spent T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:27:31.216176  9881 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1462) took 2770 ms (client timeout 2129 ms). Trace:
W20260709 12:27:31.313835  9881 rpcz_store.cc:269] 0709 12:27:28.426342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.976674 (+550332us) service_pool.cc:224] Handling call
0709 12:27:31.196172 (+2219498us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b540003d254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:31.196262 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2128524032}
W20260709 12:27:31.216529 13795 log.cc:927] Time spent T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:27:31.248689 13627 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:31.177404 13729 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:31.218648  9889 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:27:31.334167  9889 pending_rounds.cc:85] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 7
I20260709 12:27:31.334455  9889 pending_rounds.cc:107] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:27:31.334712  9889 raft_consensus.cc:2889] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:31.224561  9887 rpcz_store.cc:276] 0709 12:27:29.878120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:29.939330 (+ 61210us) service_pool.cc:224] Handling call
0709 12:27:31.195091 (+1255761us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b540027a454. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:31.195195 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647045888}
I20260709 12:27:31.196125  9882 raft_consensus.cc:1240] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:31.228376  9890 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:31.190460 13703 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:27:31.247568  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 85385.8us
I20260709 12:27:31.203009 13546 raft_consensus.cc:3055] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:31.252959 10525 raft_consensus.cc:1240] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:31.228557 13761 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:31.299723  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:31.313521 13640 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:31.187672 13792 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:31.240782 13484 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:31.326108 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:31.328368 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:31.355566 10526 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:31.328672 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:31.329139 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:31.338042 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 237738us
I20260709 12:27:31.338577  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:31.341784  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:31.311908 13699 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:31.333966 13627 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:31.344565 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:31.366393 10533 raft_consensus.cc:2393] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:31.310420 13788 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:31.241992 13588 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:31.343561 13546 raft_consensus.cc:740] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:31.346482 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:31.357122 10496 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:31.251478 13674 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:31.357578  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:31.250553 13647 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:31.335688 13642 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.362185  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:31.342655 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:31.365942  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:31.342682 13703 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:31.248450 13715 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.089s
W20260709 12:27:31.373225  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 141327us
I20260709 12:27:31.369678 13627 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:31.376251  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:31.371251  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:31.338061 13651 consensus_queue.cc:260] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:31.468360  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:31.562834  9887 raft_consensus.cc:2393] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
W20260709 12:27:31.564167 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 207120us
W20260709 12:27:31.467270  9961 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55946 (request call id 2133) took 3156 ms (client timeout 1558 ms). Trace:
W20260709 12:27:31.566210  9961 rpcz_store.cc:269] 0709 12:27:28.310806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.342447 (+ 31641us) service_pool.cc:224] Handling call
0709 12:27:31.467012 (+3124565us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54003bb354. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:31.467187 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3335838976}
W20260709 12:27:31.563905  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 192675us
I20260709 12:27:31.568008  9806 raft_consensus.cc:2393] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 11: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:31.469272  9963 raft_consensus.cc:1240] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:31.568092  9928 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:31.580294 10496 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:31.591001  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:31.460354 13810 log.cc:927] Time spent T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:27:31.595775  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:31.583021 13703 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:31.534588 13818 log.cc:927] Time spent T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:27:31.366674 13691 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:27:31.599033  9884 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.000s	sys 0.007s
I20260709 12:27:31.602038  9814 raft_consensus.cc:1240] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:31.583293 13715 consensus_queue.cc:1243] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Peer 4104e34a61b7448281d6d91ce23ebf71 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:27:31.602370  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:31.603183  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:31.632176  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:31.596939 10496 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:31.358542 13484 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:31.633628 10528 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:31.633577  9928 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:31.460855 13814 log.cc:927] Time spent T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:27:31.376590 13728 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:31.559034 13639 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:31.388808 10532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 1004) took 1131 ms. Trace:
I20260709 12:27:31.732800 10532 rpcz_store.cc:276] 0709 12:27:30.257519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.261873 (+  4354us) service_pool.cc:224] Handling call
0709 12:27:31.388563 (+1126690us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b540069f854. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:31.388735 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1898224384}
I20260709 12:27:31.584147 13599 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:31.639586  9884 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.000s	sys 0.008s
I20260709 12:27:31.595919 13376 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:31.699031  9806 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:31.735891  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:31.736497  9806 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
W20260709 12:27:31.699627 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 102765us
I20260709 12:27:31.638823  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:31.701212  9808 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:31.595592 13689 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:31.744336 13689 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:31.747526 13821 log.cc:927] Time spent T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.268s	user 0.000s	sys 0.000s
I20260709 12:27:31.374540 13788 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:31.704478  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 70973.2us
I20260709 12:27:31.707175 13798 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:31.707906  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:31.710729 13729 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:31.700690 13691 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:31.731134 13781 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:31.436861 13711 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.251s
I20260709 12:27:31.739044 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:27:31.878382 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 139409us
I20260709 12:27:31.632241 13762 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:31.562484 13775 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:31.691653 13784 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:31.884068  9960 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:27:31.885886  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:31.978894  9955 raft_consensus.cc:2410] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:27:31.980446  9955 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:31.703552 13651 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:31.634266 13824 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:31.634994 13827 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.926896 13816 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:31.927534  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:32.024510  9961 raft_consensus.cc:2376] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9. Re-sending same reply.
W20260709 12:27:31.911366  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:31.749315 13826 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:31.603297 13789 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:31.934751  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:31.925716 13813 log.cc:927] Time spent T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.352s	user 0.000s	sys 0.000s
W20260709 12:27:32.045948 10496 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 1.661s (SENT) [suppressed 27 similar messages]
W20260709 12:27:31.955056 13828 log.cc:927] Time spent T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:27:31.956712 13723 consensus_meta.cc:287] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.790s	user 0.008s	sys 0.001s
I20260709 12:27:31.929298 13691 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:31.950131 13698 consensus_meta.cc:287] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.799s	user 0.008s	sys 0.000s
I20260709 12:27:31.973654 10528 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
W20260709 12:27:31.933832 13755 consensus_meta.cc:287] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.702s	user 0.005s	sys 0.001s
I20260709 12:27:31.994696  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:31.647877 13642 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:31.938164 13699 consensus_meta.cc:287] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.000s
I20260709 12:27:31.892479 13729 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:32.084724  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:32.085305 13729 raft_consensus.cc:697] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:32.036531 13588 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:31.996853 13824 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:32.037451 13826 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:32.038897  9960 raft_consensus.cc:1275] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:27:32.040437 13816 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:32.034893 13827 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:32.080332  9955 raft_consensus.cc:2393] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 11: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:32.081955 13706 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.084640  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:32.084372 13699 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:32.085577 13627 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:32.076493 13825 log.cc:927] Time spent T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.526s	user 0.000s	sys 0.001s
W20260709 12:27:32.083210 13554 consensus_meta.cc:287] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 1.143s	user 0.011s	sys 0.000s
I20260709 12:27:32.088433 13824 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:32.086365 13689 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:32.101346 13706 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:32.128343 13674 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:32.129071 13647 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:32.129870 13699 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:32.086211 13729 consensus_queue.cc:237] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:32.123826 13800 consensus_meta.cc:287] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 1.025s	user 0.010s	sys 0.001s
I20260709 12:27:32.083333 13755 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:32.130755  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 703) took 1219 ms. Trace:
I20260709 12:27:32.133507  9959 rpcz_store.cc:276] 0709 12:27:30.910879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.018565 (+107686us) service_pool.cc:224] Handling call
0709 12:27:31.018926 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:31.019235 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:31.019261 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:31.019685 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 12:27:31.337222 (+317537us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:31.363689 (+ 26467us) log.cc:844] Serialized 14 byte log entry
0709 12:27:31.364503 (+   814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:31.364572 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:32.130504 (+765932us) raft_consensus.cc:1685] finished
0709 12:27:32.130531 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:32.130684 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27692,"prepare.run_cpu_time_us":700,"prepare.run_wall_time_us":16545,"raft.queue_time_us":1749,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":47730,"spinlock_wait_cycles":11856640,"thread_start_us":317133,"threads_started":1,"wal-append.queue_time_us":355963}
I20260709 12:27:32.140805 13627 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:32.142724 13816 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:32.143410 13798 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:32.123647 13554 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:32.151185 13554 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:32.152063 13800 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:32.155755 13755 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:32.158546 13703 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:32.161074 13703 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:32.161799 13484 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:32.171597 13484 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:32.176582 13824 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:31.946712  9888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 868) took 1225 ms. Trace:
W20260709 12:27:32.278568  9853 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.005s	sys 0.009s
W20260709 12:27:32.278972  9884 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.000s	sys 0.011s
W20260709 12:27:32.279158  9853 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.005s	sys 0.009s
W20260709 12:27:32.279426  9884 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.000s	sys 0.011s
W20260709 12:27:32.279866  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 529261us
I20260709 12:27:32.281790  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 872) took 1204 ms. Trace:
W20260709 12:27:32.282802  9957 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 699) took 1579 ms (client timeout 2006 ms). Trace:
I20260709 12:27:32.283473  9885 raft_consensus.cc:2410] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:27:32.278810  9881 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:32.286128 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 240060us
I20260709 12:27:32.287139  9928 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:32.278323  9888 rpcz_store.cc:276] 0709 12:27:30.721730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.950120 (+228390us) service_pool.cc:224] Handling call
0709 12:27:30.950668 (+   548us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:30.954599 (+  3931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:30.954628 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:30.955084 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 12:27:31.163032 (+207948us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:31.163092 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:31.163199 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:31.946426 (+783227us) raft_consensus.cc:1685] finished
0709 12:27:31.946452 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:31.946640 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":984,"raft.queue_time_us":1139,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":14931,"thread_start_us":195810,"threads_started":1,"wal-append.queue_time_us":364106}
I20260709 12:27:32.293358  9882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2375) took 2432 ms. Trace:
I20260709 12:27:32.293612 13736 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:32.296519  9957 rpcz_store.cc:269] 0709 12:27:30.703445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.704119 (+   674us) service_pool.cc:224] Handling call
0709 12:27:32.282182 (+1578063us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54000b3bd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:32.282528 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1141783936}
I20260709 12:27:32.300467  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 2185) took 2210 ms. Trace:
I20260709 12:27:32.319875 13827 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:32.321550  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:32.323244 13788 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:32.278059  9807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 642) took 1386 ms. Trace:
W20260709 12:27:32.284125  9853 leader_election.cc:336] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.558s (SENT)
I20260709 12:27:32.328397 13826 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:32.305887  9813 rpcz_store.cc:276] 0709 12:27:30.089463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.089790 (+   327us) service_pool.cc:224] Handling call
0709 12:27:30.119239 (+ 29449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:30.903100 (+783861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:32.299668 (+1396568us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b54001842d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:32.300162 (+   494us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1801365376}
W20260709 12:27:32.340689 13766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.383s	user 0.000s	sys 0.039s
W20260709 12:27:32.341403 13766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.404s	user 0.000s	sys 0.039s
I20260709 12:27:32.329084  9713 catalog_manager.cc:5697] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 4 to 6, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 6 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:27:32.325044  9807 rpcz_store.cc:276] 0709 12:27:30.891299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.021743 (+130444us) service_pool.cc:224] Handling call
0709 12:27:32.277278 (+1255535us) spinlock_profiling.cc:243] Waited 72.1 ms on lock 0x7b54001f5754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:32.277653 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165845376}
I20260709 12:27:32.379477 13636 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:32.389369 13695 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.389461  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:32.390806 13695 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:32.298695  9882 rpcz_store.cc:276] 0709 12:27:29.860495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.531129 (+670634us) service_pool.cc:224] Handling call
0709 12:27:31.195956 (+664827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:31.336015 (+140059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:32.292842 (+956827us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b540027a450. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:32.293144 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1511246720}
I20260709 12:27:32.416437 13761 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:32.418408  9963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 680) took 5027 ms. Trace:
I20260709 12:27:32.417409 13736 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:32.418573 13761 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:32.419986  9956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 2137) took 4108 ms. Trace:
I20260709 12:27:32.403980  9853 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:32.420305 13736 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:32.426389  9956 rpcz_store.cc:276] 0709 12:27:28.311909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.477003 (+165094us) service_pool.cc:224] Handling call
0709 12:27:29.952450 (+1475447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:30.199701 (+247251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:30.199732 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:30.844033 (+644301us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b2c0013c378. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8ce15a11 00007f2f8ce25372 00007f2f8e557a01 00007f2f8e51c43a 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2
0709 12:27:30.844400 (+   367us) log.cc:844] Serialized 26 byte log entry
0709 12:27:30.869293 (+ 24893us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:30.869346 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.869433 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:31.351015 (+481582us) raft_consensus.cc:1685] finished
0709 12:27:31.351035 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:32.419568 (+1068533us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400114250. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:32.419773 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4496,"raft.queue_time_us":12399,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":23432,"spinlock_wait_cycles":3399666176,"thread_start_us":266872,"threads_started":2,"wal-append.queue_time_us":182226,"wal-append.run_cpu_time_us":2915,"wal-append.run_wall_time_us":1307230}
I20260709 12:27:32.296408  9884 rpcz_store.cc:276] 0709 12:27:31.077035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.085878 (+  8843us) service_pool.cc:224] Handling call
0709 12:27:31.086190 (+   312us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:31.090812 (+  4622us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:31.090840 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:31.091408 (+   568us) log.cc:844] Serialized 52 byte log entry
0709 12:27:31.734124 (+642716us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:32.280249 (+546125us) log.cc:844] Serialized 14 byte log entry
0709 12:27:32.280979 (+   730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:32.281167 (+   188us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:32.281312 (+   145us) raft_consensus.cc:1685] finished
0709 12:27:32.281332 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:32.281606 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":431626,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":14220,"raft.run_cpu_time_us":408,"raft.run_wall_time_us":408,"thread_start_us":1187722,"threads_started":2,"wal-append.queue_time_us":783225}
I20260709 12:27:32.440106  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1475) took 2563 ms. Trace:
I20260709 12:27:32.440734  9886 rpcz_store.cc:276] 0709 12:27:29.877599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.679712 (+802113us) service_pool.cc:224] Handling call
0709 12:27:30.680269 (+   557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.873753 (+193484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:32.439522 (+1565769us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54001e4454. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:32.439911 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319835904}
W20260709 12:27:32.457230 13791 log.cc:927] Time spent T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 1.615s	user 0.018s	sys 0.012s
W20260709 12:27:32.457836  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:32.474359  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55720 (request call id 27) took 1394 ms. Trace:
I20260709 12:27:32.474953  9810 rpcz_store.cc:276] 0709 12:27:31.080200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.081764 (+  1564us) service_pool.cc:224] Handling call
0709 12:27:32.473780 (+1392016us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b540006efd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e516853 00007f2f934e460a 00007f2f8ca6a7d4 00007f2f8ca6a762 00007f2f8ca6a691 00007f2f8ca6a60c 00007f2f8ca698c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:32.474049 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21038336}
I20260709 12:27:32.477044 13766 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:32.477735 13766 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:32.478315 13766 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:32.483242 10496 leader_election.cc:336] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.511s (SENT)
I20260709 12:27:32.484640 13787 raft_consensus.cc:3055] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:32.485152 13787 raft_consensus.cc:740] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:32.485762 13826 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:32.488380  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2589) took 1719 ms. Trace:
I20260709 12:27:32.488888  9814 rpcz_store.cc:276] 0709 12:27:30.769289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.769444 (+   155us) service_pool.cc:224] Handling call
0709 12:27:30.818516 (+ 49072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:31.639804 (+821288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:32.487771 (+847967us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b540002dfd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:32.488152 (+   381us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1801478016}
I20260709 12:27:32.421696  9963 rpcz_store.cc:276] 0709 12:27:27.391102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.456859 (+1065757us) service_pool.cc:224] Handling call
0709 12:27:31.469030 (+3012171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:31.569021 (+ 99991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:32.417847 (+848826us) spinlock_profiling.cc:243] Waited 3 s on lock 0x7b54003bb350. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:32.418094 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6896320896}
I20260709 12:27:32.508512 13824 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:32.509480  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 222714us
I20260709 12:27:32.510787  9928 leader_election.cc:400] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6.
I20260709 12:27:32.511113  9928 leader_election.cc:403] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:27:32.512910 13646 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:32.517699 10524 raft_consensus.cc:1240] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:32.518918 13787 consensus_queue.cc:260] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:32.519687 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:32.520608 13787 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:32.520673 10528 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:32.523048 13761 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:32.523188 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:32.461975 13546 consensus_queue.cc:260] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:32.527842 13546 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:32.532025  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 248039us
I20260709 12:27:32.532151 13781 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6.
W20260709 12:27:32.532927  9853 leader_election.cc:336] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.559s (SENT)
I20260709 12:27:32.533457  9853 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:32.534413 13736 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:32.549657  9881 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:32.551517 13759 consensus_queue.cc:1059] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:27:32.552860  9883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1471) took 2679 ms. Trace:
I20260709 12:27:32.553128 13759 raft_consensus.cc:3055] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:32.553704 13759 raft_consensus.cc:740] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:27:32.559820 10496 leader_election.cc:336] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.614s (SENT)
I20260709 12:27:32.560395 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:32.560446 13800 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:32.559803  9928 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:32.562861 13781 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:32.542923 13761 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:32.567273 13695 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:32.567576  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:32.568244 13778 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:32.568558  9963 raft_consensus.cc:2410] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:27:32.550418 13736 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.579033 13632 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:32.584559  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:32.571228 13736 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:32.591913 13794 log.cc:927] Time spent T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 1.699s	user 0.000s	sys 0.030s
I20260709 12:27:32.592703 13736 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:32.600708 13824 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:32.602748 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:32.604502  9882 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:32.604673 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:32.606206  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:32.617515  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:32.618296 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:32.553323  9883 rpcz_store.cc:276] 0709 12:27:29.875643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.561605 (+685962us) service_pool.cc:224] Handling call
0709 12:27:30.974935 (+413330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:30.975278 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:30.975308 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:30.975857 (+   549us) log.cc:844] Serialized 52 byte log entry
0709 12:27:31.228392 (+252535us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:31.228436 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:31.228504 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:31.732251 (+503747us) raft_consensus.cc:1685] finished
0709 12:27:31.732273 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:32.552322 (+820049us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b5400366850. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:32.552645 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3483,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":21179,"spinlock_wait_cycles":949746048,"thread_start_us":252180,"threads_started":1,"wal-append.queue_time_us":370618}
I20260709 12:27:32.597401 13736 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:32.657528  9889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2342) took 6110 ms. Trace:
I20260709 12:27:32.651130  9963 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:32.662529 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:32.657984  9956 raft_consensus.cc:1240] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:32.658146  9889 rpcz_store.cc:276] 0709 12:27:26.546877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.684946 (+138069us) service_pool.cc:224] Handling call
0709 12:27:26.685239 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:31.335086 (+4649847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:32.656928 (+1321842us) spinlock_profiling.cc:243] Waited 4.53 s on lock 0x7b54003c6254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:32.657296 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10424847104}
I20260709 12:27:32.657248  9887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1483) took 1500 ms. Trace:
I20260709 12:27:32.598681 13759 consensus_queue.cc:260] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:32.657356  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 1.31629e+06us
I20260709 12:27:32.670079  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2583) took 1964 ms. Trace:
I20260709 12:27:32.670676  9779 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:32.670583  9815 rpcz_store.cc:276] 0709 12:27:30.705177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.708852 (+  3675us) service_pool.cc:224] Handling call
0709 12:27:30.709191 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.709406 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:27:30.738644 (+ 29238us) log.cc:844] Serialized 14 byte log entry
0709 12:27:31.188696 (+450052us) log.cc:844] Serialized 14 byte log entry
0709 12:27:31.254071 (+ 65375us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b1800331300. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f3f3 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:27:32.595417 (+1341346us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b1800331300. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b3a9c0a 00007f2f94ae9219 00007f2f923f058f 00007f2f8b42f571 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd
0709 12:27:32.669268 (+ 73851us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:32.669411 (+   143us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:32.669541 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:32.669656 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:32.669863 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1509085,"prepare.queue_time_us":31542,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":82,"raft.queue_time_us":25742,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":3533,"spinlock_wait_cycles":65424512,"thread_start_us":439346,"threads_started":2,"wal-append.queue_time_us":173432,"wal-append.run_cpu_time_us":1638,"wal-append.run_wall_time_us":1046775}
I20260709 12:27:32.672955 13621 raft_consensus.cc:3060] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:32.674242 10524 raft_consensus.cc:2368] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8.
I20260709 12:27:32.646775 13781 raft_consensus.cc:697] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:32.683849  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:32.693574 13454 raft_consensus.cc:2764] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:27:32.666816  9887 rpcz_store.cc:276] 0709 12:27:31.157075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.939361 (+782286us) service_pool.cc:224] Handling call
0709 12:27:31.939646 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:31.939837 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:32.542820 (+602983us) log.cc:844] Serialized 14 byte log entry
0709 12:27:32.640048 (+ 97228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:32.642931 (+  2883us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:32.649650 (+  6719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:32.649782 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:32.657002 (+  7220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10666,"prepare.queue_time_us":239015,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":1762,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":39371,"thread_start_us":544026,"threads_started":2,"wal-append.queue_time_us":114287}
W20260709 12:27:32.694773 13651 consensus_meta.cc:287] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.693s	user 0.012s	sys 0.011s
W20260709 12:27:32.696316  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:32.712507  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:32.712198 10528 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
W20260709 12:27:32.720973 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 177286us
I20260709 12:27:32.722640 13844 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:32.722746  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:32.723474 13455 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:32.723399 13844 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:32.726883 13455 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:32.727319 13802 raft_consensus.cc:697] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:32.728461 13844 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:32.730744 13759 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:32.724352 13770 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:32.723578  9963 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:32.679412 13736 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:32.761018  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:32.765714  9884 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:27:32.760066 13770 raft_consensus.cc:697] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:27:32.774653 10496 leader_election.cc:336] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.682s (SENT)
I20260709 12:27:32.777393 10496 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:32.782331 13590 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:32.767792 13695 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.787147 13770 consensus_queue.cc:237] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:32.787986 13695 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:32.792073  9956 raft_consensus.cc:1240] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:32.792425  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:32.793254  9815 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:32.804389  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:32.805136 13455 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:32.808485 10496 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:32.810485 13805 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:32.811969 13847 log.cc:927] Time spent T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:27:32.812757  9928 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:32.814258  9928 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:32.815937 13706 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:32.816569  9928 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:32.817728 13781 consensus_queue.cc:237] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:32.819832  9811 raft_consensus.cc:1240] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:32.825479  9815 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:32.826992 13802 consensus_queue.cc:237] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:32.830725 13852 raft_consensus.cc:2804] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:32.830902 13695 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:32.831426 13852 raft_consensus.cc:697] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:32.832665 13852 consensus_queue.cc:237] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:32.833696 13823 log.cc:927] Time spent T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.890s	user 0.013s	sys 0.000s
I20260709 12:27:32.834263 10527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36672 (request call id 937) took 1524 ms. Trace:
I20260709 12:27:32.830142  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:32.830145 13844 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:32.834789 10527 rpcz_store.cc:276] 0709 12:27:31.227878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.228081 (+   203us) service_pool.cc:224] Handling call
0709 12:27:31.251994 (+ 23913us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:31.279149 (+ 27155us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:27:31.333218 (+ 54069us) log.cc:844] Serialized 14 byte log entry
0709 12:27:32.479589 (+1146371us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b1800324dc0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b411e07 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f8e0b620b 00007f2f8e0bbd23 00007f2f8e0bc23a 00007f2f8e526a2a
0709 12:27:32.598308 (+118719us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:32.725036 (+126728us) log.cc:844] Serialized 52 byte log entry
0709 12:27:32.725226 (+   190us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:32.725271 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:32.725376 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:32.733140 (+  7764us) raft_consensus.cc:1685] finished
0709 12:27:32.739690 (+  6550us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:32.752567 (+ 12877us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37416,"prepare.queue_time_us":53856,"prepare.run_cpu_time_us":2397,"prepare.run_wall_time_us":8066,"raft.queue_time_us":110549,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":50184,"spinlock_wait_cycles":9275136,"thread_start_us":62107,"threads_started":1,"wal-append.queue_time_us":1200386}
I20260709 12:27:32.829223  9957 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
W20260709 12:27:32.836490  9885 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1479) took 2946 ms (client timeout 3102 ms). Trace:
W20260709 12:27:32.836957  9885 rpcz_store.cc:269] 0709 12:27:29.890381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.029256 (+138875us) service_pool.cc:224] Handling call
0709 12:27:32.836252 (+2806996us) spinlock_profiling.cc:243] Waited 2.23 s on lock 0x7b54002c56d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:32.836420 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5136974080}
I20260709 12:27:32.838497  9881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1484) took 1681 ms. Trace:
I20260709 12:27:32.838936  9881 rpcz_store.cc:276] 0709 12:27:31.157364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.638557 (+481193us) service_pool.cc:224] Handling call
0709 12:27:32.838266 (+1199709us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b54003c5854. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:32.838410 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1240028416}
I20260709 12:27:32.843209  9883 raft_consensus.cc:1240] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10. Ops: []
W20260709 12:27:32.843421 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:32.844990  9713 catalog_manager.cc:5697] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:32.847391 13736 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:32.847179  9713 catalog_manager.cc:5697] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 3 to 4, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 4 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:32.848054 13845 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:32.851634 13766 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:32.852514 13642 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:32.854965 13787 consensus_queue.cc:1059] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:32.856426  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:32.856581 13787 raft_consensus.cc:3055] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:32.856709  9854 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:32.860870  9808 raft_consensus.cc:1240] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:32.860939 13787 raft_consensus.cc:740] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:32.861649 13736 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:32.862032 13736 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:32.859123  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:32.862408 13736 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:32.863593  9813 raft_consensus.cc:1240] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:32.865348  9854 leader_election.cc:400] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8.
I20260709 12:27:32.865679  9854 leader_election.cc:403] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:27:32.866250 13642 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8.
I20260709 12:27:32.862231 13787 consensus_queue.cc:260] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:32.868379  9854 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:32.868687 13787 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:32.862725  9814 raft_consensus.cc:1240] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:32.857297  9956 raft_consensus.cc:2393] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 12: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:32.873533  9813 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af001ec909824ed199d355fd69f43ede"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:27:32.874550  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:32.856523 13639 consensus_queue.cc:1059] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:27:32.876152  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:32.877475  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:32.878461  9815 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:32.872426  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:32.857300  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:32.880725  9957 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:32.876502 13639 raft_consensus.cc:3055] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:32.881667 13639 raft_consensus.cc:740] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:32.863253  9811 raft_consensus.cc:2393] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 12: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:32.881740  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:32.903965 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:32.869436 13642 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:32.913331 10527 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:32.899447 13824 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:32.914525  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:32.917464  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 247012us
I20260709 12:27:32.918450  9779 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:32.919250 13849 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.920073 13849 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:32.921407 13455 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:32.921980 13454 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:32.922142 13455 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:32.922689 13454 raft_consensus.cc:697] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:27:32.935909 13779 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.111s	user 0.013s	sys 0.055s
I20260709 12:27:32.909634 13642 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:32.939711  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:32.954452  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:32.958480  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 142019us
I20260709 12:27:32.958360 13599 consensus_queue.cc:1059] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:27:32.959332  9928 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:32.959558 13599 raft_consensus.cc:3055] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:32.959941 13599 raft_consensus.cc:740] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:32.960821  9928 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:32.961045 13599 consensus_queue.cc:260] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:32.962013 13544 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.962565 13792 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:27:32.962811 13845 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:32.963330 13845 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:32.962860 13544 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:32.964463 13706 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.964529  9813 raft_consensus.cc:606] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:27:32.914052  9713 catalog_manager.cc:5697] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 4 to 7, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 7 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:32.965240  9813 raft_consensus.cc:614] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:32.965206 13706 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:32.962154 13651 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:32.966217 13455 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:32.963714 13845 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:32.953481 13766 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:32.967509 13706 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:32.968458 13660 consensus_queue.cc:1059] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:27:32.969709 13660 raft_consensus.cc:3055] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:32.970055 13660 raft_consensus.cc:740] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:32.971025 13660 consensus_queue.cc:260] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:32.972282 13660 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:32.964763  9928 leader_election.cc:400] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6.
I20260709 12:27:32.940462 13642 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:32.988742 13544 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:32.989650 13454 consensus_queue.cc:237] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:32.999876 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:33.000171 13849 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:33.000562 10532 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:32.993376 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:32.994083 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:33.003818 10528 raft_consensus.cc:2410] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:27:32.996436  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:33.005033  9890 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:32.998037  9854 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:32.998436 13639 consensus_queue.cc:260] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:32.998950  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:27:32.999369  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:32.999702 13793 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.077s	user 0.049s	sys 0.041s
I20260709 12:27:33.011054  9815 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:33.011809 13590 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:33.011919  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:33.041011  9854 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:33.043057  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:33.045645  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:33.046504  9881 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:33.015103 13793 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.207s	user 0.049s	sys 0.041s
I20260709 12:27:33.051028 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:32.981803 13736 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.014767 13706 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:27:32.952970 13779 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.129s	user 0.014s	sys 0.055s
I20260709 12:27:33.055930  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:33.056174  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:33.059007  9962 raft_consensus.cc:2393] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:33.058041  9713 catalog_manager.cc:5697] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:27:33.047528 13761 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:33.062394 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:33.064097  9853 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:33.065680  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:33.053846 13599 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:33.078754 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:33.056591 13706 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.082299 10524 raft_consensus.cc:2393] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:33.088104 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:33.088944 10528 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:33.089004  9883 raft_consensus.cc:2410] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:27:33.063771 13761 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.091609  9927 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:33.093734  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 192591us
I20260709 12:27:33.094090 13765 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:33.094683 13765 raft_consensus.cc:697] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:33.095701 13765 consensus_queue.cc:237] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.096825 13844 consensus_queue.cc:1059] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:27:33.098523 13843 raft_consensus.cc:3055] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:33.099058 13843 raft_consensus.cc:740] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:33.100485 13843 consensus_queue.cc:260] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.101313  9807 raft_consensus.cc:1240] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:33.103762 13711 consensus_queue.cc:1059] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:33.105719  9812 raft_consensus.cc:1240] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: []
W20260709 12:27:33.103065 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 292663us
I20260709 12:27:33.107990 13843 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:33.110446 13546 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:33.115401  9812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 2190) took 1777 ms. Trace:
I20260709 12:27:33.115922  9812 rpcz_store.cc:276] 0709 12:27:31.338452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.340920 (+  2468us) service_pool.cc:224] Handling call
0709 12:27:31.341254 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:33.109881 (+1768627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:33.115102 (+  5221us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54000307d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:33.115335 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4056738176}
W20260709 12:27:33.119006 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 243556us
I20260709 12:27:33.119230 10496 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
W20260709 12:27:33.123085  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 124282us
I20260709 12:27:33.083922 13639 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:33.085520 13706 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:33.122661 13761 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:33.136402 13766 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:27:33.155440  9710 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59992 (request call id 299) took 25690 ms (client timeout 15000 ms). Trace:
I20260709 12:27:33.156003 13766 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:33.156611 13766 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:33.137418  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 54802.6us
I20260709 12:27:33.138763 13801 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:33.158461 13695 consensus_queue.cc:1048] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:33.092439  9713 catalog_manager.cc:5697] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:33.160322  9713 catalog_manager.cc:5697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:33.158810 13801 raft_consensus.cc:697] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:33.163319 13801 consensus_queue.cc:237] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.165743  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:33.166164 13802 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.166707 13802 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.168926 13802 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:33.174765 13695 consensus_queue.cc:1059] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:33.162079  9713 catalog_manager.cc:5697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 4 to 6, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 6 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:33.176033 13546 raft_consensus.cc:3055] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:33.177299 13546 raft_consensus.cc:740] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:33.178464 13546 consensus_queue.cc:260] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.182433 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:33.183539  9881 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:33.183853 13856 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:33.199513 13856 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.199942 13856 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:33.184208 13546 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:33.205031 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:33.205444 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:33.205564 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:33.205737 10532 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:33.206163 10524 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:33.209553 13761 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.210754 10527 raft_consensus.cc:1240] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:33.079875 13590 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.217182 13640 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:33.217900 13590 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:33.187291 10528 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:27:33.230851  9961 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
W20260709 12:27:33.239534  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:33.240250  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:33.243551  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 140317us
I20260709 12:27:33.245671 10524 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:33.182013  9713 catalog_manager.cc:5697] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 7 to 8, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 8 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
W20260709 12:27:33.249827 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 61578.6us
W20260709 12:27:33.254236  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:33.217933 13640 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:33.255511  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 96655.8us
W20260709 12:27:33.262638  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:33.174085 13642 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.247923 13590 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.217402 13856 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:33.272969  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 228552us
I20260709 12:27:33.263048 13640 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:33.283133 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:33.298954  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:33.304011  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:33.303936  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:33.306135  9883 raft_consensus.cc:2393] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 13: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:33.281373 13765 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:27:33.318776 10529 raft_consensus.cc:2393] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:27:33.320151  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 53063.7us
I20260709 12:27:33.291706 13660 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:27:33.331957  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 166286us
I20260709 12:27:33.335327  9886 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:33.290093 13766 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:33.350487  9927 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:33.327569 13454 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:33.351780  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:33.344518  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:33.366555  9887 raft_consensus.cc:1275] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:33.349191  9884 raft_consensus.cc:1240] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: []
W20260709 12:27:33.155929  9710 rpcz_store.cc:269] 0709 12:27:07.488931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.538979 (+ 50048us) service_pool.cc:224] Handling call
0709 12:27:33.155190 (+25616211us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:23.015680 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:23.110007 (+ 94327us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:23.110072 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:27:23.110094 (+    22us) tablet.cc:662] Decoding operations
0709 12:27:23.111018 (+   924us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:23.111092 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:23.111123 (+    31us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:27:23.111943 (+   820us) tablet.cc:701] Row locks acquired
0709 12:27:23.111992 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:27:23.112187 (+   195us) write_op.cc:270] Start()
0709 12:27:23.112330 (+   143us) write_op.cc:276] Timestamp: P: 1783600043112117 usec, L: 0
0709 12:27:23.112350 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:27:23.248116 (+135766us) log.cc:844] Serialized 3199 byte log entry
0709 12:27:24.407171 (+1159055us) spinlock_profiling.cc:243] Waited 9.86 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8b4120ac 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f8e0b620b
0709 12:27:25.104444 (+697273us) op_driver.cc:464] REPLICATION: finished
0709 12:27:25.139096 (+ 34652us) write_op.cc:301] APPLY: starting
0709 12:27:25.139210 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:25.139414 (+   204us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:25.139452 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:25.140827 (+  1375us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:25.141174 (+   347us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:27:25.141220 (+    46us) write_op.cc:312] APPLY: finished
0709 12:27:25.141566 (+   346us) log.cc:844] Serialized 65 byte log entry
0709 12:27:25.143546 (+  1980us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:25.143667 (+   121us) write_op.cc:454] Released schema lock
0709 12:27:25.143723 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:25.177539 (+ 33816us) spinlock_profiling.cc:243] Waited 7.33 ms on lock 0x7b54001abb54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e517e28 00007f2f91f52581 00007f2f91f51d58 00007f2f91f569f1 00007f2f91f569a9 00007f2f91f56939 00007f2f91f56901 00007f2f91f55b2d 0000000000388634 0000000000388479
0709 12:27:25.177734 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:25.177762 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":337137,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":34326,"apply.run_cpu_time_us":3165,"apply.run_wall_time_us":32907,"num_ops":8,"prepare.queue_time_us":176061,"prepare.run_cpu_time_us":27081,"prepare.run_wall_time_us":2192936,"raft.queue_time_us":67129,"raft.run_cpu_time_us":1207,"raft.run_wall_time_us":38524,"replication_time_us":1991885,"spinlock_wait_cycles":39554176,"thread_start_us":1812729,"threads_started":4,"wal-append.queue_time_us":1784158,"wal-append.run_cpu_time_us":11994,"wal-append.run_wall_time_us":1109875}]]}
I20260709 12:27:33.358536  9713 catalog_manager.cc:5697] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 1 to 2, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 2 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:27:33.359956  9809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 645) took 2467 ms. Trace:
W20260709 12:27:33.368624 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:33.360497  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:33.360857 13856 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:33.361248 13863 log.cc:927] Time spent T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:27:33.361686 13736 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:33.363276 10497 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:33.348542 13590 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.365413  9778 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:33.335681 13770 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.291785 13805 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:27:33.379998  9713 catalog_manager.cc:5697] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:33.386168 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:33.387027 10524 raft_consensus.cc:2393] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 12: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:33.382433 13765 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:33.391381 13765 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.392364 10497 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:33.393426 13765 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:33.394105 13779 raft_consensus.cc:2764] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:27:33.382385 13770 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.394996 13607 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:33.395403 13607 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.395746 13607 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:33.396879 13770 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:33.386624  9779 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:33.378012 13844 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:33.368520  9809 rpcz_store.cc:276] 0709 12:27:30.892907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.012727 (+119820us) service_pool.cc:224] Handling call
0709 12:27:31.013107 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:32.916421 (+1903314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:32.916501 (+    80us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:32.917264 (+   763us) log.cc:844] Serialized 26 byte log entry
0709 12:27:33.089796 (+172532us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:33.089841 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:33.122328 (+ 32487us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:33.359507 (+237179us) raft_consensus.cc:1685] finished
0709 12:27:33.359524 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:33.359790 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1700859,"raft.queue_time_us":1712313,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"thread_start_us":350587,"threads_started":2,"wal-append.queue_time_us":352107}
I20260709 12:27:33.420390  9807 raft_consensus.cc:1275] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:33.420295  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:33.423094 13852 raft_consensus.cc:3055] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:27:33.434383  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:33.435053 13711 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:27:33.449741  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 92737.6us
I20260709 12:27:33.450538  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:33.437399 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 48580.7us
W20260709 12:27:33.451534  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 94971.3us
I20260709 12:27:33.382961 13761 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:33.448553  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:33.471800 13706 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.476722 13740 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:33.478448 13856 consensus_queue.cc:1059] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:33.480788 13640 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:33.481266 13770 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:33.481719 13770 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:33.484279  9886 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:33.500794  9713 catalog_manager.cc:5697] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
W20260709 12:27:33.537012  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 47208.7us
I20260709 12:27:33.374639 13454 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.548259  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:33.446844 13852 raft_consensus.cc:740] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:33.550457  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:33.551383  9963 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:33.552731  9956 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:33.485263 13770 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:33.554798  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 104347us
I20260709 12:27:33.558976  9886 raft_consensus.cc:1240] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:33.560720 13640 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:33.562407 13785 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:27:33.562692 13607 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.482712 13711 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.487211 13759 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.565079 13590 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:33.554339 13781 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.565663  9778 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:33.573578 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:33.574103 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:33.574645 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:33.651242 10532 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:33.652422  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:33.653875  9887 raft_consensus.cc:1240] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:33.577045 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:33.654780 10533 raft_consensus.cc:2393] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 12: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:27:33.577965 13860 log.cc:927] Time spent T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:27:33.578461 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:33.578713 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:33.656430  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:33.659672 13607 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:33.656611 10524 raft_consensus.cc:2393] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 11: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:33.660009  9886 raft_consensus.cc:2393] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 11: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:33.620752 13765 consensus_queue.cc:1048] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 12:27:33.656272  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 111318us
I20260709 12:27:33.582976 13642 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:33.570152 13706 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:33.487957 13844 raft_consensus.cc:697] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:33.654903 13781 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.664417 13844 consensus_queue.cc:237] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:33.665409  9778 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:33.598531  9889 raft_consensus.cc:1240] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:33.598773  9882 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:27:33.599380 13868 log.cc:927] Time spent T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:27:33.666939 13599 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.603161 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:33.667900 10528 raft_consensus.cc:2393] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 13: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:33.593899 13761 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.673259 13599 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.607847  9779 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:33.608585 13843 consensus_meta.cc:287] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.500s	user 0.012s	sys 0.003s
W20260709 12:27:33.553462 13845 consensus_meta.cc:287] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.586s	user 0.012s	sys 0.004s
I20260709 12:27:33.674819 13781 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:33.675055 13845 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:33.658344 13785 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:33.675434 13599 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:33.680919  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:33.681736 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:33.681886  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:33.683066  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:33.683149 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:33.683964 10524 raft_consensus.cc:2393] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 12: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:33.684270  9886 raft_consensus.cc:1240] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:33.685221  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:33.685453 13779 consensus_queue.cc:1059] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:33.686255 13779 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:27:33.686585  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 78873.9us
I20260709 12:27:33.687356  9779 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:33.688676  9779 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:33.689523 13455 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:33.690307 13455 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:33.690987 13455 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:33.692270  9779 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:33.639179 13505 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.679896 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:33.676012 13852 consensus_queue.cc:260] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:33.698486 13505 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.699599 13852 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:33.701717 13505 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:33.639863 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:33.647408 13759 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.702688 10530 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 8: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:33.703835 13759 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:33.705026 10528 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:33.646615 13711 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:33.593060  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 44598.9us
I20260709 12:27:33.672178  9956 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:33.667011 13765 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.674036 13761 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.708794 13759 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.709482 13761 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:33.709288 13759 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:33.709810 13862 log.cc:927] Time spent T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:27:33.706837 13765 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:33.711594 13759 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:33.693527  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:33.712690  9889 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:33.655699 13766 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:33.443248 13736 consensus_queue.cc:1059] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.173s
I20260709 12:27:33.695272 13544 consensus_queue.cc:1059] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:33.677201 13845 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:33.677726  9958 raft_consensus.cc:1240] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 12:27:33.717396  9882 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:33.697301  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:33.675760 13454 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:33.692577 10532 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:33.712123 13759 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:27:33.735888  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:33.735996  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 43869.3us
I20260709 12:27:33.738818  9854 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:33.739212  9889 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:27:33.675792 13740 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:33.764851  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:33.770069  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:33.756376 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:33.771683 10530 raft_consensus.cc:2393] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:33.779597 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:33.742580 13785 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:33.780987 10524 raft_consensus.cc:2393] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 11: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:33.773387  9882 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
W20260709 12:27:33.784024 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 145374us
I20260709 12:27:33.756685 13455 consensus_queue.cc:1059] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:27:33.803788  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:33.805492 10525 raft_consensus.cc:1240] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:33.805980 10524 raft_consensus.cc:1240] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:33.808457  9886 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:27:33.808928  9886 pending_rounds.cc:85] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 7
I20260709 12:27:33.810667  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:33.811658  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:33.801688  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:33.812417  9889 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:33.811494  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:33.816139  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:33.817342  9779 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:33.781608 13706 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:33.814707  9813 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:33.820478 13785 raft_consensus.cc:697] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:33.822268  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:33.809221  9886 pending_rounds.cc:107] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:27:33.828457  9882 raft_consensus.cc:1240] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:33.840077  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:33.841009  9961 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:33.844062 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:33.844821 10524 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:33.756855 13759 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:33.817297  9928 connection.cc:256] RPC call timeout handler was delayed by -1.3013719059999858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2312s for a response
I20260709 12:27:33.822882  9808 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:33.824215  9886 raft_consensus.cc:2889] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:33.854549  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:33.856794 13765 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:33.858538  9889 raft_consensus.cc:1275] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:33.854606  9883 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:33.862743 13785 consensus_queue.cc:237] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.869011 13660 raft_consensus.cc:3055] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:33.869524 13660 raft_consensus.cc:740] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:33.869844  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:33.870795  9813 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:33.878230  9927 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:33.885553  9927 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:33.886808  9927 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:33.848624 13454 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:33.895900  9778 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:33.848189 13706 raft_consensus.cc:697] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:33.900954 10525 raft_consensus.cc:1240] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:33.845134 13736 consensus_queue.cc:1059] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:27:33.893204 13711 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:33.892413 13632 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:27:33.909531 13882 log.cc:927] Time spent T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:27:33.912597 13642 raft_consensus.cc:3055] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:33.913175 13642 raft_consensus.cc:740] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:33.914316 13642 consensus_queue.cc:260] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:33.915943 13642 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:33.916642 13544 raft_consensus.cc:3055] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:33.917017 13544 raft_consensus.cc:740] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:33.917779 13544 consensus_queue.cc:260] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:33.918936 13544 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:33.883175 13761 consensus_queue.cc:1059] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:27:33.920715 13761 raft_consensus.cc:3055] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:33.921044 13761 raft_consensus.cc:740] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:33.921888 13761 consensus_queue.cc:260] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:33.923111 13761 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:33.929067 13711 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.928478 13706 consensus_queue.cc:237] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.929565 13711 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:33.931075 13770 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:33.933780 13770 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:33.899639 13454 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:33.934619  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 43513.3us
I20260709 12:27:33.935235 13632 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.935736 13632 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:33.935796  9928 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:33.937068 13736 raft_consensus.cc:3055] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:33.937435 13736 raft_consensus.cc:740] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:33.938329 13736 consensus_queue.cc:260] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:33.939488 13736 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:33.942457  9810 raft_consensus.cc:1240] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: []
W20260709 12:27:33.946143  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 53429.1us
I20260709 12:27:33.947093  9778 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:33.947741 13853 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:33.948637 13853 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:33.949841  9778 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:33.934715 13454 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:33.962692  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 54264.9us
I20260709 12:27:33.977448 10524 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
W20260709 12:27:34.000993  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 65323.2us
W20260709 12:27:34.002729 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 181015us
I20260709 12:27:33.966710 13770 raft_consensus.cc:2804] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:33.904093 13660 consensus_queue.cc:260] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:34.005759 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 147914us
W20260709 12:27:34.099320  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 282020us
I20260709 12:27:34.019712  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.101214  9815 raft_consensus.cc:2393] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 8: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:34.006655 13766 raft_consensus.cc:2804] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:27:34.083914  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:33.999907 13874 consensus_queue.cc:1059] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 12:27:34.006851 13607 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:27:34.017746 13853 consensus_queue.cc:1059] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:27:34.000147 13695 raft_consensus.cc:3055] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:34.003389 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:34.090142  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:34.091609  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 89922.6us
I20260709 12:27:34.090683 13770 raft_consensus.cc:697] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 7 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:34.095235  9813 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:34.095669  9810 raft_consensus.cc:1275] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:27:33.971535 13845 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:34.119442  9890 raft_consensus.cc:1240] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:34.122908  9779 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:34.133031  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:34.135630  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:34.136500  9815 raft_consensus.cc:2393] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 11: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:34.137295  9779 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:27:34.139572  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:34.140579 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 137231us
I20260709 12:27:34.148665  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:34.124943 13695 raft_consensus.cc:740] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:34.114343 13802 consensus_queue.cc:1059] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:27:34.156656  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.166884 13762 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.167403 13762 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.169365 13762 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:34.170548  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.140626 13785 raft_consensus.cc:3055] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:34.184240 13770 consensus_queue.cc:237] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:34.141449 13853 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:34.185922 13802 raft_consensus.cc:3055] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:34.171833  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.138355 13874 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:34.175774  9809 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 13. Current term is 14. Ops: [11.11-13.12]
W20260709 12:27:34.177019  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 48924.8us
I20260709 12:27:34.177168 13632 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.179047  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.179556 13896 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:34.183414 13740 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:34.224408  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:34.170547 13759 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:34.199553  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:34.173954  9810 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:34.154359 13856 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:34.186317 13802 raft_consensus.cc:740] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:34.238418  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:34.238515 13802 consensus_queue.cc:260] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.239259  9808 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 13: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:34.240069  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.240669  9808 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:34.241466  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:34.241667  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:34.229708 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 76196.4us
I20260709 12:27:34.203603  9928 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:34.241984  9808 raft_consensus.cc:2376] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12. Re-sending same reply.
W20260709 12:27:34.247876  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:34.248291  9963 raft_consensus.cc:1275] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:34.248591  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.233814 13844 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.249083 13695 consensus_queue.cc:260] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.249471 13844 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.243563 13632 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:34.251883 13844 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:34.184249 13785 raft_consensus.cc:740] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:34.236686  9811 raft_consensus.cc:2393] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:34.189437 13736 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:34.252807 13736 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.252959 13785 consensus_queue.cc:260] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:34.231691 13896 raft_consensus.cc:697] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:34.254211 13785 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:34.254642  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:34.255218 13736 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:34.256496 10496 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
W20260709 12:27:34.257107  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:34.257418 13607 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:34.246124  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:34.257681 10496 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:34.258206  9807 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:34.258980 13867 raft_consensus.cc:2804] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:34.259415 13867 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:34.259789 13867 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:34.261219 10496 leader_election.cc:336] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 1.926s (SENT)
I20260709 12:27:34.261665 10496 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:34.249760  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:34.253408  9811 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:34.263366  9808 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:34.242497  9809 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 8: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:34.262795  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.268860  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.269827  9811 raft_consensus.cc:2393] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 10: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
W20260709 12:27:34.236353 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 82936us
I20260709 12:27:34.253553 13711 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:34.324209  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.336464  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:34.337282  9811 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:34.350435  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:34.240064 13802 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:34.250092 13695 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:34.296196 13844 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.338303  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.357904  9962 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:34.363236  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.373575  9808 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:34.243294 13766 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:34.243572 13856 raft_consensus.cc:697] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:27:34.365664 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:34.366880  9961 raft_consensus.cc:1240] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:27:34.370342  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:34.371187  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:34.381639  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:34.371091 13455 consensus_queue.cc:1048] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:27:34.378458  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 174902us
I20260709 12:27:34.363236  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:34.379769  9963 raft_consensus.cc:2393] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:34.378142  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.386942  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.245143 13454 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.357218 13632 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:34.395007  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.380857 13766 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:34.403182  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.430869  9959 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:34.381327 13844 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.433686 13844 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:34.406613  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.434628  9956 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:34.434906  9810 raft_consensus.cc:2393] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:34.407284  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:34.435967 13454 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:34.436424  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:34.437868  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 51936.5us
I20260709 12:27:34.410888  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.438990  9812 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:34.439021  9928 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:34.440222  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:34.437953  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.441731  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:34.442462  9808 raft_consensus.cc:2393] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 11: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:34.443224  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.443763  9808 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:34.444499  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:34.411938 13711 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:34.412875 13856 consensus_queue.cc:237] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.415096  9807 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:34.418331  9811 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:34.418529 13905 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.423177  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.395893 13904 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:34.424041  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:34.425349  9962 raft_consensus.cc:1275] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:27:34.426017  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:34.427830 13852 consensus_meta.cc:287] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.728s	user 0.007s	sys 0.004s
I20260709 12:27:34.458384  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.256089 13896 consensus_queue.cc:237] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.442510  9779 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:34.374369 13853 raft_consensus.cc:697] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:34.394630 13845 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:34.459348  9928 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:34.459230  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:34.461091  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.460995  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.457929  9778 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:34.471302 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 151368us
I20260709 12:27:34.472056  9807 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:34.475916  9808 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:34.476837  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.455415 13844 raft_consensus.cc:2804] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:34.481398  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.481335  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:34.454742 13642 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.485638  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:34.481376  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 67305.9us
I20260709 12:27:34.486548  9779 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:34.486732  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.487890  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.491550  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:34.480803  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 192328us
I20260709 12:27:34.482079  9811 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:34.496496  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:34.483676  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.493520  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.497063  9814 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:34.497115  9853 leader_election.cc:336] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 1.503s (SENT)
I20260709 12:27:34.493767  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.497566  9962 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:34.495213  9807 raft_consensus.cc:2393] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:34.492303  9812 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
W20260709 12:27:34.497745  9853 leader_election.cc:336] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.503s (SENT)
I20260709 12:27:34.497818  9959 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:34.498370  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:34.493702  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:34.503342  9811 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:34.481678 13904 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.485517 13781 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:34.510177  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.506300  9779 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:34.508550  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:34.511400  9811 raft_consensus.cc:1275] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:34.494030 13454 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:34.511890  9956 raft_consensus.cc:2368] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10.
I20260709 12:27:34.473747 13632 consensus_queue.cc:1059] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:27:34.512729  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.512856  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.514439  9959 raft_consensus.cc:2393] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 13: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:34.507472  9807 raft_consensus.cc:1240] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:27:34.515825  9812 raft_consensus.cc:1240] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:34.517460  9958 raft_consensus.cc:2393] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:34.513603  9962 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:34.490373 13907 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:27:34.517108 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:34.558037 10496 leader_election.cc:336] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 1.661s (SENT)
I20260709 12:27:34.558679 10496 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:34.460929 13905 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.490170 13455 consensus_queue.cc:1048] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 12:27:34.562922  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 56751.7us
I20260709 12:27:34.555488 10530 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:34.566614  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.494117 13642 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.567174  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:34.566087 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 83756us
I20260709 12:27:34.568634  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:34.572041  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:34.567302  9853 leader_election.cc:336] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.545s (SENT)
I20260709 12:27:34.588689  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.589922  9853 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:34.592958  9958 raft_consensus.cc:2393] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:34.591013  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.555399 13706 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:34.560012 13544 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:34.596227  9854 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:34.512099 13904 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.563217 13781 raft_consensus.cc:697] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:34.566452  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:34.606763  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 43771.7us
I20260709 12:27:34.598649  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.608760  9779 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:34.588521 13910 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.622551  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.626875  9779 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:34.607368 13639 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:34.628944  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.619360 13736 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:34.636993  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.641460  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.645278  9779 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:27:34.641180 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 83179.5us
I20260709 12:27:34.625725 13916 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:34.623121 13844 raft_consensus.cc:697] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:34.619669 13544 consensus_queue.cc:1048] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:27:34.654544  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:34.599859 13915 consensus_queue.cc:1059] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:27:34.630252 13770 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:34.640332 13785 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:34.637861 13736 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:34.698113  9881 raft_consensus.cc:1240] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13. Ops: []
W20260709 12:27:34.706651  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:34.700769  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 55570us
I20260709 12:27:34.665222  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:34.659375 13913 log.cc:927] Time spent T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.141s	user 0.001s	sys 0.001s
I20260709 12:27:34.708591  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:34.710096  9964 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 8: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:34.598380 13853 consensus_queue.cc:237] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.709430  9888 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:34.712735  9959 raft_consensus.cc:2393] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 13: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:34.713568 10530 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:27:34.647451 13895 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:34.715330 10528 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:60770
I20260709 12:27:34.717468  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:34.718022  9960 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:34.627041 13910 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.721544  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.722062 13905 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:34.709038 13736 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:34.706338 13761 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.648531 13766 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.727349  9964 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:27:34.657290 13867 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.725840 13785 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:34.744513 13904 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:34.736613  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.749835  9960 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:34.763629  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.764307  9811 raft_consensus.cc:3055] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:34.764683  9811 raft_consensus.cc:740] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:27:34.753224  9853 leader_election.cc:336] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.744s (SENT)
I20260709 12:27:34.766997  9853 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:34.770465  9886 raft_consensus.cc:1240] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:34.706032 13781 consensus_queue.cc:237] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.776922  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.777033  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:34.777757  9882 raft_consensus.cc:1240] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:34.779321  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:34.783428  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:34.784256  9889 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:34.769887  9811 consensus_queue.cc:260] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.732712 13761 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.766832 13785 raft_consensus.cc:697] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:34.792837  9888 raft_consensus.cc:1275] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:27:34.795140  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.800309 13766 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:34.795213 13779 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:27:34.801430 13779 consensus_queue.cc:1243] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer 4104e34a61b7448281d6d91ce23ebf71 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:27:34.802757 13914 log.cc:927] Time spent T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:27:34.805979  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:34.806560  9964 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:34.809862  9853 leader_election.cc:336] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.788s (SENT)
I20260709 12:27:34.804813 13910 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:34.787432 13918 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.815335  9886 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:34.815500  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:34.815685  9853 leader_election.cc:336] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 1.788s (SENT)
I20260709 12:27:34.816028  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:34.816121  9853 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:34.819802 13918 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:34.820964 13761 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:34.796475 13642 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:34.823146 13885 log.cc:927] Time spent T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.708s	user 0.000s	sys 0.010s
W20260709 12:27:34.824023  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:34.793418 13639 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.824815  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.825503  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:34.827678  9888 raft_consensus.cc:2410] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 11 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 12:27:34.828594  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:34.829674  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:34.829550 13785 consensus_queue.cc:237] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:34.830536  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.830722  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.821997 13918 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:34.832455  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:34.785437 13904 consensus_queue.cc:1048] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:27:34.832996  9959 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:34.851550  9853 leader_election.cc:336] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.788s (SENT)
I20260709 12:27:34.855260  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.860265  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:34.860654  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:34.865406 10496 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:34.870415  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.871014  9962 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:34.875394  9815 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
W20260709 12:27:34.871112  9853 leader_election.cc:336] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 1.846s (SENT)
I20260709 12:27:34.877249  9853 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:34.854038 13761 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:34.878607  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:34.879551  9960 raft_consensus.cc:2393] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:34.879475 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:34.844340 13639 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.882514 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:34.785722 13844 consensus_queue.cc:237] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.885087 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:34.889858  9964 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:34.865437  9885 raft_consensus.cc:2955] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:34.897528 10525 raft_consensus.cc:2393] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:34.897571 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:34.900120  9779 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:34.897944 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:34.901165 10529 raft_consensus.cc:2393] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:34.901544  9779 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:34.906243  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:34.907025  9882 raft_consensus.cc:2393] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 10: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:34.907263  9889 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
W20260709 12:27:34.908079 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:34.908946 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:34.883492 13915 consensus_queue.cc:1243] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer 963185e117384b2085d7cea02a64478b log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:27:34.909363  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:34.909765 10527 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:34.826756 13824 raft_consensus.cc:2955] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:34.904248 13911 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:27:34.925767  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:34.927088  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:34.928180  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:34.923647  9814 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:34.933954  9779 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:34.914511 13785 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:27:34.943509  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:34.948325 13923 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:34.948501 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:34.948757 10526 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:34.948650 13941 consensus_queue.cc:1059] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:27:34.949108 13922 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:34.949460 13941 consensus_queue.cc:1243] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Peer 4104e34a61b7448281d6d91ce23ebf71 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:27:34.924688 13761 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:34.950325 13938 raft_consensus.cc:3055] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:27:34.950634  9882 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:34.950755 13938 raft_consensus.cc:740] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:34.951599  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:34.952152  9882 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:34.951601 13938 consensus_queue.cc:260] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:34.949990 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:34.948580 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:34.955224 13929 log.cc:927] Time spent T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:27:34.949193 10529 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:34.925146 13896 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:35.008720 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 121946us
I20260709 12:27:35.010890 13639 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:34.968561 13922 raft_consensus.cc:697] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:27:35.012645 13695 consensus_meta.cc:287] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.635s	user 0.009s	sys 0.000s
I20260709 12:27:35.013375  9882 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:35.012925 13922 consensus_queue.cc:237] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.014551 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:35.016023 10528 raft_consensus.cc:606] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:27:35.016422 10528 raft_consensus.cc:614] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:35.020064 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:35.014370 13867 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:35.022362  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:35.026120  9882 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:35.026512 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:35.026880 10496 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:35.022751 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:34.967900  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 57182.2us
I20260709 12:27:34.937251 13924 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:35.025429  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:35.099655  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.114598 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:35.045933  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:35.039889  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.042547 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:35.129695 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:35.162218  9882 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:35.091799  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:35.028494 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:35.084955  9959 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:35.163664  9885 raft_consensus.cc:2410] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 11 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 12:27:35.160854  9853 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:35.087797 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:35.160974 10525 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:35.171641 10533 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:35.173102  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
W20260709 12:27:35.176977  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 145873us
I20260709 12:27:35.177874  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:35.177809  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:35.099291 13933 log.cc:927] Time spent T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:27:35.029582 13805 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:35.181864  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:35.188731  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:35.050447 13660 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:35.199153 13951 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:35.199754 13951 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.200922  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:35.201613  9889 raft_consensus.cc:2393] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 10: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:35.055552 13599 raft_consensus.cc:3055] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:35.202423 13599 raft_consensus.cc:740] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:35.202571  9889 raft_consensus.cc:1240] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:35.203848  9889 raft_consensus.cc:1240] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:35.189410  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:35.204813 13736 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.205117  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:35.037881 13905 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:35.036533 13711 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.191805  9812 raft_consensus.cc:2393] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:35.206864  9884 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:35.181366 13943 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:27:35.192538  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:35.209600  9885 raft_consensus.cc:1275] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:35.192725 13845 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:35.192909 13948 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:35.193192  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:35.211937  9807 raft_consensus.cc:2376] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10. Re-sending same reply.
I20260709 12:27:35.174185 13792 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.168761 13639 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.046852 13874 consensus_queue.cc:1059] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.162s
W20260709 12:27:35.087993  9698 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d1e4bd6e7a424475b1d707bfa268d54e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f5208640a51f493e930ce4f64ceeed0b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:35.203322 13599 consensus_queue.cc:260] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.207638  9882 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:35.190042  9853 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:35.198632 13924 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:35.050421 13930 consensus_queue.cc:1059] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.160s
I20260709 12:27:35.218246  9889 raft_consensus.cc:1275] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:27:35.218174  9812 raft_consensus.cc:1240] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:27:35.223794  9807 raft_consensus.cc:1217] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 4.4->[4.5-10.7]   Dedup: 4.5->[7.6-10.7]
I20260709 12:27:35.221666  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:35.226308  9812 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:35.224264  9807 pending_rounds.cc:85] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71: Aborting all ops after (but not including) 5
W20260709 12:27:35.227387  9698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 139550us
I20260709 12:27:35.227826  9807 pending_rounds.cc:107] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:27:35.228380  9807 raft_consensus.cc:2889] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:35.191263 13896 consensus_queue.cc:1059] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:27:35.234871 13907 raft_consensus.cc:3055] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:35.221179 13924 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:35.211499 13711 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.235275 13907 raft_consensus.cc:740] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:35.220402 13951 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:35.247745 10496 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:35.244988  9807 raft_consensus.cc:2955] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:35.219702 13639 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:35.253160  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.233919 13943 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:35.253942  9962 raft_consensus.cc:1275] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:27:35.218458 13792 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.260187 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:35.261255  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.251386 13599 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:35.243687 13924 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:35.215585 13948 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.251272 13736 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:35.272511 13785 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:35.252882 13706 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:27:35.274215  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.257714 13930 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:35.256943 13943 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:35.277081 10496 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:35.285657 13905 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:35.292892  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 102912us
I20260709 12:27:35.294474 13943 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:35.306717 10496 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:35.311033 13792 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:35.303891  9853 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:35.318842  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:35.294260 13706 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:35.322122 13711 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:35.319519  9889 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:27:35.303728 13695 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:35.332650  9853 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:35.343078  9806 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:27:35.351585  9812 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:35.342041 13942 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:35.330690 13905 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:35.357508  9853 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:35.366528 13905 raft_consensus.cc:697] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:27:35.367079 13945 log.cc:927] Time spent T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:27:35.367652 13905 consensus_queue.cc:237] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.368614 13948 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:35.335078 13736 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:35.371173  9888 raft_consensus.cc:1240] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:27:35.352746 13706 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:35.384914  9853 leader_election.cc:336] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.958s (SENT)
I20260709 12:27:35.387128  9853 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:35.335911 13792 consensus_queue.cc:1059] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:27:35.296844 13907 consensus_queue.cc:260] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.394874 13907 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:35.395095 13921 raft_consensus.cc:3055] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:35.395602 13921 raft_consensus.cc:740] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:35.396566 13921 consensus_queue.cc:260] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.397763 13921 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:35.401151 13765 raft_consensus.cc:3055] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:35.401630 13765 raft_consensus.cc:740] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:35.402649 13765 consensus_queue.cc:260] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.403823 13765 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:35.385713 13761 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:35.371512 13736 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:35.411631  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:35.422847  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 245084us
W20260709 12:27:35.424577 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.409756 13639 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:35.412667 13736 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:35.435098 13922 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:35.416342 13942 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 12:27:35.435866  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 50986.4us
I20260709 12:27:35.435786 13922 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.422467 13706 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:35.439282 10533 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:27:35.445317  9928 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:35.446599  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:35.462154  9814 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 13: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:35.446132  9809 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
W20260709 12:27:35.443157  9853 leader_election.cc:336] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 2.012s (SENT)
I20260709 12:27:35.464437  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:35.449815  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 654) took 1314 ms. Trace:
I20260709 12:27:35.466537  9813 rpcz_store.cc:276] 0709 12:27:34.136296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.142073 (+  5777us) service_pool.cc:224] Handling call
0709 12:27:35.449595 (+1307522us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b5400252bd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:35.449732 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1604705536}
I20260709 12:27:35.457516 10496 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:35.468860  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.468765  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:35.469573  9813 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:35.474035  9927 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:35.474638  9853 leader_election.cc:336] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 2.061s (SENT)
I20260709 12:27:35.438441 13930 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:35.438246 13922 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:35.485047  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:35.474252 13639 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:35.476236 13505 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:35.461655 13864 consensus_queue.cc:1059] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:27:35.492518  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:35.493008  9957 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:27:35.496726  9853 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:35.498888  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 53699.4us
I20260709 12:27:35.500341  9928 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:35.481267 13954 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:35.483057 13599 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:35.449421 13736 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.503659  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:35.505775  9960 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
W20260709 12:27:35.507783  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.491313 13505 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:35.508632 13874 consensus_queue.cc:1059] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:27:35.518638 13639 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.518743 13505 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:35.519196 13639 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:35.521487 13639 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:35.488387 13930 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.522532  9928 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:35.523849  9928 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:35.524506 13930 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:35.525439  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:35.525553  9928 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:35.527070  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:35.529150 13740 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.529810 13740 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.531191  9853 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:35.538668 13957 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:35.533842 13844 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:35.539057  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:35.539794  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:35.538447 13852 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:35.544646 13852 raft_consensus.cc:697] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:35.544543  9888 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:35.546447  9853 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:35.536702 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:35.550414 10533 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:35.533182 13740 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:35.484258 13711 consensus_queue.cc:1048] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:27:35.545671 13852 consensus_queue.cc:237] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:35.553323  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:35.560825  9959 raft_consensus.cc:3060] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:35.556193  9853 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:35.559456  9813 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:35.500079 13907 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.503103 13942 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:35.562826 10496 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:35.571550  9960 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:27:35.571735  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:35.580866  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.519193 13874 raft_consensus.cc:3055] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:35.596639  9927 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:35.534354 13951 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:35.555974 13639 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:35.535296 13706 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:35.599694  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.599622  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:27:35.574016 13770 consensus_meta.cc:287] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.867s	user 0.008s	sys 0.004s
I20260709 12:27:35.595891 10496 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:35.643781  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:35.555346 13954 raft_consensus.cc:697] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:35.646395  9813 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:35.597357 13907 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:35.598541 13921 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:35.647534 13921 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:35.647927 13921 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:35.649492  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 101603us
I20260709 12:27:35.651026  9853 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:35.571215 13966 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.654392 13957 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:35.654644 13966 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:35.657055 13966 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:35.657640 13966 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:35.658821 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 63015.1us
I20260709 12:27:35.580509 13761 raft_consensus.cc:697] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
W20260709 12:27:35.666174  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.672870  9959 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:35.597028 13874 raft_consensus.cc:740] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:35.662438 13770 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:35.594444 13844 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 12:27:35.675818 13905 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:27:35.706509  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 55566.1us
I20260709 12:27:35.679867 13948 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:27:35.707278  9853 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:35.645349 13711 consensus_queue.cc:1048] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:27:35.708914  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:35.678257 13957 raft_consensus.cc:697] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:35.682332 13922 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:27:35.722885 13957 consensus_queue.cc:237] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:35.660440 13924 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:35.706846 13905 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:35.733424  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:35.733943  9853 leader_election.cc:336] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 2.235s (SENT)
I20260709 12:27:35.735137  9853 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:35.738976 13971 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:27:35.740928 13909 log.cc:927] Time spent T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259: Append to log took a long time: real 1.152s	user 0.002s	sys 0.003s
I20260709 12:27:35.741190  9853 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:35.719254 13942 raft_consensus.cc:2764] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:27:35.685701 13943 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.732550 13905 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:35.750648  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:35.752444  9814 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:35.742096 13761 consensus_queue.cc:237] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:35.758512 13736 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:35.752619 13971 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:27:35.761420 13938 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:35.770519 13973 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:35.793180 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:35.811313  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 70179.7us
W20260709 12:27:35.811463 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 133579us
I20260709 12:27:35.812587  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:35.812788 10496 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:35.713404 13954 consensus_queue.cc:237] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.822440 13505 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.819064 13971 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:35.826538 13971 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:35.826924 13971 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:35.830658 13966 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:35.777117 13973 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:35.823666 13921 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.822645 13974 raft_consensus.cc:2804] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:27:35.822626  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 222764us
I20260709 12:27:35.863483  9928 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:35.845417  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:35.865703  9881 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:35.859710  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:35.860209 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:35.833817  9814 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:27:35.833961 13505 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:35.847463 13973 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:35.847656 13921 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:35.844241 13924 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:35.876416 13972 raft_consensus.cc:2804] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:35.890045 13972 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:35.890494 13972 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:35.891304 13867 raft_consensus.cc:3055] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:35.891602 10497 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:35.891914 13867 raft_consensus.cc:740] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:35.892858 13867 consensus_queue.cc:260] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.893474 13930 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:35.893853 13867 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:35.893884 13930 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:35.894359 13922 consensus_queue.cc:1175] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "963185e117384b2085d7cea02a64478b" responder_term: 8 status { last_received { term: 8 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 8 index: 8 } }
I20260709 12:27:35.841148 13971 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:35.887362  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:35.878850  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.880107 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:35.900655 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:35.900738 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:35.901571 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:35.885355 10528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60770 (request call id 0) took 1183 ms. Trace:
I20260709 12:27:35.879093  9928 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:27:35.904781  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.904357  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:35.918192  9814 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:35.893893 10497 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:35.909575 13896 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.922225  9881 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:35.916896 10528 rpcz_store.cc:276] 0709 12:27:34.701726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.701861 (+   135us) service_pool.cc:224] Handling call
0709 12:27:35.885098 (+1183237us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b5400705154. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e516853 00007f2f934e460a 00007f2f8ca6a7d4 00007f2f8ca6a762 00007f2f8ca6a691 00007f2f8ca6a60c 00007f2f8ca698c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:35.885233 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":689831296}
I20260709 12:27:35.937755  9779 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:35.939263 10530 raft_consensus.cc:2368] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8.
I20260709 12:27:35.941324  9956 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:35.942008 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:27:35.942520  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 63515.2us
W20260709 12:27:35.946023 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 52188.8us
I20260709 12:27:35.948470 10497 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:35.963292  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:35.964226  9814 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:35.910386 13930 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:35.910108 13943 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:35.912158 13454 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.935829 13973 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.936093 13974 raft_consensus.cc:697] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:35.973657 10532 raft_consensus.cc:1240] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:27:35.940089 13923 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.974635  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:35.951424 13770 consensus_queue.cc:1059] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:27:35.976787  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:35.977455  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:35.960745 13844 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:35.961655 13936 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:35.979357  9889 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:27:35.979866  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:35.980546  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:35.981520  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:35.977859  9927 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:35.992836  9957 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:27:35.993893  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:35.969350 13957 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.984268  9887 raft_consensus.cc:1240] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:35.995479  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:35.996747  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:35.997001  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:35.985321 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:35.997424  9928 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:35.982470 13973 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:35.967316 13911 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:35.992277  9960 raft_consensus.cc:2376] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10. Re-sending same reply.
I20260709 12:27:35.951637 13896 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:35.997844  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:36.001957  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:35.998189  9959 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:35.998920  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:36.000049 13711 raft_consensus.cc:2764] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:27:36.004695  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:35.993621 13936 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.001499  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:36.010618 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:36.011371  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:36.011871  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:36.012436  9961 raft_consensus.cc:2376] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9. Re-sending same reply.
I20260709 12:27:36.005321  9963 raft_consensus.cc:2376] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10. Re-sending same reply.
I20260709 12:27:36.000480  9928 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:36.013170  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:36.006049  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:36.011125  9814 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:36.003999  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:36.014974  9958 raft_consensus.cc:2393] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:35.998965 13781 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:35.982771 13852 consensus_queue.cc:1059] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:27:36.016664  9955 raft_consensus.cc:2393] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:35.986048 13905 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.018217 13844 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:36.018373  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:36.025843  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:36.022542  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:35.991819 13923 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:36.048378 13923 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:36.023972  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:35.978425 13454 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:36.048416  9806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2209) took 1786 ms (client timeout 1715 ms). Trace:
I20260709 12:27:36.030175  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:36.052233 10533 raft_consensus.cc:2393] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 11: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:36.049401  9814 raft_consensus.cc:2376] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9. Re-sending same reply.
I20260709 12:27:36.053233 13905 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:36.024623  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:36.016181 13936 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:36.036513 13896 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:36.037099 13971 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:36.038090 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:36.023685 13984 raft_consensus.cc:2764] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:27:36.016013 13911 raft_consensus.cc:697] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:36.046515  9960 raft_consensus.cc:2393] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:36.055558  9963 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
W20260709 12:27:36.055174  9806 rpcz_store.cc:269] 0709 12:27:34.262364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.356933 (+ 94569us) service_pool.cc:224] Handling call
0709 12:27:36.048183 (+1691250us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b54002d7154. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:36.048321 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2211717504}
W20260709 12:27:36.067060  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 99071us
I20260709 12:27:36.067008 10532 raft_consensus.cc:2393] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 8: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:36.070195 13972 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:36.071561  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 47049.9us
I20260709 12:27:36.072072 13766 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:36.075882 13911 consensus_queue.cc:237] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.082607 13896 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:36.075668 13974 consensus_queue.cc:237] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.086098 13972 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:36.082039  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:36.088821 13972 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:36.088929  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:36.089432 13972 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.089633  9888 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:36.089877  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:36.089915 13972 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:36.090866 13766 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:36.092257  9779 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:36.092795 13987 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:36.093672 13973 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:36.094758 13987 raft_consensus.cc:2764] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:27:36.097800  9928 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:36.001230 13957 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.101154 13957 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:36.101722 13957 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:36.102718 13975 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.103221 13975 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.103636 13454 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:36.105460 13975 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:36.105562  9854 leader_election.cc:400] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8.
I20260709 12:27:36.106113  9854 leader_election.cc:403] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:27:36.106933  9883 raft_consensus.cc:1275] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:36.107040  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:36.107769 13943 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:36.107685  9806 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:36.109865  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:36.106060  9853 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:36.032147 13781 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.115222  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:36.119573  9889 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:36.120255  9883 raft_consensus.cc:1240] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:27:36.102087 13957 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.124627  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:36.125213  9806 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:36.125335 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:36.116562  9928 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:36.118829  9927 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:36.126570  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:36.129633  9887 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:36.131451  9853 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:36.119436 13770 consensus_queue.cc:1243] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Peer 963185e117384b2085d7cea02a64478b log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 12:27:36.133172  9810 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 660) took 1894 ms (client timeout 2028 ms). Trace:
W20260709 12:27:36.135443  9810 rpcz_store.cc:269] 0709 12:27:34.238641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.323939 (+ 85298us) service_pool.cc:224] Handling call
0709 12:27:36.132920 (+1808981us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540002e4d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:36.133084 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252554496}
I20260709 12:27:36.133490  9889 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:36.121754 13781 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:36.144624  9853 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:36.145174  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:36.145774  9853 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:36.146894  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:36.147171 13938 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:36.147940  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:36.148615  9808 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:36.149367  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:36.150272  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:36.150810  9808 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:36.150916 13941 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:36.151574  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:36.152109  9808 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:36.152951  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:36.154100  9808 raft_consensus.cc:1240] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:36.137669 10497 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:36.132530 13852 consensus_queue.cc:1059] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:27:36.139065 13766 consensus_queue.cc:1059] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:36.139213 13844 consensus_queue.cc:1048] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:36.129077 13759 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:36.139595  9928 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:36.139940 13948 consensus_queue.cc:1059] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:27:36.142998 13981 log.cc:927] Time spent T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:27:36.143603 13971 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:36.143739 13845 raft_consensus.cc:3055] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:36.130713 13632 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:36.124943 13957 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:36.048903 13923 consensus_queue.cc:1048] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:27:36.161265  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:36.155893  9808 raft_consensus.cc:1240] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:36.163023  9964 raft_consensus.cc:1275] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:36.166874 10529 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:36.166939  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:36.172329  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:36.174639  9885 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:27:36.160480  9961 raft_consensus.cc:1240] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:36.173692  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:36.161653  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:36.167726  9959 raft_consensus.cc:1240] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:36.186168 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:36.224608  9882 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:36.226234  9883 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:27:36.160914  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:36.166244  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.168059  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:36.228626  9955 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:27:36.173183  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:36.229439  9881 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:36.232097  9883 raft_consensus.cc:1275] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:36.183440  9806 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:27:36.147895 13938 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:36.158738  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:36.226596  9958 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:36.225922 10531 raft_consensus.cc:2410] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:27:36.152143  9853 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:36.227435  9779 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:36.185782  9887 raft_consensus.cc:1240] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:36.180562 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:36.164592 13454 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:36.228816  9963 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:36.159407 13915 raft_consensus.cc:3055] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:36.247331  9808 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:36.248701  9812 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:36.162256 13852 raft_consensus.cc:3055] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:36.162334 13907 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:36.282091 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.185457 13845 raft_consensus.cc:740] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:36.285951  9928 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:36.253763 10524 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:27:36.249692  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:36.165637 13919 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:36.262945  9888 raft_consensus.cc:2410] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 11 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 12:27:36.164477 13770 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.154412 13896 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:36.184037 13948 consensus_queue.cc:1243] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Peer 963185e117384b2085d7cea02a64478b log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:27:36.184595 13971 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:36.271179 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.239352 13759 raft_consensus.cc:2804] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:36.154244 13930 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:36.285175  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 133099us
I20260709 12:27:36.288371  9889 raft_consensus.cc:2410] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:27:36.281118  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:36.292323  9810 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:36.291373  9928 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:36.268700 13915 raft_consensus.cc:740] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:36.296959  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:36.312814  9959 raft_consensus.cc:2393] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:36.281908 13942 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:27:36.274135 13852 raft_consensus.cc:740] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:36.311836  9810 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:27:36.289402 13919 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.293484 13844 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:36.316129  9853 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:36.322786 10527 raft_consensus.cc:2393] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:36.304594 13896 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.310984 13845 consensus_queue.cc:260] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:36.325014 13845 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:36.325536 13896 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:36.252907 13986 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 12:27:36.331967  9853 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:36.274492 13454 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.309679 13971 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:36.317550 13948 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:36.311632 13455 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:36.298512 13770 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.290310 13972 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.321036 13919 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:36.347101  9853 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:36.337146 13941 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:36.334427 13642 raft_consensus.cc:2764] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:27:36.351251  9853 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:36.337270  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 107871us
I20260709 12:27:36.339977 13455 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.361006  9853 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:36.357725 13970 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:36.362207 13455 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:36.351956  9810 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:27:36.352185 13966 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:36.368165 13990 log.cc:927] Time spent T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:27:36.421778  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 60856us
I20260709 12:27:36.360517 13938 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:27:36.423039  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 195681us
I20260709 12:27:36.425562  9853 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:36.429395  9810 raft_consensus.cc:1240] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:36.417999 13942 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:36.445019  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:36.420688 13941 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:36.425437 13963 log.cc:927] Time spent T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:27:36.425223 13802 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.453928 13943 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8.
W20260709 12:27:36.454965 13988 log.cc:927] Time spent T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:27:36.455502 13942 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:36.523671 13942 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.460542 13941 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:36.528206 13941 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:36.460567 13936 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:36.531466  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.532305 13936 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:36.351027 13852 consensus_queue.cc:260] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:36.533327 13852 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:36.451920 13642 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:36.467569  9881 raft_consensus.cc:1240] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:36.536465 13642 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.536988 13642 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:36.539966 10526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 1032) took 1424 ms. Trace:
I20260709 12:27:36.540335 10526 rpcz_store.cc:276] 0709 12:27:35.115251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:35.115402 (+   151us) service_pool.cc:224] Handling call
0709 12:27:35.118630 (+  3228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:36.538246 (+1419616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:36.538321 (+    75us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:36.538369 (+    48us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:36.538403 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:36.539716 (+  1313us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400705dd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:36.539773 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:36.539883 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3264302848}
I20260709 12:27:36.442723 13759 raft_consensus.cc:697] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:36.489403 13802 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:36.502856  9815 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 659) took 2264 ms (client timeout 1863 ms). Trace:
W20260709 12:27:36.559329  9815 rpcz_store.cc:269] 0709 12:27:34.238307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.254392 (+ 16085us) service_pool.cc:224] Handling call
0709 12:27:36.501841 (+2247449us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b5400183dd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:36.502765 (+   924us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189277568}
I20260709 12:27:36.503547  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2240) took 1124 ms. Trace:
I20260709 12:27:36.561259  9814 rpcz_store.cc:276] 0709 12:27:35.378725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.014236 (+635511us) service_pool.cc:224] Handling call
0709 12:27:36.497906 (+483670us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b5400451fd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:36.503496 (+  5590us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37758336}
W20260709 12:27:36.504243  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 357299us
I20260709 12:27:36.504535 13770 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:36.566598  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:36.567198  9962 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:27:36.568498  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:36.504856 13972 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:36.507017 13996 log.cc:927] Time spent T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:27:36.359556 13915 consensus_queue.cc:260] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.449407 13938 raft_consensus.cc:697] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 10 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:36.423360 13781 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.424878 13966 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.520018 13874 consensus_queue.cc:260] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:36.521222  9884 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54428 (request call id 918) took 1678 ms (client timeout 1870 ms). Trace:
W20260709 12:27:36.584849  9884 rpcz_store.cc:269] 0709 12:27:34.843294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.843648 (+   354us) service_pool.cc:224] Handling call
0709 12:27:36.521043 (+1677395us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54003c78d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:36.521148 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":795511552}
I20260709 12:27:36.555023  9806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2635) took 1006 ms. Trace:
W20260709 12:27:36.557979  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.572554  9960 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:27:36.576318  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:36.583846 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:36.588855 13770 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.589212 13454 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:36.589361 13770 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.590022 13930 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:36.570266 13942 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:36.590787  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:36.591507 13770 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:36.592859  9813 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:27:36.594592 13759 consensus_queue.cc:237] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:36.595829  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:36.596167  9810 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:36.596423  9888 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:36.597675  9810 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:27:36.599449 13802 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:36.600190  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:36.600319  9959 raft_consensus.cc:1240] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:36.603431  9779 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:36.604626  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:36.604803 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:36.605471  9815 raft_consensus.cc:2393] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 12: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:36.605628 10524 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:36.607292  9854 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:36.609546  9779 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:36.617149  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:36.617481  9779 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:36.617741  9960 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:36.621081  9888 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
I20260709 12:27:36.621809  9813 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:27:36.622108  9887 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:27:36.622370  9813 raft_consensus.cc:606] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:27:36.622751  9813 raft_consensus.cc:614] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:36.582517  9963 raft_consensus.cc:2955] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:36.586069  9806 rpcz_store.cc:276] 0709 12:27:35.548652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.248749 (+700097us) service_pool.cc:224] Handling call
0709 12:27:36.269538 (+ 20789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:36.269762 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:36.292522 (+ 22760us) log.cc:844] Serialized 14 byte log entry
0709 12:27:36.554692 (+262170us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:36.554742 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:36.554788 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:36.554861 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:36.554974 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23113,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":4637,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":7764,"thread_start_us":261706,"threads_started":1}
I20260709 12:27:36.624441 13998 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:36.652612 13998 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.652936 13998 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:36.653764  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.654982  9778 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:36.655804 13660 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:36.656186 13660 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.656525 13660 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:36.656347 13999 consensus_queue.cc:1059] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:36.657105 13781 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:36.657382 13999 raft_consensus.cc:3055] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:36.657764 13999 raft_consensus.cc:740] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:36.658547 13999 consensus_queue.cc:260] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:36.659902 13999 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:36.662963  9778 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:36.663203  9960 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:36.634443  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:36.664876  9959 raft_consensus.cc:2410] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:27:36.665132  9927 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:36.649978  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:36.673087  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:36.646250 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:36.627785 10497 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:36.619267 13802 raft_consensus.cc:2804] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:27:36.634970 13958 log.cc:927] Time spent T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 1.204s	user 0.000s	sys 0.004s
I20260709 12:27:36.584909 13974 consensus_queue.cc:1059] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 12:27:36.616804 13942 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:36.613395 13770 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 12:27:36.621515 13454 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 12:27:36.679705  9779 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:36.702531  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:36.627184  9853 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:36.711930  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:36.777628  9881 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:36.786768  9890 raft_consensus.cc:2410] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:27:36.786818  9888 raft_consensus.cc:2410] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:27:36.680123  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:36.703687  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:36.791198  9960 raft_consensus.cc:2393] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 11: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:36.643327 13948 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:36.669520 13986 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:36.678256 13923 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.637269 13966 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:36.721769 13972 consensus_queue.cc:1059] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 12:27:36.675951 13970 raft_consensus.cc:697] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:36.652074 13938 consensus_queue.cc:237] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.801478 13941 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:36.806118  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:36.640535 13642 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:36.682834 13915 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:36.629415 13785 consensus_queue.cc:1048] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.160s
I20260709 12:27:36.723709 13844 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
W20260709 12:27:36.799814  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 172681us
I20260709 12:27:36.873414  9853 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:27:36.814778 14002 log.cc:927] Time spent T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:27:36.820523 13895 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.709795 13987 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:36.828728  9807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 681) took 1614 ms. Trace:
I20260709 12:27:36.886708 13987 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.886633  9807 rpcz_store.cc:276] 0709 12:27:35.213964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:35.214132 (+   168us) service_pool.cc:224] Handling call
0709 12:27:35.223628 (+  9496us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:27:35.244825 (+ 21197us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:35.285035 (+ 40210us) log.cc:844] Serialized 14 byte log entry
0709 12:27:35.344495 (+ 59460us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:35.345017 (+   522us) log.cc:844] Serialized 52 byte log entry
0709 12:27:35.345149 (+   132us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:35.414405 (+ 69256us) log.cc:844] Serialized 14 byte log entry
0709 12:27:36.166676 (+752271us) log.cc:844] Serialized 14 byte log entry
0709 12:27:36.166865 (+   189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:36.166930 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:36.573234 (+406304us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:36.828519 (+255285us) raft_consensus.cc:1685] finished
0709 12:27:36.828545 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:36.828671 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":751815,"prepare.queue_time_us":1571477,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":78,"raft.queue_time_us":10412,"raft.run_cpu_time_us":496,"raft.run_wall_time_us":12454,"spinlock_wait_cycles":40405888,"thread_start_us":96601,"threads_started":2,"wal-append.queue_time_us":91527}
I20260709 12:27:36.888779 13987 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:36.635946 14004 consensus_queue.cc:1059] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.194s
W20260709 12:27:36.889000  9809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2220) took 2477 ms (client timeout 1567 ms). Trace:
I20260709 12:27:36.889627 14004 raft_consensus.cc:3055] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:36.889981 14004 raft_consensus.cc:740] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:36.890718 13995 consensus_queue.cc:1048] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:27:36.890765 14004 consensus_queue.cc:260] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:36.889391  9809 rpcz_store.cc:269] 0709 12:27:34.411404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.437640 (+ 26236us) service_pool.cc:224] Handling call
0709 12:27:36.888829 (+2451189us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540036b854. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:36.888932 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2308948224}
I20260709 12:27:36.892226 14004 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:36.831296 13660 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:36.832599 13957 consensus_meta.cc:287] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.582s	user 0.002s	sys 0.008s
I20260709 12:27:36.677667 13781 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.834949  9812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2632) took 1370 ms. Trace:
I20260709 12:27:36.902941  9812 rpcz_store.cc:276] 0709 12:27:35.464154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.169674 (+705520us) service_pool.cc:224] Handling call
0709 12:27:36.248534 (+ 78860us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:36.269104 (+ 20570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:36.834719 (+565615us) spinlock_profiling.cc:243] Waited 78.6 ms on lock 0x7b540033f750. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:36.834883 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180782464}
I20260709 12:27:36.781992 13802 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.785264 13936 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:27:36.862120  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:36.630596 13695 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.166s
I20260709 12:27:36.864176  9955 raft_consensus.cc:2410] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:27:36.806963 13907 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:36.788120 13942 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:36.725072 13766 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.128s
I20260709 12:27:36.869081  9811 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:36.909051  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:36.910121  9890 raft_consensus.cc:2410] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 11 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 12:27:36.869805  9956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1605) took 2142 ms. Trace:
W20260709 12:27:36.876891 13971 consensus_meta.cc:287] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.531s	user 0.006s	sys 0.004s
I20260709 12:27:36.911422  9956 rpcz_store.cc:276] 0709 12:27:34.727397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.727543 (+   146us) service_pool.cc:224] Handling call
0709 12:27:34.749362 (+ 21819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:35.941806 (+1192444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:36.869581 (+927775us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54000b40d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:36.869745 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2740575616}
I20260709 12:27:36.880401 13930 raft_consensus.cc:3055] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:36.853490 13923 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.864106 13919 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.884456 13642 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:36.884964 13455 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:36.891418 13765 raft_consensus.cc:3055] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:36.729336 13599 consensus_queue.cc:1059] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 12:27:36.897975  9881 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 12:27:36.898048  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.926442  9888 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:27:36.905840 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 278093us
W20260709 12:27:36.917236  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 43890.8us
I20260709 12:27:36.927784  9853 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:36.929141 10524 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:27:36.930486 10528 raft_consensus.cc:1240] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:36.907706 13802 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:36.932504  9964 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:36.934535  9853 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:36.923373 13762 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.913434 13942 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:36.936813  9882 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:27:36.931775  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:27:36.947952  9882 raft_consensus.cc:1240] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:36.938637  9883 raft_consensus.cc:1240] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:36.945999 14006 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:36.950064 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:36.950387 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:36.945881 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:36.950984 10530 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:36.951223 10528 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:36.940081 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:36.942703 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:36.952678 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:36.953121 10527 raft_consensus.cc:2393] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 11: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:36.906850 13995 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:36.954761 13995 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.956944 13995 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:36.958837 13923 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:36.922613 13954 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:36.961671 13954 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:36.962129 13954 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:36.897073 13740 consensus_queue.cc:1175] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b011791796d1457284b857d7d3422195" responder_term: 8 status { last_received { term: 6 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:36.962563  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:36.917809 13941 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:36.963934 13941 raft_consensus.cc:697] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 6 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:36.964030  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:36.964860 13941 consensus_queue.cc:237] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:36.965531 13762 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.966753 13660 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:36.967530 10531 raft_consensus.cc:2410] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:27:36.967747 13762 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:36.950570  9890 raft_consensus.cc:1275] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:36.970731  9853 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:36.973731  9853 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:36.917294 13930 raft_consensus.cc:740] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:36.932677 13985 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:36.949939 14006 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.923525 13936 raft_consensus.cc:697] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:36.886579 13895 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.907544 13957 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:36.911365 13781 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:36.991184 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 326530us
I20260709 12:27:36.906739 13998 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:36.940240  9811 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
W20260709 12:27:36.995071  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 315418us
I20260709 12:27:36.982098  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:36.919785 13971 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:36.925434 13765 raft_consensus.cc:740] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:36.976699 13966 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:37.005116  9959 raft_consensus.cc:1240] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:36.986819 14005 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:36.977475 13642 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:36.989283 14006 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:37.015525 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:37.017340 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:37.018072 10528 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:37.021746 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:37.013299 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:36.997768  9811 pending_rounds.cc:85] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: Aborting all ops after (but not including) 8
I20260709 12:27:37.001060 13455 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:37.043193  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:37.044155  9888 raft_consensus.cc:2393] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 11: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:36.981086 13844 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:27:36.995759  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:37.009675 13660 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.005414 13943 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:37.053606  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:37.010154  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:36.992259 13599 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:27:37.054600  9885 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
W20260709 12:27:37.050033  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 54341.1us
W20260709 12:27:37.049499  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 338662us
I20260709 12:27:37.058125  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:37.058873  9807 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:37.062906  9883 raft_consensus.cc:1275] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:27:37.055323  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:37.007272 13966 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:37.004339  9853 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:37.079288  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 75050.6us
I20260709 12:27:37.080848  9853 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:37.047370  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:37.082671  9958 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:36.993705 13632 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:27:37.066355  9881 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:27:37.011108 13642 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:37.082228  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:27:37.103750 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 48212.9us
I20260709 12:27:36.968478 13970 consensus_queue.cc:237] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:37.043216 13740 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.090937  9815 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:37.066385 13943 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:37.121773 13943 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:37.110088 13936 consensus_queue.cc:237] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:37.083468 13660 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:37.091353  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:37.127020  9809 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:27:37.129395  9779 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:37.132798 13454 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:37.133231  9779 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:37.134008 13454 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:37.090919 13966 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:37.109543 13642 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:37.127161 14007 log.cc:927] Time spent T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:27:37.139009  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:37.144557  9956 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:37.137841  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:37.109378 13455 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:37.103526 14005 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:37.146258  9779 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:37.202615  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 56435.4us
I20260709 12:27:37.053076 13923 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.103289 13766 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:37.034686  9811 pending_rounds.cc:107] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:27:37.213265  9811 raft_consensus.cc:2889] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:37.214011  9811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 2229) took 2450 ms. Trace:
I20260709 12:27:37.153456  9807 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:37.041985 10530 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:37.205830  9813 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:27:37.206187  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:37.222590  9812 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:27:37.214421  9811 rpcz_store.cc:276] 0709 12:27:34.763824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.763936 (+   112us) service_pool.cc:224] Handling call
0709 12:27:34.764200 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:36.868653 (+2104453us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b580092ffd0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e4780aa 00007f2f8e4fa447 00007f2f8e512fe7 00007f2f8e5147de 00007f2f8e51eb49 00007f2f8e51f416 00007f2f8e51bd8f 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4
0709 12:27:37.213758 (+345105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.213954 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2911217408}
I20260709 12:27:37.089365 13984 consensus_queue.cc:1059] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.125s
I20260709 12:27:37.235584  9814 raft_consensus.cc:1275] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:27:37.066533 13930 consensus_queue.cc:260] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:37.201866 13455 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:37.237584 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 96995.8us
I20260709 12:27:37.238982  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:37.131796 13740 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:37.208289 13986 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:37.135337 13999 consensus_queue.cc:1059] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 12:27:37.202540 13824 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:27:37.111472 13765 consensus_queue.cc:260] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:37.217875 13995 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.255333  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:37.281265  9887 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:37.276610  9956 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:37.204818 13923 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:37.235378 14017 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:37.285482 13766 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:37.252235 14005 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:37.251453 13454 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:37.253389 13711 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:37.289742  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:37.246433 13919 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:37.233500 13695 consensus_queue.cc:1059] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:27:37.256290 13455 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:37.259920 13867 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.349267  9956 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
W20260709 12:27:37.352267  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 270105us
W20260709 12:27:37.353149 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.351136 13987 raft_consensus.cc:3055] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:37.360594  9806 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:37.371642 10525 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:27:37.360370 13957 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:37.351984 13781 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:37.359956  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 303358us
I20260709 12:27:37.250491 13805 consensus_queue.cc:1059] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:27:37.390864  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
W20260709 12:27:37.351459 14001 log.cc:927] Time spent T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:27:37.301666 13998 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:37.302598 13938 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:37.280937 13762 consensus_queue.cc:1048] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 12:27:37.296124 14017 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:37.454900 14009 log.cc:927] Time spent T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
I20260709 12:27:37.455083 14017 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:37.297619 13995 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:37.350015 13895 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:37.401481 13867 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:37.435637 13844 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:37.360260 13711 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:37.366979 13454 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:37.439131  9957 raft_consensus.cc:1275] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:37.489291  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:37.347427 13766 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:37.452687 14027 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:37.453697 13740 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:37.417660 13971 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:37.420683 13987 raft_consensus.cc:740] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:37.426324  9927 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:37.477696 13632 consensus_queue.cc:1048] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:37.455866 14016 raft_consensus.cc:3055] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:27:37.500949 13954 consensus_meta.cc:287] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.001s
I20260709 12:27:37.528589  9889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1523) took 1101 ms. Trace:
I20260709 12:27:37.557673  9889 rpcz_store.cc:276] 0709 12:27:36.427398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.427735 (+   337us) service_pool.cc:224] Handling call
0709 12:27:36.428067 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:36.529200 (+101133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:36.529245 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:36.529840 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 12:27:36.755424 (+225584us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:37.006068 (+250644us) log.cc:844] Serialized 14 byte log entry
0709 12:27:37.349759 (+343691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.528220 (+178461us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540027a454. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:37.528262 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:37.528307 (+    45us) raft_consensus.cc:1685] finished
0709 12:27:37.528396 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:37.528535 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":534826,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":69053,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":27792,"spinlock_wait_cycles":231624960,"thread_start_us":773574,"threads_started":3,"wal-append.queue_time_us":463741}
W20260709 12:27:37.501591 14004 consensus_meta.cc:287] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.609s	user 0.010s	sys 0.000s
I20260709 12:27:37.503959  9884 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:27:37.506765  9887 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
W20260709 12:27:37.509078 13942 consensus_meta.cc:287] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.000s
W20260709 12:27:37.509739  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 121884us
I20260709 12:27:37.526091  9958 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
W20260709 12:27:37.516659 14022 log.cc:927] Time spent T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:27:37.493916 13844 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:37.517139 13930 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:37.517603 13766 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:37.518452 13923 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:37.510407 13874 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:37.532907 13845 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:37.519902 13711 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:37.520100 14020 log.cc:927] Time spent T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
W20260709 12:27:37.520911 14008 log.cc:927] Time spent T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.283s	user 0.000s	sys 0.000s
I20260709 12:27:37.617012  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2636) took 2037 ms. Trace:
I20260709 12:27:37.617353  9808 rpcz_store.cc:276] 0709 12:27:35.580052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.275819 (+695767us) service_pool.cc:224] Handling call
0709 12:27:36.276198 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:36.422621 (+146423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:36.422653 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:36.452641 (+ 29988us) log.cc:844] Serialized 26 byte log entry
0709 12:27:36.924087 (+471446us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:36.924158 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:36.924248 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:37.616807 (+692559us) raft_consensus.cc:1685] finished
0709 12:27:37.616832 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:37.616957 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45539,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":10065,"thread_start_us":483144,"threads_started":2,"wal-append.queue_time_us":538722}
I20260709 12:27:37.618471 13642 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:37.623761  9884 raft_consensus.cc:1240] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:37.482286 13938 raft_consensus.cc:697] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 13 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
W20260709 12:27:37.531216  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 105093us
I20260709 12:27:37.562618 10497 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:37.563148 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:27:37.516245 14010 log.cc:927] Time spent T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.355s	user 0.001s	sys 0.000s
I20260709 12:27:37.536290 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:37.539888 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:27:37.540411  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.540500 10532 raft_consensus.cc:1240] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:27:37.532716 14016 raft_consensus.cc:740] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:37.543048  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:37.544687  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:37.553316  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:37.539608 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:37.535781 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:37.555838  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:37.637351 10524 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:27:37.638012  9882 raft_consensus.cc:2393] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:37.638471 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:37.588143  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:37.570570  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 142671us
W20260709 12:27:37.517598 14013 log.cc:927] Time spent T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.294s	user 0.001s	sys 0.000s
I20260709 12:27:37.643105  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:37.635706  9957 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
W20260709 12:27:37.526226 13915 consensus_meta.cc:287] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.654s	user 0.005s	sys 0.003s
W20260709 12:27:37.540973 14021 log.cc:927] Time spent T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:27:37.527413 13454 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:37.534307 13905 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.546291 13740 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.535961 13867 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:37.555691 13948 raft_consensus.cc:3055] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:37.528409 13987 consensus_queue.cc:260] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:37.615595 14039 raft_consensus.cc:3055] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:27:37.627439 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 64915.8us
W20260709 12:27:37.627873 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 77643.5us
I20260709 12:27:37.702373 10496 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:37.537037 14011 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.547290 14027 raft_consensus.cc:697] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:37.526124 14017 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:37.542673  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:37.712678  9963 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:37.630820 14040 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:27:37.713557  9810 raft_consensus.cc:1275] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:27:37.713917  9810 pending_rounds.cc:85] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71: Aborting all ops after (but not including) 3
I20260709 12:27:37.714218  9810 pending_rounds.cc:107] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:27:37.714547  9810 raft_consensus.cc:2889] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:37.634052  9808 raft_consensus.cc:1275] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:37.633924 13711 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:37.634196 13922 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:37.634459 13762 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:37.550222  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:37.691259 13895 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:37.648413 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:37.532313 13455 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:37.570071 13942 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:37.658895  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:37.655239  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:37.654203 10533 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:27:37.747751 10533 pending_rounds.cc:85] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: Aborting all ops after (but not including) 8
I20260709 12:27:37.748106 10533 pending_rounds.cc:107] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:27:37.748414 10533 raft_consensus.cc:2889] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:37.636585 14006 consensus_meta.cc:287] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.589s	user 0.007s	sys 0.002s
I20260709 12:27:37.655920 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:37.684998  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:37.631690 13642 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:37.661398  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.719669 14036 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:37.685823  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:37.688359  9928 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:37.690205  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:37.654101 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:37.690696  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:37.594632 13971 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:27:37.551033 13954 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:37.635835 13923 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.696739  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:37.697781  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:37.776895  9815 raft_consensus.cc:2393] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 13: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:37.707299  9778 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:37.701294 10497 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:37.777858 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 76664.1us
I20260709 12:27:37.647881  9884 raft_consensus.cc:1275] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:27:37.711580 13943 consensus_meta.cc:287] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.589s	user 0.006s	sys 0.005s
W20260709 12:27:37.783648  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 76402.8us
I20260709 12:27:37.784818  9778 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:37.786473 13999 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:37.787279 13999 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:37.787864 13999 raft_consensus.cc:697] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:37.788913 13999 consensus_queue.cc:237] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:37.770313 13824 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.693104 13948 raft_consensus.cc:740] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:37.728628  9962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 750) took 1159 ms. Trace:
I20260709 12:27:37.728442 14027 consensus_queue.cc:237] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:37.728875 14031 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:37.729324 13454 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:37.760428 13895 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:37.720767 13941 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.706985 14039 raft_consensus.cc:740] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:37.717793 14026 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.762257  9957 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:37.793161 14035 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:37.712679 13867 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:37.646510 13759 consensus_queue.cc:1048] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:27:37.765717  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:37.765930 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.733464 13762 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:37.697160 13740 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:37.767431  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:37.722707 14046 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:37.725363 13922 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:37.770267  9956 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:37.772186  9887 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:27:37.692530 13905 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:37.762919 13966 consensus_meta.cc:287] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.561s	user 0.006s	sys 0.003s
I20260709 12:27:37.774183  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2411) took 1798 ms. Trace:
I20260709 12:27:37.646332 13845 raft_consensus.cc:697] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:27:37.791584 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 83364.8us
I20260709 12:27:37.743808 13936 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:27:37.795929  9962 rpcz_store.cc:276] 0709 12:27:36.566136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.567725 (+  1589us) service_pool.cc:224] Handling call
0709 12:27:36.568014 (+   289us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:36.583325 (+ 15311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:36.583354 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:36.617063 (+ 33709us) log.cc:844] Serialized 52 byte log entry
0709 12:27:36.911433 (+294370us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:36.911476 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:36.911542 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:37.724850 (+813308us) raft_consensus.cc:1685] finished
0709 12:27:37.724881 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:37.725110 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18474,"raft.queue_time_us":4421,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":268461,"threads_started":1,"wal-append.queue_time_us":425546}
W20260709 12:27:37.725349  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 175241us
I20260709 12:27:37.713806 14011 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:37.794973 13943 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:37.774015 14036 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:37.783100 13923 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:37.803601  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 115350us
I20260709 12:27:37.725932 13938 consensus_queue.cc:237] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:37.777570 13642 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.740962  9963 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:37.719367 13987 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:37.809644  9778 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:37.800989 13454 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:37.797322 13711 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.763952 14006 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:37.792930 13915 consensus_queue.cc:1059] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:27:37.801343 13824 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:37.952257 13740 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:37.953047 10527 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:37.953486 13942 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:37.954553 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:27:37.963765  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 154207us
I20260709 12:27:37.965157 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:37.965353  9778 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:37.966398  9778 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:37.810467 13802 consensus_meta.cc:287] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.836s	user 0.011s	sys 0.001s
I20260709 12:27:37.975632 10496 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:37.861730  9702 maintenance_manager.cc:419] P 9af5d83221164294aea87056091c2259: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033367
W20260709 12:27:37.904266 14048 log.cc:927] Time spent T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:27:37.805372 13972 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:38.031663 13972 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:38.032105 13972 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:37.903016 14050 log.cc:927] Time spent T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 12:27:37.908872 14005 consensus_meta.cc:287] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.000s
I20260709 12:27:37.959190  9957 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:37.968385  9963 raft_consensus.cc:1275] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:37.969527  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:37.848001 14043 log.cc:927] Time spent T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 12:27:37.970552  9962 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:27:37.905077 14053 log.cc:927] Time spent T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:27:37.972105  9779 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
W20260709 12:27:37.825129 14025 log.cc:927] Time spent T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.375s	user 0.004s	sys 0.000s
I20260709 12:27:37.956182  9886 rpcz_store.cc:276] 0709 12:27:35.976138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:35.977940 (+  1802us) service_pool.cc:224] Handling call
0709 12:27:35.978234 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:35.978601 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:35.978620 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:35.984750 (+  6130us) log.cc:844] Serialized 26 byte log entry
0709 12:27:36.836522 (+851772us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b1800275c20. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b411e07 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f8e0b620b 00007f2f8e0bbd23 00007f2f8e0bc0d1 00007f2f8e4d7a0f
0709 12:27:37.140733 (+304211us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:37.444843 (+304110us) log.cc:844] Serialized 14 byte log entry
0709 12:27:37.640433 (+195590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.640546 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:37.767564 (+127018us) raft_consensus.cc:1685] finished
0709 12:27:37.773979 (+  6415us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:37.774122 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14946,"prepare.queue_time_us":347892,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":54281,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":13768,"spinlock_wait_cycles":12892032,"thread_start_us":713274,"threads_started":3,"wal-append.queue_time_us":1303070}
I20260709 12:27:37.976766 10525 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:27:37.814954 13762 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:37.910054 13455 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:37.983889  9882 raft_consensus.cc:1240] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:37.826941 14044 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.899060 14059 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.845338 14055 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:37.961730 13922 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:37.982558  9956 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:37.810259 13896 consensus_queue.cc:1059] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.160s
I20260709 12:27:37.844723 14017 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:37.826589 13895 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:37.880427 13985 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:37.967680 13454 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:37.928998 13948 consensus_queue.cc:260] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:37.840684 14035 raft_consensus.cc:697] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:37.814563 14012 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:37.995085  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.998550 10532 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:37.904907 13954 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:37.910260 14039 consensus_queue.cc:260] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:37.970423 13770 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:37.808832 13941 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:37.976991 13740 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:37.977538 13907 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:37.962991 13919 consensus_queue.cc:1059] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:27:37.963809 13966 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:37.991498 14057 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:37.805203 14031 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:37.973598 14046 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.013818 13998 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.027661 13845 consensus_queue.cc:237] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:38.046064  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 76609.4us
I20260709 12:27:38.051944 10533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 1046) took 1052 ms. Trace:
I20260709 12:27:38.118474 10533 rpcz_store.cc:276] 0709 12:27:36.999395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.028277 (+ 28882us) service_pool.cc:224] Handling call
0709 12:27:37.052824 (+ 24547us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.748981 (+696157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:38.051654 (+302673us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b54005c35d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:38.051867 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1382250368}
I20260709 12:27:38.067718  9881 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:37.974730 13642 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:38.021373 13923 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:38.112498  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:37.978351 13711 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:38.072440 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:38.065403  9889 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:38.076782  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:38.077129  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:38.056658 14051 log.cc:927] Time spent T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.177s	user 0.002s	sys 0.000s
I20260709 12:27:38.105580  9813 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:38.136039  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:38.106887  9713 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59986 (request call id 332) took 35870 ms (client timeout 15000 ms). Trace:
I20260709 12:27:38.109755  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:38.139958  9814 raft_consensus.cc:2393] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 10: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:38.055243 14059 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.061343 13762 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.112071 13957 consensus_queue.cc:1048] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:27:38.142568 14059 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:38.143344 13762 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:38.061412 13765 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:38.032248 13905 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:38.130820  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:38.061987 14039 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:38.131558  9887 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
W20260709 12:27:38.087167  9964 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 753) took 1502 ms (client timeout 1954 ms). Trace:
W20260709 12:27:38.134253  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:38.134821  9853 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:38.161388  9853 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:38.074674 13911 consensus_queue.cc:1048] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 12:27:38.057969 13985 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:38.162189 14058 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:38.162894 14058 raft_consensus.cc:697] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 10 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:38.111507  9927 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:38.159412  9964 rpcz_store.cc:269] 0709 12:27:36.584601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.590529 (+  5928us) service_pool.cc:224] Handling call
0709 12:27:38.086992 (+1496463us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54003bb354. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:38.087091 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":594641792}
I20260709 12:27:38.063441 13824 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:38.065953 13919 raft_consensus.cc:3055] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:38.053791 13766 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:38.001523 13802 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.109788 14006 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:38.067471 13966 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:38.157682  9959 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:38.084857 13805 raft_consensus.cc:3055] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:38.065572 13907 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:38.154770 14017 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:38.045523 13972 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.067060 13454 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.077723 13998 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:38.139072  9713 rpcz_store.cc:269] 0709 12:27:02.241415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.242794 (+  1379us) service_pool.cc:224] Handling call
0709 12:27:38.106766 (+35863972us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:34.096074 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:34.096733 (+   659us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:34.096782 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:27:34.096804 (+    22us) tablet.cc:662] Decoding operations
0709 12:27:34.117564 (+ 20760us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:34.117653 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:34.117691 (+    38us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:27:34.149351 (+ 31660us) tablet.cc:701] Row locks acquired
0709 12:27:34.149399 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:27:34.149666 (+   267us) write_op.cc:270] Start()
0709 12:27:34.149818 (+   152us) write_op.cc:276] Timestamp: P: 1783600054149602 usec, L: 0
0709 12:27:34.149836 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:27:34.205239 (+ 55403us) log.cc:844] Serialized 4729 byte log entry
0709 12:27:35.739485 (+1534246us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:35.821684 (+ 82199us) op_driver.cc:464] REPLICATION: finished
0709 12:27:35.901131 (+ 79447us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8b4120ac 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f91f52ef0
0709 12:27:35.950070 (+ 48939us) write_op.cc:301] APPLY: starting
0709 12:27:35.950231 (+   161us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:35.950655 (+   424us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:35.950716 (+    61us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:35.985245 (+ 34529us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:35.985696 (+   451us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:27:35.985765 (+    69us) write_op.cc:312] APPLY: finished
0709 12:27:35.986245 (+   480us) log.cc:844] Serialized 89 byte log entry
0709 12:27:36.001268 (+ 15023us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:36.010592 (+  9324us) write_op.cc:454] Released schema lock
0709 12:27:36.032526 (+ 21934us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:36.037311 (+  4785us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:36.037343 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":542784,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":127962,"apply.run_cpu_time_us":5190,"apply.run_wall_time_us":87273,"num_ops":12,"prepare.queue_time_us":455963,"prepare.run_cpu_time_us":89363,"prepare.run_wall_time_us":294303,"raft.queue_time_us":65605,"raft.run_cpu_time_us":13794,"raft.run_wall_time_us":141865,"replication_time_us":1671630,"spinlock_wait_cycles":94406912,"thread_start_us":705003,"threads_started":4,"wal-append.queue_time_us":280141,"wal-append.run_cpu_time_us":34135,"wal-append.run_wall_time_us":2532017}]]}
I20260709 12:27:38.066076 14036 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:38.035413 14005 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:38.092695 13922 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.065056 13941 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:38.144594 13599 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:38.115137 13948 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:37.813345 14026 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:38.156883  9881 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:38.108989 13943 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:38.170702  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:38.171077  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:38.228466  9956 raft_consensus.cc:2368] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8.
I20260709 12:27:38.171743  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:38.173297  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 61849.2us
I20260709 12:27:38.178643  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:38.230701  9963 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:27:38.231048 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 43558.9us
I20260709 12:27:38.072588 13852 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:38.087620 13660 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:38.069772 14046 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:38.183069  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:38.059267 14035 consensus_queue.cc:237] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:38.158942 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 170509us
I20260709 12:27:38.211094  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:38.139860 13874 consensus_meta.cc:287] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.000s
I20260709 12:27:38.165728 13895 raft_consensus.cc:3055] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:38.214777  9807 raft_consensus.cc:1240] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:27:38.169344 13919 raft_consensus.cc:740] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:38.059538 14012 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.194478 13805 raft_consensus.cc:740] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:38.137626 13917 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:27:38.216590 14052 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:38.218025 13972 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:38.185616 13938 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 12:27:38.165905 13740 raft_consensus.cc:697] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:38.151074 14040 consensus_queue.cc:1048] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:27:38.195573 14059 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:38.235947  9928 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:38.209571 13907 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:38.256556  9927 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:38.335117  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 78636us
W20260709 12:27:38.335736 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:38.336093  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 100253us
I20260709 12:27:38.338896  9853 leader_election.cc:400] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8.
I20260709 12:27:38.339212  9853 leader_election.cc:403] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:27:38.262508  9959 raft_consensus.cc:2410] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:27:38.263314  9963 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:38.266319  9887 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:38.234552 13599 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.054788 14044 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:38.264520 10526 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:38.209810 14004 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:38.175956 13942 consensus_queue.cc:1048] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:27:38.194591 13759 consensus_queue.cc:1059] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:27:38.288735 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:38.267215 13766 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:27:38.055486 14055 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:38.356231 14003 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:38.058676 14016 consensus_queue.cc:260] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.357348 14016 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:38.343755 14059 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:38.354573 14004 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.361591 14004 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:38.361938 13642 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:38.157872 13770 raft_consensus.cc:697] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:38.383075 13770 consensus_queue.cc:237] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.275491 13852 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.388063  9887 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
W20260709 12:27:38.328963  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 356910us
I20260709 12:27:38.196082  9854 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:38.392306  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 196282us
I20260709 12:27:38.290656 13895 raft_consensus.cc:740] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:38.163865 14058 consensus_queue.cc:237] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:38.344676  9853 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:38.346516  9927 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:38.310410 14029 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:38.350344 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 73050.9us
I20260709 12:27:38.355337 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:38.357882 14066 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:27:38.368464 13711 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:38.368971 13802 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:38.347636 14052 raft_consensus.cc:697] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:38.369505 13599 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:38.369441 13805 consensus_queue.cc:260] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.371639 14044 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:38.347339 14046 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8.
I20260709 12:27:38.357908 14059 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:38.375077 13922 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:38.375907 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:38.428680 10533 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:38.376084 13998 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:38.377023 13454 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:38.380541 14026 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:38.393463 10497 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:38.294560  9960 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:27:38.402827 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:38.406656 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:38.440892  9960 pending_rounds.cc:85] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 6
W20260709 12:27:38.409544  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 64938.2us
I20260709 12:27:38.441367  9960 pending_rounds.cc:107] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:27:38.441671  9960 raft_consensus.cc:2889] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:38.409989  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 63563.8us
I20260709 12:27:38.411199 10496 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:38.411628 13852 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:38.413878 10532 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:27:38.429286  9779 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:38.435091  9854 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:38.450119 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 56749us
I20260709 12:27:38.413546 13642 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:38.450662  9779 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:38.415469 13711 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:38.463279  9779 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:38.465842  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:38.429747 14059 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:38.467026  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:38.467118  9809 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:38.467768  9810 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:27:38.469900  9779 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:38.475453  9957 raft_consensus.cc:1240] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:38.475791  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:38.476554  9813 raft_consensus.cc:2393] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 13: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:38.476554  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:38.480715  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:38.481477  9812 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
W20260709 12:27:38.482355 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 71239.1us
I20260709 12:27:38.484877 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:38.485173 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:38.485667 10529 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:38.487350 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:38.489004  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:38.489753  9887 raft_consensus.cc:2393] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 13: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:38.492007 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:38.493779  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:38.495230  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:38.495716 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:38.496315 10524 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:38.496750  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:38.480357 13852 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.526887 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:38.542586  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:38.543196  9809 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
W20260709 12:27:38.543396 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 83192.5us
W20260709 12:27:38.545037  9778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.010s	sys 0.008s
W20260709 12:27:38.545960  9778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.010s	sys 0.008s
I20260709 12:27:38.503211  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:38.541720 10529 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:38.550628  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:38.551432  9961 raft_consensus.cc:2393] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 13: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:38.462407 13998 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:38.437171 13943 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:27:38.559629  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:38.559800  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:38.566507 10524 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:38.466034 14006 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:38.478789 14004 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:38.414672 13895 consensus_queue.cc:260] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.477757 13642 raft_consensus.cc:697] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:38.575045  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:38.607331  9883 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:38.578224  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:38.580806 14077 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:27:38.581674  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:38.583969  9961 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:38.613332  9957 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:27:38.586431 14060 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.587745 14014 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.159s
I20260709 12:27:38.588317 14033 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:38.588716 14072 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:38.568348 13943 consensus_queue.cc:1243] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer f5208640a51f493e930ce4f64ceeed0b log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:27:38.589425 14075 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:38.590342 14068 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:27:38.609335  9809 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:27:38.547561 13455 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.436393 13740 consensus_queue.cc:237] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:38.571956 13987 consensus_meta.cc:287] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.607s	user 0.009s	sys 0.006s
I20260709 12:27:38.413808 14029 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:38.569492 14017 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.568709 13785 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.562762 14026 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.541816 13852 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:38.569319 13923 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:38.649178 14037 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:38.635773 13936 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:38.652846 14031 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:38.654146  9807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2647) took 1496 ms. Trace:
I20260709 12:27:38.702255  9807 rpcz_store.cc:276] 0709 12:27:37.157794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.215648 (+ 57854us) service_pool.cc:224] Handling call
0709 12:27:37.216050 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:38.290965 (+1074915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:38.653836 (+362871us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b540036b354. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:38.654067 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2296247552}
I20260709 12:27:38.655380 13907 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.658133 13919 consensus_queue.cc:260] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.662606  9885 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:27:38.648041  9779 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:38.640116 14075 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:38.628839 13998 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:38.649390  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:38.647781 14033 raft_consensus.cc:697] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:38.575657 14052 consensus_queue.cc:237] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:38.715176 13785 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.751567  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:38.755883  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:38.767999  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:38.673905 13455 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:38.698987 14068 raft_consensus.cc:697] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:38.760475  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:38.768599  9958 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:38.775816  9807 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
W20260709 12:27:38.753432 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:38.769105  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:38.769416  9809 raft_consensus.cc:2368] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10.
I20260709 12:27:38.643034 13985 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:38.756399  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 108430us
I20260709 12:27:38.776733  9812 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:38.777343  9779 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:38.778167  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:38.779794  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:38.781236  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:38.781919  9807 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:38.701143 14017 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.773294 10524 pending_rounds.cc:85] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: Aborting all ops after (but not including) 8
I20260709 12:27:38.755486 14031 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:38.771384 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 287743us
I20260709 12:27:38.626432 14060 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:38.757988 14075 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:38.810245  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:38.813046 10524 pending_rounds.cc:107] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:27:38.817929 10524 raft_consensus.cc:2889] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:38.761142 13919 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:38.757254 13987 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:27:38.807825  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:38.811378 14016 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:38.822613 10496 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:38.826809  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 44219.6us
I20260709 12:27:38.823257  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:38.823818  9811 raft_consensus.cc:1240] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:38.751734 14026 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.781975 13770 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:38.758143 13922 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:27:38.826222 14082 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:38.807504 14067 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:38.832679  9807 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:38.758373 13923 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.758216 13936 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:38.837697 14081 log.cc:927] Time spent T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:27:38.838619  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 762) took 1074 ms. Trace:
I20260709 12:27:38.840448 13805 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:38.841799 13895 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:38.842921 14086 consensus_queue.cc:1048] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:38.831326 14057 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:38.850705 14011 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:38.851668 14074 log.cc:927] Time spent T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 12:27:38.855670 14078 log.cc:927] Time spent T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:27:38.855852 14077 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:38.856948 13759 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:38.762154 13998 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.860325 14082 raft_consensus.cc:697] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:38.860715  9959 rpcz_store.cc:276] 0709 12:27:37.764528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.764627 (+    99us) service_pool.cc:224] Handling call
0709 12:27:38.838390 (+1073763us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54003372d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:38.838548 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":449968000}
I20260709 12:27:38.764742 13642 consensus_queue.cc:237] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.864086 10533 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:27:38.757694 14037 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.886427 13948 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:38.931668 10526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 773) took 1390 ms (client timeout 1669 ms). Trace:
W20260709 12:27:38.932078 10526 rpcz_store.cc:269] 0709 12:27:37.535348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.535471 (+   123us) service_pool.cc:224] Handling call
0709 12:27:38.925894 (+1390423us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b540002fdd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:38.926015 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1441959680}
I20260709 12:27:38.891572  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:38.822691 13915 consensus_queue.cc:1059] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:27:38.893420  9881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1534) took 1655 ms. Trace:
I20260709 12:27:38.937397  9881 rpcz_store.cc:276] 0709 12:27:37.237977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.238289 (+   312us) service_pool.cc:224] Handling call
0709 12:27:38.893203 (+1654914us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b54000ba4d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:38.893347 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1880285952}
I20260709 12:27:38.819631 14031 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.860898 13971 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.862819  9812 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:38.924207 14077 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:38.894109 13695 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:38.871964 13985 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:38.872622 14029 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:38.928133  9928 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:38.835579 14033 consensus_queue.cc:237] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:38.871699 14068 consensus_queue.cc:237] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.945499  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:38.952237  9812 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:38.955300  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:38.958209 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 128281us
I20260709 12:27:38.927205 13759 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.941311 13948 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:38.951267 13971 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:39.121418  9883 consensus_meta.cc:287] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.000s
I20260709 12:27:39.233134  9883 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:39.232033  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2655) took 1124 ms. Trace:
I20260709 12:27:38.957561 14040 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:39.022570 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:39.005749  9812 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:39.234754  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:39.235307  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:39.236485  9815 rpcz_store.cc:276] 0709 12:27:38.107621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.107762 (+   141us) service_pool.cc:224] Handling call
0709 12:27:38.108261 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:38.166202 (+ 57941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:38.166233 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:38.166673 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 12:27:38.459004 (+292331us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:38.459042 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:38.459106 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:39.231732 (+772626us) raft_consensus.cc:1685] finished
0709 12:27:39.231763 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:39.231955 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67712,"raft.queue_time_us":60928,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":15876,"thread_start_us":243011,"threads_started":1,"wal-append.queue_time_us":424220}
I20260709 12:27:38.996433  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:38.959508 13907 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:39.272997  9809 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:39.271278 10526 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:39.272559  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:39.277664 14040 raft_consensus.cc:697] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:39.278455  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:39.278824 14037 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:39.278589 14040 consensus_queue.cc:237] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:39.274382  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:39.282073  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:39.275794 10496 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:38.963362 13852 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:39.282819  9812 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:27:39.007700 14090 log.cc:927] Time spent T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:27:38.989995 14039 consensus_meta.cc:287] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.817s	user 0.007s	sys 0.003s
I20260709 12:27:39.291189  9959 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:27:38.952965 13695 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:39.293370  9854 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:39.279820 13922 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:38.967489 13995 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:39.021241 14031 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:39.238953 13974 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:39.095377 13966 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.300163 13998 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:39.300050 13922 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:39.009136 14077 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:39.240067 13455 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:39.107798 13785 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:39.305826  9812 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
I20260709 12:27:39.311029  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:39.291234 14014 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:39.329663 14014 raft_consensus.cc:697] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:39.298804 14057 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.312142  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:39.020807 14059 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:39.318518 13948 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:39.319011 14097 log.cc:927] Time spent T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
W20260709 12:27:39.325526 14079 log.cc:927] Time spent T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.504s	user 0.001s	sys 0.000s
I20260709 12:27:39.326980 13781 raft_consensus.cc:3055] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:39.298827 13923 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:39.304581 13936 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:39.313874 14017 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:39.360047  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:39.361421 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:39.361747  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:39.362774  9881 raft_consensus.cc:2410] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:27:39.363831  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:39.366823  9889 raft_consensus.cc:2393] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 11: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:39.353416  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:39.019796 14082 consensus_queue.cc:237] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:39.300791 14052 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:39.351753  9815 raft_consensus.cc:2393] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 8: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:39.368441 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:39.430908 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:39.431914 10529 raft_consensus.cc:2410] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:27:39.431991  9958 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:27:39.368666 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:39.369679 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:39.433198 10526 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:39.372395  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:39.440696  9888 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:39.373342  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:39.442114  9883 raft_consensus.cc:2393] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:39.374042 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:39.374455 14031 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.304726 14075 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:39.428386  9955 raft_consensus.cc:1240] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:39.356205 13781 raft_consensus.cc:740] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:39.330472 14057 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:39.518637  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:39.514966  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:39.314929 13974 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:39.522043  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2658) took 1411 ms. Trace:
I20260709 12:27:39.522943  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:39.371080 14026 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:39.527323  9808 rpcz_store.cc:276] 0709 12:27:38.110978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.111096 (+   118us) service_pool.cc:224] Handling call
0709 12:27:38.111399 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:38.166874 (+ 55475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:38.166906 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:38.167301 (+   395us) log.cc:844] Serialized 26 byte log entry
0709 12:27:38.475297 (+307996us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:38.475343 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:38.475435 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:39.324970 (+849535us) spinlock_profiling.cc:243] Waited 31.3 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:39.513286 (+188316us) raft_consensus.cc:1685] finished
0709 12:27:39.513320 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:39.521980 (+  8660us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57846,"raft.queue_time_us":62629,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":16078,"spinlock_wait_cycles":72011136,"thread_start_us":256543,"threads_started":1,"wal-append.queue_time_us":561292}
I20260709 12:27:39.529726  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:39.529819 10496 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:39.531777  9963 raft_consensus.cc:2393] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:39.433297 14052 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:39.533406  9808 raft_consensus.cc:2368] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13.
I20260709 12:27:39.317384 13966 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:39.510769 13740 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:39.546787 14075 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:39.546926 13740 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:39.528496 14094 log.cc:927] Time spent T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 12:27:39.548877 13740 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:39.510767 13792 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:39.551564 13974 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:39.538162 14052 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:39.429407 14014 consensus_queue.cc:237] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:39.559921 13922 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:39.560158 14072 consensus_meta.cc:287] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.884s	user 0.004s	sys 0.005s
I20260709 12:27:39.560541 14072 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:39.562137  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:39.541752  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:39.542029 10496 leader_election.cc:400] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13.
I20260709 12:27:39.546041 13781 consensus_queue.cc:260] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:39.554036  9809 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:27:39.563439 10496 leader_election.cc:403] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:27:39.566546  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:39.567319  9963 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:39.569234  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:39.569856  9815 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:27:39.570789  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:39.571636  9808 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:39.572738  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:39.561496 14059 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:39.575300 10496 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:39.578999  9808 raft_consensus.cc:2393] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 14: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:39.582012  9811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2657) took 1471 ms. Trace:
I20260709 12:27:39.584539  9811 rpcz_store.cc:276] 0709 12:27:38.110203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.110342 (+   139us) service_pool.cc:224] Handling call
0709 12:27:38.110600 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:38.827871 (+717271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:39.581717 (+753846us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b54002d6254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:39.581938 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1639833472}
I20260709 12:27:39.549989 13792 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:39.585078  9956 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:27:39.603811  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:39.605687  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:39.520398 14031 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:39.615510  9956 raft_consensus.cc:1240] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:39.573747 14067 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:39.612593 10526 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:27:39.573675 13781 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:39.577315 13759 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:39.626144  9809 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:27:39.627578  9809 pending_rounds.cc:85] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71: Aborting all ops after (but not including) 10
I20260709 12:27:39.627871  9809 pending_rounds.cc:107] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:27:39.628151  9809 raft_consensus.cc:2889] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:39.629612 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 54383.7us
I20260709 12:27:39.630044  9815 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:27:39.585312 13971 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:39.641172  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:39.634949  9960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 2221) took 2644 ms. Trace:
I20260709 12:27:39.679080  9956 raft_consensus.cc:1240] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:39.614477 14055 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:39.621533 13922 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13.
I20260709 12:27:39.680765  9960 rpcz_store.cc:276] 0709 12:27:36.990184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.990346 (+   162us) service_pool.cc:224] Handling call
0709 12:27:36.995968 (+  5622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:38.461839 (+1465871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:39.634683 (+1172844us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400088ed4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:39.634882 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2985409920}
I20260709 12:27:39.633405 13974 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:39.673142 13740 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.679977 14067 consensus_queue.cc:1059] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:27:39.673418 14039 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.018s
W20260709 12:27:39.706315 13919 consensus_meta.cc:287] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.863s	user 0.009s	sys 0.001s
I20260709 12:27:39.710378 13974 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:39.726821  9853 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:39.726960 10525 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:39.725487 13642 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:39.732698 13642 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:39.736016  9853 leader_election.cc:400] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10.
I20260709 12:27:39.723503 14104 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.723788 14067 consensus_queue.cc:1243] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer 4104e34a61b7448281d6d91ce23ebf71 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:27:39.737104  9853 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:39.740382  9960 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:27:39.740880  9960 pending_rounds.cc:85] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 8
I20260709 12:27:39.741176  9960 pending_rounds.cc:107] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:27:39.741478  9960 raft_consensus.cc:2889] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:39.743350  9853 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:39.728086 13974 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:39.758029  9960 raft_consensus.cc:1275] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:27:39.759444  9960 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:27:39.759732  9960 pending_rounds.cc:85] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 7
I20260709 12:27:39.759938  9960 pending_rounds.cc:107] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:27:39.768740  9960 raft_consensus.cc:2889] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:39.771013 13792 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:39.771982 14031 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:39.772224  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:39.772586 14031 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:39.772987 14031 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:39.773340 14031 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:39.716914 13740 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:39.778971 10530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 1048) took 2244 ms. Trace:
I20260709 12:27:39.779443 10530 rpcz_store.cc:276] 0709 12:27:37.534419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.538850 (+  4431us) service_pool.cc:224] Handling call
0709 12:27:37.539172 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:38.194174 (+655002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:38.194210 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:38.213164 (+ 18954us) log.cc:844] Serialized 26 byte log entry
0709 12:27:38.405613 (+192449us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:38.405648 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:39.778465 (+1372817us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54002ee0d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:39.778528 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:39.778586 (+    58us) raft_consensus.cc:1685] finished
0709 12:27:39.778609 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:39.778881 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1856,"raft.queue_time_us":36198,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":40613,"spinlock_wait_cycles":1037990272,"thread_start_us":338911,"threads_started":2,"wal-append.queue_time_us":253201,"wal-append.run_cpu_time_us":1647,"wal-append.run_wall_time_us":1091648}
I20260709 12:27:39.782362  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2431) took 1642 ms. Trace:
I20260709 12:27:39.782835  9884 rpcz_store.cc:276] 0709 12:27:38.139779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.140769 (+   990us) service_pool.cc:224] Handling call
0709 12:27:38.141056 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:38.163634 (+ 22578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:38.163665 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:38.164112 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 12:27:38.291588 (+127476us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:38.291643 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:39.781818 (+1490175us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b5400328054. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:39.781894 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:39.781955 (+    61us) raft_consensus.cc:1685] finished
0709 12:27:39.781985 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:39.782291 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34772,"raft.queue_time_us":9356,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":7361,"spinlock_wait_cycles":18560384,"thread_start_us":112637,"threads_started":1,"wal-append.queue_time_us":184834,"wal-append.run_cpu_time_us":1577,"wal-append.run_wall_time_us":1004290}
I20260709 12:27:39.788679  9955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1635) took 1241 ms. Trace:
I20260709 12:27:39.789156  9955 rpcz_store.cc:276] 0709 12:27:38.547169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.547433 (+   264us) service_pool.cc:224] Handling call
0709 12:27:38.583141 (+ 35708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:39.512745 (+929604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:39.788374 (+275629us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b5400412154. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:39.788586 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1943412992}
I20260709 12:27:39.736792 13966 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:39.748816 13895 consensus_meta.cc:287] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.868s	user 0.008s	sys 0.004s
I20260709 12:27:39.806173 13942 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:39.799265 13792 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:39.806881 13792 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:39.809029 13792 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:39.814453  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2664) took 1356 ms. Trace:
W20260709 12:27:39.817550 14088 log.cc:927] Time spent T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.996s	user 0.006s	sys 0.005s
I20260709 12:27:39.815012  9814 rpcz_store.cc:276] 0709 12:27:38.457797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.457929 (+   132us) service_pool.cc:224] Handling call
0709 12:27:38.458225 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:38.462851 (+  4626us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:39.639584 (+1176733us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b1800345d60. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b411e07 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42c455 00007f2f91f143c7 00007f2f8e5269a7 00007f2f8e5360bf 00007f2f8e536038
0709 12:27:39.738253 (+ 98669us) log.cc:844] Serialized 14 byte log entry
0709 12:27:39.779998 (+ 41745us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:39.780413 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 12:27:39.780522 (+   109us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:39.780552 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:39.780609 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:39.814137 (+ 33528us) raft_consensus.cc:1685] finished
0709 12:27:39.814236 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:39.814383 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35082,"prepare.queue_time_us":1274006,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":8444,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":22410,"spinlock_wait_cycles":9259904,"thread_start_us":139420,"threads_started":2,"wal-append.queue_time_us":73129}
I20260709 12:27:39.818567 10496 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:39.820675 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:39.820916 14060 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:39.822089 13919 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:39.822189 13867 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:39.822791 13919 consensus_queue.cc:1059] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:27:39.823688 14108 log.cc:927] Time spent T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:27:39.745488 14104 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:39.826689 14104 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:39.827962  9964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 2236) took 1383 ms. Trace:
I20260709 12:27:39.828770  9964 rpcz_store.cc:276] 0709 12:27:38.444673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.444777 (+   104us) service_pool.cc:224] Handling call
0709 12:27:38.445172 (+   395us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:38.455388 (+ 10216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:38.455429 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:38.480188 (+ 24759us) log.cc:844] Serialized 52 byte log entry
0709 12:27:38.713099 (+232911us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:38.713272 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:38.713586 (+   314us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:39.816857 (+1103271us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:39.827395 (+ 10538us) raft_consensus.cc:1685] finished
0709 12:27:39.827457 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:39.827841 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74381,"raft.queue_time_us":1989,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8887,"spinlock_wait_cycles":47300480,"thread_start_us":122368,"threads_started":1,"wal-append.queue_time_us":219005}
I20260709 12:27:39.832338 14052 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:39.834975  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:39.835542 13642 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:39.837222 13740 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:39.837437 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:39.839637 14039 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:39.842509  9812 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:39.742699 14033 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:27:39.798774 14056 raft_consensus.cc:2749] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:39.847791 13942 raft_consensus.cc:697] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:39.847452 14052 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:39.861514  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 114207us
W20260709 12:27:39.862872  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 119581us
I20260709 12:27:39.869004  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:39.871317  9853 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:39.873847 13942 consensus_queue.cc:237] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:39.879588  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:39.880209  9956 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:39.881387  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:39.882241  9964 raft_consensus.cc:2393] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 13: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:39.862856 13915 consensus_queue.cc:1059] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:27:39.883076 13844 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:39.858920 14069 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:27:39.889463  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:39.871747 14056 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:39.893648  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:39.870255 14052 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:39.891543  9956 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:27:39.897317  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:39.898010  9955 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:39.900784 10525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 1057) took 1546 ms. Trace:
I20260709 12:27:39.901153 10525 rpcz_store.cc:276] 0709 12:27:38.354875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.355039 (+   164us) service_pool.cc:224] Handling call
0709 12:27:39.900593 (+1545554us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400690ad4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:39.900726 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3038371584}
I20260709 12:27:39.908624  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:39.910720  9955 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:39.879276 14112 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:39.896215 14106 log.cc:927] Time spent T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.053s	user 0.001s	sys 0.001s
I20260709 12:27:39.917976  9778 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:39.923432  9778 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:39.924446  9778 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:39.929745  9853 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:39.933053  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:39.933642  9956 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:39.934471  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:39.932005  9853 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:39.935796  9960 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:27:39.941103  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:39.941885  9964 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:27:39.969269  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:39.970007  9778 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:39.912354 14052 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:39.928061 13895 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:39.928251 13923 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:39.945021  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:39.978364  9956 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:27:39.930634 13781 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:39.935559 13971 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:39.986902  9960 raft_consensus.cc:2393] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 11: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:39.943538 14121 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:39.942183 13896 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:40.000978  9955 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:39.943845 14112 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:39.935719 14060 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:27:39.994422  9928 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.615s (SENT) [suppressed 53 similar messages]
I20260709 12:27:40.010512 14121 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.011376  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 764) took 1052 ms. Trace:
I20260709 12:27:39.982146 13455 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:27:40.039271  9959 rpcz_store.cc:276] 0709 12:27:38.959438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.959874 (+   436us) service_pool.cc:224] Handling call
0709 12:27:38.960148 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:39.294983 (+334835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:40.011148 (+716165us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54001dd154. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:40.011320 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754098560}
I20260709 12:27:40.012823 14033 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:39.979907 13642 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:27:39.980050 14104 consensus_queue.cc:1048] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:27:40.014545 14018 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:39.969143 14075 consensus_queue.cc:1059] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:27:39.986522 13923 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:40.015997 14084 log.cc:927] Time spent T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 1.237s	user 0.000s	sys 0.003s
W20260709 12:27:40.016374  9887 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1542) took 1525 ms (client timeout 1719 ms). Trace:
I20260709 12:27:40.016937 14095 raft_consensus.cc:3055] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:40.018512 13824 raft_consensus.cc:3055] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:40.019291 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:40.020840 14012 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:27:40.021337 13974 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.024080 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:40.065292  9887 rpcz_store.cc:269] 0709 12:27:38.490848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.493531 (+  2683us) service_pool.cc:224] Handling call
0709 12:27:40.016196 (+1522665us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540029a4d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:40.016313 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2811282176}
I20260709 12:27:39.937193 14120 consensus_queue.cc:1059] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:27:40.068434 10528 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:40.031122 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:40.036345 10524 raft_consensus.cc:1240] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:27:40.075301 10524 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:40.045482 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:40.005724 13999 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:27:40.046667  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 52286.5us
W20260709 12:27:40.076861  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:40.023940 14031 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.077957  9928 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:40.070462 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:39.993848 13781 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:40.081883 14052 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:40.082459 14037 raft_consensus.cc:2804] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:40.082857 14037 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:40.083242 14037 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:40.083503 14120 raft_consensus.cc:3055] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:40.083882 14120 raft_consensus.cc:740] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:40.084263 13766 consensus_queue.cc:1059] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:40.084695 14120 consensus_queue.cc:260] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:40.067345 13824 raft_consensus.cc:740] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:40.087054 13632 raft_consensus.cc:3055] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:40.086946 13824 consensus_queue.cc:260] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.087488 13632 raft_consensus.cc:740] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:40.087984 13824 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:40.064827 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:40.077502  9854 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:40.066421 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:40.093170 10533 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:40.096036 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:40.072773 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:40.069036  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 120743us
W20260709 12:27:40.103147  9961 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55952 (request call id 1639) took 1553 ms (client timeout 1507 ms). Trace:
I20260709 12:27:40.066759 13923 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:40.106559 10526 raft_consensus.cc:1240] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:40.067147 14095 raft_consensus.cc:740] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:40.047533 14060 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.088387 13632 consensus_queue.cc:260] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.110311 10533 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:40.079016 13999 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:40.064723 14018 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:40.069139 13896 raft_consensus.cc:3055] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:27:40.235081  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:40.103557  9961 rpcz_store.cc:269] 0709 12:27:38.549828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.559321 (+  9493us) service_pool.cc:224] Handling call
0709 12:27:40.102978 (+1543657us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b54001522d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:40.103072 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49262336}
I20260709 12:27:40.203048  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:40.140724  9964 raft_consensus.cc:1275] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:27:40.148363  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:40.149770  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:40.255672  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:40.191486  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 166647us
I20260709 12:27:40.202554  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:40.262460  9962 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:27:40.200328 14085 log.cc:927] Time spent T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 1.432s	user 0.002s	sys 0.002s
I20260709 12:27:40.211143 10531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 1059) took 1817 ms. Trace:
I20260709 12:27:40.149191  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:40.141798 14075 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.267315  9961 raft_consensus.cc:1240] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:40.145421 14082 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:40.140192 14059 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.102739 14066 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:40.111935 13762 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.268440 14095 consensus_queue.cc:260] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.269447 14018 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:40.141817 13844 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.299927 13844 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:40.232115 14124 log.cc:927] Time spent T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:27:40.125262 13642 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:40.271776  9927 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:40.274571  9957 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:27:40.278023 14069 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.256399  9814 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:40.276464  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.273689 13930 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:27:40.239655 13999 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:27:40.111083  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 141110us
I20260709 12:27:40.239004 14012 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:40.271464 10531 rpcz_store.cc:276] 0709 12:27:38.393404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.393521 (+   117us) service_pool.cc:224] Handling call
0709 12:27:38.394393 (+   872us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:38.402879 (+  8486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:38.402910 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:38.408273 (+  5363us) log.cc:844] Serialized 26 byte log entry
0709 12:27:38.604745 (+196472us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:38.604790 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:38.604860 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:40.015497 (+1410637us) spinlock_profiling.cc:243] Waited 70.1 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:40.194908 (+179411us) raft_consensus.cc:1685] finished
0709 12:27:40.194938 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:40.210929 (+ 15991us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13038,"raft.queue_time_us":6565,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":4638,"spinlock_wait_cycles":161143552,"thread_start_us":167835,"threads_started":1,"wal-append.queue_time_us":286172}
I20260709 12:27:40.113746  9853 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:40.252733 13896 raft_consensus.cc:740] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:27:40.299161 14123 log.cc:927] Time spent T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
I20260709 12:27:40.299050 14095 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:40.303678  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.302580 13844 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:40.371251  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:40.282267 14075 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.297542 14066 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:40.311250  9881 raft_consensus.cc:2368] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15.
I20260709 12:27:40.277925  9809 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:27:40.284332 13632 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:40.315726  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 44016.4us
I20260709 12:27:40.309393 13642 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:40.336357  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.370085 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:40.373925  9883 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:27:40.303892 13762 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.287746 14059 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.317826 14112 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:40.388481  9888 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:40.321404 13759 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:40.288686 14082 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.324821 14026 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:40.320771 14104 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.324484 14046 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:40.333336 14018 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:40.382040 13642 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:40.364428 14012 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.319898 14069 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.394861 14031 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:40.422857 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:40.422750  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 309101us
I20260709 12:27:40.427712  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.427896  9853 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:40.429714  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.400230 14026 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:40.418530 13759 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:40.433559  9853 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:40.434635  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.435686  9888 raft_consensus.cc:2393] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 12: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:40.437748  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.438179  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:40.430235 14137 log.cc:927] Time spent T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:27:40.441648 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:40.443879  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.423317 14060 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:40.421525 14131 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:40.445676  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.445828 14031 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.446528 14143 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:40.446741  9887 raft_consensus.cc:1240] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:40.456920  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.457393 14143 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:40.457645  9882 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:27:40.457870 14143 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:27:40.460379 14134 log.cc:927] Time spent T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:27:40.462185 14066 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:40.464516 13759 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:40.466729 14101 log.cc:927] Time spent T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.956s	user 0.000s	sys 0.006s
I20260709 12:27:40.466801 14012 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:40.447759  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:40.443025  9779 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:40.469565 14127 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:40.441067 14146 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:40.390513 13896 consensus_queue.cc:260] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:40.470067  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:40.431316 13781 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:40.453193  9883 raft_consensus.cc:1240] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:27:40.433370 14026 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:40.419922 14046 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:40.471963  9854 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:40.416968 14104 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.482295  9779 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:40.483989 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:40.484616 10524 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:27:40.421550 14018 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:40.453935 14072 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.451960 14128 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:40.470445 13740 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:40.470331 14146 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:40.489130  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:40.517874  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 142839us
I20260709 12:27:40.507740 10524 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 15.
W20260709 12:27:40.508291  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 74822.4us
I20260709 12:27:40.488072 14126 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:40.513324 13896 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:40.529762 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 129053us
I20260709 12:27:40.530619  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:40.531118  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 210760us
I20260709 12:27:40.525906  9956 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:27:40.528160  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:40.474534 14031 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.517570 14146 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:40.524421  9927 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:40.466004 14143 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:40.414999 14112 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.470124 14127 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:40.528268 14140 log.cc:927] Time spent T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:27:40.493101 14037 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.549947  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.481945 14131 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.561838 14037 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:40.562937 14131 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:40.564220 14104 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:40.539333 13895 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:40.566654 13895 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:40.567802  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.568421  9883 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:27:40.553753 13762 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:40.555413 14075 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:40.556294 14082 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:40.556773 14127 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:40.544138 14144 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:40.576943 10497 leader_election.cc:400] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15.
I20260709 12:27:40.582231 10497 leader_election.cc:403] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:40.543643 13740 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:27:40.570113 14136 log.cc:927] Time spent T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:27:40.580054  9884 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:40.515137 14072 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:40.577940  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 53578.7us
I20260709 12:27:40.581782 14003 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:40.583858 10497 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:40.588137  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:40.591863  9812 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:40.588820  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:40.593014  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:40.594583  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:40.595291  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 113093us
I20260709 12:27:40.580459 13455 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.596942  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:40.599211  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:40.598367  9809 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:27:40.596935 14147 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.588104 14059 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:40.546860 14151 consensus_queue.cc:1059] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:27:40.588263 13895 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:40.605357 13999 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:40.587949 14012 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:27:40.606839 14018 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:40.601992 14072 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:40.594798 14144 raft_consensus.cc:697] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:40.668991  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.608286  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:40.669948  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:40.595427 13740 raft_consensus.cc:697] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:27:40.671532  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:40.721310  9882 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:40.596565 13824 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:40.585923 13762 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15.
I20260709 12:27:40.650172  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:40.670168  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:40.673725  9883 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:40.693586  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.737135  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.696389  9927 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:40.739276 14059 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:40.739435  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.741009  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.741714  9881 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:40.743335  9815 raft_consensus.cc:2410] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:27:40.718667  9779 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:40.723752  9808 raft_consensus.cc:2393] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 14: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:40.671489  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:40.745086  9809 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:27:40.659040 14069 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:40.686899 14144 consensus_queue.cc:237] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.608518 14146 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.682049 14046 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:40.673821 13455 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:40.681701 14031 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:40.720053 13695 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:40.678889 14112 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:40.678892 14143 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:40.733846 14026 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:40.799527  9807 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
W20260709 12:27:40.800392  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 81821.3us
I20260709 12:27:40.801120  9779 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:40.801478  9812 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:27:40.755688  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.803668  9881 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:40.804867  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.756253 13759 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:27:40.757010 14066 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.760247 14060 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.678709 13974 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:40.813978  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:40.765784  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 275563us
I20260709 12:27:40.815313  9854 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:40.690442 14127 raft_consensus.cc:3055] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:27:40.772192  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 247610us
I20260709 12:27:40.774257  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.816530  9889 raft_consensus.cc:2393] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 12: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:40.785612  9882 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:40.818001  9778 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:40.769827 14157 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.843988  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.845019  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.845144  9956 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:27:40.680974 13642 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.808287  9779 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:40.809935  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:40.813284  9810 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:27:40.596947 13792 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.152s
I20260709 12:27:40.819351  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.827963  9809 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:40.814872 13740 consensus_queue.cc:237] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.811525 14141 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.810721 13895 raft_consensus.cc:2804] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:40.813745 13896 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:40.834618 14060 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:40.839562 14046 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:27:40.840248 14100 log.cc:927] Time spent T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195: Append to log took a long time: real 1.410s	user 0.000s	sys 0.006s
I20260709 12:27:40.672514 14147 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.842422 14151 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.790308 14142 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:27:40.806107 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:40.854847  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 83642.2us
W20260709 12:27:40.843535 13923 consensus_meta.cc:287] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.001s
I20260709 12:27:40.865265  9881 raft_consensus.cc:2410] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 9 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:27:40.845538  9882 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:40.884805  9882 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:27:40.867297  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 59091.7us
I20260709 12:27:40.842859 14127 raft_consensus.cc:740] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:40.889413 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:40.889984 10529 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:40.879596 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:40.880266 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:40.880678  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:40.865600 14016 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.889987  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:40.896799  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:40.816195 14066 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:40.875880 14160 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:40.905411  9958 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:40.899194  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:40.870124 14072 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:40.901574  9927 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:40.914640 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:40.919405 14163 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:40.919994 14163 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:40.920476 14163 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:40.871305 14104 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:27:40.875751 13895 raft_consensus.cc:697] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:40.933214 13999 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:40.882536 14046 raft_consensus.cc:697] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 15 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:40.963891 14046 consensus_queue.cc:237] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:40.964561 14156 log.cc:927] Time spent T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.406s	user 0.001s	sys 0.000s
I20260709 12:27:40.937038  9811 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:27:40.931219  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:40.940250 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:40.967195 10524 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:40.967991 14060 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:40.847415 14157 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.974084 14157 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:40.975567 14142 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:40.976087 14142 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:40.980291 14026 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:40.956061 14166 log.cc:927] Time spent T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:27:40.956974 14146 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:40.957316  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:40.958433 14147 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:40.874843 14141 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.960290 14127 consensus_queue.cc:260] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.011929  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:41.012501  9960 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:40.961606 14120 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:40.962047 13455 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:40.963052 14161 log.cc:927] Time spent T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:27:40.966055 13759 raft_consensus.cc:2804] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:40.992012 10527 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:27:41.028643 10527 pending_rounds.cc:85] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b: Aborting all ops after (but not including) 10
I20260709 12:27:41.028966 10527 pending_rounds.cc:107] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:27:41.029207 10527 raft_consensus.cc:2889] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:40.993877  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:40.995359  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:41.030126  9811 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:40.904752 14016 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:40.997511  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:40.901973 13923 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:41.010989  9963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 767) took 2047 ms. Trace:
I20260709 12:27:41.013748  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:41.023969  9957 raft_consensus.cc:1275] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:41.024806  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:41.029557  9814 raft_consensus.cc:1240] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:41.031229  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:41.039150  9815 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:41.039422  9811 raft_consensus.cc:2393] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:41.030062  9961 raft_consensus.cc:2376] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10. Re-sending same reply.
I20260709 12:27:41.039731  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:41.034670  9812 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:41.040303  9814 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
W20260709 12:27:41.033526  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 235828us
I20260709 12:27:41.037629  9963 rpcz_store.cc:276] 0709 12:27:38.963969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:39.584164 (+620195us) service_pool.cc:224] Handling call
0709 12:27:39.601191 (+ 17027us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:39.605057 (+  3866us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:40.022079 (+417022us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b18003e64a0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b411e07 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42c455 00007f2f91f143c7 00007f2f8e5269a7 00007f2f8e5360bf 00007f2f8e536038
0709 12:27:40.138533 (+116454us) log.cc:844] Serialized 14 byte log entry
0709 12:27:40.547102 (+408569us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:40.570214 (+ 23112us) log.cc:844] Serialized 26 byte log entry
0709 12:27:40.571215 (+  1001us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:40.571268 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:40.571356 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:40.964035 (+392679us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:41.010790 (+ 46755us) raft_consensus.cc:1685] finished
0709 12:27:41.010812 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:41.010933 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19760,"prepare.queue_time_us":604973,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":8163,"raft.queue_time_us":23532,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":32709,"spinlock_wait_cycles":47199872,"thread_start_us":370168,"threads_started":2,"wal-append.queue_time_us":299079}
W20260709 12:27:41.041255 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.009085 14033 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.009795  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:41.042666  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:41.043555  9813 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:41.043869  9928 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:41.045363  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:40.878000 14151 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.046546  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:41.031102 14137 log.cc:927] Time spent T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:27:41.050639 14033 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.033517 14127 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:41.054869  9812 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:41.056111  9928 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:41.062664  9813 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:27:41.052506 14121 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:41.064711  9815 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:27:41.068043  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:41.072956  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:40.997355  9927 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:41.081826  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:41.072969 10496 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:41.082845  9807 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:41.046546 13759 raft_consensus.cc:697] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:41.026618 13695 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:27:41.089480  9928 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:41.092028  9928 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:41.062850 14147 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:41.097175 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:41.100111  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:41.068213 14003 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:41.100755  9807 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:27:41.103751 10496 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:41.105173  9960 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
W20260709 12:27:41.112324  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 115066us
I20260709 12:27:41.097970 13919 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:27:41.120693  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.101920 14174 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:41.117662  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:41.125001  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:41.117213  9806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 721) took 1316 ms. Trace:
I20260709 12:27:41.109930 10496 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:41.104475 13922 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:41.116540  9928 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:41.117480  9927 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:41.146133 10496 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:41.146165  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:41.143159  9806 rpcz_store.cc:276] 0709 12:27:39.800592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:39.800791 (+   199us) service_pool.cc:224] Handling call
0709 12:27:39.801152 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:39.838053 (+ 36901us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:27:39.838345 (+   292us) log.cc:844] Serialized 14 byte log entry
0709 12:27:39.914411 (+ 76066us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:39.915094 (+   683us) log.cc:844] Serialized 26 byte log entry
0709 12:27:39.915214 (+   120us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:39.915245 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.109193 (+1193948us) spinlock_profiling.cc:243] Waited 36.5 ms on lock 0x7b5400252bd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:41.109239 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:41.109281 (+    42us) raft_consensus.cc:1685] finished
0709 12:27:41.117014 (+  7733us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:41.117141 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":987,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":5495,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":3144,"spinlock_wait_cycles":83991808,"thread_start_us":75597,"threads_started":1,"wal-append.queue_time_us":145004,"wal-append.run_cpu_time_us":1899,"wal-append.run_wall_time_us":1039273}
I20260709 12:27:41.101266 13792 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:27:41.115495 13905 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:41.154979  9928 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:41.135550 14173 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:27:41.166545  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 49144.2us
I20260709 12:27:41.138870 14003 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:41.167583  9928 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:41.168757  9927 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:41.105834 14067 consensus_queue.cc:1059] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:27:41.116142 13642 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:41.087679 13895 consensus_queue.cc:237] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.172175  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:41.164183 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:41.120451 14172 raft_consensus.cc:2764] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:27:41.170641  9927 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:41.149366 14058 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.188417  9928 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:41.149777 13762 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:41.187325 14003 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:41.198716  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:41.190716 14040 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:41.142125 14175 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:41.153254 13824 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:41.198697  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:41.141228 13919 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:41.159025 13905 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.169680 14147 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:41.199524  9806 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:41.166750 14146 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.224624  9927 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:41.204428 13844 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:27:41.192998 14174 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:41.233434 14174 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.233878 14174 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:41.234227 14146 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.235805 14172 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:41.236802 14172 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:41.237145 14172 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.237471 14172 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:41.207845 14040 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:41.191077 14060 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:41.197894 13762 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.171346 14173 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:41.202886 14003 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:41.203091 13974 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:41.205441 14058 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:41.187706 14026 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:41.188349 14066 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:41.245431  9813 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:27:41.208195 14175 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:41.247638  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:41.193521 13759 consensus_queue.cc:237] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.223984 13905 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:41.255748 14033 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:41.256239 14151 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:41.226980 14147 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:41.230732 13824 raft_consensus.cc:697] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:41.253458 13762 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:41.248639 14057 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:41.247972 14040 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:41.253454 14173 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:41.306735 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 73294.1us
I20260709 12:27:41.220956 13919 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:41.248401 14060 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.249202 13923 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:41.289414  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 101061us
I20260709 12:27:41.291887  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:41.296021  9806 raft_consensus.cc:1275] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:27:41.305979  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:41.287189 14175 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:41.241365 14141 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:41.294812 14146 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:41.298853 14147 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:41.314802  9813 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:41.314958  9928 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:27:41.315331  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 90793us
I20260709 12:27:41.307677 13844 raft_consensus.cc:697] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:41.311444 14060 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:41.329553  9812 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:41.333923  9813 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 15.
I20260709 12:27:41.336992 14058 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:41.337061 13632 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:41.338593 14170 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:41.339166 14170 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.341339 14170 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:41.342351 13824 consensus_queue.cc:237] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.344683 14173 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:41.345294  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46504 (request call id 2672) took 1196 ms. Trace:
I20260709 12:27:41.345677  9808 rpcz_store.cc:276] 0709 12:27:40.148781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.148917 (+   136us) service_pool.cc:224] Handling call
0709 12:27:41.345065 (+1196148us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54002530d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:41.345224 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1038351232}
I20260709 12:27:41.347093 14173 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:41.351665  9928 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:41.309566 14142 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:41.353647  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:41.358327  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:41.359715  9812 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:41.362339  9813 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:41.374794  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:41.375586 14142 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:41.376366  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:41.377131  9812 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:41.378734  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:41.379491  9810 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:41.383103  9811 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:27:41.384166 14058 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:41.386415  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:41.386828  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:41.387059  9814 raft_consensus.cc:2376] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7. Re-sending same reply.
I20260709 12:27:41.387399  9806 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:41.364717 13632 raft_consensus.cc:697] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:41.391870 13632 consensus_queue.cc:237] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:41.392488  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:41.393273  9808 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
W20260709 12:27:41.398437  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 46820.9us
I20260709 12:27:41.400274  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:41.401294  9806 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
I20260709 12:27:41.402674  9853 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:41.407536  9888 raft_consensus.cc:2410] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:27:41.408639 14180 log.cc:927] Time spent T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:27:41.399282 14141 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:41.377776 14163 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:41.412153 14163 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:41.413554 14172 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:41.418759 14057 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.418514 13844 consensus_queue.cc:237] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:41.426832  9813 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:41.429751  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:41.431910  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:41.433821  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:41.435727  9927 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:41.438218  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:41.439446  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:41.439042  9853 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:41.439440  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:41.445284 14163 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:41.446563  9853 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:41.452163  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:41.459673  9853 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:41.419282 14057 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.463922  9853 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:41.464656 14151 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:41.465215 14151 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:41.465250 14033 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:41.465839 14151 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:41.465963 14033 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.466885 14033 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:41.423470 14058 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:41.470098  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:41.470579  9853 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
W20260709 12:27:41.478612  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.472324  9853 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:41.482383  9812 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:41.459055 14120 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:41.471164 13766 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:41.479254 14188 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.445817 14143 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:27:41.478721 14057 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:41.481891 13974 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:41.483234 14163 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:41.484601 13695 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.485598 13824 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.451468 13919 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.487828 14144 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:27:41.503701  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:41.472527 14031 consensus_queue.cc:1048] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:27:41.504261  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:41.504074  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:41.505606  9928 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:41.477702 13966 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:27:41.499837 14174 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.521642  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:41.501124 14163 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.515650  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:41.517006  9956 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:41.517978  9928 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:41.523566  9960 raft_consensus.cc:1240] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:41.501502 13766 raft_consensus.cc:697] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:41.534806 13632 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:41.538048 14174 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:41.543077 14172 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:41.543263  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:41.544032  9812 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:41.518777 14191 log.cc:927] Time spent T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:27:41.560405  9806 raft_consensus.cc:1240] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:27:41.560986  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:41.561872  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:41.556470 14040 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:41.522365 14187 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:41.520962 13802 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.521256 14144 raft_consensus.cc:697] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 14 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:41.528438 14163 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:41.500073 14188 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.509383 13824 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.583021  9956 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
I20260709 12:27:41.581265  9812 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:41.584712  9927 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:41.557898 14060 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:41.565068 14003 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.570326 14184 consensus_queue.cc:1059] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:27:41.506886 13695 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.596479  9928 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:41.573629 13802 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:41.599843  9962 raft_consensus.cc:1240] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:41.587718 14187 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:41.601423  9959 raft_consensus.cc:1240] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 11. Current term is 12. Ops: []
W20260709 12:27:41.620533 14138 log.cc:927] Time spent T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 1.162s	user 0.004s	sys 0.000s
I20260709 12:27:41.621500 13974 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.621762  9885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 982) took 1495 ms. Trace:
I20260709 12:27:41.622008 13974 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.622110  9885 rpcz_store.cc:276] 0709 12:27:40.126401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.127385 (+   984us) service_pool.cc:224] Handling call
0709 12:27:40.127799 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:40.145666 (+ 17867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:40.145709 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:40.146245 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 12:27:40.317289 (+171044us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:40.317342 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:40.317436 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:41.593342 (+1275906us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:41.621474 (+ 28132us) raft_consensus.cc:1685] finished
0709 12:27:41.621495 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:41.621705 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17425,"raft.queue_time_us":49860,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":11212,"spinlock_wait_cycles":30329600,"thread_start_us":81880,"threads_started":1,"wal-append.queue_time_us":250717}
I20260709 12:27:41.626526 13966 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.627038 13966 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:41.628954 13966 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:41.599313 14031 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:27:41.630844 14158 log.cc:927] Time spent T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 1.068s	user 0.002s	sys 0.007s
I20260709 12:27:41.630667 14031 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:41.631490 14155 log.cc:927] Time spent T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195: Append to log took a long time: real 1.073s	user 0.004s	sys 0.005s
I20260709 12:27:41.631940 13919 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:41.632824 14031 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:41.634044 13802 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:41.635793 14003 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:41.637398 14060 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:41.637948 14072 consensus_meta.cc:287] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.702s	user 0.006s	sys 0.006s
I20260709 12:27:41.638351 14072 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:41.638571 13824 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:41.639143  9807 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:41.640399  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2442) took 1194 ms. Trace:
I20260709 12:27:41.640770  9886 rpcz_store.cc:276] 0709 12:27:40.445632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.450230 (+  4598us) service_pool.cc:224] Handling call
0709 12:27:40.454766 (+  4536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:40.455187 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:40.476458 (+ 21271us) log.cc:844] Serialized 14 byte log entry
0709 12:27:40.546136 (+ 69678us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:40.546590 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 12:27:40.546735 (+   145us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:40.546765 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:40.546831 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:41.622133 (+1075302us) spinlock_profiling.cc:243] Waited 7.03 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:41.640146 (+ 18013us) raft_consensus.cc:1685] finished
0709 12:27:41.640240 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:41.640349 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1619,"prepare.queue_time_us":25723,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":60994,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":34462,"spinlock_wait_cycles":16169728,"thread_start_us":32678,"threads_started":1,"wal-append.queue_time_us":61366}
I20260709 12:27:41.593950 13762 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.644761 14144 consensus_queue.cc:237] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:41.591588 14147 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:41.602871 14175 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:41.609665 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:41.610121 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:41.652284 10532 raft_consensus.cc:2368] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 11. Current term is 12.
I20260709 12:27:41.610428 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:41.610633 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:41.611316 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:41.653079 10524 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:41.611586 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:41.614073 10529 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:27:41.654228 10529 pending_rounds.cc:85] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b: Aborting all ops after (but not including) 10
I20260709 12:27:41.654506 10529 pending_rounds.cc:107] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:27:41.654735 10529 raft_consensus.cc:2889] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:41.648101  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54428 (request call id 989) took 1344 ms. Trace:
I20260709 12:27:41.649614  9927 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:41.650967  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:41.657728 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:41.617097  9964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1651) took 1673 ms. Trace:
I20260709 12:27:41.655297  9884 rpcz_store.cc:276] 0709 12:27:40.303331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.303451 (+   120us) service_pool.cc:224] Handling call
0709 12:27:41.647921 (+1344470us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54003c6254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:41.648043 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":483683712}
I20260709 12:27:41.658593  9964 rpcz_store.cc:276] 0709 12:27:39.943596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:39.950491 (+  6895us) service_pool.cc:224] Handling call
0709 12:27:39.950811 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:40.254294 (+303483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.616880 (+1362586us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54001527d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:41.617038 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435945856}
I20260709 12:27:41.652802 10525 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:41.677121 10525 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:41.679509 10531 raft_consensus.cc:2393] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 15: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:41.680181  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:41.681008  9812 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:41.616022 14109 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.149s	user 0.013s	sys 0.022s
I20260709 12:27:41.683527  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:41.683596 10531 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:27:41.634070 14040 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:41.688695  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:41.689376  9928 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:41.699240  9884 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:41.700105  9928 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:41.689401  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:41.692557 14033 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.693061 14016 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:41.706260  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 221506us
I20260709 12:27:41.713534 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:41.706785  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 57244.7us
I20260709 12:27:41.593298 13766 consensus_queue.cc:237] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:41.639173 13905 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.696660 14151 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.703783  9812 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
W20260709 12:27:41.684958 14109 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.219s	user 0.014s	sys 0.022s
I20260709 12:27:41.704598 13781 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:41.704985  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:41.729822 13762 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:41.705830 13632 consensus_queue.cc:1059] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:27:41.731670 13905 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:41.696722 14163 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.684165 14187 raft_consensus.cc:697] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:41.740895 14187 consensus_queue.cc:237] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.718406  9927 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:41.718998  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:41.722872 14188 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:41.724421 14175 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:41.756469 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:41.756654 10531 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:27:41.757678 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:41.757723 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:41.757846 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:41.759455 10532 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:41.736320  9884 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:41.737939  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:41.716140 14185 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:41.765920 14185 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.766341 14185 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:41.766427 13824 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:41.767369  9887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2450) took 1076 ms. Trace:
I20260709 12:27:41.742853  9890 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:41.767727  9887 rpcz_store.cc:276] 0709 12:27:40.690995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.694101 (+  3106us) service_pool.cc:224] Handling call
0709 12:27:41.648251 (+954150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:41.648433 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:41.648463 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:41.648506 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:41.648544 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.648614 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:41.767223 (+118609us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b54003c6250. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:41.767317 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2193530752}
I20260709 12:27:41.772624 13922 raft_consensus.cc:3055] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:41.773010 13922 raft_consensus.cc:740] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:41.773677 14163 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:41.713090 14040 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:27:41.775813 14194 log.cc:927] Time spent T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 12:27:41.778512 14142 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:41.779198 14142 raft_consensus.cc:697] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:41.780256 14142 consensus_queue.cc:237] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:41.782810 14026 raft_consensus.cc:3055] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:41.783178 14026 raft_consensus.cc:740] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:41.783990 14026 consensus_queue.cc:260] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.785081 14026 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:41.785862 14121 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:41.786407 14121 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.788360 14121 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:41.761518 14031 consensus_queue.cc:1059] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:41.789202 14104 raft_consensus.cc:3055] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:27:41.789525 14104 raft_consensus.cc:740] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:41.790560 14033 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:41.790246 14104 consensus_queue.cc:260] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:41.773821 13922 consensus_queue.cc:260] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:41.791435  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:41.792013 13922 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:41.792917 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:41.793567 10531 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:41.762514 14151 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:41.760829  9886 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:41.794961 10525 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:27:41.795499 14151 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.795943 14151 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:41.798058 14151 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:41.798808  9885 raft_consensus.cc:1240] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:41.801302 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:41.802692  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:41.802769  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:41.803521  9883 raft_consensus.cc:2393] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 12: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:41.803889  9890 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:27:41.795174 10497 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:41.805334 10532 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:41.807168  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:41.808480  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:41.810114  9881 raft_consensus.cc:2393] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:41.810351  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:41.811210  9959 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:27:41.814059  9886 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:27:41.825177  9928 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:27:41.828807 14046 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.001s	sys 0.029s
W20260709 12:27:41.834563 14046 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.002s	sys 0.029s
I20260709 12:27:41.738677 14147 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:41.846387  9928 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:27:41.847211  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 97121.1us
I20260709 12:27:41.930984 14012 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:41.878798 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:42.049901 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:41.930868 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:42.047482 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:41.858608 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:42.069108  9779 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:42.166440 10532 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:42.169588 10530 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:27:41.855228  9887 raft_consensus.cc:1240] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:27:41.855576  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:42.171525 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:42.163807  9853 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:42.175590  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 330780us
I20260709 12:27:42.175783 10524 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
W20260709 12:27:42.176537  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.177248 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:41.925709 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:42.000376  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.178013 10532 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:42.165274 10531 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:42.173987 10525 raft_consensus.cc:2410] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:27:42.173894  9957 raft_consensus.cc:2393] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:27:42.174813  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 105785us
I20260709 12:27:42.172387 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:42.179652 10526 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:42.164163  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 283975us
W20260709 12:27:42.180078 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 254448us
I20260709 12:27:42.182843 10532 raft_consensus.cc:1275] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:27:42.232313 10526 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:42.232396  9779 leader_election.cc:400] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 11. Current term is 12.
I20260709 12:27:42.242125  9779 leader_election.cc:403] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 12:27:42.242635  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 62911.2us
I20260709 12:27:42.243343  9854 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:41.892123 14037 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.317s	user 0.009s	sys 0.012s
W20260709 12:27:42.066885 14138 log.cc:927] Time spent T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:27:41.835767 13762 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:42.189795 14199 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:41.849232 14174 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:42.160705 13695 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:42.180606 13740 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:42.261502 14104 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:42.269560 14199 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.247274 14016 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:41.873637 14026 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:42.187321 13632 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:42.163091 14012 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:42.265779 14037 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.697s	user 0.024s	sys 0.035s
I20260709 12:27:41.876803 14202 consensus_queue.cc:1059] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.396s
W20260709 12:27:42.269763 14206 log.cc:927] Time spent T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.411s	user 0.000s	sys 0.001s
I20260709 12:27:42.203434 13896 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:42.267906 13762 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:42.268560 14185 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:42.296911 14199 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:42.294724 13740 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:42.403048 14222 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:27:42.302774 13632 raft_consensus.cc:697] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:42.342882 14026 raft_consensus.cc:697] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:42.343473 13762 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:42.377139 13740 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:42.426626 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.429421 14142 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:42.430042 14142 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:42.432148 14142 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:42.434046 13922 consensus_meta.cc:287] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.642s	user 0.010s	sys 0.000s
I20260709 12:27:42.434727  9963 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:27:42.435097  9963 pending_rounds.cc:85] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 9
I20260709 12:27:42.434957 14026 consensus_queue.cc:237] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:42.421715 13632 consensus_queue.cc:237] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:42.437131  9889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 998) took 1595 ms. Trace:
I20260709 12:27:42.407454 13766 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.437480  9889 rpcz_store.cc:276] 0709 12:27:40.841854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.887203 (+ 45349us) service_pool.cc:224] Handling call
0709 12:27:40.887444 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:40.887616 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:40.902224 (+ 14608us) log.cc:844] Serialized 14 byte log entry
0709 12:27:41.802179 (+899955us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b1800362b00. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b411e07 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f8e0b620b 00007f2f8e0bbd23 00007f2f8e0bc23a 00007f2f8e526a2a
0709 12:27:42.436811 (+634632us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:42.436859 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:42.436901 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:42.436965 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:42.437067 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":430153,"prepare.queue_time_us":13317,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"spinlock_wait_cycles":15629056,"thread_start_us":204213,"threads_started":1,"wal-append.queue_time_us":1344080}
I20260709 12:27:42.435518  9963 pending_rounds.cc:107] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:27:42.438424 13766 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:42.439249  9963 raft_consensus.cc:2889] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:42.439798  9809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 2266) took 1502 ms. Trace:
I20260709 12:27:42.440145  9809 rpcz_store.cc:276] 0709 12:27:40.937546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.937680 (+   134us) service_pool.cc:224] Handling call
0709 12:27:40.937941 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:40.987568 (+ 49627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:40.987599 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:40.988034 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 12:27:41.788600 (+800566us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b1800354400. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b411e07 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f8e0b620b 00007f2f8e0bbd23 00007f2f8e0bc0d1 00007f2f8e4d7a0f
0709 12:27:42.223220 (+434620us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:42.248269 (+ 25049us) log.cc:844] Serialized 14 byte log entry
0709 12:27:42.393235 (+144966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:42.393345 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:42.439535 (+ 46190us) raft_consensus.cc:1685] finished
0709 12:27:42.439631 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:42.439745 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61456,"prepare.queue_time_us":24894,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":49392,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5579,"spinlock_wait_cycles":50392448,"thread_start_us":579047,"threads_started":2,"wal-append.queue_time_us":1329613}
I20260709 12:27:42.441906 13695 raft_consensus.cc:3055] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:42.442327 13695 raft_consensus.cc:740] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:42.443140 13695 consensus_queue.cc:260] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:42.444576  9807 raft_consensus.cc:1240] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 11. Current term is 12. Ops: []
W20260709 12:27:42.424755 14153 log.cc:927] Time spent T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 1.867s	user 0.012s	sys 0.005s
I20260709 12:27:42.444478  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:42.343262 13896 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:42.422571  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:42.455134  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:42.456236  9809 raft_consensus.cc:2393] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
W20260709 12:27:42.464982  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 221727us
I20260709 12:27:42.465910  9779 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:42.467070  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 303287us
W20260709 12:27:42.467540  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.468009  9853 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:42.470736  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:42.483201  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 239870us
I20260709 12:27:42.490039  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:42.491262 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.494201  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:42.501184  9928 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:42.502619  9928 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:42.503624  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:42.505435  9928 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:42.491578 14058 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:42.493424 14052 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:42.467202 14188 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:27:42.506701 14037 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:42.518965 14216 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:42.517452  9809 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:42.520077  9854 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:42.520823 14151 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:27:42.521162 14201 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:42.522670  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 54725us
I20260709 12:27:42.523373 14146 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:42.523607 14220 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:42.524901 14223 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:42.510409 14208 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:42.526854 14012 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:42.527750 14057 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:42.527824 14185 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:42.528607 14221 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:42.510617 14217 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:27:42.536244  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:42.490028 14144 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:42.499011 13896 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:42.550045 14058 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:42.538026 14218 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:42.568759 14220 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:42.600869 14220 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:42.537523 13740 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:42.594841 13896 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:42.597322 14058 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:42.562304 13942 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:42.565979 14201 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:42.585945 14221 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.608651 13896 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:42.584435 14146 consensus_queue.cc:1059] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:27:42.580770 14223 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:42.586649 14057 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:42.621348 14221 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:42.536944  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 71093.1us
I20260709 12:27:42.535744  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:42.550530  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 45179.8us
I20260709 12:27:42.679454  9808 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:27:42.681667  9807 raft_consensus.cc:1275] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:27:42.741606  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 177495us
I20260709 12:27:42.678592  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:42.747727  9806 raft_consensus.cc:2393] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:42.748589 14220 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:42.747596 14229 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:42.707006 10496 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:42.683271  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:42.627866 13942 raft_consensus.cc:3055] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:42.730787 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:42.710466 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:42.682499  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:42.764200 14239 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:42.739048 14227 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:27:42.680141  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:42.769681  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 169212us
I20260709 12:27:42.768530 14239 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:42.787741 14187 consensus_queue.cc:1048] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:27:42.787956 14058 consensus_queue.cc:1059] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:27:42.789579 14058 raft_consensus.cc:3055] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:42.791139  9808 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:42.640189 14201 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:42.795246 13896 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:42.800171 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 93690.6us
I20260709 12:27:42.800539 14057 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:42.801556 14057 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:42.806391 13942 raft_consensus.cc:740] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:42.808288 13942 consensus_queue.cc:260] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:42.810179 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:42.810653 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:42.811509 10525 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:42.814630 13942 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:42.637691 14199 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:42.828753 13740 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:42.790072 14058 raft_consensus.cc:740] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:42.639983 14223 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:42.830706 10526 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:27:42.831504 14058 consensus_queue.cc:260] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:42.832860  9928 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:42.833438 14058 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:42.839493 10496 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:42.841205 14170 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:42.825066  9814 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:42.841761 10496 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:42.785918 14227 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.849073 14069 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:42.849498 14239 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:42.850634 14236 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:42.855695 14229 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:42.857686 14069 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:42.855870 14227 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:42.858428 14069 raft_consensus.cc:697] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:42.858765  9809 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:42.860618 14199 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:42.860875 14236 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:42.863121  9854 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:42.864240 14235 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:27:42.866726 14236 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:42.864729 14069 consensus_queue.cc:237] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:42.868353 14229 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:42.860646 14227 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:42.871243  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:42.857234 10525 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
W20260709 12:27:42.873481 14104 consensus_meta.cc:287] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.577s	user 0.011s	sys 0.007s
W20260709 12:27:42.879323  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 46826.3us
I20260709 12:27:42.861836 13766 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:42.884408 14145 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:42.885154 14145 raft_consensus.cc:697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 10 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:42.886509 14145 consensus_queue.cc:237] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:42.887797 10525 raft_consensus.cc:1240] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:27:42.889154 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:42.851145 14170 raft_consensus.cc:697] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:42.891053  9809 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:27:42.898561  9813 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:42.898710 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:42.899412 10533 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:42.902647  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.908854  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:42.909850  9888 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
W20260709 12:27:42.912323 14016 consensus_meta.cc:287] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.610s	user 0.005s	sys 0.014s
I20260709 12:27:42.912952 14016 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 11. Current term is 12.
W20260709 12:27:42.913126  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:42.914651 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 73127.5us
I20260709 12:27:42.894125 13974 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:42.923782 14238 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.924547 14238 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:42.927510  9887 raft_consensus.cc:1275] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:27:42.927768  9882 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:27:42.928274  9882 pending_rounds.cc:85] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 8
I20260709 12:27:42.928551  9882 pending_rounds.cc:107] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:27:42.928884  9882 raft_consensus.cc:2889] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:42.928722  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:42.929885  9890 raft_consensus.cc:2393] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:42.930927  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:42.931738  9885 raft_consensus.cc:2468] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:42.930949 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:42.934583 10530 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:42.935177  9881 raft_consensus.cc:1240] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:42.923635 14170 consensus_queue.cc:237] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:42.936370 14221 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:42.927692  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:42.938288  9886 raft_consensus.cc:2368] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 11. Current term is 12.
I20260709 12:27:42.938743 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:42.940547 13695 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:42.945998 13762 consensus_meta.cc:287] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.005s
I20260709 12:27:42.927911  9887 pending_rounds.cc:85] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 5
I20260709 12:27:42.925995  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:42.955067  9887 pending_rounds.cc:107] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:27:42.955328  9887 raft_consensus.cc:2889] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:42.949956 10533 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:42.897368 14227 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:42.964262  9815 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
W20260709 12:27:42.964473  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.965749  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:42.967523  9811 raft_consensus.cc:3055] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:42.967911  9811 raft_consensus.cc:740] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:42.969461  9811 consensus_queue.cc:260] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:42.973532  9778 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:42.974855 14222 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:42.975665 14222 raft_consensus.cc:697] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:42.977258  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:42.977133 14222 consensus_queue.cc:237] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:42.978102  9959 raft_consensus.cc:2368] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 13. Current term is 14.
I20260709 12:27:42.983632  9889 raft_consensus.cc:1275] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:27:42.984026  9889 pending_rounds.cc:85] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 3
I20260709 12:27:42.984293  9889 pending_rounds.cc:107] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:27:42.984560  9889 raft_consensus.cc:2889] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:42.984903  9889 pending_rounds.cc:107] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:27:42.985172  9889 raft_consensus.cc:2889] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:42.986491 14227 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:42.987882  9957 raft_consensus.cc:1240] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:42.990476  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:42.991663  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:42.992322  9887 raft_consensus.cc:1240] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:42.993392  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:42.993688  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:42.994742  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:42.994889  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:42.995247  9882 raft_consensus.cc:1275] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:42.995381  9885 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:42.997360  9959 raft_consensus.cc:1240] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:42.996246  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:42.998528  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:42.999326  9890 raft_consensus.cc:2393] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:43.002741  9888 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:27:43.003248  9888 pending_rounds.cc:85] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 7
I20260709 12:27:43.003490  9888 pending_rounds.cc:107] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:27:43.003728  9888 raft_consensus.cc:2889] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:43.004204  9964 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:27:43.004539 14146 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.005070 14146 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:43.004551  9964 pending_rounds.cc:85] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 6
I20260709 12:27:43.006217 14201 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:43.006446  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:43.006924  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:43.007262 14104 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:43.007929 14104 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.008719 14238 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:43.009137  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:43.009143 13762 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.010063 14104 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:43.010637 14221 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:43.006444  9964 pending_rounds.cc:107] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:27:43.006979 14201 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.011515  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:42.974951  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 126160us
I20260709 12:27:43.018363  9964 raft_consensus.cc:2889] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:43.014106 14227 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:43.023046  9813 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:27:43.025444 10527 raft_consensus.cc:1240] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:43.029961  9885 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
W20260709 12:27:43.043684  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 102894us
I20260709 12:27:43.039129  9811 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:43.057895  9889 raft_consensus.cc:1240] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:43.037739  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:43.083837  9806 raft_consensus.cc:1275] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:27:43.348888 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:43.241297  9807 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:27:43.348450 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:27:43.345973 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 269905us
W20260709 12:27:43.172791 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:43.325657  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.295300 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:43.070801  9808 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:27:43.080750 10527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 1079) took 1034 ms. Trace:
I20260709 12:27:43.393347  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:43.101889  9778 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:43.400529  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:43.199270  9884 raft_consensus.cc:3055] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:43.404755  9885 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:27:43.406224  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.401986  9884 raft_consensus.cc:740] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
W20260709 12:27:43.082219 14237 log.cc:927] Time spent T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.318s	user 0.000s	sys 0.004s
W20260709 12:27:43.259224 14242 log.cc:927] Time spent T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 12:27:43.359711  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:43.157452  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:43.415346  9814 raft_consensus.cc:1275] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:27:43.415438 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:43.317176 14239 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.260881 13974 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:43.415824 13844 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.427524 10525 raft_consensus.cc:2393] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 12: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:43.413245  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:43.416827  9963 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
W20260709 12:27:43.404407 14241 log.cc:927] Time spent T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.375s	user 0.001s	sys 0.000s
I20260709 12:27:43.417282  9886 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:43.423821  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:43.425638  9888 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:43.316306 14151 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:43.376896 14060 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.436614  9890 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:43.399788 10527 rpcz_store.cc:276] 0709 12:27:42.046348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:42.046474 (+   126us) service_pool.cc:224] Handling call
0709 12:27:42.163934 (+117460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:43.025904 (+861970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:43.071777 (+ 45873us) spinlock_profiling.cc:243] Waited 861 ms on lock 0x7b54002b52d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:43.080655 (+  8878us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1980180224}
I20260709 12:27:43.444753 13824 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:43.445365 13824 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.446491 14151 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:43.447954 13824 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:43.448596 14060 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:43.449594 13766 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:43.450243 13766 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:43.450416 14239 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.450999 14060 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:43.452378 13766 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:43.452900 14239 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:43.454082  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:43.454911  9956 raft_consensus.cc:2368] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 13. Current term is 14.
I20260709 12:27:43.456518  9779 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:43.458321 14230 consensus_queue.cc:1059] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:27:43.462347 14239 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:27:43.463560 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.416937 13762 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:43.043787 14221 consensus_queue.cc:1048] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.394s
I20260709 12:27:43.475237 10529 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:43.474077 14069 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.013s	sys 0.021s
I20260709 12:27:43.428637 14189 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:43.443377 14238 raft_consensus.cc:2764] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:27:43.437034 13942 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:43.090422 14174 consensus_queue.cc:1048] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.377s
I20260709 12:27:43.483599 13844 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:43.477458 14012 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.484941 14012 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.485813 13844 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:43.486650 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:43.487598 14012 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:43.487958 14248 log.cc:927] Time spent T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.369s	user 0.000s	sys 0.001s
W20260709 12:27:43.488178 14244 log.cc:927] Time spent T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 12:27:43.493225 14189 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.030754 10533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:60770
I20260709 12:27:43.473165 13974 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.495483 14189 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:43.496343 13974 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:43.497200 13942 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.499699 13942 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:43.500239 13942 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.500747 13942 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:43.501717  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:43.503134 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:43.503974 10525 raft_consensus.cc:2393] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 12: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:43.509600 14151 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:43.510931 13942 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:43.511420 14146 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:43.512008 10524 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:27:43.513010 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:43.511421  9812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 734) took 1068 ms. Trace:
W20260709 12:27:43.513705 13695 consensus_meta.cc:287] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.000s
I20260709 12:27:43.514863 10532 raft_consensus.cc:1240] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:27:43.513556  9812 rpcz_store.cc:276] 0709 12:27:42.443153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:42.445971 (+  2818us) service_pool.cc:224] Handling call
0709 12:27:42.446316 (+   345us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:42.683280 (+236964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:42.683346 (+    66us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:42.684808 (+  1462us) log.cc:844] Serialized 52 byte log entry
0709 12:27:42.762264 (+ 77456us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:42.847774 (+ 85510us) log.cc:844] Serialized 14 byte log entry
0709 12:27:42.854011 (+  6237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:42.856913 (+  2902us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:43.081350 (+224437us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:43.086388 (+  5038us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b180016daa0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f3f3 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:27:43.087357 (+   969us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b180016daa0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f522 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:27:43.511067 (+423710us) raft_consensus.cc:1685] finished
0709 12:27:43.511089 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:43.511227 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4140,"prepare.queue_time_us":78391,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":87873,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":251,"spinlock_wait_cycles":64022016,"thread_start_us":313128,"threads_started":2,"wal-append.queue_time_us":78792}
I20260709 12:27:43.515511  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:43.516276  9963 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:43.517009  9956 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:27:43.517179  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:43.517721  9963 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:43.520416  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:43.520737  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:43.521871  9956 raft_consensus.cc:1240] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:43.522818  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:43.520583  9962 raft_consensus.cc:1240] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12. Ops: []
W20260709 12:27:43.479789 14069 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.014s	sys 0.021s
I20260709 12:27:43.525275  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:43.529960  9964 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:43.540362 10529 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:43.544975  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:43.546967 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:43.530668 14238 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:43.549940 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:43.565841 10530 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
W20260709 12:27:43.566252  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 502817us
I20260709 12:27:43.572516 10525 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:43.544550  9884 consensus_queue.cc:260] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:43.577034 13844 consensus_queue.cc:1059] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:27:43.580017  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:43.580405 13844 raft_consensus.cc:3055] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:43.572458 13942 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.584762  9778 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:43.585219  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:43.584467  9884 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:43.556082 14201 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:43.567198 14227 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.580942 13844 raft_consensus.cc:740] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:43.593205  9964 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:27:43.587987  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:43.638451  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 53808.9us
W20260709 12:27:43.665154  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:43.666064  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.666477  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:43.668500  9778 leader_election.cc:400] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 13. Current term is 14.
I20260709 12:27:43.668843  9778 leader_election.cc:403] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:27:43.671564 14227 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.664897  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:43.628696 14060 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:43.686444  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 52422.5us
I20260709 12:27:43.692602  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:43.592089 14238 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:43.584728 13942 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.694990 13695 consensus_queue.cc:1059] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:27:43.695348 13844 consensus_queue.cc:260] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.696446 13695 raft_consensus.cc:3055] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:43.696632 13844 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:43.696938 13695 raft_consensus.cc:740] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:43.698524  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:43.688787 14222 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.014s	sys 0.022s
I20260709 12:27:43.701370  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:43.704588  9963 raft_consensus.cc:2393] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 12: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:43.706684  9881 raft_consensus.cc:2393] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:43.674256 14227 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:43.698470 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:43.708539  9886 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:43.708901  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:43.708078  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:43.705107 14222 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.015s	sys 0.023s
I20260709 12:27:43.733402  9928 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:43.737910  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:43.738850  9890 raft_consensus.cc:2393] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:43.732070 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:43.742026 13942 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:43.741869  9710 catalog_manager.cc:5697] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 5 to 12, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 12 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:43.742928 14251 log.cc:927] Time spent T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 12:27:43.744742 14250 log.cc:927] Time spent T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:27:43.744375  9710 catalog_manager.cc:5697] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:43.735797  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:43.748374  9883 raft_consensus.cc:2410] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:27:43.748663  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:43.697912 13695 consensus_queue.cc:260] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.753851  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:43.755957 10530 raft_consensus.cc:1275] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:43.762966  9812 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:27:43.751019 14060 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.746018  9710 catalog_manager.cc:5697] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 4 to 11, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 11 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:43.766101 14222 consensus_queue.cc:1048] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:43.768026 14238 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:43.768169 14222 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 13. Current term is 14.
I20260709 12:27:43.767518  9710 catalog_manager.cc:5697] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 7 to 9, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 9 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
W20260709 12:27:43.768688  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 78163us
I20260709 12:27:43.735901 14215 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.768875 13844 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:43.748354 14227 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:27:43.772818  9928 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:43.737546 14069 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:43.766142 14060 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:43.779040  9710 catalog_manager.cc:5697] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 7 to 10, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 10 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:43.785806 10533 raft_consensus.cc:606] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:43.786252 10533 raft_consensus.cc:614] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:27:43.786001  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 81660.7us
W20260709 12:27:43.815572  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:43.799090  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:43.787842 14170 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.008s	sys 0.010s
W20260709 12:27:43.841725  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.842433 13942 consensus_queue.cc:1059] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:27:43.843732  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:43.846927  9814 raft_consensus.cc:1240] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:43.848136 14221 raft_consensus.cc:3055] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:27:43.848524 14221 raft_consensus.cc:740] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:43.849526 14221 consensus_queue.cc:260] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.850747  9710 catalog_manager.cc:5697] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 7 to 11, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 11 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:43.852293 14033 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:43.853063 14033 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.852838  9710 catalog_manager.cc:5697] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 8 to 9, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 9 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:43.854471 14201 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:43.855078 14201 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.855234  9710 catalog_manager.cc:5697] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:27:43.856184 14033 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:43.856854 14033 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:43.856518  9710 catalog_manager.cc:5697] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:27:43.857173 14201 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:43.857720 14201 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:43.850777 14221 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:43.857496 14033 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.829790 14239 raft_consensus.cc:697] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:43.797608 14060 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:43.787061 14227 raft_consensus.cc:697] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:43.776942 14215 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:43.867771  9710 catalog_manager.cc:5697] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 6 to 10, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 10 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:43.840559 13695 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:43.859705 13942 raft_consensus.cc:3055] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:43.864916 14222 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.882833  9854 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:43.890959  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 52035.2us
I20260709 12:27:43.882028 14060 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:27:43.839653 14170 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.008s	sys 0.011s
I20260709 12:27:43.886040  9710 catalog_manager.cc:5697] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:27:43.901588  9854 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:43.895372 14060 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:43.886408 13942 raft_consensus.cc:740] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:43.909008 14239 consensus_queue.cc:237] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.909482 13942 consensus_queue.cc:260] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.911314 13942 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:43.931380  9808 raft_consensus.cc:1240] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:27:43.931811  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:43.932118  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:43.933074  9810 raft_consensus.cc:1240] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:27:43.933370  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:43.933754  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:43.934005 14257 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:43.934646  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:43.935904  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:43.936157  9809 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:27:43.936645  9808 raft_consensus.cc:2393] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 10: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:43.934053  9815 raft_consensus.cc:2393] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 12: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:43.937130  9955 raft_consensus.cc:1240] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:43.940132 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:43.934779 14215 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:43.958613 14259 consensus_queue.cc:1059] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:43.958598  9710 catalog_manager.cc:5697] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 7 to 10, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 10 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:43.962924 14259 raft_consensus.cc:3055] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:43.963762 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:43.786414 14069 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.964527 10527 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:43.905956 14174 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:43.968683  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 300360us
I20260709 12:27:43.970723 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:43.906613 14104 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:43.965978 10528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 803) took 1103 ms. Trace:
I20260709 12:27:43.858254 14201 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:43.952883 14170 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:43.963359 14259 raft_consensus.cc:740] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:43.980033  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:43.974299  9710 catalog_manager.cc:5697] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 3 to 6, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 6 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:43.981851  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 210563us
I20260709 12:27:43.981920  9854 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:43.895960 14222 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:43.987401  9778 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:43.988432  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.992542  9815 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:43.976696 10528 rpcz_store.cc:276] 0709 12:27:42.857073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:42.857210 (+   137us) service_pool.cc:224] Handling call
0709 12:27:43.239791 (+382581us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:43.240278 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:43.240312 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:43.240891 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 12:27:43.426707 (+185816us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:43.478918 (+ 52211us) log.cc:844] Serialized 14 byte log entry
0709 12:27:43.785702 (+306784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:43.787089 (+  1387us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:43.787139 (+    50us) raft_consensus.cc:1685] finished
0709 12:27:43.787157 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:43.960488 (+173331us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54006801d0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:43.960657 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2602,"prepare.queue_time_us":46842,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":47,"raft.queue_time_us":1517,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":43178,"spinlock_wait_cycles":877668736,"thread_start_us":487084,"threads_started":2,"wal-append.queue_time_us":323927}
I20260709 12:27:43.973562 14215 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:43.981169 13844 raft_consensus.cc:697] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:44.001194 14256 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:44.001663  9809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:27:44.001777 14256 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:44.002305  9809 raft_consensus.cc:606] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:27:43.988469 14174 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:44.002708  9809 raft_consensus.cc:614] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:44.003180 14259 consensus_queue.cc:260] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:44.004297 14174 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:44.004452 14259 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:44.005851 14201 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:44.006425 14263 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:44.006848 14263 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:44.007174 14263 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:43.991873 14227 consensus_queue.cc:237] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:44.002384 14256 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:44.001318 14033 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:44.011433  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 43964.3us
I20260709 12:27:44.001871 14260 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:44.015806  9811 consensus_meta.cc:287] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.001s
I20260709 12:27:43.991782 14104 raft_consensus.cc:697] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 10 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:44.021488  9811 raft_consensus.cc:1275] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:27:44.022200  9811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2732) took 1056 ms. Trace:
I20260709 12:27:44.022532  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:44.023295  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:44.026010  9815 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:27:44.027570  9778 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:44.029965 14222 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:44.031046 14222 consensus_queue.cc:1059] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:43.999079 14170 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:44.033676 14170 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:44.034412 14222 consensus_queue.cc:1243] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer b011791796d1457284b857d7d3422195 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:27:44.035005 14260 raft_consensus.cc:3055] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:44.035363 14260 raft_consensus.cc:740] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:44.036351 14260 consensus_queue.cc:260] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:44.037142 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:44.037364 14260 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:44.022526  9811 rpcz_store.cc:276] 0709 12:27:42.965317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:42.966874 (+  1557us) service_pool.cc:224] Handling call
0709 12:27:42.967286 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:44.021979 (+1054693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:44.022151 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:44.039855  9710 catalog_manager.cc:5697] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:44.010927 14215 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:44.059471 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:44.059741  9710 catalog_manager.cc:5697] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:44.061254 14265 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:44.061239  9710 catalog_manager.cc:5697] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:44.063141  9710 catalog_manager.cc:5697] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:44.064744  9710 catalog_manager.cc:5697] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:27:44.066711 13844 consensus_queue.cc:237] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:44.070681  9778 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:44.071516 14222 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:44.073227 14222 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:44.073961  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 86015.5us
I20260709 12:27:44.075281  9884 raft_consensus.cc:1275] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:27:44.079895  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 59374.8us
I20260709 12:27:44.078413  9710 catalog_manager.cc:5697] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 7 to 10, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 10 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:44.086309  9815 raft_consensus.cc:606] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:27:44.087796 14256 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:44.090826 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 90795.6us
I20260709 12:27:44.093472 10497 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:44.094434  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:44.095049  9811 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
I20260709 12:27:44.074018 14104 consensus_queue.cc:237] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:44.106999  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2482) took 1192 ms. Trace:
I20260709 12:27:44.107570  9884 rpcz_store.cc:276] 0709 12:27:42.906269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:42.906919 (+   650us) service_pool.cc:224] Handling call
0709 12:27:42.907383 (+   464us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:44.077683 (+1170300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:44.098137 (+ 20454us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b540043b7d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:44.098380 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":652097280}
I20260709 12:27:44.120868  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:44.117493  9710 catalog_manager.cc:5697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
W20260709 12:27:44.125360 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:44.128052  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:44.128444  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:44.128887  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:44.128722  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:44.106863 13695 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:44.130821  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:44.132378  9710 catalog_manager.cc:5697] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 4 to 9, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 9 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:44.140734  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 59888.6us
I20260709 12:27:44.143050  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:44.146256  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:44.133162 14267 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:44.166463  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:44.163149 10497 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:44.167817  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:44.139837 14256 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:44.138664 13695 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:44.173056  9962 raft_consensus.cc:2393] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 11: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:44.172165 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:44.174305  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:44.175283  9964 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:27:44.176550  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:44.178361  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:44.181941  9710 catalog_manager.cc:5697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:44.182592  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:44.183370  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:44.183921  9811 raft_consensus.cc:2410] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:27:44.125731 14239 consensus_queue.cc:1059] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:27:44.189605  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:44.170923 14267 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:44.211731  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:44.190366  9957 raft_consensus.cc:2393] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 12: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:44.190371  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:44.215497  9812 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:44.189836 14069 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:27:44.180325 13695 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:44.215411  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:44.215183  9710 catalog_manager.cc:5697] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:27:44.219340  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:44.204444 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 50028.8us
I20260709 12:27:44.222016  9812 raft_consensus.cc:2376] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12. Re-sending same reply.
I20260709 12:27:44.223104  9778 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:44.221444  9963 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:44.225440 14037 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 12:27:44.225724  9813 raft_consensus.cc:1275] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:27:44.225770  9698 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d1e4bd6e7a424475b1d707bfa268d54e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f5208640a51f493e930ce4f64ceeed0b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:44.226841  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:44.228001  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:44.228719  9813 raft_consensus.cc:2393] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:44.229456  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:44.229951  9813 raft_consensus.cc:2376] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12. Re-sending same reply.
I20260709 12:27:44.230410  9811 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:27:44.231071  9811 raft_consensus.cc:606] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 LEADER]: Received request to transfer leadership to TS b011791796d1457284b857d7d3422195
I20260709 12:27:44.232342  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:44.212801 13974 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:27:44.236472 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:44.236945  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:44.233348  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:44.234973 14275 log.cc:927] Time spent T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:27:44.187191 14199 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:44.253242  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:44.257069 10531 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:44.258355  9778 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:44.213982 14060 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:44.261660  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:44.162185 14268 consensus_queue.cc:1048] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:27:44.263621  9815 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
W20260709 12:27:44.260663  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 185885us
W20260709 12:27:44.236472 14272 log.cc:927] Time spent T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:27:44.278482  9811 raft_consensus.cc:2393] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 12: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:44.263337 14060 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:44.267818 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:44.277776  9809 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 15.
I20260709 12:27:44.264178 14265 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:44.256513 14227 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.284761  9806 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:27:44.286017  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:44.288040  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:44.267655 14222 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:44.303870  9809 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:44.253249 14239 consensus_queue.cc:1243] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer b011791796d1457284b857d7d3422195 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:27:44.313246  9885 raft_consensus.cc:1275] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:27:44.302850  9812 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
I20260709 12:27:44.322652  9854 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:44.325917  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:44.330184  9811 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:27:44.331213  9811 raft_consensus.cc:606] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:27:44.326597  9888 raft_consensus.cc:2376] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14. Re-sending same reply.
I20260709 12:27:44.331745  9811 raft_consensus.cc:614] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:44.331751  9883 raft_consensus.cc:1275] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:27:44.302974 14222 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:44.335803 10528 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:44.338550 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:44.336870  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:44.340179  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:44.340566 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:44.341913  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:44.343036  9890 raft_consensus.cc:2410] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:27:44.343673  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:44.308686 14215 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:44.284336 14263 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:44.333633 14266 log.cc:927] Time spent T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 12:27:44.344470  9884 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:44.350521  9888 raft_consensus.cc:2368] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 11. Current term is 12.
I20260709 12:27:44.351945  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:44.353451 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:44.354732  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:44.348815  9885 raft_consensus.cc:1275] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:27:44.348130  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:44.364312  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:44.366209  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:44.333948 14201 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:44.384538 10527 raft_consensus.cc:2393] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 14: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:44.351804 14037 consensus_queue.cc:1059] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:44.346256 14222 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:44.386013 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:44.339999 14199 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.392850  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:27:44.394477 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 58584.4us
I20260709 12:27:44.394722  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:44.395673 14274 log.cc:927] Time spent T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 12:27:44.396615  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:44.413566  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 146029us
I20260709 12:27:44.413930  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:44.398653  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:44.415014  9886 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:44.415897  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:44.400275 14270 log.cc:927] Time spent T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 12:27:44.416992  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:44.401754 14284 log.cc:927] Time spent T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:27:44.402437  9958 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:44.416121  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:44.418105 14258 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:44.420753 14230 consensus_queue.cc:1059] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:27:44.422550  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:44.423059 14230 consensus_queue.cc:1048] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:44.312951 14227 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:44.404186  9881 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:27:44.425580  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:44.426884 14258 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:44.428000 14227 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:44.429179 14227 consensus_queue.cc:1048] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:44.429448  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:44.430290  9886 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 4.
I20260709 12:27:44.431761  9779 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:44.432793 14227 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:44.435226 14227 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:44.439253  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:44.440264 14227 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:44.442163  9779 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:44.443171 14227 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:44.444726  9779 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:44.445647 14227 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:44.447316  9779 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:44.449544  9779 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:44.455005  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:44.462432 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 123949us
I20260709 12:27:44.464010 10496 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:44.407788 14201 raft_consensus.cc:697] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
W20260709 12:27:44.467900  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 302765us
I20260709 12:27:44.451987 13942 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:44.467150 14278 log.cc:927] Time spent T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 12:27:44.494959  9928 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:44.466317 14104 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.464447 14292 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:44.470562 14258 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:44.527019 14290 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:44.527900  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:44.527784 14290 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:44.529045  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:44.481138 14279 consensus_queue.cc:1048] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.240s
I20260709 12:27:44.488135 13942 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:44.453034 14199 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:44.530035 14290 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:44.558350  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 63519us
W20260709 12:27:44.566150  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:44.566390  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 117195us
I20260709 12:27:44.546692 14104 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:44.571794 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 107856us
I20260709 12:27:44.572016  9779 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:44.572607 10496 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
W20260709 12:27:44.557736 14260 consensus_meta.cc:287] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.520s	user 0.012s	sys 0.001s
I20260709 12:27:44.512203 14288 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:27:44.591616 14201 consensus_queue.cc:237] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:44.582799 14265 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:44.579746 14283 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:44.601934 10496 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:44.603423  9779 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:44.573427 14286 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 12:27:44.618543  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 141838us
W20260709 12:27:44.610459 14285 log.cc:927] Time spent T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 12:27:44.609055 14271 log.cc:927] Time spent T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.300s	user 0.001s	sys 0.001s
I20260709 12:27:44.611735 13942 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:44.610684 14263 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:44.613777 14267 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:44.659238 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 57391.1us
I20260709 12:27:44.604784 14300 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:44.615289 14265 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:44.615370 14199 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:44.593336 14215 consensus_queue.cc:1048] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:27:44.652094 14282 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:44.659003 14227 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:44.665691  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 94214.6us
W20260709 12:27:44.675704  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 81185.3us
I20260709 12:27:44.657164 14230 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:44.679946  9779 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:44.682865  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:44.664577 14303 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.684268 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:44.688561  9779 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:44.701623 14296 log.cc:927] Time spent T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:27:44.701936 14302 consensus_queue.cc:1048] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.111s
I20260709 12:27:44.704638 14260 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:44.687289 14267 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:44.740152 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 73958.7us
I20260709 12:27:44.741080 10496 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
W20260709 12:27:44.741147  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 52634.3us
I20260709 12:27:44.742129  9779 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:44.676978 14300 raft_consensus.cc:697] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:44.704463 14302 consensus_queue.cc:1048] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:27:44.704463 13695 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:44.746306  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 65324.2us
I20260709 12:27:44.668020 14286 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:27:44.756316  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:44.769820  9928 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:44.746538 14267 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:44.770359  9959 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:44.737043 14037 raft_consensus.cc:2804] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:27:44.782191 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:44.748101 14230 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:44.747623 14239 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:44.787233 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 121432us
I20260709 12:27:44.787755  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:44.791643  9958 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:44.829119 14307 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:44.831086 14307 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:44.828835 14315 consensus_queue.cc:1048] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
W20260709 12:27:44.831710 14305 log.cc:927] Time spent T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:27:44.831516 14300 consensus_queue.cc:237] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:44.831535 14307 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:44.833526 14267 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:44.822670 14215 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:27:44.834460 14301 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:44.737668 14303 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:44.835260 14298 log.cc:927] Time spent T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 12:27:44.836709 14303 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:44.834859 14301 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:44.838030 14301 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:44.838503 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 46844.7us
I20260709 12:27:44.770637 14260 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
W20260709 12:27:44.848196  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:44.826653 14299 log.cc:927] Time spent T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 12:27:44.854164  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 84429.6us
I20260709 12:27:44.856462  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:44.858757  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 115212us
I20260709 12:27:44.860096  9779 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:44.865473  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:44.866452  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:44.867388  9963 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:44.868568  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:44.869405  9963 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:44.869930 13942 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.870018 14239 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:44.870319 14313 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:44.872213 14307 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:44.873221  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:44.873857  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:44.874464  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:44.878916 10527 raft_consensus.cc:1275] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:27:44.879261  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:44.883416  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:44.842634 14282 raft_consensus.cc:697] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:44.904796  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:44.913614  9779 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:44.854547 14104 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:44.921659  9964 raft_consensus.cc:2393] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 12: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:27:44.923245 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 182199us
W20260709 12:27:44.924388  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:44.927295 10496 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:44.862812 14288 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:44.905673 14239 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:44.947965  9958 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
I20260709 12:27:44.945003  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:44.947125  9961 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:44.952942  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:44.936923 14288 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:44.948081  9853 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:44.953572  9955 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:44.919459 13942 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:44.956213 14311 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
W20260709 12:27:44.957581 14310 log.cc:927] Time spent T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:27:44.957895 13695 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:44.958907 14221 raft_consensus.cc:3055] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:44.959461 14307 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:44.956001 14288 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:44.975657  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:44.977856  9958 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:27:44.957607 14259 consensus_meta.cc:287] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.953s	user 0.006s	sys 0.007s
I20260709 12:27:44.978217  9886 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:27:44.971720 10524 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:44.944723 14145 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.924626 14313 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:44.943992 14320 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:44.979560  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:44.988894  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 45075.2us
I20260709 12:27:44.990890  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:44.979421  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:44.944324 14239 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:44.992425  9886 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:44.999490  9853 leader_election.cc:400] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 13. Current term is 14.
W20260709 12:27:44.999872  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:44.999943  9853 leader_election.cc:403] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:27:44.995062 14282 consensus_queue.cc:237] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:45.005682  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:45.006337  9888 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:45.007311  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:45.008697  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:45.009806  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:45.010473 14037 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:45.010936 14037 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:45.012012 14313 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:45.015151  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:45.015735  9887 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:27:44.985519 14288 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:45.016698  9961 raft_consensus.cc:1240] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:45.007812  9888 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:44.979425 14221 raft_consensus.cc:740] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:45.022367  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:44.981642 13942 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:45.023239 14290 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:27:45.025308  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 111794us
I20260709 12:27:44.994794 14058 raft_consensus.cc:2804] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:45.025004 14221 consensus_queue.cc:260] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:45.029717 14221 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:45.033756  9779 leader_election.cc:400] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 11. Current term is 12.
I20260709 12:27:45.036782  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:45.030680 14290 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.037843 14290 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:45.033862  9853 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:45.045511  9809 raft_consensus.cc:1275] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:27:45.051158  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:45.030872 14058 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.052201 14058 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:45.052279  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:45.065341  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:45.059957  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:45.026010 14311 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 13. Current term is 14.
I20260709 12:27:45.020226 14145 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:45.067075 14301 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:45.083279  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:45.084414  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:45.086302  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:45.068363 14263 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:45.088534  9815 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:27:45.088984 14279 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.089677  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:45.095902  9927 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:45.094762  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:45.099529  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 73563.3us
I20260709 12:27:45.100271  9927 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:45.101336  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:45.102192  9927 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:45.102216  9806 raft_consensus.cc:2410] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:27:45.103317  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:45.096462 14222 consensus_meta.cc:287] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.002s
I20260709 12:27:45.103258 14322 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:45.107332 14309 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:45.094172 14263 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.097338 14288 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:45.113453 14227 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:45.083886 14104 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:27:45.095471 14268 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:45.120180  9779 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:45.117674  9853 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:45.108148 14215 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:45.114624 14263 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:45.134927 14145 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:45.128489 14294 consensus_queue.cc:1048] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:27:45.140321 14239 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:45.143740 14239 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:45.145565 14058 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:45.147358 14301 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:45.111734 14222 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:45.148917 14291 raft_consensus.cc:3055] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:45.150936  9888 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:45.156176  9886 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:45.126157 14215 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.127787 13942 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:45.218108  9882 raft_consensus.cc:1240] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:45.215099  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:45.215682 14330 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:45.217568  9883 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:27:45.219558  9928 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:27:45.234496  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 120390us
I20260709 12:27:45.236174  9884 raft_consensus.cc:1240] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:27:45.238397  9960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1686) took 1063 ms. Trace:
W20260709 12:27:45.241487  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:45.243568 14294 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:45.244261 14294 raft_consensus.cc:697] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:45.246897  9853 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:45.247947 14104 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:45.249715 14104 consensus_queue.cc:1059] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:45.250898 14256 raft_consensus.cc:3055] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:45.251340 14256 raft_consensus.cc:740] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:45.252442 14256 consensus_queue.cc:260] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:45.254318  9853 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:45.238905  9960 rpcz_store.cc:276] 0709 12:27:44.174632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:44.174756 (+   124us) service_pool.cc:224] Handling call
0709 12:27:44.190578 (+ 15822us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:44.968519 (+777941us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b1800170ec0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8e0c44bc 00007f2f8b41248b 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42c455 00007f2f8e514060 00007f2f8e514bfb 00007f2f8e51f64b
0709 12:27:44.968666 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:44.968690 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:44.969160 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 12:27:45.041664 (+ 72504us) spinlock_profiling.cc:243] Waited 5.93 ms on lock 0x7b4800272358. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f93445aa1 00007f2f9343cb37 00007f2f9343c9ca 00007f2f9353426f 00007f2f93533f37 00007f2f9354855c 00007f2f93548508 00007f2f93548488 00007f2f93548443 00007f2f935476ec 00007f2f92471a96
0709 12:27:45.114351 (+ 72687us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:45.114412 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:45.114498 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:45.238077 (+123579us) raft_consensus.cc:1685] finished
0709 12:27:45.238102 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:45.238300 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13965,"raft.queue_time_us":83615,"raft.run_cpu_time_us":4694,"raft.run_wall_time_us":736774,"spinlock_wait_cycles":24493184,"thread_start_us":190851,"threads_started":2,"wal-append.queue_time_us":247250}
I20260709 12:27:45.245332 14294 consensus_queue.cc:237] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:45.259613 14145 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:45.262526  9853 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:45.265823 14145 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:45.108494 14279 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:45.272552  9779 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:45.273576  9810 raft_consensus.cc:1240] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:27:45.123652 14268 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:45.279390 13942 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:45.214337 14291 raft_consensus.cc:740] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:45.217741 14215 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:45.283704  9814 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:27:45.222509 14311 raft_consensus.cc:2764] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:27:45.282527  9815 raft_consensus.cc:1275] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:27:45.220886 14330 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:45.285833  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 49694.4us
I20260709 12:27:45.290859  9779 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:45.291918  9779 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:45.291545  9853 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:45.300057  9779 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:45.286296 14239 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:45.291832 14330 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:45.294843 14260 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:45.315068 14268 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:45.315553 14258 consensus_meta.cc:287] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.777s	user 0.012s	sys 0.000s
I20260709 12:27:45.318356  9928 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:45.323155 14268 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:45.323855  9928 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:45.324661 14294 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:45.325165  9928 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:45.325374  9853 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:45.326071 14268 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:45.328051  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:45.296809 14320 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:45.278365 14037 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:45.341929  9779 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:45.321975 14260 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:45.341106 14258 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:45.349994 14260 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:45.352819 14260 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:45.343138 14320 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.359706  9779 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:45.361004 14279 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:45.364151 14349 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:45.369261  9853 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:45.347507 14239 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:45.375835  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:45.376163  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:45.376576  9813 raft_consensus.cc:2393] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 12: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:45.376641  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:45.368034 14320 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:45.370440 14349 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:45.373494 14221 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:45.387547 14326 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.358045 14291 consensus_queue.cc:260] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:45.388309 14326 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:45.389439 14291 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:45.377301 14258 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:45.391292  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:45.392304  9853 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:45.386303 14222 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:45.386785 14349 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:45.409736  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 751) took 1232 ms. Trace:
W20260709 12:27:45.426306  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:45.398244 14258 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:45.457676 14344 log.cc:927] Time spent T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:27:45.412250 14170 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:27:45.491441  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 87842.5us
I20260709 12:27:45.496893 14221 consensus_queue.cc:1059] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:27:45.497673  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:45.500954 14360 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:45.501416  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:45.382649 14230 consensus_queue.cc:1059] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:27:45.506996  9808 rpcz_store.cc:276] 0709 12:27:44.177612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:44.178161 (+   549us) service_pool.cc:224] Handling call
0709 12:27:44.219437 (+ 41276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:44.219699 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:44.219732 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:44.219790 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:44.219835 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:44.219909 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:45.409533 (+1189624us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b54004510d0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:45.409666 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74300800}
I20260709 12:27:45.402626 14351 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:27:45.524803 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 597566us
I20260709 12:27:45.521323  9890 raft_consensus.cc:1275] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:27:45.528898  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:45.525931 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:45.515782 14311 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:27:45.531430  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:45.517623 14330 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:45.537438  9854 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:45.546622  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:45.548394  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 162538us
I20260709 12:27:45.548204  9962 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
I20260709 12:27:45.533720 14311 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.533800 14292 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:45.554659  9961 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 13. Current term is 14. Ops: []
I20260709 12:27:45.556311  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:45.537616 14221 raft_consensus.cc:3055] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:45.540663 14058 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:45.538385 13695 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.524286 14170 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:45.564369 10497 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:45.542042 14326 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:45.570850  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:45.559294 14311 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:45.560105 14292 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:45.560410 14221 raft_consensus.cc:740] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:45.562353 14354 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:27:45.583483 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 57618.3us
I20260709 12:27:45.588477 14323 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:45.588956 14323 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:45.589329 14323 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:45.591879  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:45.592693 13942 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:45.593169 13942 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:45.595937  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 763) took 1307 ms. Trace:
I20260709 12:27:45.596365  9810 rpcz_store.cc:276] 0709 12:27:44.288038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:44.288197 (+   159us) service_pool.cc:224] Handling call
0709 12:27:44.307085 (+ 18888us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:45.274124 (+967039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:45.595641 (+321517us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b54002d7b54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:45.595874 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2216800000}
I20260709 12:27:45.598035 14352 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:45.598450 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:27:45.598737 14341 log.cc:927] Time spent T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.130s	user 0.004s	sys 0.000s
I20260709 12:27:45.599088 10525 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:45.600287 14293 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.600723 14347 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:45.601215 14347 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:45.600828 14293 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:45.601622 14347 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:45.602839 10528 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:45.605556 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:27:45.605871  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:45.614778 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 52686.5us
W20260709 12:27:45.616484 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:45.621351 10525 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:27:45.623557 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:45.530053 14360 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:45.629871 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:45.630539 10526 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
I20260709 12:27:45.631219 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:45.624956  9853 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:45.633949  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:45.634833 10533 raft_consensus.cc:1240] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12. Ops: []
W20260709 12:27:45.640153  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 53559.4us
I20260709 12:27:45.640769 10525 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:27:45.642153  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:45.642802  9961 raft_consensus.cc:2393] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 14: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:45.642865  9886 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
I20260709 12:27:45.643500 10525 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:27:45.643482 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:45.584789 14292 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:45.538913 14351 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:45.617355 10496 connection.cc:256] RPC call timeout handler was delayed by -1.271385243000168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
I20260709 12:27:45.647621  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:45.574568 13695 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:45.650938  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 73641.5us
I20260709 12:27:45.648902 10530 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:27:45.625579 14283 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:45.621984 14354 raft_consensus.cc:697] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:45.584583 14326 consensus_queue.cc:1048] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:27:45.626593 14037 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:45.675212  9778 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:45.663697 14256 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:45.663869 14273 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:45.664976 14330 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:45.666028 14345 log.cc:927] Time spent T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.147s	user 0.001s	sys 0.001s
I20260709 12:27:45.666566  9928 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:45.666798 14293 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:45.674721 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:45.672577  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:45.662308 14351 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:45.679378 14259 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:45.675669 14263 consensus_meta.cc:287] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.525s	user 0.013s	sys 0.000s
I20260709 12:27:45.698398 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:45.647233 14352 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:45.678093  9779 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:45.657207 14230 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:45.692147 10496 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:45.695734 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:45.696382  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:45.697595  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:45.680749 14290 consensus_meta.cc:287] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.642s	user 0.007s	sys 0.006s
I20260709 12:27:45.699056 10530 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:27:45.691916  9853 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:45.698951  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:45.692864 14283 raft_consensus.cc:697] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:45.720301  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:45.723775  9962 raft_consensus.cc:1240] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11. Ops: []
W20260709 12:27:45.725000  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 46983.6us
I20260709 12:27:45.694170 14227 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:45.730159 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:45.695209 14258 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:45.732990  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:45.719712 14170 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:45.731765  9962 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:27:45.735441 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:45.675343 14260 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:45.716114 14230 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:45.657271 14221 consensus_queue.cc:260] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:45.808339  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 75878.9us
I20260709 12:27:45.810007 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:45.719631 14366 consensus_queue.cc:1059] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:27:45.735811 13766 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:27:45.730545 14330 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:45.715623 14263 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:45.730939 14227 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.730336 14201 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 12:27:45.732317 14301 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:45.715493 14259 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:45.722033 14365 consensus_queue.cc:1059] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.096s
I20260709 12:27:45.741168 14145 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:45.730022 14290 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:45.812394 14230 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:27:45.843580  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 177091us
I20260709 12:27:45.842553  9853 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:45.739394 14215 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:45.807350 14258 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:27:45.840215 14227 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:45.842355 14221 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:45.836624 13766 raft_consensus.cc:697] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:45.852401 10496 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:45.848639  9885 raft_consensus.cc:1240] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:27:45.892097  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:45.892586  9809 raft_consensus.cc:1240] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:45.893388 14067 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:27:45.894371 14260 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:45.895915 14263 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:45.897217  9960 raft_consensus.cc:1240] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:27:45.841784 14301 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:45.848076  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:45.904824 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 52535.6us
I20260709 12:27:45.906198  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:45.907202 14290 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:45.908232 13695 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:45.910976 14215 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:45.910509 14363 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.822101 14352 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:27:45.919073 10496 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:45.908830 14319 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:45.923597  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 81114us
W20260709 12:27:45.924911  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 76908.4us
I20260709 12:27:45.952620  9928 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:45.902925 14296 log.cc:927] Time spent T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:27:45.883879 14365 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.987783  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:45.663857 14311 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:45.699846 14273 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:45.698016 14349 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:45.970009  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:45.741493 14320 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:45.986377  9853 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:45.906378 14353 consensus_queue.cc:1059] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.176s
W20260709 12:27:45.926476  9881 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54428 (request call id 1025) took 1804 ms (client timeout 1535 ms). Trace:
I20260709 12:27:45.718858 14354 consensus_queue.cc:237] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:46.027971  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 70735.3us
I20260709 12:27:45.922652 14301 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:46.041684  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:45.926362 14302 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:45.927340 14145 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:45.896757 14283 consensus_queue.cc:237] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:45.851621 14313 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 12:27:45.929245 14067 raft_consensus.cc:697] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:27:46.275287 14347 consensus_meta.cc:287] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.673s	user 0.005s	sys 0.006s
I20260709 12:27:45.959666 14363 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:46.190085 14303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.038s	sys 0.035s
W20260709 12:27:46.151060  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:46.166702 14259 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:46.169358 14323 consensus_meta.cc:287] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.000s
I20260709 12:27:46.170171 14326 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:45.990890 14357 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:46.029551 14069 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.168444  9815 raft_consensus.cc:2393] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 14: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:45.991256 14170 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.191s
I20260709 12:27:46.182509  9887 raft_consensus.cc:1240] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 11. Current term is 12. Ops: []
W20260709 12:27:46.171516 14292 consensus_meta.cc:287] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.000s
I20260709 12:27:46.073329 14260 raft_consensus.cc:3055] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:27:46.180289 13942 consensus_meta.cc:287] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.587s	user 0.009s	sys 0.001s
I20260709 12:27:46.154557 14058 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:46.169168 13766 consensus_queue.cc:237] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:45.986512 14290 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:45.991111 13695 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:27:46.083752  9881 rpcz_store.cc:269] 0709 12:27:44.109150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:44.109286 (+   136us) service_pool.cc:224] Handling call
0709 12:27:45.913555 (+1804269us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b540030d254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:45.913679 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":633543040}
W20260709 12:27:46.270871  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 423774us
I20260709 12:27:46.026933 14365 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:46.272468  9928 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:46.225252 14215 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.226889 14366 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:46.281524  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 329268us
I20260709 12:27:46.502641  9853 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:46.406267 14377 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:46.417094  9883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1597) took 1526 ms. Trace:
W20260709 12:27:46.378364 14303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.048s	sys 0.044s
I20260709 12:27:46.237772 14319 consensus_queue.cc:1059] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 12:27:46.291667 14375 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:46.504721  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:46.452895 14260 raft_consensus.cc:740] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:46.355002 14347 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:46.355187 10497 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.535s (SENT) [suppressed 25 similar messages]
I20260709 12:27:46.509855  9883 rpcz_store.cc:276] 0709 12:27:44.890713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.030353 (+139640us) service_pool.cc:224] Handling call
0709 12:27:45.217334 (+186981us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:45.227448 (+ 10114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:46.416883 (+1189435us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b540029a4d0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:46.417031 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429265792}
W20260709 12:27:46.532671  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:46.460475 14239 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.003s	sys 0.008s
I20260709 12:27:46.475207 14058 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:46.511987  9853 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:46.550052 10528 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.000s	sys 0.015s
I20260709 12:27:46.432173 14326 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:46.552147 10528 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.000s	sys 0.016s
I20260709 12:27:46.570480  9890 raft_consensus.cc:1240] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:46.514578 14352 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:46.510717 14215 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:46.419399 14323 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:46.453220 14069 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:46.475220 13942 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:46.546671 14239 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.003s	sys 0.008s
I20260709 12:27:46.531113 14201 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:46.471346 14292 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:46.544469 14058 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:46.453449 14357 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:46.583760  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 311327us
I20260709 12:27:46.590099 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:27:46.582765 14370 log.cc:927] Time spent T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.481s	user 0.000s	sys 0.001s
I20260709 12:27:46.579859 14353 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:46.592918  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 100987us
I20260709 12:27:46.512573 14366 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:46.578169 14311 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:46.598851  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 86948.8us
I20260709 12:27:46.594422 10529 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 15. Current term is 16. Ops: []
W20260709 12:27:46.595448 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 495497us
I20260709 12:27:46.601908  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:46.602998  9853 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:46.603715 14145 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:46.604163 14352 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:46.604585 14352 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:46.604991 14352 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:46.607877 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:46.608556 14358 log.cc:927] Time spent T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 1.045s	user 0.008s	sys 0.010s
I20260709 12:27:46.609376 14259 consensus_queue.cc:1059] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:46.583060 14201 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:46.585616 14349 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:46.610853 10530 raft_consensus.cc:1240] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:46.610982  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:46.604394 14145 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:46.572952 14290 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
W20260709 12:27:46.613368 14374 log.cc:927] Time spent T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.478s	user 0.000s	sys 0.001s
I20260709 12:27:46.614477 14366 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:46.586233 14273 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:46.593003 14227 consensus_meta.cc:287] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.688s	user 0.005s	sys 0.006s
I20260709 12:27:46.593393 14303 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:46.611711  9853 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:46.610658 10496 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:46.619834 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 264669us
I20260709 12:27:46.580289 14174 consensus_queue.cc:1048] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:27:46.633055 10530 raft_consensus.cc:1240] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:46.544351 14375 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:46.637713 14376 raft_consensus.cc:3055] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:46.638164 14376 raft_consensus.cc:740] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:46.638535 14375 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:46.598966 14256 consensus_meta.cc:287] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.904s	user 0.011s	sys 0.002s
I20260709 12:27:46.625099 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:46.640348  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:46.641798  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:46.625432 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:46.518512 14377 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:46.625432  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:46.534528 14067 consensus_queue.cc:237] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:46.643496  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:46.643949 14377 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:46.620533 14201 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:46.648819 14265 raft_consensus.cc:3055] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:46.649264 14265 raft_consensus.cc:740] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:46.650202 14265 consensus_queue.cc:260] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:46.651110  9885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1603) took 1723 ms. Trace:
I20260709 12:27:46.651644  9885 rpcz_store.cc:276] 0709 12:27:44.927315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.355004 (+427689us) service_pool.cc:224] Handling call
0709 12:27:45.355409 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:45.911408 (+555999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:46.650797 (+739389us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b54001e4454. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:46.651028 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1131686144}
I20260709 12:27:46.654680 13942 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:46.655138  9960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1695) took 1107 ms. Trace:
I20260709 12:27:46.655670 13942 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:46.655611  9960 rpcz_store.cc:276] 0709 12:27:45.547742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.547867 (+   125us) service_pool.cc:224] Handling call
0709 12:27:45.559529 (+ 11662us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:45.922627 (+363098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:46.654845 (+732218us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b5400115b54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:46.655055 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776151296}
W20260709 12:27:46.658324  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 46588.5us
W20260709 12:27:46.661494 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 50923.8us
I20260709 12:27:46.666884  9813 raft_consensus.cc:1240] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:27:46.668738  9888 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:46.658910  9890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 1043) took 1031 ms. Trace:
I20260709 12:27:46.670130  9890 rpcz_store.cc:276] 0709 12:27:45.627883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.639417 (+ 11534us) service_pool.cc:224] Handling call
0709 12:27:45.639768 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:46.571080 (+931312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:46.658616 (+ 87536us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b54002c5bd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:46.658808 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2139802496}
I20260709 12:27:46.687005  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2321) took 1290 ms. Trace:
I20260709 12:27:46.623200 14258 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:46.687481  9815 rpcz_store.cc:276] 0709 12:27:45.376192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.376334 (+   142us) service_pool.cc:224] Handling call
0709 12:27:46.666325 (+1289991us) spinlock_profiling.cc:243] Waited 791 ms on lock 0x7b54002d8554. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:46.666515 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1818498944}
I20260709 12:27:46.690888 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:46.688364  9853 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:46.692368  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:46.692899 10496 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:46.696064  9889 raft_consensus.cc:2393] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:46.661473 14303 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:46.735409 14363 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:46.661221 14227 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:46.736779 14303 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:46.708590 14258 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:46.757143 14383 log.cc:927] Time spent T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:27:46.761083  9887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 1044) took 1132 ms. Trace:
W20260709 12:27:46.807890  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 211990us
W20260709 12:27:46.903422  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:46.687232 14273 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:46.905310  9888 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:27:46.930140  9887 rpcz_store.cc:276] 0709 12:27:45.628216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.628383 (+   167us) service_pool.cc:224] Handling call
0709 12:27:45.628737 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:46.453027 (+824290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:46.760825 (+307798us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b5400216e54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:46.761024 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1185895296}
I20260709 12:27:46.696556 14377 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:46.906735  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 218438us
I20260709 12:27:46.598853 14260 consensus_queue.cc:260] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:46.946439 14365 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:46.946988 14365 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:46.947475 14365 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:46.948268 14201 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:46.949506 14365 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:46.950390  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:46.950778 14323 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:27:46.950981  9809 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
W20260709 12:27:46.952240 14388 log.cc:927] Time spent T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.239s	user 0.001s	sys 0.008s
I20260709 12:27:46.952386 14349 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:27:46.952754 14227 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:46.953039 14349 consensus_queue.cc:1243] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Peer 4104e34a61b7448281d6d91ce23ebf71 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:27:46.917982 14239 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:46.953856 14239 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:46.696369 14375 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:46.913902  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 286993us
I20260709 12:27:46.955428  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:46.919056  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:46.922334  9960 raft_consensus.cc:1240] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:46.923108  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 768) took 1232 ms. Trace:
I20260709 12:27:46.925863  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:46.916599 14396 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:46.931759  9961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1696) took 1239 ms. Trace:
I20260709 12:27:46.912880 14199 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:46.916425 14222 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.940022 14292 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:46.940316 14369 log.cc:927] Time spent T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.841s	user 0.009s	sys 0.012s
W20260709 12:27:46.941148 14372 log.cc:927] Time spent T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.774s	user 0.009s	sys 0.033s
W20260709 12:27:46.941825 14230 consensus_meta.cc:287] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 1.044s	user 0.007s	sys 0.011s
I20260709 12:27:46.970747 14263 raft_consensus.cc:3055] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:46.971379 14263 raft_consensus.cc:740] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:46.972186 14263 consensus_queue.cc:260] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:46.973408 14263 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:46.916734 14366 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.954121 14069 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:46.933370 14267 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:46.961902  9806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2756) took 1071 ms. Trace:
I20260709 12:27:46.915411 14386 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:46.964214  9927 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:46.960409  9964 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:46.986841  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:46.927870  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:46.954174 14349 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.959620  9808 rpcz_store.cc:276] 0709 12:27:45.690369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.695244 (+  4875us) service_pool.cc:224] Handling call
0709 12:27:45.718999 (+ 23755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:45.719213 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:27:45.719243 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:45.719719 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 12:27:45.872015 (+152296us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:45.872066 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:45.872155 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:46.922891 (+1050736us) raft_consensus.cc:1685] finished
0709 12:27:46.922911 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:46.923043 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":151914,"threads_started":1,"wal-append.queue_time_us":177135}
I20260709 12:27:46.967197 14201 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:46.963690 14375 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:46.968158 14222 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:46.970821 14311 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.941660  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:46.962555 14396 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:46.982086  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:47.043892  9890 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:47.045293  9890 raft_consensus.cc:1240] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:27:46.982684  9889 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:27:47.046334  9889 pending_rounds.cc:85] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 10
I20260709 12:27:47.046636  9889 pending_rounds.cc:107] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:27:47.046911  9889 raft_consensus.cc:2889] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:46.982939 10531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 817) took 1386 ms. Trace:
I20260709 12:27:47.047658 10531 rpcz_store.cc:276] 0709 12:27:45.596896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.603783 (+  6887us) service_pool.cc:224] Handling call
0709 12:27:45.604093 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:45.604460 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:45.604487 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:45.604908 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 12:27:45.835784 (+230876us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:45.835825 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:45.835896 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:46.761746 (+925850us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:46.974344 (+212598us) raft_consensus.cc:1685] finished
0709 12:27:46.974366 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:46.982862 (+  8496us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10237,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":4168,"spinlock_wait_cycles":58290944,"thread_start_us":230515,"threads_started":1,"wal-append.queue_time_us":344677}
I20260709 12:27:46.983369  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:46.988579  9812 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:47.050081  9956 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:46.984266  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:46.962625  9961 rpcz_store.cc:276] 0709 12:27:45.692465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.692713 (+   248us) service_pool.cc:224] Handling call
0709 12:27:45.716212 (+ 23499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:45.716509 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:45.732729 (+ 16220us) log.cc:844] Serialized 14 byte log entry
0709 12:27:45.733038 (+   309us) log.cc:844] Serialized 14 byte log entry
0709 12:27:46.748115 (+1015077us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b180043e8e0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f522 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:27:46.916122 (+168007us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b180043e8e0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b3a9c0a 00007f2f94ae9219 00007f2f8b431a40 00007f2f8b42c4e4 00007f2f8b42c455 00007f2f91f143c7 00007f2f8e5269a7 00007f2f8e5360bf 00007f2f8e536038
0709 12:27:46.916307 (+   185us) log.cc:844] Serialized 14 byte log entry
0709 12:27:46.930051 (+ 13744us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:46.931369 (+  1318us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:46.931434 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:46.931525 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:46.931685 (+   160us) inbound_call.cc:177] Queueing success response
0709 12:27:46.948924 (+ 17239us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b180043e8e0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f3f3 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
Metrics: {"mutex_wait_us":1190270,"prepare.queue_time_us":2487439,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":109,"raft.queue_time_us":29924,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":72995,"spinlock_wait_cycles":79794944}
I20260709 12:27:46.984906  9806 rpcz_store.cc:276] 0709 12:27:45.890958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.891105 (+   147us) service_pool.cc:224] Handling call
0709 12:27:45.904947 (+ 13842us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:45.914545 (+  9598us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:45.914585 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:45.949861 (+ 35276us) log.cc:844] Serialized 26 byte log entry
0709 12:27:46.414470 (+464609us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:46.487724 (+ 73254us) log.cc:844] Serialized 14 byte log entry
0709 12:27:46.488012 (+   288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:46.488112 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:46.756413 (+268301us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:46.959474 (+203061us) raft_consensus.cc:1685] finished
0709 12:27:46.961701 (+  2227us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:46.961847 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9255,"prepare.queue_time_us":73134,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":264821,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":10648,"spinlock_wait_cycles":9591680,"thread_start_us":338959,"threads_started":1,"wal-append.queue_time_us":600814}
I20260709 12:27:46.969799 14230 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:46.961297 14347 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.042611  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:47.042743  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 78601.5us
I20260709 12:27:46.976433 14227 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.981365  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:47.062018  9814 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
W20260709 12:27:47.053385  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 97937.8us
I20260709 12:27:47.064173  9928 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:46.978297 14104 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:47.065197  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:47.068531  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:46.959836 14377 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:46.937616 14352 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.076419  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:47.039922 14326 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.040079 14215 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.091413  9811 raft_consensus.cc:1240] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15. Ops: []
W20260709 12:27:47.092955  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:47.093544 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:47.093832 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:47.094797  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:47.095795  9806 raft_consensus.cc:2410] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:27:47.096714  9889 raft_consensus.cc:1240] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:47.057965 14396 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:47.104144 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:47.107980  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:47.108103  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:47.108680 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:47.109752 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:47.111059 14258 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:47.115134 14239 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:47.062564 14037 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:47.115494 14222 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:47.116799  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:47.075886 14104 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.117704  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:47.038614 14267 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:47.119004  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:47.119411 14230 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.120018  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:47.053115 14311 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:47.121428 14267 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:47.121806 14311 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:47.123395 14375 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:47.123392 14221 consensus_meta.cc:287] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 1.221s	user 0.013s	sys 0.005s
W20260709 12:27:47.124631 14380 log.cc:927] Time spent T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.557s	user 0.003s	sys 0.000s
I20260709 12:27:47.125255 14060 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:47.125768 14060 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.126091 14286 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:47.126597 14286 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.127753 14060 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.128248 14060 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:47.128520 14286 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.128832 14290 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:47.129364 14290 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:47.123528 14058 consensus_meta.cc:287] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.525s	user 0.007s	sys 0.006s
W20260709 12:27:47.131973  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 55687.8us
I20260709 12:27:47.135164 10531 raft_consensus.cc:2393] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 12: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:46.987047 14366 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:47.147377  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:47.175320  9888 raft_consensus.cc:1240] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:47.174074  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:47.121727 14303 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.074990 14363 consensus_queue.cc:1059] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:27:47.052804 14349 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.068825 14227 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:47.329439  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:47.182155 14268 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:27:47.335775  9884 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.009s	sys 0.029s
I20260709 12:27:47.317078  9956 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:27:47.255560  9778 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:47.317848 10497 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:47.343672  9889 raft_consensus.cc:2410] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 12:27:47.230207  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:47.175640  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:47.225565  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:47.347214  9890 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:47.335785  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:47.336220  9884 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.009s	sys 0.030s
I20260709 12:27:47.352169  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:47.352888  9808 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:47.098865 14365 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:47.356892  9779 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:47.254992 14393 log.cc:927] Time spent T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.642s	user 0.000s	sys 0.001s
I20260709 12:27:47.131827 14279 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:27:47.359346  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 103864us
I20260709 12:27:47.359787  9810 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:27:47.254364 14368 log.cc:927] Time spent T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.806s	user 0.004s	sys 0.016s
W20260709 12:27:47.361548  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:47.362699  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:47.360142  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:47.320463 14330 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:27:47.362697  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:47.364513  9881 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:47.258755 14293 raft_consensus.cc:3055] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:47.317304 14033 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:47.384853  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:47.385282  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:47.365423  9890 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:47.386371  9958 raft_consensus.cc:1240] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:27:47.386757  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:47.380492  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:47.388554  9883 raft_consensus.cc:2393] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
W20260709 12:27:47.357239 14301 consensus_meta.cc:287] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 1.076s	user 0.014s	sys 0.003s
I20260709 12:27:47.389233  9964 raft_consensus.cc:2393] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:47.174753 14311 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:47.290735 14357 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.335330 14268 raft_consensus.cc:697] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:47.256071 14290 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.361078 14365 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.404966 14365 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.368527  9778 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:47.260354 14360 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.384214  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:47.382968 14293 raft_consensus.cc:740] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:47.390064  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:47.394671  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:47.423679  9883 raft_consensus.cc:2393] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 15: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
W20260709 12:27:47.424495  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 56071.2us
I20260709 12:27:47.424662 14326 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:47.397070  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:47.364485 14222 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:47.425581 14222 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.425968 14222 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:47.426175  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:47.427263  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:47.427891  9882 raft_consensus.cc:2393] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 12: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:47.428606  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:47.429538  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:47.399710  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:47.364089 14239 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:27:47.287083 14067 consensus_queue.cc:1059] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 12:27:47.407002 10526 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:47.424513  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:47.407649 14283 raft_consensus.cc:3055] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:47.431756 14283 raft_consensus.cc:740] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:47.432376 14326 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:27:47.430047  9882 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:47.432920 14283 consensus_queue.cc:260] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.181239 14058 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:47.355824 14221 consensus_queue.cc:1059] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:27:47.286859 14386 consensus_queue.cc:1059] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.107s
I20260709 12:27:47.431945  9883 raft_consensus.cc:2410] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:27:47.151528 14060 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.410532  9853 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:47.360960 14230 consensus_queue.cc:1059] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:27:47.361786 14375 consensus_queue.cc:1059] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:27:47.434315 14283 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:47.448794 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 131044us
I20260709 12:27:47.444885  9778 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:47.442255  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:47.450342  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:47.458756  9958 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:47.420920 14365 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:47.423053 14258 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:47.455744  9886 raft_consensus.cc:1240] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:47.420970 14069 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:47.395633 14033 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.363796 14399 consensus_queue.cc:1059] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:27:47.526386 10532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 822) took 1112 ms. Trace:
I20260709 12:27:47.396684 14301 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.401758 14311 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.529379  9957 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:47.521447 10497 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:47.522935  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:47.451371 14307 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.521028  9890 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:27:47.522151  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:47.389079 14330 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.532035  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:47.565886  9890 raft_consensus.cc:1240] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:27:47.565922  9959 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:47.540534 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 78793.5us
I20260709 12:27:47.568403  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:47.569173  9956 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:27:47.456872 14360 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:47.461277 14069 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.526849 10532 rpcz_store.cc:276] 0709 12:27:46.413695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.413846 (+   151us) service_pool.cc:224] Handling call
0709 12:27:46.471261 (+ 57415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:46.471638 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:46.471662 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:46.497057 (+ 25395us) log.cc:844] Serialized 26 byte log entry
0709 12:27:46.593997 (+ 96940us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:46.594125 (+   128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:46.594387 (+   262us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:47.254414 (+660027us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:47.456626 (+202212us) raft_consensus.cc:1685] finished
0709 12:27:47.456648 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:47.526257 (+ 69609us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2130,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":11779,"spinlock_wait_cycles":13447424,"thread_start_us":78003,"threads_started":1,"wal-append.queue_time_us":99542}
I20260709 12:27:47.578015  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:47.456334 14037 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:47.567286  9964 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:27:47.462047 14326 raft_consensus.cc:3055] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:47.518389 14221 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:47.582840  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:47.530728 14290 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.534834 14230 raft_consensus.cc:2749] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:47.589146  9956 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:47.589490  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:47.592741 10525 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 13. Current term is 14. Ops: []
I20260709 12:27:47.592803 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:47.570921 14258 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:47.598106  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:47.566756 14386 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:47.579839 14069 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:47.595688  9812 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:47.604225 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:47.605063  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:47.605376 10525 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:27:47.611863  9815 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:47.606632 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:47.612517 10531 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:47.609933 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:47.601239 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:47.585029 14104 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.530857 14365 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:47.619815 14405 log.cc:927] Time spent T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:27:47.619709 14394 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:27:47.621112 14403 log.cc:927] Time spent T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:27:47.622620 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:47.623169 14408 log.cc:927] Time spent T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 12:27:47.623474  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:47.593776 14352 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.588344 14326 raft_consensus.cc:740] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:47.628739  9958 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:47.630764  9956 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:47.639763 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:47.567234 14293 consensus_queue.cc:260] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.575416 14307 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.590147 14037 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.669147  9960 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
I20260709 12:27:47.642571 14386 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:47.601861 14290 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:47.673929 10531 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:47.602919 14366 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:47.639551 14258 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.641559 14303 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.678979  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:47.673264 14349 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.682191 14058 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:47.596319 14221 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:47.686385  9815 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:47.687901  9810 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:27:47.698993  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:47.707047  9958 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:47.708379  9958 raft_consensus.cc:1240] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:47.690606 14399 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:47.702643  9963 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:47.586127 14268 consensus_queue.cc:237] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:47.721503  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:47.723670  9815 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:47.664803 14394 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:47.770310 14409 log.cc:927] Time spent T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:27:47.771844  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:47.772653  9958 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
W20260709 12:27:47.778297  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:47.705178 14258 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:47.777841 10527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36672 (request call id 1057) took 1351 ms. Trace:
W20260709 12:27:47.763607 14406 log.cc:927] Time spent T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
I20260709 12:27:47.781132  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:47.784898  9959 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:47.695715 14386 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.794394  9960 raft_consensus.cc:2410] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:27:47.763072 14365 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:47.796813  9808 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:47.796579 10496 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:47.799629  9815 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 16.
I20260709 12:27:47.801688 14427 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:47.803063 14386 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:47.803656 14386 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:47.804144 14386 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.806200 14386 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:47.807427  9963 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:47.807502 14386 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:47.782305 10527 rpcz_store.cc:276] 0709 12:27:46.426604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.426776 (+   172us) service_pool.cc:224] Handling call
0709 12:27:46.476005 (+ 49229us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:46.492670 (+ 16665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:46.492714 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:47.110364 (+617650us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b2c0010bbf8. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8ce15a11 00007f2f8ce25372 00007f2f8e557a01 00007f2f8e51c43a 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2
0709 12:27:47.110772 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 12:27:47.397855 (+287083us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:47.397887 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:47.397944 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:47.777552 (+379608us) raft_consensus.cc:1685] finished
0709 12:27:47.777573 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:47.777782 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18918,"raft.queue_time_us":16711,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":9856,"spinlock_wait_cycles":8605440,"thread_start_us":286694,"threads_started":1,"wal-append.queue_time_us":352823}
I20260709 12:27:47.780682 14416 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.183s
I20260709 12:27:47.812026 14386 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:47.768110 14366 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:47.812845 14060 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.813210 14366 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:47.815719 14366 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:47.819380 14221 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:47.826632  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:47.839695 14386 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:47.797749 14375 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:47.844370 14263 consensus_meta.cc:287] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.871s	user 0.011s	sys 0.001s
W20260709 12:27:47.852912 14411 log.cc:927] Time spent T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 12:27:47.725147 14326 consensus_queue.cc:260] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:47.825572 14365 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:47.793511 14258 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.863592 14375 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:47.863829 14033 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.880559 14290 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:47.880980 14375 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:47.881551 14037 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.881801 14326 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:47.859125 14301 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:47.877351 14365 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.884447 14360 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:47.858724 14311 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.880017 14222 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:47.885387 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 88879.2us
I20260709 12:27:47.889187 14394 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.839102 14427 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.895433 14307 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.896405 14330 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:47.896927 14396 consensus_meta.cc:287] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.710s	user 0.007s	sys 0.005s
I20260709 12:27:47.897360 14396 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.832352 14399 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.901064 10496 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:47.902927 10496 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:47.905320 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:47.909653 14386 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.903906 14365 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.911446 14416 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:47.911834 14416 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:47.911981 14386 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:47.912216 14416 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:47.912912 14362 raft_consensus.cc:3055] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:27:47.913276 14362 raft_consensus.cc:740] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:47.913300 14069 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.914207 14362 consensus_queue.cc:260] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:47.914839 14222 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.915710 14362 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:47.917466 14396 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:47.917639 14373 log.cc:927] Time spent T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 1.755s	user 0.004s	sys 0.008s
I20260709 12:27:47.920655 14265 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:47.921231 14416 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.921919 14399 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:47.922947 14376 consensus_queue.cc:260] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:47.924078 14376 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:47.926304 14430 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:47.926776 14430 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.927086 14430 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:47.927764 10528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36672 (request call id 1048) took 2310 ms. Trace:
I20260709 12:27:47.928138 10528 rpcz_store.cc:276] 0709 12:27:45.617334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.625472 (+  8138us) service_pool.cc:224] Handling call
0709 12:27:45.647371 (+ 21899us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:45.675446 (+ 28075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:45.675479 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:45.676016 (+   537us) log.cc:844] Serialized 52 byte log entry
0709 12:27:45.870891 (+194875us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:46.569864 (+698973us) log.cc:844] Serialized 14 byte log entry
0709 12:27:46.570069 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:46.570140 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:47.916936 (+1346796us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:47.925513 (+  8577us) raft_consensus.cc:1685] finished
0709 12:27:47.927508 (+  1995us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:47.927682 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2931,"prepare.queue_time_us":751073,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":1665,"raft.queue_time_us":25666,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":4871,"spinlock_wait_cycles":67526016,"thread_start_us":843253,"threads_started":2,"wal-append.queue_time_us":334501}
I20260709 12:27:47.935683  9887 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15. Ops: []
I20260709 12:27:47.939805  9885 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:48.195050 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:48.242710 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:48.243018 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:48.137542 14416 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:48.208231 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:48.189976 14386 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:48.435225 14386 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:48.435602 10529 raft_consensus.cc:1240] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:48.437493 14386 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:48.010728 14069 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:48.474172 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:48.489795  9814 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 772) took 1562 ms (client timeout 1954 ms). Trace:
W20260709 12:27:48.493749  9814 rpcz_store.cc:269] 0709 12:27:46.927202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.927582 (+   380us) service_pool.cc:224] Handling call
0709 12:27:48.489506 (+1561924us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540002dad4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:48.489697 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243625728}
W20260709 12:27:48.489245 14430 consensus_meta.cc:287] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.561s	user 0.007s	sys 0.001s
I20260709 12:27:48.478559 14391 raft_consensus.cc:3055] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:48.498679 14391 raft_consensus.cc:740] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:48.498205 14430 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:48.511234  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:48.511889  9814 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
W20260709 12:27:48.513914 10496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.023s	sys 0.047s
W20260709 12:27:48.516405 10496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.024s	sys 0.047s
I20260709 12:27:48.510717 13974 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:48.516752 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 614069us
I20260709 12:27:48.501842 14258 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:48.515486  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:48.519397  9814 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:48.520277 13974 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:48.515615 14391 consensus_queue.cc:260] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:48.536264 13974 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:48.532684 14442 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:48.600557 14442 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:48.976428 13974 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:49.302959 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:49.356756 14391 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:49.377947 14430 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:49.293124 13974 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:49.666869 14430 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:49.707247 14442 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:49.708148 14442 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:49.708732 14442 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:49.713647 13974 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:49.718628 14430 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:49.721724 14430 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:49.722230 14448 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.727059 14448 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:49.730252 14448 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:49.712232 14442 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:49.740566  9814 consensus_meta.cc:287] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 1.220s	user 0.010s	sys 0.001s
I20260709 12:27:49.757465  9814 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 15.
W20260709 12:27:49.850605 10497 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.031s	user 0.005s	sys 0.020s
W20260709 12:27:49.851137 10497 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.005s	sys 0.020s
W20260709 12:27:49.851480 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 1.03224e+06us
W20260709 12:27:49.956413  9814 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2332) took 2355 ms (client timeout 1824 ms). Trace:
W20260709 12:27:49.957161  9814 rpcz_store.cc:269] 0709 12:27:47.403285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:48.512593 (+1109308us) service_pool.cc:224] Handling call
0709 12:27:49.758224 (+1245631us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:49.958498  9814 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2326) took 2819 ms (client timeout 2149 ms). Trace:
I20260709 12:27:49.746718 14320 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:49.745699 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:49.964388 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:50.025662 14416 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.026520 14430 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:50.026532 14416 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.027262 14430 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.028414 14314 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:50.029457 14430 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:50.030046 14430 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.030520 14430 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.029567 14314 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.031831 14416 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:50.032569 14430 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:49.959456 14402 raft_consensus.cc:3055] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:50.033579 14402 raft_consensus.cc:740] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:50.033681 14314 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:50.035053 14430 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.036094 14430 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:50.038367  9814 rpcz_store.cc:269] 0709 12:27:47.139384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:49.958252 (+2818868us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:49.958418 (+   166us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:50.034899 14402 consensus_queue.cc:260] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.039422 14430 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:50.041365  9814 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2327) took 2901 ms (client timeout 2228 ms). Trace:
W20260709 12:27:50.041754  9814 rpcz_store.cc:269] 0709 12:27:47.141443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.039112 (+2897669us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:50.041296 (+  2184us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:50.042636  9814 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 777) took 2676 ms (client timeout 2065 ms). Trace:
I20260709 12:27:50.042717 14450 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:50.043022  9814 rpcz_store.cc:269] 0709 12:27:47.366529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.042438 (+2675909us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:50.042553 (+   115us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:50.043507 14450 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:50.043999  9814 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2341) took 2371 ms (client timeout 1783 ms). Trace:
W20260709 12:27:50.046064  9814 rpcz_store.cc:269] 0709 12:27:47.672718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.043839 (+2371121us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:50.043945 (+   106us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:50.046942  9814 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46504 (request call id 2784) took 2348 ms (client timeout 2225 ms). Trace:
I20260709 12:27:50.047451 14450 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:50.047312  9814 rpcz_store.cc:269] 0709 12:27:47.698175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.046790 (+2348615us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:50.046891 (+   101us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:50.048854  9814 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 14. Current term is 15. Ops: []
I20260709 12:27:50.049494  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2768) took 2934 ms. Trace:
I20260709 12:27:50.049855  9814 rpcz_store.cc:276] 0709 12:27:47.114669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.048357 (+2933688us) service_pool.cc:224] Handling call
0709 12:27:50.048710 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.049285 (+   575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.049447 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:50.050467  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2762) took 4151 ms. Trace:
I20260709 12:27:50.050664 14430 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:50.050812  9813 rpcz_store.cc:276] 0709 12:27:45.898834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.898943 (+   109us) service_pool.cc:224] Handling call
0709 12:27:46.666619 (+767676us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:46.686912 (+ 20293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.050223 (+3363311us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b54002d8550. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:50.050392 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1764633984}
I20260709 12:27:50.051357 14430 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.053519 14430 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:50.052845  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2770) took 2937 ms. Trace:
I20260709 12:27:50.059376  9813 rpcz_store.cc:276] 0709 12:27:47.115138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.051906 (+2936768us) service_pool.cc:224] Handling call
0709 12:27:50.052248 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.052458 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:50.052495 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:50.052552 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:50.052594 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.052665 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.052785 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:50.060319 14239 raft_consensus.cc:3055] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:50.060747 14239 raft_consensus.cc:740] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:50.061509 14239 consensus_queue.cc:260] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:50.068794  9810 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46504 (request call id 2765) took 2954 ms (client timeout 1890 ms). Trace:
W20260709 12:27:50.069320  9810 rpcz_store.cc:269] 0709 12:27:47.113864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:47.116502 (+  2638us) service_pool.cc:224] Handling call
0709 12:27:50.068555 (+2952053us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54001f5c54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:50.068683 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557458176}
I20260709 12:27:50.074925 14227 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:50.079684  9883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.509s	user 0.023s	sys 0.026s
W20260709 12:27:50.080195  9883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.510s	user 0.024s	sys 0.027s
I20260709 12:27:50.084004  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2773) took 2968 ms. Trace:
I20260709 12:27:50.085227 14391 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:50.085865 14391 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.086299 14294 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.088147 14391 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.084471  9810 rpcz_store.cc:276] 0709 12:27:47.115856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.075970 (+2960114us) service_pool.cc:224] Handling call
0709 12:27:50.077182 (+  1212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.077410 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:27:50.077712 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 12:27:50.083657 (+  5945us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:50.083711 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:50.083751 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.083815 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.083947 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1001,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"thread_start_us":5586,"threads_started":1,"wal-append.queue_time_us":5917}
I20260709 12:27:50.088714 14391 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:50.090852  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2774) took 2974 ms. Trace:
I20260709 12:27:50.091019 14391 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:50.091389  9963 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55946 (request call id 2300) took 2670 ms (client timeout 1802 ms). Trace:
I20260709 12:27:50.093508 14391 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.089573  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2771) took 2974 ms. Trace:
I20260709 12:27:50.094519  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2769) took 2979 ms. Trace:
I20260709 12:27:50.086777 14294 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.094446  9813 rpcz_store.cc:276] 0709 12:27:47.115379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.060877 (+2945498us) service_pool.cc:224] Handling call
0709 12:27:50.061191 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:50.061485 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:50.061513 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:50.061970 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:27:50.089236 (+ 27266us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:50.089279 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.089345 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:50.089386 (+    41us) raft_consensus.cc:1685] finished
0709 12:27:50.089399 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.089522 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14076,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":26904,"threads_started":1,"wal-append.queue_time_us":25393}
I20260709 12:27:50.094990  9814 rpcz_store.cc:276] 0709 12:27:47.114906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.050719 (+2935813us) service_pool.cc:224] Handling call
0709 12:27:50.050962 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.051144 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:50.062535 (+ 11391us) log.cc:844] Serialized 14 byte log entry
0709 12:27:50.093069 (+ 30534us) log.cc:844] Serialized 14 byte log entry
0709 12:27:50.094167 (+  1098us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:50.094222 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:50.094268 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.094350 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.094462 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15481,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":70,"raft.queue_time_us":12227,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":153,"thread_start_us":40627,"threads_started":3,"wal-append.queue_time_us":1068}
I20260709 12:27:50.096520 14294 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.091250  9810 rpcz_store.cc:276] 0709 12:27:47.116116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.089902 (+2973786us) service_pool.cc:224] Handling call
0709 12:27:50.090378 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.090545 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:50.090571 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:50.090622 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:50.090654 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.090705 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.090799 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:50.091912  9963 rpcz_store.cc:269] 0709 12:27:47.421068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:47.421191 (+   123us) service_pool.cc:224] Handling call
0709 12:27:50.091207 (+2670016us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54001dd154. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:50.091306 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":561268992}
I20260709 12:27:50.097352  9813 raft_consensus.cc:1240] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:50.098170 14239 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:50.098483  9810 raft_consensus.cc:1240] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:27:50.099202  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 2331) took 2956 ms. Trace:
I20260709 12:27:50.099538  9810 rpcz_store.cc:276] 0709 12:27:47.142568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.097603 (+2955035us) service_pool.cc:224] Handling call
0709 12:27:50.098069 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:50.098938 (+   869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.099149 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:50.100764  9814 raft_consensus.cc:1240] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:27:50.101472  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 2328) took 2959 ms. Trace:
I20260709 12:27:50.101819  9814 rpcz_store.cc:276] 0709 12:27:47.141725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.096985 (+2955260us) service_pool.cc:224] Handling call
0709 12:27:50.100503 (+  3518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:50.101209 (+   706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.101416 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:50.103309  9814 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:27:50.103739  9815 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46504 (request call id 2777) took 2578 ms (client timeout 1631 ms). Trace:
I20260709 12:27:50.103870  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 778) took 2737 ms. Trace:
W20260709 12:27:50.104226  9815 rpcz_store.cc:269] 0709 12:27:47.524980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.103521 (+2578541us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:50.103660 (+   139us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:50.104262  9814 rpcz_store.cc:276] 0709 12:27:47.366983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.102649 (+2735666us) service_pool.cc:224] Handling call
0709 12:27:50.102949 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.103659 (+   710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.103816 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:50.105950  9814 raft_consensus.cc:1240] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:27:50.106565  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 780) took 2739 ms. Trace:
I20260709 12:27:50.106869  9814 rpcz_store.cc:276] 0709 12:27:47.367557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.105421 (+2737864us) service_pool.cc:224] Handling call
0709 12:27:50.105721 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:50.106345 (+   624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.106519 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:50.108631  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 2334) took 2704 ms. Trace:
W20260709 12:27:50.109351  9812 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2325) took 2970 ms (client timeout 1827 ms). Trace:
I20260709 12:27:50.110023  9814 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 15. Current term is 16. Ops: [11.11-15.13]
I20260709 12:27:50.110713  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 2333) took 2707 ms. Trace:
I20260709 12:27:50.111019  9814 rpcz_store.cc:276] 0709 12:27:47.403638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.107566 (+2703928us) service_pool.cc:224] Handling call
0709 12:27:50.109733 (+  2167us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:27:50.110461 (+   728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.110665 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:50.109754  9812 rpcz_store.cc:269] 0709 12:27:47.139021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:47.384634 (+245613us) service_pool.cc:224] Handling call
0709 12:27:50.109174 (+2724540us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54001847d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:50.109287 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":483431296}
I20260709 12:27:50.109143  9810 rpcz_store.cc:276] 0709 12:27:47.403917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.107863 (+2703946us) service_pool.cc:224] Handling call
0709 12:27:50.108151 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.108324 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:50.108353 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:50.108400 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:50.108435 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.108487 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.108580 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:50.114459  9812 raft_consensus.cc:1275] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:27:50.115265  9812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 2336) took 2709 ms. Trace:
W20260709 12:27:50.115793  9778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.583s	user 0.029s	sys 0.038s
W20260709 12:27:50.116356  9778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.583s	user 0.029s	sys 0.038s
W20260709 12:27:50.116926  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 2.67185e+06us
I20260709 12:27:50.115721  9812 rpcz_store.cc:276] 0709 12:27:47.405964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.113434 (+2707470us) service_pool.cc:224] Handling call
0709 12:27:50.113763 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.114973 (+  1210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.115205 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:50.123749  9812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 2337) took 2717 ms. Trace:
I20260709 12:27:50.124205  9812 rpcz_store.cc:276] 0709 12:27:47.406580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.122827 (+2716247us) service_pool.cc:224] Handling call
0709 12:27:50.123163 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.123356 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:50.123392 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:50.123446 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:50.123489 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.123556 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.123690 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:50.124904  9778 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:50.126991  9778 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:50.127278  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2775) took 3010 ms. Trace:
I20260709 12:27:50.127794  9956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 848) took 2604 ms. Trace:
I20260709 12:27:50.128324  9956 rpcz_store.cc:276] 0709 12:27:47.519747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:47.682131 (+162384us) service_pool.cc:224] Handling call
0709 12:27:47.685599 (+  3468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:47.685769 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:47.685793 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:47.685833 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:47.685863 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:47.685917 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.123868 (+2437951us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b5400114c50. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:50.124017 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7260544}
I20260709 12:27:50.130560  9883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2530) took 2783 ms. Trace:
I20260709 12:27:50.132118  9778 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:50.131101  9883 rpcz_store.cc:276] 0709 12:27:47.346807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:47.451899 (+105092us) service_pool.cc:224] Handling call
0709 12:27:47.462768 (+ 10869us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:47.518124 (+ 55356us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:27:47.570220 (+ 52096us) log.cc:844] Serialized 14 byte log entry
0709 12:27:50.130075 (+2559855us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:50.130145 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:50.130203 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.130321 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.130464 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12503,"prepare.queue_time_us":54174,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":48697,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":128,"thread_start_us":2559379,"threads_started":2,"wal-append.queue_time_us":300491,"wal-append.run_cpu_time_us":1356,"wal-append.run_wall_time_us":1105545}
I20260709 12:27:50.132951 14450 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:27:50.133554 14450 raft_consensus.cc:697] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:50.127648  9813 rpcz_store.cc:276] 0709 12:27:47.116364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.096587 (+2980223us) service_pool.cc:224] Handling call
0709 12:27:50.097190 (+   603us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.098049 (+   859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.127226 (+ 29177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:50.134507 14450 consensus_queue.cc:237] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.129714 14239 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:50.142573 14239 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:50.143772 14413 log.cc:927] Time spent T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 2.482s	user 0.008s	sys 0.010s
I20260709 12:27:50.144784 14239 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:50.147555 14239 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:50.141129 14227 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:50.150729 14227 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.152215 14260 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:50.153393 14227 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.164814 14461 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.165508 14461 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.168437 14461 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.164319 14227 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.170665  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 2335) took 2766 ms. Trace:
I20260709 12:27:50.169909 14320 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.169708 14227 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.164510 14239 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.171312  9814 rpcz_store.cc:276] 0709 12:27:47.404383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.111755 (+2707372us) service_pool.cc:224] Handling call
0709 12:27:50.112013 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.112207 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:50.112826 (+   619us) log.cc:844] Serialized 14 byte log entry
0709 12:27:50.149429 (+ 36603us) log.cc:844] Serialized 14 byte log entry
0709 12:27:50.170307 (+ 20878us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:50.170352 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:50.170417 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.170490 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.170609 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14591,"prepare.queue_time_us":562,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":74,"raft.queue_time_us":21992,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":28955776,"thread_start_us":35655,"threads_started":1,"wal-append.queue_time_us":37294}
I20260709 12:27:50.173002 14454 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:50.173071 14320 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.174791  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2781) took 2603 ms. Trace:
I20260709 12:27:50.175158  9814 rpcz_store.cc:276] 0709 12:27:47.571696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.173970 (+2602274us) service_pool.cc:224] Handling call
0709 12:27:50.174293 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.174458 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:50.174483 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:50.174519 (+    36us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:50.174555 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.174616 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.174728 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:50.175951 14227 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.176501 14239 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.178035  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2782) took 2589 ms. Trace:
I20260709 12:27:50.178418  9814 rpcz_store.cc:276] 0709 12:27:47.588948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.177159 (+2588211us) service_pool.cc:224] Handling call
0709 12:27:50.177446 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.177604 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:50.177758 (+   154us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:50.177805 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:50.177836 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.177887 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.177985 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:50.179749 14239 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.180277  9814 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:27:50.180896  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46496 (request call id 2340) took 2590 ms. Trace:
I20260709 12:27:50.181202  9814 rpcz_store.cc:276] 0709 12:27:47.590790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.179747 (+2588957us) service_pool.cc:224] Handling call
0709 12:27:50.179997 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.180668 (+   671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.180850 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:50.182608  9814 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:27:50.183175  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2783) took 2522 ms. Trace:
I20260709 12:27:50.184091  9814 rpcz_store.cc:276] 0709 12:27:47.661106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.181886 (+2520780us) service_pool.cc:224] Handling call
0709 12:27:50.182307 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.182931 (+   624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.183131 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:50.186050  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2785) took 2420 ms. Trace:
I20260709 12:27:50.186450  9814 rpcz_store.cc:276] 0709 12:27:47.766201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.185340 (+2419139us) service_pool.cc:224] Handling call
0709 12:27:50.185588 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.185752 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:50.185778 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:50.185813 (+    35us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:50.185845 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.185908 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.186005 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:50.188508  9814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2786) took 2400 ms. Trace:
I20260709 12:27:50.188838  9814 rpcz_store.cc:276] 0709 12:27:47.788682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.187813 (+2399131us) service_pool.cc:224] Handling call
0709 12:27:50.188092 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.188233 (+   141us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:50.188256 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:50.188295 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:50.188327 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.188376 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.188465 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:50.192901 14294 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.193379 14457 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:50.193470 14294 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.194347 14457 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:50.195712 14377 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.196513 14294 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:50.197325  9927 connection.cc:256] RPC call timeout handler was delayed by -1.4155100179996225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
I20260709 12:27:50.197523 14309 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:27:50.197707  9927 connection.cc:256] RPC call timeout handler was delayed by -1.2009825869995439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
W20260709 12:27:50.198020  9927 connection.cc:256] RPC call timeout handler was delayed by -1.187482586999522s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
I20260709 12:27:50.199651 14391 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:50.200196 14391 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:50.193418  9811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 766) took 4504 ms. Trace:
I20260709 12:27:50.205631  9811 rpcz_store.cc:276] 0709 12:27:45.688925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:45.695362 (+  6437us) service_pool.cc:224] Handling call
0709 12:27:45.721489 (+ 26127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:47.098323 (+1376834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.193185 (+3094862us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54002512d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:50.193346 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3149900032}
I20260709 12:27:50.203926 14457 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:50.209810  9812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2776) took 2688 ms. Trace:
I20260709 12:27:50.210220  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.211141  9814 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:27:50.198024 14309 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:50.210143  9812 rpcz_store.cc:276] 0709 12:27:47.521698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.125112 (+2603414us) service_pool.cc:224] Handling call
0709 12:27:50.125354 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.125537 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:27:50.126078 (+   541us) log.cc:844] Serialized 14 byte log entry
0709 12:27:50.209476 (+ 83398us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:50.209530 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:50.209574 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.209645 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.209751 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5975,"prepare.queue_time_us":150,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":7458,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":734,"thread_start_us":76934,"threads_started":2,"wal-append.queue_time_us":81239}
I20260709 12:27:50.211937  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2779) took 2640 ms. Trace:
I20260709 12:27:50.212159  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.212764  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.212312  9810 rpcz_store.cc:276] 0709 12:27:47.571177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.125841 (+2554664us) service_pool.cc:224] Handling call
0709 12:27:50.126146 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:50.126360 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:50.126383 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:50.126776 (+   393us) log.cc:844] Serialized 26 byte log entry
0709 12:27:50.170240 (+ 43464us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:50.210698 (+ 40458us) log.cc:844] Serialized 14 byte log entry
0709 12:27:50.211656 (+   958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.211725 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:50.211761 (+    36us) raft_consensus.cc:1685] finished
0709 12:27:50.211773 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.211886 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40455,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":100,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":76,"thread_start_us":70345,"threads_started":2,"wal-append.queue_time_us":47978}
I20260709 12:27:50.209153 14391 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:50.214733  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.214939 14309 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:50.216243  9814 raft_consensus.cc:1275] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:27:50.236397 14309 consensus_queue.cc:1059] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:50.236652 14391 consensus_queue.cc:1059] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:50.237319 14309 raft_consensus.cc:3055] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:27:50.237613 14294 raft_consensus.cc:3055] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:27:50.237680 14309 raft_consensus.cc:740] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:50.238125 14294 raft_consensus.cc:740] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:50.238782 14309 consensus_queue.cc:260] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:50.238966 14294 consensus_queue.cc:260] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:50.240034 14309 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:50.243500  9927 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:50.244264 14391 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:27:50.244742 14391 raft_consensus.cc:697] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:50.245574 14391 consensus_queue.cc:237] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:50.247920  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:50.252849  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.257649  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:50.262952  9957 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55946 (request call id 2297) took 2877 ms (client timeout 1827 ms). Trace:
I20260709 12:27:50.266907  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:50.267077  9957 rpcz_store.cc:269] 0709 12:27:47.385875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:47.385975 (+   100us) service_pool.cc:224] Handling call
0709 12:27:50.262772 (+2876797us) spinlock_profiling.cc:243] Waited 98.7 ms on lock 0x7b54001de554. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:50.262886 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227120896}
W20260709 12:27:50.269840  9808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2338) took 2862 ms (client timeout 1613 ms). Trace:
W20260709 12:27:50.270247  9808 rpcz_store.cc:269] 0709 12:27:47.407011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.269647 (+2862636us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:50.269765 (+   118us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:50.271154  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.267477  9814 raft_consensus.cc:2376] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 16. Re-sending same reply.
I20260709 12:27:50.272276  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:50.272341  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:50.273625  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.274246  9814 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:50.274788 14456 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:50.295594  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.295543 14456 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:50.297894 14456 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:50.275005  9779 connection.cc:256] RPC call timeout handler was delayed by -2.0553597380003339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 12:27:50.298839  9779 connection.cc:256] RPC call timeout handler was delayed by -2.0510328300001675s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:27:50.275213 14364 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:50.299274  9779 connection.cc:256] RPC call timeout handler was delayed by -1.7197635359998458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
I20260709 12:27:50.274577 14347 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.299600 14364 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.300158 14347 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.301764 14364 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.302150 14347 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.289901  9888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 1047) took 3318 ms. Trace:
I20260709 12:27:50.350948  9888 rpcz_store.cc:276] 0709 12:27:46.971646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.971772 (+   126us) service_pool.cc:224] Handling call
0709 12:27:46.972055 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:47.175771 (+203716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.289650 (+3113879us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400217d54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:50.289843 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":466947840}
W20260709 12:27:50.497992 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 59215.9us
I20260709 12:27:50.498387  9814 raft_consensus.cc:2393] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 11: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:50.305336  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2780) took 2733 ms. Trace:
I20260709 12:27:50.275647  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.286423  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 779) took 2919 ms. Trace:
I20260709 12:27:50.500260  9815 rpcz_store.cc:276] 0709 12:27:47.367274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.105355 (+2738081us) service_pool.cc:224] Handling call
0709 12:27:50.113204 (+  7849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.113374 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:50.113398 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:50.113436 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:50.113465 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.113514 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.286201 (+172687us) spinlock_profiling.cc:243] Waited 7.51 ms on lock 0x7b54001847d0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:50.286358 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17273088}
I20260709 12:27:50.502007  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:50.299621  9779 connection.cc:256] RPC call timeout handler was delayed by -1.7197635359998458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 12:27:50.503150  9779 connection.cc:256] RPC call timeout handler was delayed by -1.4177676590002193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 12:27:50.503486  9779 connection.cc:256] RPC call timeout handler was delayed by -1.4145213680003508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
W20260709 12:27:50.503764  9779 connection.cc:256] RPC call timeout handler was delayed by -1.4002635359997839s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
W20260709 12:27:50.504035  9779 connection.cc:256] RPC call timeout handler was delayed by -1.3827021539996167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2002s for a response
W20260709 12:27:50.504304  9779 connection.cc:256] RPC call timeout handler was delayed by -1.3714635359997374s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260709 12:27:50.504586  9779 connection.cc:256] RPC call timeout handler was delayed by -1.2288021539998226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260709 12:27:50.504853  9779 connection.cc:256] RPC call timeout handler was delayed by -1.1736530690000109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
W20260709 12:27:50.505124  9779 connection.cc:256] RPC call timeout handler was delayed by -1.173315619999812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
I20260709 12:27:50.498988  9813 rpcz_store.cc:276] 0709 12:27:47.571451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.134539 (+2563088us) service_pool.cc:224] Handling call
0709 12:27:50.134888 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.143352 (+  8464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:50.143399 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:50.143458 (+    59us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:27:50.143508 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.305092 (+161584us) spinlock_profiling.cc:243] Waited 8.17 ms on lock 0x7b5400183dd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:50.305140 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.305275 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18787200}
W20260709 12:27:50.305437  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:50.509220 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:50.496012  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:50.510099 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:50.513218 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:50.513549  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.513789 10524 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:50.515383  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.515930 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:50.516884  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.517661 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:50.518162  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:50.290560 14470 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:50.520078 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:50.293515 14440 log.cc:927] Time spent T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 1.783s	user 0.000s	sys 0.017s
I20260709 12:27:50.520952 10532 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:50.302248 14364 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:50.274441 14351 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.523258  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.525825  9808 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:50.522434 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:50.527189 10533 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:50.523685  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.530171  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:50.530934  9813 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:50.511507 14347 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:27:50.534204  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 264614us
I20260709 12:27:50.536082  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.536221 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:50.538947 10529 raft_consensus.cc:2410] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 12:27:50.538932 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:50.527632 14464 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.521951 14470 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:50.522403 14472 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:50.523995 14463 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.543174  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.544202  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.544730  9808 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:27:50.545455  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.546450  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.547262  9808 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
W20260709 12:27:50.549172 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:50.549748  9808 raft_consensus.cc:1240] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15. Ops: []
I20260709 12:27:50.533882 14351 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.555653 14470 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:50.555918 14351 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.527998 14364 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.564092 14364 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.543066 14464 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.568732  9813 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:50.538902 14347 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:50.555932 14294 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:50.575515  9815 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:27:50.578794  9813 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:27:50.549219 14472 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.549047 14463 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:50.588972  9780 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.810s	user 0.018s	sys 0.039s
I20260709 12:27:50.590051  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.590863  9957 raft_consensus.cc:2393] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 5: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:50.591084  9813 raft_consensus.cc:1240] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11. Ops: []
W20260709 12:27:50.594336  9780 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.826s	user 0.020s	sys 0.039s
I20260709 12:27:50.595450 14364 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.595074  9813 raft_consensus.cc:1240] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:50.596428 14364 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:50.596830 14347 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:50.597482 14377 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.598058 14377 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.603375  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:50.604524  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:50.602495 14364 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:50.606921 14391 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:50.611626 14463 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:50.611526 14391 consensus_queue.cc:1059] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:27:50.613201 14472 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.613752 14472 raft_consensus.cc:3055] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:50.614085 14472 raft_consensus.cc:740] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:50.614938 14472 consensus_queue.cc:260] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.616114 14472 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:50.619431 14464 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.607052 14410 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:50.622452 14377 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:50.622598  9955 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.798s	user 0.025s	sys 0.031s
W20260709 12:27:50.630826  9955 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.806s	user 0.025s	sys 0.031s
I20260709 12:27:50.631645  9955 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 843) took 3113 ms. Trace:
I20260709 12:27:50.631996  9955 rpcz_store.cc:276] 0709 12:27:47.518165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:47.518285 (+   120us) service_pool.cc:224] Handling call
0709 12:27:47.565048 (+ 46763us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:47.565246 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:27:47.590832 (+ 25586us) log.cc:844] Serialized 14 byte log entry
0709 12:27:47.824352 (+233520us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b1800439240. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b411e07 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f8e0b620b 00007f2f8e0bbd23 00007f2f8e0bc23a 00007f2f8e526a2a
0709 12:27:50.631269 (+2806917us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:50.631324 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:50.631389 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.631469 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.631588 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22628,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"spinlock_wait_cycles":5530880,"thread_start_us":2806660,"threads_started":1,"wal-append.queue_time_us":281610,"wal-append.run_cpu_time_us":1375,"wal-append.run_wall_time_us":1103940}
I20260709 12:27:50.633846 14309 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:50.634428 14309 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.618456  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.636168  9957 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:50.626482 14470 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:50.637171 14470 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.628484 14347 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:50.640817 14347 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.644301 14347 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.644906 14347 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:50.628933 14351 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.647377 14351 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.629331 14456 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:50.650847 14456 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:50.653440 14456 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:50.649997 14351 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.639914 14470 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.669149 14259 raft_consensus.cc:3055] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:50.669626 14259 raft_consensus.cc:740] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:50.670476 14259 consensus_queue.cc:260] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:50.671003  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 132724us
I20260709 12:27:50.671478 14259 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:50.645466 14347 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:50.691262  9962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 845) took 3172 ms. Trace:
I20260709 12:27:50.691946  9962 rpcz_store.cc:276] 0709 12:27:47.518814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:47.518939 (+   125us) service_pool.cc:224] Handling call
0709 12:27:50.265994 (+2747055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.266177 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:50.266201 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:50.266239 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:50.266799 (+   560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.266866 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.690362 (+423496us) spinlock_profiling.cc:243] Waited 2.75 s on lock 0x7b54001de550. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:50.691129 (+   767us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6316821248}
W20260709 12:27:50.695183 14417 log.cc:927] Time spent T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 3.130s	user 0.010s	sys 0.012s
I20260709 12:27:50.700268 14347 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:50.687019  9779 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:50.703883  9779 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:50.716094  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:50.707738 14464 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:50.722564 14364 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:50.744890 14364 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:50.746551 14364 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:50.736096 14464 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:50.747924 14464 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:50.750456  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:50.754444  9853 connection.cc:256] RPC call timeout handler was delayed by -2.2728974670003481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 12:27:50.755848  9853 connection.cc:256] RPC call timeout handler was delayed by -2.2377974670002914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
W20260709 12:27:50.756235  9853 connection.cc:256] RPC call timeout handler was delayed by -2.1693974670001808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
W20260709 12:27:50.758483  9853 connection.cc:256] RPC call timeout handler was delayed by -2.1693974670001808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
W20260709 12:27:50.758845  9853 connection.cc:256] RPC call timeout handler was delayed by -2.07309746700048s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1785s for a response
W20260709 12:27:50.759181  9853 connection.cc:256] RPC call timeout handler was delayed by -2.0577974670004551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 12:27:50.759505  9853 connection.cc:256] RPC call timeout handler was delayed by -2.0352974670004187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 12:27:50.759811  9853 connection.cc:256] RPC call timeout handler was delayed by -2.0352974670004187s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
I20260709 12:27:50.760387 14477 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:50.760890 14477 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:50.763160 14477 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:50.763689  9853 connection.cc:256] RPC call timeout handler was delayed by -1.8174974670005213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
W20260709 12:27:50.774060  9853 connection.cc:256] RPC call timeout handler was delayed by -1.8059332030002224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
W20260709 12:27:50.774513  9853 connection.cc:256] RPC call timeout handler was delayed by -1.7705641900001865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
W20260709 12:27:50.774848  9853 connection.cc:256] RPC call timeout handler was delayed by -1.7705641900001865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
W20260709 12:27:50.775184  9853 connection.cc:256] RPC call timeout handler was delayed by -1.7454974670004049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
W20260709 12:27:50.775530  9853 connection.cc:256] RPC call timeout handler was delayed by -1.67439746700029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
W20260709 12:27:50.777909  9853 connection.cc:256] RPC call timeout handler was delayed by -1.67439746700029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
W20260709 12:27:50.778296  9853 connection.cc:256] RPC call timeout handler was delayed by -1.5806641900003342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
W20260709 12:27:50.778764  9853 connection.cc:256] RPC call timeout handler was delayed by -1.5806641900003342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
W20260709 12:27:50.779093  9853 connection.cc:256] RPC call timeout handler was delayed by -1.4290716810000959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 12:27:50.779452  9853 connection.cc:256] RPC call timeout handler was delayed by -1.3502359640001487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
W20260709 12:27:50.779867  9853 connection.cc:256] RPC call timeout handler was delayed by -1.335482590000538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
W20260709 12:27:50.780234  9853 connection.cc:256] RPC call timeout handler was delayed by -1.2596332030002486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
W20260709 12:27:50.780565  9853 connection.cc:256] RPC call timeout handler was delayed by -1.009297467000124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2967s for a response
I20260709 12:27:50.782066  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:50.784642  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.785163 14454 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:50.785665 14454 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:50.787060  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.787778  9811 raft_consensus.cc:2393] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 13: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:50.789482  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.792079  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.792879  9811 raft_consensus.cc:2410] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:27:50.793370 14454 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:50.794355 14443 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.417s	user 0.008s	sys 0.011s
I20260709 12:27:50.794859  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.796592  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:50.800536 14443 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.423s	user 0.008s	sys 0.012s
I20260709 12:27:50.801431  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.801852 14454 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:50.797993  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.802596  9814 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 15.
I20260709 12:27:50.799371  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.805083  9811 raft_consensus.cc:2393] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 11: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
W20260709 12:27:50.807765  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 197240us
I20260709 12:27:50.809211  9928 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:50.809549  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2522) took 4173 ms. Trace:
I20260709 12:27:50.809947  9886 rpcz_store.cc:276] 0709 12:27:46.636157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.638366 (+  2209us) service_pool.cc:224] Handling call
0709 12:27:46.638693 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:47.460183 (+821490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:50.809327 (+3349144us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54003c5354. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:50.809493 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878596992}
I20260709 12:27:50.813282  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:50.814451 14475 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:50.819484  9701 tablet_replica.cc:1406] Time spent applying in-flights took a long time: real 5.007s	user 0.015s	sys 0.006s
W20260709 12:27:50.821983  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 284937us
I20260709 12:27:50.823516 14469 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:27:50.823678  9928 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:50.824862 14464 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.839493  9809 raft_consensus.cc:2410] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:27:50.840996  9928 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:50.841442  9809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2324) took 3735 ms (client timeout 3559 ms). Trace:
I20260709 12:27:50.841747 14464 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.842542 14472 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:50.843878 14467 consensus_queue.cc:1059] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:50.845170 14457 raft_consensus.cc:3055] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:50.845526 14457 raft_consensus.cc:740] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:50.845988 14467 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:27:50.846823  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:50.847496  9811 raft_consensus.cc:2376] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11. Re-sending same reply.
I20260709 12:27:50.846899 14457 consensus_queue.cc:260] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:50.848372 14457 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:50.849030  9927 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:50.851341 14475 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:50.851753 14475 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:50.852097 14475 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:50.854995 14476 consensus_queue.cc:1048] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:27:50.841821  9809 rpcz_store.cc:269] 0709 12:27:47.105648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:47.105870 (+   222us) service_pool.cc:224] Handling call
0709 12:27:50.841261 (+3735391us) spinlock_profiling.cc:243] Waited 3.73 s on lock 0x7b540036b354. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:50.841383 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8578983168}
I20260709 12:27:50.860127  9928 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:50.861490  9962 raft_consensus.cc:1240] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15. Ops: []
I20260709 12:27:50.863224  9962 raft_consensus.cc:1240] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 11. Current term is 12. Ops: []
W20260709 12:27:50.863833 14412 log.cc:927] Time spent T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 3.283s	user 0.011s	sys 0.015s
I20260709 12:27:50.864622  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.865288  9962 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:50.870641  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:50.871248  9962 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:50.872313  9806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2767) took 3757 ms. Trace:
I20260709 12:27:50.872689  9806 rpcz_store.cc:276] 0709 12:27:47.114422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:47.129280 (+ 14858us) service_pool.cc:224] Handling call
0709 12:27:47.129637 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:47.130189 (+   552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:47.130223 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:47.150408 (+ 20185us) log.cc:844] Serialized 26 byte log entry
0709 12:27:47.435716 (+285308us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:47.585036 (+149320us) log.cc:844] Serialized 14 byte log entry
0709 12:27:47.585376 (+   340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:47.585457 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:50.863358 (+3277901us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:50.872023 (+  8665us) raft_consensus.cc:1685] finished
0709 12:27:50.872148 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:50.872260 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":249442,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":3000,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":10084,"spinlock_wait_cycles":13515520,"thread_start_us":311976,"threads_started":2,"wal-append.queue_time_us":228586}
I20260709 12:27:50.879406 14472 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:50.879837 14472 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:50.880199 14472 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:50.881551  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:50.882627  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:50.883785  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:50.884961  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:50.885588  9886 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:50.886672  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.887358  9956 raft_consensus.cc:2393] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 13: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:50.891348  9888 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 14. Current term is 15. Ops: []
I20260709 12:27:50.894634  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:50.895587 14320 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.898574  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:50.899170  9885 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:50.901073 14472 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.902439  9962 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:50.902824 14309 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.906718  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.908115  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:50.908654  9956 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:50.914872 14427 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.915719  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.916327  9963 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:27:50.917526  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.918987  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.920352  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.924475 10496 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:50.926409  9779 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:50.926604 14442 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:27:50.927681 14427 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:50.928076 14427 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:50.928030 14442 consensus_queue.cc:1059] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:27:50.928622 14427 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:50.929211 14442 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:27:50.929814 14446 raft_consensus.cc:3055] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:27:50.930198 14446 raft_consensus.cc:740] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:50.931085 14446 consensus_queue.cc:260] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.932377 14446 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:50.933681 14475 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:50.936064 14475 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:50.938005  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.938472 14469 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:50.938867  9963 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:27:50.939944  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.940636  9962 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
W20260709 12:27:50.940850 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:50.942601 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:50.943284  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:50.943989  9885 raft_consensus.cc:2393] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 12: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:50.943980 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:50.945324 14069 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:50.945936 14069 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:50.947685 10496 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:50.947827  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.948428 14069 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:50.948791 14069 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:50.949165 14069 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:50.951364  9956 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
W20260709 12:27:50.952243  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 137186us
I20260709 12:27:50.949172  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:50.958169  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:50.958678  9962 raft_consensus.cc:2376] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9. Re-sending same reply.
I20260709 12:27:50.952924 14472 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.954388  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:50.959676  9853 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:50.959935  9885 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:27:50.956745  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:50.960551  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:50.960932  9883 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
W20260709 12:27:50.962097  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:50.949705 14427 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.963186  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:50.964334 14427 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:50.965255 14069 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:50.967466 14069 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:50.969180 14470 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:50.969725 14470 raft_consensus.cc:697] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:50.970461 14477 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:27:50.970611 13942 consensus_queue.cc:1059] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:50.971029 14477 raft_consensus.cc:697] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 15 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:50.969183 10496 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:50.971949 14477 consensus_queue.cc:237] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:50.972247 14351 consensus_queue.cc:1059] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:50.972963 10496 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:50.973727 14439 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:50.974121 14439 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:50.974473 14439 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:50.975216  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.975934  9961 raft_consensus.cc:2393] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 13: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:50.976686  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.977721  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.978593 14292 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:50.978915  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.979633  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:50.971959  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:50.970420  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.978634  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.981403  9963 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:50.982234  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.982187  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.983111 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:50.983414  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:50.983803 10524 raft_consensus.cc:2393] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:50.984711  9956 raft_consensus.cc:1240] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:50.985405 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:50.986088 10532 raft_consensus.cc:2393] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 10: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:50.986820 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:50.990501 10533 raft_consensus.cc:1240] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:50.991680  9779 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:50.991925 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:50.996999  9955 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:51.046245  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:51.048825 14320 raft_consensus.cc:2804] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:27:51.049021 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 54615.5us
W20260709 12:27:51.049759 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:51.050096 14259 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:51.050945 10496 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:51.051529 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.051923 10496 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:51.051777 14273 consensus_queue.cc:1059] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:27:51.058955  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.058637 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.058735  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.052868 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:51.052117 14423 consensus_queue.cc:1059] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:27:51.080062 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:51.079082  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:51.076615  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.080988  9962 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:27:51.078862  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.060870  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:51.082053 10533 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:51.059494  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.082151 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.083329  9886 raft_consensus.cc:1275] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:27:51.083608 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:51.090559  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:51.091168  9883 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:27:50.979123 14292 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:51.084208  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.085755  9885 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:27:51.092396 10524 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:51.086427  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.087072  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.093210  9957 raft_consensus.cc:2393] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:51.093420  9964 raft_consensus.cc:2393] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 13: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:51.089871 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.088271  9815 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:51.094456 10532 raft_consensus.cc:2393] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:51.088850  9956 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 6.
I20260709 12:27:51.092787  9958 raft_consensus.cc:2393] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 12: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:51.104628  9889 raft_consensus.cc:1275] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:27:51.129622  9815 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:51.162320 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.098003 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.162398 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.163854 10531 raft_consensus.cc:2393] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 11: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:51.163722  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:51.164480  9957 raft_consensus.cc:2410] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:27:51.165187  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:51.165915 14427 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.166311 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.166428 14427 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:51.170174 14427 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:51.076016 14486 consensus_queue.cc:1059] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 12:27:51.110726  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:51.173189  9964 raft_consensus.cc:1240] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:51.097864 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.097543 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.176365 10533 raft_consensus.cc:2410] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:27:51.049429 14320 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:51.171149  9886 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:51.181913  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:50.999377 14442 raft_consensus.cc:697] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 16 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:51.188091 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.190341 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.084702 14283 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:51.207058  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:51.052464 14199 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:51.245594  9886 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 11: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:50.999727 14435 consensus_queue.cc:1059] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.181s
I20260709 12:27:51.250857  9813 raft_consensus.cc:1240] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:51.249817 10526 raft_consensus.cc:2393] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 11: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:51.258041  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:51.259624  9928 connection.cc:256] RPC call timeout handler was delayed by -2.4979270750000069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:27:51.260150  9928 connection.cc:256] RPC call timeout handler was delayed by -2.264399191999928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
W20260709 12:27:51.260540  9928 connection.cc:256] RPC call timeout handler was delayed by -2.0384991920000175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
W20260709 12:27:51.260954  9928 connection.cc:256] RPC call timeout handler was delayed by -1.9727991919999113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
I20260709 12:27:51.173821 14292 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:51.077909 14414 consensus_queue.cc:1059] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.151s
I20260709 12:27:51.289345  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:51.182894 14320 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:51.289389  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:51.289830  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:51.291960  9883 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:51.293154  9813 raft_consensus.cc:1275] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:27:51.293563  9813 pending_rounds.cc:85] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71: Aborting all ops after (but not including) 7
I20260709 12:27:51.293810  9813 pending_rounds.cc:107] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:27:51.294086  9813 raft_consensus.cc:2889] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:51.295895 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:51.296537  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:51.289723  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:51.299124  9809 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:51.088582 14351 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.163s
W20260709 12:27:51.301108  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 303123us
I20260709 12:27:51.303527 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.304399 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.304728 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.305693 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.308066 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.308923 10531 raft_consensus.cc:2410] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:27:51.311456  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.246888  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:27:51.320035  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:51.322414 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.246563 14283 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:51.327487 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.289469 14309 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.289165 14199 raft_consensus.cc:697] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:51.329417 14283 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:51.333884  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.335212 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.336407 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.337201 10533 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 8.
I20260709 12:27:51.335227  9958 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:51.307331 14473 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:51.189321 14301 consensus_queue.cc:1059] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.137s
I20260709 12:27:51.345819 14486 consensus_queue.cc:1243] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Peer 4104e34a61b7448281d6d91ce23ebf71 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:27:51.186750 14470 consensus_queue.cc:237] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:51.354773 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 64421.3us
I20260709 12:27:51.343576 14309 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:51.362735 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:27:51.355352  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 47125.4us
I20260709 12:27:51.346561 14351 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.365958  9928 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:51.356451 14364 consensus_meta.cc:287] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.609s	user 0.012s	sys 0.000s
I20260709 12:27:51.378414 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:51.373724  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:51.406734  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.351225 14414 consensus_queue.cc:1243] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer 4104e34a61b7448281d6d91ce23ebf71 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:27:51.351218 14487 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.410223 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.367694 14457 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:51.413434  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:51.414800 14410 consensus_queue.cc:1048] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:27:51.367571 14486 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.426596 10533 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:51.349274 14442 consensus_queue.cc:237] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:51.427968  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.425200 14480 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:51.428680  9928 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:51.413791 14423 consensus_queue.cc:1059] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:27:51.439296 14475 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:51.439890 14475 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:51.440405 14475 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:51.433177  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 111959us
I20260709 12:27:51.342670 14199 consensus_queue.cc:237] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:51.415527 14457 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:51.412398 14493 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:51.435111  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.435637 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:51.447113 10533 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:51.406401 14351 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:51.409286 14364 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:51.452257  9955 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:27:51.456825 14439 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:51.464454 14439 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:51.443450  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.473088  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:51.441578 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 63296.9us
I20260709 12:27:51.444412  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.474014  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.447853 14493 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:51.444010  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.474715 10496 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:51.475356  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.476351  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.450779  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.477187  9961 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:51.477707 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.478824 10528 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:51.479102 14351 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:51.466475 14457 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:51.479743 14069 raft_consensus.cc:3055] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:51.480219 14069 raft_consensus.cc:740] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:51.481138 14069 consensus_queue.cc:260] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:51.453696  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.454712  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.477187 10533 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:27:51.484587  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.452571 14364 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:51.433873 14473 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:51.416920 14487 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:51.465534 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.469956 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.470649 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:51.500849 10526 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:51.436324  9958 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
W20260709 12:27:51.471076 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:51.447964  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.478070  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:51.452574 14309 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:51.479947 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.482862  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:51.490758 14491 log.cc:927] Time spent T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:27:51.477345 10496 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:51.509079 14443 raft_consensus.cc:3055] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:27:51.509552 14443 raft_consensus.cc:740] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:51.491040 14480 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:51.510468 14443 consensus_queue.cc:260] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:51.490636  9964 raft_consensus.cc:2410] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:27:51.492262 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.512056 14497 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:51.466899 14472 consensus_queue.cc:1048] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:27:51.509403 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:51.442322  9927 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:51.505298  9956 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:51.450044 14283 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:51.482252 14069 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:51.510885 14480 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:51.503994  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:51.436120 14486 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:51.536190 10497 leader_election.cc:336] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.504s (SENT)
I20260709 12:27:51.477806 14493 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:51.526151 10496 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:51.492208 14473 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:51.529007  9962 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:51.469019 14292 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:51.551550 10531 raft_consensus.cc:2393] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 14: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:27:51.551725 10497 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.518s (SENT) [suppressed 39 similar messages]
W20260709 12:27:51.523994  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 81771.6us
I20260709 12:27:51.552430  9956 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:51.553679 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.547142 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:51.554692 14309 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:51.563694 14487 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:51.564802 14292 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:51.565653 14292 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:27:51.569619 14446 consensus_meta.cc:287] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.637s	user 0.010s	sys 0.000s
I20260709 12:27:51.570405 10525 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 15.
I20260709 12:27:51.556404 10496 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:51.584764 10526 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:51.524801 14293 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:51.529662 14495 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:51.587010 10496 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:51.591084 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.591763 10530 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:27:51.592633 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:51.587548 10532 raft_consensus.cc:2393] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 15: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:51.533308 14480 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:51.551362 14473 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:51.566141 14292 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:51.583076 14477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.017s	sys 0.025s
I20260709 12:27:51.611510 10496 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:51.745579  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:51.747349 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 135900us
I20260709 12:27:51.748350 10496 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:51.796697 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 48448us
I20260709 12:27:51.589147 14446 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:51.634268 14199 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:51.838348 10530 raft_consensus.cc:1240] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
W20260709 12:27:51.754820  9985 debug-util.cc:398] Leaking SignalData structure 0x7b08000c0a80 after lost signal to thread 8640
W20260709 12:27:51.854785  9985 debug-util.cc:398] Leaking SignalData structure 0x7b08000dd3a0 after lost signal to thread 9747
W20260709 12:27:51.855391  9985 debug-util.cc:398] Leaking SignalData structure 0x7b0800109740 after lost signal to thread 9778
W20260709 12:27:51.856590  9985 debug-util.cc:398] Leaking SignalData structure 0x7b08000efd80 after lost signal to thread 9839
W20260709 12:27:51.856916  9985 debug-util.cc:398] Leaking SignalData structure 0x7b08000b8120 after lost signal to thread 9840
W20260709 12:27:51.746687 14477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.018s	sys 0.026s
I20260709 12:27:51.740221 14292 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:51.737968 14414 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:27:51.963065 14500 log.cc:927] Time spent T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:27:51.965272 14283 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:51.966105 14283 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:51.966576 14283 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:51.967020 14283 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:51.975313 14501 log.cc:927] Time spent T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:27:51.989284 14493 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:51.993737 14475 consensus_meta.cc:287] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.553s	user 0.007s	sys 0.001s
I20260709 12:27:51.893368 14503 consensus_queue.cc:1059] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 9, Time since last communication: 0.110s
I20260709 12:27:51.799105 14439 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:27:51.916193 14472 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:51.845966 14320 consensus_meta.cc:287] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.001s
W20260709 12:27:52.306355 14457 consensus_meta.cc:287] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.826s	user 0.010s	sys 0.000s
W20260709 12:27:52.323977  9927 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.000s	sys 0.016s
W20260709 12:27:52.324470  9927 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.000s	sys 0.016s
W20260709 12:27:52.324786  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 710964us
I20260709 12:27:52.309154 14320 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:52.328245 14486 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:52.333974 14320 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:52.350420 14493 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:51.890419 10496 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:52.353221 14439 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:27:52.353370 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 463035us
I20260709 12:27:52.354158 10496 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:52.354882 14439 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:52.357679 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:52.358127 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:51.858166  9985 debug-util.cc:398] Leaking SignalData structure 0x7b0800326f20 after lost signal to thread 9914
I20260709 12:27:52.327320 14457 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:52.306116 14475 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:52.361218 14293 consensus_meta.cc:287] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.771s	user 0.007s	sys 0.000s
I20260709 12:27:52.232635 14414 raft_consensus.cc:697] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:52.398185 14292 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:52.404500 14493 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:27:52.457118  9930 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.998s	user 0.013s	sys 0.007s
W20260709 12:27:52.644797  9930 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.186s	user 0.014s	sys 0.008s
I20260709 12:27:52.636076  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:52.645413  9960 raft_consensus.cc:1240] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:52.637156  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:52.151582 14480 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:52.644054 10527 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 5.
W20260709 12:27:52.458088 10497 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.009s	sys 0.024s
I20260709 12:27:52.646451  9964 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:27:52.639680 14507 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:52.642688 14199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.010s	sys 0.029s
I20260709 12:27:52.648370  9961 raft_consensus.cc:1240] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:52.579234 14446 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:52.650712 10497 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.098s	user 0.009s	sys 0.024s
I20260709 12:27:52.650899 14424 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:52.653273 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 1.10146e+06us
W20260709 12:27:52.655987 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:52.656296 10497 leader_election.cc:336] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.853s (SENT)
W20260709 12:27:52.659144 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:52.659600 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:52.661083  9928 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.004s	sys 0.013s
W20260709 12:27:52.661432  9928 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.004s	sys 0.013s
W20260709 12:27:52.653281 14199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.010s	sys 0.029s
W20260709 12:27:52.661993  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 916427us
I20260709 12:27:52.665076  9928 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:52.667042 14439 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:52.652290 14507 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:52.670089 10530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 1135) took 1198 ms. Trace:
W20260709 12:27:52.670387 10498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.012s	sys 0.010s
I20260709 12:27:52.657392 14424 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:52.647200 14493 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:52.666707 14442 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.092s	user 0.022s	sys 0.081s
I20260709 12:27:52.674247 14507 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:52.674768 14457 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:52.703342 14442 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.022s	sys 0.081s
I20260709 12:27:52.704586 14507 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:27:52.705454 10525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 1077) took 1401 ms. Trace:
I20260709 12:27:52.705720 10525 rpcz_store.cc:276] 0709 12:27:51.304339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:51.304473 (+   134us) service_pool.cc:224] Handling call
0709 12:27:52.705297 (+1400824us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b5400705154. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:52.705388 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":609440640}
I20260709 12:27:52.701511 14294 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:52.693926 14473 consensus_meta.cc:287] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.942s	user 0.010s	sys 0.000s
I20260709 12:27:52.707334 10525 raft_consensus.cc:1240] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:52.707104 14294 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:52.708045 10525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 1138) took 1221 ms. Trace:
I20260709 12:27:52.708413 10525 rpcz_store.cc:276] 0709 12:27:51.486238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:52.706597 (+1220359us) service_pool.cc:224] Handling call
0709 12:27:52.707171 (+   574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:52.707822 (+   651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:52.707997 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:52.709039 14493 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:52.709175 14294 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:52.679684 14475 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:52.672362 14509 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.715454 14509 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:52.717510 14480 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:52.718498 14509 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:52.959964 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:52.960872 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:52.666234 14199 raft_consensus.cc:697] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:53.138525 14199 consensus_queue.cc:237] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:53.161859 14423 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.162636 14423 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:53.165279 14423 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:53.839120 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:53.840422 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:54.261165 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:54.321141 10497 connection.cc:256] RPC call timeout handler was delayed by -1.4951500459997078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
W20260709 12:27:54.322304 10497 leader_election.cc:336] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.805s (SENT)
W20260709 12:27:54.324898 10497 leader_election.cc:336] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.928s (SENT)
I20260709 12:27:54.325513 10497 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
W20260709 12:27:54.547212 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 222414us
W20260709 12:27:54.550556 10497 leader_election.cc:336] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 2.053s (SENT)
I20260709 12:27:54.551128 10497 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:27:54.554477 14199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.003s	sys 0.006s
W20260709 12:27:54.554945 14199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.003s	sys 0.006s
I20260709 12:27:54.555914 14199 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:27:54.554731 10497 leader_election.cc:336] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 2.214s (SENT)
W20260709 12:27:54.556887  9930 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.907s	user 0.003s	sys 0.027s
I20260709 12:27:54.556933 14199 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:54.557714  9930 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.908s	user 0.004s	sys 0.028s
I20260709 12:27:51.250797  9701 maintenance_manager.cc:643] P 9af5d83221164294aea87056091c2259: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 13.219s	user 0.232s	sys 0.116s Metrics: {"bytes_written":29456,"cfile_init":1,"dirs.queue_time_us":136936,"dirs.run_cpu_time_us":567,"dirs.run_wall_time_us":80530,"drs_written":1,"lbm_read_time_us":16099,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":2,"lbm_write_time_us":137756,"lbm_writes_10-100_ms":5,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"rows_written":63,"thread_start_us":103059,"threads_started":2,"wal-append.queue_time_us":818,"wal-append.run_cpu_time_us":401,"wal-append.run_wall_time_us":1000416}
I20260709 12:27:54.571684  9702 maintenance_manager.cc:419] P 9af5d83221164294aea87056091c2259: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10439 bytes on disk
I20260709 12:27:54.575328  9701 maintenance_manager.cc:643] P 9af5d83221164294aea87056091c2259: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":614,"lbm_reads_lt_1ms":4}
I20260709 12:27:54.558102 14199 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.560693 14442 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:54.589949 14442 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.589980 14456 raft_consensus.cc:3055] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:27:54.590709 14456 raft_consensus.cc:740] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:54.590940 14442 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.592454 14456 consensus_queue.cc:260] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:54.576017 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 297152us
W20260709 12:27:54.560099 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:54.595080 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:54.595703 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:54.597857 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:54.599098 14442 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:54.599886 14442 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.600915 14442 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.605546 14442 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:54.606230 14442 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:54.607535 14293 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.607203 14442 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.608474 14293 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.610533 14442 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:54.603003  9956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 882) took 2185 ms. Trace:
I20260709 12:27:54.603469 14199 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:27:54.587250 14518 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:54.594122 14456 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:54.635830 14518 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.639073 14518 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:54.625655 10528 raft_consensus.cc:1240] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 13. Current term is 14. Ops: []
I20260709 12:27:54.630867 14476 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:54.641759 14476 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.644246 14476 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:54.616138 14293 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:54.645359 10528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 1140) took 3158 ms. Trace:
I20260709 12:27:54.645875 10528 rpcz_store.cc:276] 0709 12:27:51.486823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:54.622074 (+3135251us) service_pool.cc:224] Handling call
0709 12:27:54.625052 (+  2978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:54.640796 (+ 15744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:54.645262 (+  4466us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:54.635314  9956 rpcz_store.cc:276] 0709 12:27:52.417335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:52.417498 (+   163us) service_pool.cc:224] Handling call
0709 12:27:52.417883 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:54.601120 (+2183237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:54.601166 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:54.601225 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:54.601256 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:54.602492 (+  1236us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b54000898d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:54.602533 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:54.602761 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5019537792}
I20260709 12:27:54.649070 14293 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:54.651309  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 3.34854e+06us
W20260709 12:27:54.654935  9854 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.357s	user 0.042s	sys 0.048s
W20260709 12:27:54.658754  9854 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.361s	user 0.042s	sys 0.049s
I20260709 12:27:54.650127 14293 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:54.667876  9985 debug-util.cc:398] Leaking SignalData structure 0x7b080041b1a0 after lost signal to thread 9988
W20260709 12:27:54.668318  9985 debug-util.cc:398] Leaking SignalData structure 0x7b08003ad920 after lost signal to thread 9989
I20260709 12:27:54.671060 14521 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.671880 14521 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:54.674707 14521 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:54.685322 10497 leader_election.cc:336] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.518s (SENT)
I20260709 12:27:54.685961 14521 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:27:54.684108  9854 connection.cc:256] RPC call timeout handler was delayed by -2.2829377309999472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 12:27:54.691267 10497 leader_election.cc:336] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.751s (SENT)
W20260709 12:27:54.693089 10533 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 1137) took 3207 ms (client timeout 2028 ms). Trace:
W20260709 12:27:54.694995  9854 connection.cc:256] RPC call timeout handler was delayed by -2.0678377310000542s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 12:27:54.696470  9854 connection.cc:256] RPC call timeout handler was delayed by -1.8275377310001204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2069s for a response
W20260709 12:27:54.696905  9854 connection.cc:256] RPC call timeout handler was delayed by -1.755537731000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
I20260709 12:27:54.702696 14293 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:54.705225  9928 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.039s	user 0.028s	sys 0.075s
I20260709 12:27:54.706691 14456 consensus_queue.cc:1059] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:27:54.693570 10533 rpcz_store.cc:269] 0709 12:27:51.485918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:54.692545 (+3206627us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:54.692764 (+   219us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:54.709089  9928 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.043s	user 0.029s	sys 0.076s
I20260709 12:27:54.711314 14441 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:54.712219 14441 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:54.714944  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 2.04969e+06us
W20260709 12:27:52.691557 14283 consensus_meta.cc:287] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.724s	user 0.004s	sys 0.005s
I20260709 12:27:54.727447 14283 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.758098 14283 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:54.761827 14499 raft_consensus.cc:3055] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:54.762382 14499 raft_consensus.cc:740] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:54.763859 14499 consensus_queue.cc:260] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.765375 14499 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:54.719424 14293 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:54.729532 14441 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:54.732939 14424 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:54.744541 14384 raft_consensus.cc:3055] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:54.747157  9853 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:54.772097 14384 raft_consensus.cc:740] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:54.753180 14292 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:54.753857  9811 raft_consensus.cc:1240] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:54.774524  9811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2799) took 3465 ms. Trace:
I20260709 12:27:54.773790 14384 consensus_queue.cc:260] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.774981  9811 rpcz_store.cc:276] 0709 12:27:51.309489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:51.309655 (+   166us) service_pool.cc:224] Handling call
0709 12:27:54.753454 (+3443799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:54.774104 (+ 20650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:54.774382 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:54.775728 14384 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:54.754899 14402 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:54.777446 14488 log.cc:927] Time spent T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 3.421s	user 0.022s	sys 0.024s
I20260709 12:27:54.720634  9928 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:27:54.780938  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 60605.8us
W20260709 12:27:54.781606 10524 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 842) took 3683 ms (client timeout 3260 ms). Trace:
I20260709 12:27:54.781443 14293 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.785638 14293 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:54.786873 14519 raft_consensus.cc:2804] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:27:54.782157 10524 rpcz_store.cc:269] 0709 12:27:51.097662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:51.097792 (+   130us) service_pool.cc:224] Handling call
0709 12:27:54.781074 (+3683282us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54003d18d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:54.781352 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":790973184}
I20260709 12:27:54.789690 14519 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:54.790177 14519 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:54.791481  9806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 814) took 3728 ms. Trace:
W20260709 12:27:54.791599 10531 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 847) took 3457 ms (client timeout 3971 ms). Trace:
W20260709 12:27:54.792104 10531 rpcz_store.cc:269] 0709 12:27:51.334042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:51.334960 (+   918us) service_pool.cc:224] Handling call
0709 12:27:54.791148 (+3456188us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54002ed454. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:54.791415 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495816576}
I20260709 12:27:54.791940  9806 rpcz_store.cc:276] 0709 12:27:51.062932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:51.063038 (+   106us) service_pool.cc:224] Handling call
0709 12:27:51.063406 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:51.084278 (+ 20872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:51.084308 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:51.084651 (+   343us) log.cc:844] Serialized 26 byte log entry
0709 12:27:51.293803 (+209152us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:51.294074 (+   271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:51.294322 (+   248us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:54.776401 (+3482079us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:54.790915 (+ 14514us) raft_consensus.cc:1685] finished
0709 12:27:54.790944 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:54.791266 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7971,"raft.queue_time_us":20598,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":12148,"spinlock_wait_cycles":5434752,"thread_start_us":207885,"threads_started":1,"wal-append.queue_time_us":271263}
W20260709 12:27:54.795181  9927 connection.cc:256] RPC call timeout handler was delayed by -2.0790655369996784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
I20260709 12:27:52.675738 14414 consensus_queue.cc:237] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.832859  9960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 886) took 2357 ms. Trace:
W20260709 12:27:52.671741 10498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.013s	sys 0.010s
I20260709 12:27:54.835162 14519 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:54.840140 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:54.840073  9961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 885) took 2365 ms. Trace:
W20260709 12:27:54.841550 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:54.842860 14443 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:54.840857  9961 rpcz_store.cc:276] 0709 12:27:52.474795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:52.474994 (+   199us) service_pool.cc:224] Handling call
0709 12:27:52.636831 (+161837us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:52.652924 (+ 16093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:54.839443 (+2186519us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b54003372d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:54.839842 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26013568}
I20260709 12:27:54.836867  9960 rpcz_store.cc:276] 0709 12:27:52.475179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:52.475292 (+   113us) service_pool.cc:224] Handling call
0709 12:27:52.636389 (+161097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:52.647456 (+ 11067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:54.832109 (+2184653us) spinlock_profiling.cc:243] Waited 8.84 ms on lock 0x7b54003b8154. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:54.832587 (+   478us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20337408}
W20260709 12:27:54.836817  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 99650.1us
W20260709 12:27:54.848021  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 52176.9us
W20260709 12:27:54.850806  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 103941us
W20260709 12:27:54.852394  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:54.853030  9927 connection.cc:256] RPC call timeout handler was delayed by -1.8477655369997592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1888s for a response
W20260709 12:27:54.853567  9927 connection.cc:256] RPC call timeout handler was delayed by -1.6407655369998793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
W20260709 12:27:54.854035  9927 connection.cc:256] RPC call timeout handler was delayed by -1.5444655369997236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22250000000000003s for a response
W20260709 12:27:54.856256 10497 leader_election.cc:336] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.878s (SENT)
I20260709 12:27:54.858266 14476 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.859184 14476 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.860549 14457 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.861308 14457 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.861677  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:54.862224  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:54.862430  9960 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:54.865944 14518 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.869268 14518 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:54.870047 14528 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:54.870573 14528 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:54.870952 14528 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:54.871202 14519 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:54.871665 14518 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:54.872545  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:54.872761  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 784) took 4653 ms. Trace:
I20260709 12:27:54.873636  9956 raft_consensus.cc:2410] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:27:54.875167  9961 raft_consensus.cc:1240] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:27:54.875502 14292 consensus_queue.cc:1059] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:27:54.876808 14292 consensus_queue.cc:1059] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:54.877188 14441 raft_consensus.cc:3055] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:54.877660 14441 raft_consensus.cc:740] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:54.861750 14476 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:54.878360 14293 raft_consensus.cc:3055] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:54.878862 14293 raft_consensus.cc:740] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:54.879070 14441 consensus_queue.cc:260] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.880831 14441 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:54.880136 14293 consensus_queue.cc:260] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.882239 14293 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:54.883708 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:54.885182 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:54.876972 14457 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:54.886545 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:54.886957 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:54.887794 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:54.888350 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:54.889201 10528 raft_consensus.cc:2393] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 11: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:54.889249 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:54.890338 10526 raft_consensus.cc:2393] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 13: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:54.886751  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:54.895126  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:54.895430  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:54.896057  9957 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:27:54.888055 10531 raft_consensus.cc:2393] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 10: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:54.896559  9963 raft_consensus.cc:2393] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:54.897127  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:54.897792  9957 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:54.873348  9808 rpcz_store.cc:276] 0709 12:27:50.219029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.551780 (+332751us) service_pool.cc:224] Handling call
0709 12:27:50.551942 (+   162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:50.565352 (+ 13410us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:27:50.573037 (+  7685us) log.cc:844] Serialized 14 byte log entry
0709 12:27:50.608398 (+ 35361us) log.cc:844] Serialized 14 byte log entry
0709 12:27:50.608957 (+   559us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:50.609017 (+    60us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:50.609151 (+   134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:54.872207 (+4263056us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b540033e354. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:54.872289 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:54.872525 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8070,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":1074,"raft.queue_time_us":120,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":30347648,"thread_start_us":34534,"threads_started":1,"wal-append.queue_time_us":34900,"wal-append.run_cpu_time_us":1721,"wal-append.run_wall_time_us":1003245}
W20260709 12:27:54.886749  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:54.906226  9957 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:54.896070  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:54.906726  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:54.911798  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 44555.7us
I20260709 12:27:54.914949  9956 raft_consensus.cc:2393] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:27:54.915293  9955 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 858) took 4036 ms (client timeout 1609 ms). Trace:
W20260709 12:27:54.915863  9928 connection.cc:256] RPC call timeout handler was delayed by -2.1637064169999576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.193s for a response
W20260709 12:27:54.915829  9955 rpcz_store.cc:269] 0709 12:27:50.878907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.883562 (+  4655us) service_pool.cc:224] Handling call
0709 12:27:54.914882 (+4031320us) spinlock_profiling.cc:243] Waited 963 us on lock 0x7b5400242554. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:54.915077 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2214272}
W20260709 12:27:54.898084 10527 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 1070) took 3819 ms (client timeout 1655 ms). Trace:
I20260709 12:27:54.917083  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:54.917490 10527 rpcz_store.cc:269] 0709 12:27:51.078427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:51.079193 (+   766us) service_pool.cc:224] Handling call
0709 12:27:54.897726 (+3818533us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54005c4254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:54.897896 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3379032960}
W20260709 12:27:54.918949 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:54.920804  9959 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:27:54.922573 14518 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.923471 14518 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:54.923978  9853 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:54.926412 14476 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.935001 14476 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.936156 14292 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:54.936985  9911 debug-util.cc:398] Leaking SignalData structure 0x7b08003eb300 after lost signal to thread 8640
I20260709 12:27:54.936717 14292 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.937402 14476 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:54.926138 14518 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:54.931035  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2800) took 3618 ms. Trace:
I20260709 12:27:54.933724 14528 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.938326  9813 rpcz_store.cc:276] 0709 12:27:51.312567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:51.313050 (+   483us) service_pool.cc:224] Handling call
0709 12:27:51.314075 (+  1025us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:51.314532 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:51.314574 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:51.315133 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 12:27:54.862804 (+3547671us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:54.862887 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:54.863080 (+   193us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:54.930736 (+ 67656us) raft_consensus.cc:1685] finished
0709 12:27:54.930754 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:54.930874 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8246,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":1490,"thread_start_us":44422,"threads_started":1,"wal-append.queue_time_us":116311}
W20260709 12:27:54.916438  9928 connection.cc:256] RPC call timeout handler was delayed by -2.0818064169998252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
I20260709 12:27:54.940078  9854 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:54.940361  9928 connection.cc:256] RPC call timeout handler was delayed by -1.5117569369999728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2028s for a response
W20260709 12:27:54.941243  9928 connection.cc:256] RPC call timeout handler was delayed by -1.5117569369999728s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2028s for a response
W20260709 12:27:54.941570  9928 connection.cc:256] RPC call timeout handler was delayed by -1.4662064170001941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2705s for a response
I20260709 12:27:54.944674  9960 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:27:54.938056 14534 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:54.945812 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:54.948146 10496 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:54.948870  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:54.949498 10496 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:54.951494  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:54.952111 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:54.952675 10531 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:54.951912 14443 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:54.945927 14534 consensus_queue.cc:1059] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:27:54.952350  9960 raft_consensus.cc:2376] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13. Re-sending same reply.
I20260709 12:27:54.958854 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:52.661000 14446 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.954363 14402 consensus_queue.cc:1059] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:27:54.958664 14443 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:54.968981  9810 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.719s	user 0.047s	sys 0.068s
I20260709 12:27:52.670729 10530 rpcz_store.cc:276] 0709 12:27:51.471932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:51.904459 (+432527us) service_pool.cc:224] Handling call
0709 12:27:51.904861 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:51.905118 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:27:52.643219 (+738101us) log.cc:844] Serialized 14 byte log entry
0709 12:27:52.669770 (+ 26551us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:52.669818 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:52.669864 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:52.669925 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:52.670036 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":637711,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":810,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":13592,"spinlock_wait_cycles":9083402752,"thread_start_us":363563,"threads_started":2,"wal-append.queue_time_us":73200}
I20260709 12:27:54.973901 10531 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:54.974895  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:54.981307  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:54.982678  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:54.987116 14490 raft_consensus.cc:3055] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:27:54.987540 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:54.988530 10528 raft_consensus.cc:2410] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:27:54.984663 14443 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:54.988901  9810 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.801s	user 0.048s	sys 0.068s
I20260709 12:27:54.987546 14490 raft_consensus.cc:740] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:54.989953  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 811) took 4018 ms. Trace:
I20260709 12:27:54.979421 14528 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:54.994674 14414 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:54.994897 10527 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:27:54.999402 14414 raft_consensus.cc:697] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:55.000574 14414 consensus_queue.cc:237] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.995146 14523 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:54.988538 14446 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:55.006384 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:54.990401  9810 rpcz_store.cc:276] 0709 12:27:50.971739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.983302 (+ 11563us) service_pool.cc:224] Handling call
0709 12:27:50.983575 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:50.983897 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:50.983923 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:51.079955 (+ 96032us) log.cc:844] Serialized 26 byte log entry
0709 12:27:54.989470 (+3909515us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:54.989527 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:54.989652 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:54.989716 (+    64us) raft_consensus.cc:1685] finished
0709 12:27:54.989732 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:54.989903 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9484,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":14170,"thread_start_us":3801445,"threads_started":1,"wal-append.queue_time_us":178677,"wal-append.run_cpu_time_us":2947,"wal-append.run_wall_time_us":1285947}
W20260709 12:27:54.995707  9927 leader_election.cc:336] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 1.631s (SENT)
I20260709 12:27:55.009480  9927 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:55.011265 14503 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:55.011281 10496 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:54.992949 14490 consensus_queue.cc:260] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.014178 14490 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:55.014443 14446 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:27:55.014792  9985 debug-util.cc:398] Leaking SignalData structure 0x7b08003b34a0 after lost signal to thread 10557
I20260709 12:27:55.014971 14446 raft_consensus.cc:697] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:55.016185 14446 consensus_queue.cc:237] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:54.981283  9928 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:55.018854 14503 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:55.020227 14503 consensus_queue.cc:1059] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:27:55.020574 14518 consensus_queue.cc:1059] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:27:55.021864 14476 raft_consensus.cc:3055] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:27:55.022358 14476 raft_consensus.cc:740] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:55.023391 14476 consensus_queue.cc:260] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.024801 14476 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:55.021937 14469 raft_consensus.cc:3055] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:55.026410 14469 raft_consensus.cc:740] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:27:55.027900  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.027627 14469 consensus_queue.cc:260] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.029023 14469 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:55.029711  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:55.030341  9960 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
W20260709 12:27:55.031725 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.034679 10533 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:27:55.036550 10524 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
W20260709 12:27:55.039710 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:55.041333 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:55.043984 10496 leader_election.cc:336] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 1.988s (SENT)
I20260709 12:27:55.044777  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1711) took 4069 ms. Trace:
I20260709 12:27:55.045166  9959 rpcz_store.cc:276] 0709 12:27:50.975512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.979852 (+  4340us) service_pool.cc:224] Handling call
0709 12:27:54.920047 (+3940195us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:54.921358 (+  1311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:55.044557 (+123199us) spinlock_profiling.cc:243] Waited 3.94 s on lock 0x7b5400242550. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:55.044722 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9060571904}
I20260709 12:27:55.049211 14292 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:55.056962  9964 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
W20260709 12:27:55.057789  9964 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 884) took 2639 ms (client timeout 1908 ms). Trace:
W20260709 12:27:55.058249  9964 rpcz_store.cc:269] 0709 12:27:52.418735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:52.636905 (+218170us) service_pool.cc:224] Handling call
0709 12:27:55.057676 (+2420771us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:55.064643 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:55.069937 10496 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:55.071022 14497 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:55.071069 14347 raft_consensus.cc:3055] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:55.071501 14497 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:55.071568 14347 raft_consensus.cc:740] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:55.071990 14497 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:55.072669 14347 consensus_queue.cc:260] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.073685 14347 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:55.076006  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.077458  9813 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
W20260709 12:27:55.077924 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:55.078639  9927 leader_election.cc:336] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 2.225s (SENT)
I20260709 12:27:55.079174  9927 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:55.080000 14518 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.080653 14518 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:55.084556  9964 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:55.084781  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.085650  9815 raft_consensus.cc:2393] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 13: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:55.086544  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:55.087231  9806 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:55.087693 14503 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:55.087561 14292 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:55.089033 14518 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:55.090943  9811 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:55.091689 14523 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:55.092305  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.093216  9809 raft_consensus.cc:2410] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:27:55.082033 14410 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.096997 14410 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:52.707352 14473 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.101274 14473 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:55.104400  9911 debug-util.cc:398] Leaking SignalData structure 0x7b080036d3a0 after lost signal to thread 9747
I20260709 12:27:55.104254  9961 raft_consensus.cc:1240] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:55.079802 14443 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:55.106178  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.109051  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:55.110289  9811 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:27:55.110833  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.110973  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.111820  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:55.114621 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.118201  9806 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
W20260709 12:27:55.118884  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 53085.1us
W20260709 12:27:55.120682 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.124336  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.131244 14410 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:55.131505  9812 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:55.138722 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:55.143170  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.142607  9808 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:55.142772  9815 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
W20260709 12:27:55.146432  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.143682  9814 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:27:55.144824  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:55.146855  9779 connection.cc:256] RPC call timeout handler was delayed by -3.0285067099998741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
W20260709 12:27:55.147195  9779 connection.cc:256] RPC call timeout handler was delayed by -3.0276067099998727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
W20260709 12:27:55.148551  9779 connection.cc:256] RPC call timeout handler was delayed by -2.9574067100002139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
W20260709 12:27:55.148756  9779 connection.cc:256] RPC call timeout handler was delayed by -2.9550840730003074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260709 12:27:55.148923  9779 connection.cc:256] RPC call timeout handler was delayed by -2.945706710000195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
W20260709 12:27:55.149082  9779 connection.cc:256] RPC call timeout handler was delayed by -2.9388840730002812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 12:27:55.149230  9779 connection.cc:256] RPC call timeout handler was delayed by -2.9316840730002696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 12:27:55.149394  9779 connection.cc:256] RPC call timeout handler was delayed by -2.9316840730002696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 12:27:55.149542  9779 connection.cc:256] RPC call timeout handler was delayed by -2.925906710000163s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1773s for a response
W20260709 12:27:55.149689  9779 connection.cc:256] RPC call timeout handler was delayed by -2.9001840730002186s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
W20260709 12:27:55.149840  9779 connection.cc:256] RPC call timeout handler was delayed by -2.9001840730002186s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
W20260709 12:27:55.150009  9779 connection.cc:256] RPC call timeout handler was delayed by -2.8287067100000058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
W20260709 12:27:55.150156  9779 connection.cc:256] RPC call timeout handler was delayed by -2.7462840730004245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
W20260709 12:27:55.150384  9779 connection.cc:256] RPC call timeout handler was delayed by -2.7219840730003853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 12:27:55.150837  9779 connection.cc:256] RPC call timeout handler was delayed by -2.7153067099998225s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
W20260709 12:27:55.151131  9779 connection.cc:256] RPC call timeout handler was delayed by -2.649606710000171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
W20260709 12:27:55.151437  9779 connection.cc:256] RPC call timeout handler was delayed by -2.6256840730002295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
W20260709 12:27:55.151713  9779 connection.cc:256] RPC call timeout handler was delayed by -2.6256840730002295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
I20260709 12:27:55.148075 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:55.120924 14497 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.152189  9813 raft_consensus.cc:1240] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:55.152645  9806 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
W20260709 12:27:55.152486  9779 connection.cc:256] RPC call timeout handler was delayed by -2.6121840730002077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
I20260709 12:27:55.155860  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:55.156121  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.157686 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:55.152843  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:55.158058 14448 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.152132 14539 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:55.159373  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:55.162514 14538 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.150550 14473 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:55.165367  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.166015  9812 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
W20260709 12:27:55.166653 10532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 853) took 3701 ms (client timeout 1709 ms). Trace:
I20260709 12:27:55.193315  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.170516  9964 raft_consensus.cc:1240] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:27:55.173260  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:55.174211  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:55.180001  9911 debug-util.cc:398] Leaking SignalData structure 0x7b08003d9800 after lost signal to thread 9839
I20260709 12:27:55.180099 14435 raft_consensus.cc:3055] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:27:55.208401  9911 debug-util.cc:398] Leaking SignalData structure 0x7b08003667c0 after lost signal to thread 9840
I20260709 12:27:55.208535 14435 raft_consensus.cc:740] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:55.209884  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.210626  9814 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:27:55.210021 14435 consensus_queue.cc:260] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.210892  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.211474 14435 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:55.188028  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:55.182452  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.188472  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:55.189302  9884 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
W20260709 12:27:55.189100 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.192876  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.198472 10531 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:55.194900  9928 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:55.198654  9779 connection.cc:256] RPC call timeout handler was delayed by -2.597162453999772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
W20260709 12:27:55.213871  9779 connection.cc:256] RPC call timeout handler was delayed by -2.5884067100000721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21480000000000002s for a response
I20260709 12:27:55.198454  9808 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:55.199110  9962 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
W20260709 12:27:55.214351  9779 connection.cc:256] RPC call timeout handler was delayed by -2.5833840730001612s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260709 12:27:55.207388 10532 rpcz_store.cc:269] 0709 12:27:51.465139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:51.465293 (+   154us) service_pool.cc:224] Handling call
0709 12:27:55.166159 (+3700866us) spinlock_profiling.cc:243] Waited 73 ms on lock 0x7b54006801d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:55.166413 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167948672}
W20260709 12:27:55.215183  9779 connection.cc:256] RPC call timeout handler was delayed by -2.5551067100000182s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 12:27:55.215821  9779 connection.cc:256] RPC call timeout handler was delayed by -2.5551067100000182s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
I20260709 12:27:55.216120  9809 raft_consensus.cc:2393] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 13: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
W20260709 12:27:55.216264  9779 connection.cc:256] RPC call timeout handler was delayed by -2.5203840730000593s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2002s for a response
W20260709 12:27:55.216771  9779 connection.cc:256] RPC call timeout handler was delayed by -2.4501840730004005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
W20260709 12:27:55.217167  9779 connection.cc:256] RPC call timeout handler was delayed by -2.4291067099998145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23250000000000004s for a response
W20260709 12:27:55.217540  9779 connection.cc:256] RPC call timeout handler was delayed by -2.4291067099998145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23250000000000004s for a response
W20260709 12:27:55.217917  9779 connection.cc:256] RPC call timeout handler was delayed by -2.4164526429999569s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
I20260709 12:27:55.212414  9884 pending_rounds.cc:85] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 8
I20260709 12:27:55.221522  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:55.221745 14539 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.222615  9882 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:55.224170 14539 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:55.224948 14539 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.225468 14539 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.168262 10525 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 14. Current term is 15. Ops: []
I20260709 12:27:55.222236  9887 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:55.227217  9813 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:55.230647  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.231395  9885 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:27:55.232214  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:55.203390  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 263363us
I20260709 12:27:55.232858  9885 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:55.233456  9854 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:55.233675  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.234361  9886 raft_consensus.cc:2393] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:55.234624  9854 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:55.235287  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.235934  9854 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:55.236470  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.237653  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.238657 14443 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:55.239804  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:55.240422  9890 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:55.218806 14448 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.243501  9887 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:55.254455  9854 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:55.245136  9882 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:55.211560  9806 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:27:55.255510 14521 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:55.246356 10529 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:27:55.247457 14456 raft_consensus.cc:3055] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:55.256328  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.256618 14456 raft_consensus.cc:740] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:55.256971  9887 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:27:55.257871  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.257649 14456 consensus_queue.cc:260] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.258508  9887 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:27:55.258993 14456 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:55.247571  9911 debug-util.cc:398] Leaking SignalData structure 0x7b080011c720 after lost signal to thread 9914
W20260709 12:27:55.262557  9911 debug-util.cc:398] Leaking SignalData structure 0x7b08002fbea0 after lost signal to thread 9915
W20260709 12:27:55.263895  9911 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9400 after lost signal to thread 9988
W20260709 12:27:55.264204  9911 debug-util.cc:398] Leaking SignalData structure 0x7b08000f2d80 after lost signal to thread 9989
W20260709 12:27:55.265566  9911 debug-util.cc:398] Leaking SignalData structure 0x7b08003f7300 after lost signal to thread 10557
I20260709 12:27:55.218681 14541 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:55.233397  9856 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.983s	user 0.020s	sys 0.035s
I20260709 12:27:55.250308 10525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 1139) took 3763 ms. Trace:
I20260709 12:27:55.252318 14527 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:27:55.252791 14490 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:55.254645  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:55.266551 14541 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:55.267398  9964 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:55.219746  9884 pending_rounds.cc:107] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 14.9
W20260709 12:27:55.245321  9779 connection.cc:256] RPC call timeout handler was delayed by -2.386920051999823s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260709 12:27:55.262032 10529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 1126) took 4199 ms (client timeout 1930 ms). Trace:
I20260709 12:27:55.266654 10525 rpcz_store.cc:276] 0709 12:27:51.486544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:52.712570 (+1226026us) service_pool.cc:224] Handling call
0709 12:27:55.167834 (+2455264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:55.226520 (+ 58686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:55.249899 (+ 23379us) spinlock_profiling.cc:243] Waited 2.45 s on lock 0x7b54006801d0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:55.250023 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5645682560}
I20260709 12:27:55.268168  9884 raft_consensus.cc:2889] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:55.268222  9779 connection.cc:256] RPC call timeout handler was delayed by -2.3823067100001936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2377s for a response
W20260709 12:27:55.268671  9779 connection.cc:256] RPC call timeout handler was delayed by -2.3823067100001936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2377s for a response
W20260709 12:27:55.269076  9779 connection.cc:256] RPC call timeout handler was delayed by -2.3664840730002652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
W20260709 12:27:55.269387  9779 connection.cc:256] RPC call timeout handler was delayed by -2.2342824749998726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 12:27:55.269909  9779 connection.cc:256] RPC call timeout handler was delayed by -2.1555067099998269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2629s for a response
I20260709 12:27:55.269315  9712 catalog_manager.cc:5697] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:55.270473  9881 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:27:55.271530  9712 catalog_manager.cc:5697] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:55.273428  9712 catalog_manager.cc:5697] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 6 to 7, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 7 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:55.213178 14473 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:55.274453 14473 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:55.268309 10529 rpcz_store.cc:269] 0709 12:27:51.062912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:51.064072 (+  1160us) service_pool.cc:224] Handling call
0709 12:27:55.261807 (+4197735us) spinlock_profiling.cc:243] Waited 4.07 s on lock 0x7b54005c12d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:55.261934 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9362843904}
I20260709 12:27:55.277634 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:55.278319 14443 consensus_queue.cc:1059] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:55.280802 14292 raft_consensus.cc:3055] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:55.281209 14292 raft_consensus.cc:740] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:27:55.282210  9710 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59972 (request call id 305) took 20462 ms (client timeout 15000 ms). Trace:
I20260709 12:27:55.282375 14292 consensus_queue.cc:260] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.282903 14473 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.283774 14292 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:55.284574  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.285017 14473 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:55.286166  9964 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
W20260709 12:27:55.270186  9779 connection.cc:256] RPC call timeout handler was delayed by -2.1456067099998108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.264s for a response
W20260709 12:27:55.287376  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 70734.3us
I20260709 12:27:55.221442  9883 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:55.288671 14521 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:55.289062 14521 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:55.289424 14521 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:55.290249 10496 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:55.316701  9815 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:55.309250  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:55.287350  9779 connection.cc:256] RPC call timeout handler was delayed by -2.1074663560002591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2169s for a response
W20260709 12:27:55.333545  9779 connection.cc:256] RPC call timeout handler was delayed by -2.0508085080000455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
W20260709 12:27:55.333959  9779 connection.cc:256] RPC call timeout handler was delayed by -1.9038840730004267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2687s for a response
W20260709 12:27:55.334353  9779 connection.cc:256] RPC call timeout handler was delayed by -1.8531067099997927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2965s for a response
W20260709 12:27:55.334751  9779 connection.cc:256] RPC call timeout handler was delayed by -1.78512942999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2784s for a response
W20260709 12:27:55.335439 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:55.307636  9853 connection.cc:256] RPC call timeout handler was delayed by -2.8042932310004289s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
W20260709 12:27:55.336400  9853 connection.cc:256] RPC call timeout handler was delayed by -2.713393231000282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
W20260709 12:27:55.336814  9853 connection.cc:256] RPC call timeout handler was delayed by -2.6692932310002107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.165s for a response
W20260709 12:27:55.337184  9853 connection.cc:256] RPC call timeout handler was delayed by -2.395693231000223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
W20260709 12:27:55.337555  9853 connection.cc:256] RPC call timeout handler was delayed by -2.3146932310005468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 12:27:55.337942  9853 connection.cc:256] RPC call timeout handler was delayed by -2.2903932310005075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
W20260709 12:27:55.335116  9779 connection.cc:256] RPC call timeout handler was delayed by -1.5876067099998181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.326s for a response
W20260709 12:27:55.342564  9779 connection.cc:256] RPC call timeout handler was delayed by -1.5876067099998181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.326s for a response
W20260709 12:27:55.343434  9779 connection.cc:256] RPC call timeout handler was delayed by -1.3999294299997018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32120000000000004s for a response
W20260709 12:27:55.338322  9853 connection.cc:256] RPC call timeout handler was delayed by -2.17429323100032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
W20260709 12:27:55.344775  9853 connection.cc:256] RPC call timeout handler was delayed by -1.697293231000458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.273s for a response
I20260709 12:27:55.350960  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:55.355221  9883 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:27:55.324421  9712 catalog_manager.cc:5697] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 5 to 6, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 6 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:55.299999  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.356460  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:55.360184  9962 raft_consensus.cc:2393] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 13: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:55.361413  9890 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:27:55.362442  9882 raft_consensus.cc:1240] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:55.358980  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:55.363044  9856 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.113s	user 0.020s	sys 0.036s
I20260709 12:27:55.365782  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:55.316483 14497 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:55.326924 14472 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:55.291273 14439 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:55.292029 14443 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:55.367547  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.290740 14541 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:55.307185 14448 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:55.375396  9778 connection.cc:256] RPC call timeout handler was delayed by -2.748374323000462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 12:27:55.374053  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:55.377856  9778 connection.cc:256] RPC call timeout handler was delayed by -2.7321743230004358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 12:27:55.378362  9778 connection.cc:256] RPC call timeout handler was delayed by -2.6934743230003733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15800000000000003s for a response
W20260709 12:27:55.378700  9778 connection.cc:256] RPC call timeout handler was delayed by -2.6223743230002583s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
I20260709 12:27:55.378763  9808 raft_consensus.cc:2410] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:27:55.379074  9778 connection.cc:256] RPC call timeout handler was delayed by -2.6214743230002568s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
I20260709 12:27:55.376186  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.375010  9890 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:55.379453  9778 connection.cc:256] RPC call timeout handler was delayed by -2.5773743230001855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
W20260709 12:27:55.380590  9778 connection.cc:256] RPC call timeout handler was delayed by -2.5512743230005981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1738s for a response
I20260709 12:27:55.297194 14521 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:55.381002  9778 connection.cc:256] RPC call timeout handler was delayed by -2.5287743230005617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1763s for a response
I20260709 12:27:55.380817  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:55.381531  9778 connection.cc:256] RPC call timeout handler was delayed by -2.5197743230005472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1773s for a response
W20260709 12:27:55.382680  9778 connection.cc:256] RPC call timeout handler was delayed by -2.42257432300039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
W20260709 12:27:55.383102  9778 connection.cc:256] RPC call timeout handler was delayed by -2.4099743230003696s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
W20260709 12:27:55.383462  9778 connection.cc:256] RPC call timeout handler was delayed by -2.4054743230003623s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
W20260709 12:27:55.383796  9778 connection.cc:256] RPC call timeout handler was delayed by -2.3874743230003332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
W20260709 12:27:55.384195  9778 connection.cc:256] RPC call timeout handler was delayed by -2.3766743230003158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260709 12:27:55.384613  9778 connection.cc:256] RPC call timeout handler was delayed by -2.3451743230002648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1967s for a response
W20260709 12:27:55.385087  9778 connection.cc:256] RPC call timeout handler was delayed by -2.3154743230002168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260709 12:27:55.385540  9778 connection.cc:256] RPC call timeout handler was delayed by -2.3091743230002066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
W20260709 12:27:55.385823  9778 connection.cc:256] RPC call timeout handler was delayed by -2.2434743230005552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
W20260709 12:27:55.386101  9778 connection.cc:256] RPC call timeout handler was delayed by -2.2434743230005552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
W20260709 12:27:55.386389  9778 connection.cc:256] RPC call timeout handler was delayed by -2.1822743230004562s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21480000000000002s for a response
W20260709 12:27:55.386658  9778 connection.cc:256] RPC call timeout handler was delayed by -2.126474323000366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 12:27:55.386915  9778 connection.cc:256] RPC call timeout handler was delayed by -2.1073490680000759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2169s for a response
W20260709 12:27:55.387187  9778 connection.cc:256] RPC call timeout handler was delayed by -2.1057743230003325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22330000000000003s for a response
W20260709 12:27:55.387547  9778 connection.cc:256] RPC call timeout handler was delayed by -2.0532778530000542s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2008s for a response
W20260709 12:27:55.387812  9778 connection.cc:256] RPC call timeout handler was delayed by -1.6971743230005814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2687s for a response
W20260709 12:27:55.388075  9778 connection.cc:256] RPC call timeout handler was delayed by -1.6503743230005057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2739s for a response
W20260709 12:27:55.388330  9778 connection.cc:256] RPC call timeout handler was delayed by -1.6098743230004402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2784s for a response
W20260709 12:27:55.388587  9778 connection.cc:256] RPC call timeout handler was delayed by -1.4469743230001768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2965s for a response
I20260709 12:27:55.377710  9712 catalog_manager.cc:5697] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:55.384557  9812 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:55.399363  9881 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
W20260709 12:27:55.400928 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.402740  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:55.403366  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 251584us
I20260709 12:27:55.404516  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.418125  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:55.421581 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.375357 14439 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:55.422499  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 55117.5us
I20260709 12:27:55.423113  9883 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:55.422021  9886 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 5.
I20260709 12:27:55.426083  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:55.430575  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:55.431375  9882 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:55.432169  9963 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:27:55.438792  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.406590 14443 raft_consensus.cc:697] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:55.440183  9885 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:55.424566 14439 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:55.444353 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:55.282644  9710 rpcz_store.cc:269] 0709 12:27:34.819659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.822521 (+  2862us) service_pool.cc:224] Handling call
0709 12:27:55.282001 (+20459480us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:44.836737 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:44.837385 (+   648us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:44.837435 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:27:44.837467 (+    32us) tablet.cc:662] Decoding operations
0709 12:27:44.962632 (+125165us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:44.962720 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:44.962751 (+    31us) tablet.cc:685] Acquiring locks for 23 operations
0709 12:27:44.964641 (+  1890us) tablet.cc:701] Row locks acquired
0709 12:27:44.964690 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:27:44.964896 (+   206us) write_op.cc:270] Start()
0709 12:27:44.965030 (+   134us) write_op.cc:276] Timestamp: P: 1783600064964805 usec, L: 0
0709 12:27:44.965053 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:27:45.020768 (+ 55715us) log.cc:844] Serialized 8950 byte log entry
0709 12:27:45.491053 (+470285us) op_driver.cc:464] REPLICATION: finished
0709 12:27:45.741273 (+250220us) write_op.cc:301] APPLY: starting
0709 12:27:45.818514 (+ 77241us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:46.157130 (+338616us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:46.157303 (+   173us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:47.937624 (+1780321us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:47.938160 (+   536us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=23,key_file_lookups=23,delta_file_lookups=0,mrs_lookups=46
0709 12:27:47.938227 (+    67us) write_op.cc:312] APPLY: finished
0709 12:27:47.939010 (+   783us) log.cc:844] Serialized 296 byte log entry
0709 12:27:48.017660 (+ 78650us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:48.017927 (+   267us) write_op.cc:454] Released schema lock
0709 12:27:48.018029 (+   102us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:48.430297 (+412268us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:48.430333 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2086,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":179959,"apply.run_cpu_time_us":63560,"apply.run_wall_time_us":2704085,"cfile_cache_hit":44,"cfile_cache_hit_bytes":45936,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6215,"cfile_init":1,"lbm_read_time_us":62479,"lbm_reads_10-100_ms":4,"lbm_reads_lt_1ms":4,"num_ops":23,"prepare.queue_time_us":238196,"prepare.run_cpu_time_us":42705,"prepare.run_wall_time_us":259097,"raft.queue_time_us":77548,"raft.run_cpu_time_us":12526,"raft.run_wall_time_us":243473,"replication_time_us":431399,"thread_start_us":332128,"threads_started":5,"wal-append.queue_time_us":628267,"wal-append.run_cpu_time_us":20556,"wal-append.run_wall_time_us":2226565}]]}
I20260709 12:27:55.470889  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.471732  9885 raft_consensus.cc:2393] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:55.473436  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.474620  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.375288 14538 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:55.475078 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.475334  9883 raft_consensus.cc:2368] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10.
I20260709 12:27:55.477350  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.472715  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.481526  9882 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:55.485549 10496 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:55.482676 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:55.486405 10525 raft_consensus.cc:2393] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 13: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:55.487560  9890 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:55.487931  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:55.488498  9883 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:55.490743  9811 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:55.497388  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.498713  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.504403  9881 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:27:55.508823 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:55.511081 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:55.501847 14402 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:55.512719 14402 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:55.513070 14402 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:55.522686 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:55.535862  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:55.546480  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 45966.9us
I20260709 12:27:55.548914  9882 raft_consensus.cc:1240] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 16. Ops: []
I20260709 12:27:55.550444 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:55.551604  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.552614 14503 consensus_queue.cc:1059] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:55.554476 14538 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:55.554523 14519 consensus_queue.cc:1059] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:27:55.490638 14472 consensus_queue.cc:1048] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:27:55.557670 14539 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:55.556551 14443 consensus_queue.cc:237] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.563323  9885 raft_consensus.cc:1240] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11. Ops: []
W20260709 12:27:55.563828 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:55.573822 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.574069  9883 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:27:55.567013 10529 raft_consensus.cc:2393] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 14: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:55.562947  9712 catalog_manager.cc:5697] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:55.568058  9928 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:55.572286  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.575332 14503 raft_consensus.cc:3055] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:55.577433  9881 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:27:55.578294  9928 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:55.583210  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.581686  9712 catalog_manager.cc:5697] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:55.577340 14503 raft_consensus.cc:740] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:55.583853  9888 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:55.585935  9963 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:27:55.585820 14503 consensus_queue.cc:260] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.586764 10532 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:27:55.580210 14502 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:55.587591 14502 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:55.588008 14502 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:55.590726  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:55.591377  9962 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
I20260709 12:27:55.592496  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:55.589996  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:55.582782 14473 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:55.594630 14473 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:55.594980 14473 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:55.596985  9853 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:55.598380 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.598654  9928 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:55.587280 14503 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:55.599109 14521 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:55.599655 14472 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:55.600028  9928 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:55.600279 14521 consensus_queue.cc:1059] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:27:55.600883 14472 raft_consensus.cc:2804] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:55.601121  9928 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:55.601410 14472 raft_consensus.cc:697] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:55.602445 14534 raft_consensus.cc:3055] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:55.602828  9886 raft_consensus.cc:1240] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:55.603152  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:55.603724  9881 raft_consensus.cc:2376] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11. Re-sending same reply.
I20260709 12:27:55.603806  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.604642  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:55.605106  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:55.607132  9887 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
W20260709 12:27:55.643190  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.643364  9888 raft_consensus.cc:1240] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 11. Current term is 13. Ops: []
I20260709 12:27:55.587436  9712 catalog_manager.cc:5697] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:55.649487  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:55.649978 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.651182  9886 raft_consensus.cc:2393] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:55.652416  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.653970  9815 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:55.655548  9884 raft_consensus.cc:1240] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:55.655936  9888 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15. Ops: []
W20260709 12:27:55.656714 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.648753  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:55.659312  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 69052.9us
I20260709 12:27:55.663622  9853 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:55.665262  9882 raft_consensus.cc:1240] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:55.602092 14521 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:55.669207  9712 catalog_manager.cc:5697] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:55.667992 14402 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.672288  9712 catalog_manager.cc:5697] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 5 to 8, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 8 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:27:55.673573 14402 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:55.602854 14534 raft_consensus.cc:740] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:55.679363  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:55.680780 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.681813  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:55.682546  9881 raft_consensus.cc:2376] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10. Re-sending same reply.
W20260709 12:27:55.685571  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.687654 14469 raft_consensus.cc:3055] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:55.688050 14469 raft_consensus.cc:740] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:27:55.696511  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 143500us
I20260709 12:27:55.675504 14476 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:55.699898  9882 raft_consensus.cc:1275] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:27:55.676486  9712 catalog_manager.cc:5697] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:55.700075  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 152294us
I20260709 12:27:55.710371  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.711328  9882 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 16: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:55.703583 14476 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:55.714527 14476 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:55.703531 14469 consensus_queue.cc:260] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.728826  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:55.729506  9811 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:55.731783  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:55.732338 14469 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:55.732863  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:55.733865  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.734458  9884 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:27:55.734647  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.735011  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.735333  9881 raft_consensus.cc:2368] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10.
I20260709 12:27:55.735471  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:55.736071  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.736313  9884 raft_consensus.cc:2393] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 13: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:55.736238  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.737002  9881 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 5.
I20260709 12:27:55.737112  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.737242  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:55.738055  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.738588  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.738451  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:55.739537  9884 raft_consensus.cc:2393] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:55.740024  9883 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:55.740619  9884 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:27:55.740996  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.741572  9887 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:27:55.742667  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.743417  9886 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:27:55.743199 14534 consensus_queue.cc:260] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:55.734583  9779 leader_election.cc:336] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.537s (SENT)
I20260709 12:27:55.744376 14534 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:55.744854  9779 leader_election.cc:336] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.545s (SENT)
W20260709 12:27:55.745592  9779 leader_election.cc:336] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Timed out: RequestConsensusVote RPC to 127.8.111.68:37417 timed out after 1.545s (SENT)
I20260709 12:27:55.707645 14521 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:55.729053  9889 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:27:55.737785  9885 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 15.
I20260709 12:27:55.745985  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:55.748867  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 104465us
I20260709 12:27:55.737713  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:55.749476  9927 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:55.752135 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 84229.7us
I20260709 12:27:55.754317  9888 raft_consensus.cc:3055] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:55.754664  9888 raft_consensus.cc:740] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
W20260709 12:27:55.757109  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 45979.6us
I20260709 12:27:55.759378  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.757179  9853 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:55.767014  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:55.777746  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 115442us
I20260709 12:27:55.774466  9888 consensus_queue.cc:260] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.754099 14539 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:27:55.781461  9779 leader_election.cc:336] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.751s (SENT)
I20260709 12:27:55.786790  9882 raft_consensus.cc:3055] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:55.787169  9882 raft_consensus.cc:740] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:55.790839  9811 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:27:55.786487 14553 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:55.792049  9888 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:55.795363  9779 leader_election.cc:336] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.778s (SENT)
I20260709 12:27:55.796007  9779 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:55.797276 14538 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:55.801548  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:55.797833  9779 leader_election.cc:336] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.885s (SENT)
I20260709 12:27:55.790377  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:55.806977  9810 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:27:55.808166 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.808547  9927 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:55.692886 14472 consensus_queue.cc:237] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:55.810575  9779 leader_election.cc:336] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417): Timed out: RequestConsensusVote RPC to 127.8.111.68:37417 timed out after 1.885s (SENT)
I20260709 12:27:55.811045  9779 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:55.811820  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:55.812390  9881 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:55.798686 14521 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:55.808048  9853 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:55.819473  9853 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:55.820848  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.821717  9889 raft_consensus.cc:2393] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 15: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:55.821614  9853 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:55.822497 14490 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:55.823007 14490 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:55.823475 14490 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:55.826431 14402 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.828207 14540 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:55.830017  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.830819  9885 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:27:55.831875  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.833277  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.834878  9887 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:27:55.836287  9884 raft_consensus.cc:1240] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:27:55.837366  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.838713  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.787969 14439 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.841168 14554 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:55.841894 14554 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:55.842209 14439 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:27:55.812808 14553 raft_consensus.cc:697] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:55.815663 14559 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 12:27:55.847358  9779 leader_election.cc:336] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.900s (SENT)
I20260709 12:27:55.826960 14402 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.853542  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.816326  9882 consensus_queue.cc:260] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.850847  9811 raft_consensus.cc:1240] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:27:55.847847 14539 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:27:55.863566  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.864264  9881 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
W20260709 12:27:55.870451  9779 leader_election.cc:336] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.932s (SENT)
I20260709 12:27:55.877770  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.875379  9882 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:55.849637 14443 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.869204  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.850065 14554 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:55.879953  9884 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:55.883757  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.805919  9815 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:55.879891  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.881019  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.886701  9886 raft_consensus.cc:2410] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:27:55.884711  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.889338  9884 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 11: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:55.865573 14521 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:55.881394  9888 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:27:55.882015  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.883272  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.893136  9889 raft_consensus.cc:2393] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:55.893977  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:55.895206 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.897130  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.898231  9883 raft_consensus.cc:2393] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 11: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:27:55.902477  9779 leader_election.cc:336] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 2.002s (SENT)
I20260709 12:27:55.903085  9779 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:55.903393  9881 raft_consensus.cc:2410] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:27:55.887177 14554 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:55.904680  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 83165.7us
I20260709 12:27:55.900152 14410 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:27:55.908757  9812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:27:55.909524  9812 raft_consensus.cc:606] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Received request to transfer leadership to TS b011791796d1457284b857d7d3422195
I20260709 12:27:55.909888  9812 raft_consensus.cc:614] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:55.915769  9882 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:27:55.918051  9812 raft_consensus.cc:1275] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:27:55.889384 14553 consensus_queue.cc:237] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:55.919414  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:55.919961  9812 raft_consensus.cc:2376] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11. Re-sending same reply.
I20260709 12:27:55.921612  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.921792  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.922173  9812 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 15.
I20260709 12:27:55.925364  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:55.926599  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.926757  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.927220  9808 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:27:55.927554  9814 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:55.928165  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.926909  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.928995  9807 raft_consensus.cc:2410] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:27:55.929201  9806 raft_consensus.cc:2393] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:55.929559  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.929822  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.930521  9813 raft_consensus.cc:2393] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 11: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:55.931097  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.931654  9809 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 15.
I20260709 12:27:55.934098  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:55.934631  9809 raft_consensus.cc:2376] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13. Re-sending same reply.
I20260709 12:27:55.935804  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.936342  9809 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
I20260709 12:27:55.938494  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:55.942337 14538 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:55.943238 14540 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:55.944857 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.945641  9778 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:55.946805 14542 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:55.947299 14542 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:55.947738 14542 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:55.947996  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:55.948678  9963 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:55.950800 14402 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:55.942142 14539 consensus_queue.cc:1059] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:27:55.952508  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:55.953198  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:55.953751  9813 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:27:55.954411  9811 raft_consensus.cc:1240] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:55.957865  9885 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:27:55.929226  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.959458  9812 raft_consensus.cc:2393] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 10: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:27:55.969064  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 167560us
I20260709 12:27:55.970772  9964 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:27:55.972200  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:55.973505  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 165092us
I20260709 12:27:55.974197  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:55.975317  9927 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:55.975808  9815 raft_consensus.cc:2410] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:27:55.975672  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.886626 14443 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:55.978132  9814 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:27:55.978927  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:55.960363 14469 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.990458  9806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:27:55.990711  9963 raft_consensus.cc:2393] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 12: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:55.991101  9806 raft_consensus.cc:606] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:27:55.991498  9806 raft_consensus.cc:614] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:55.901223 14473 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:55.993882  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.994168  9928 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:55.997924  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.997833  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:55.952080 14502 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:55.998448 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:55.998827 14565 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:55.999640 14554 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.007716 14443 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:56.015822 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:56.015164  9810 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
I20260709 12:27:56.019090  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.019587 14565 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.024000 14565 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:56.036823 14554 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:56.039608 14490 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:56.043499 14538 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:56.043883 14490 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:56.039916  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.044628 14565 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:56.001835 14476 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:56.049007  9961 raft_consensus.cc:2393] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 13: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:27:56.040413  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 46369.3us
W20260709 12:27:56.054039 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:56.054457  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:56.040524 14503 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:56.009011 14469 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:56.041090  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 65884.7us
I20260709 12:27:56.055362  9885 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:56.057894  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:56.058688 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:56.059798  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:56.062599  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.062863  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:56.066068  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:56.063223  9963 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:56.068071  9887 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:56.068171  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:56.068536 14565 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:56.068902  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:56.060871 14554 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:56.060111  9778 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:56.071830  9778 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:56.060128 10496 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:56.066641  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:56.072825  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:56.072983  9881 raft_consensus.cc:2393] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 15: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:56.066934  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:56.069582  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:56.074445  9886 raft_consensus.cc:2393] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 13: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:56.067220  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:56.068984  9888 raft_consensus.cc:2393] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 11: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:56.076042  9812 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:56.077056  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:27:56.063874 14562 log.cc:927] Time spent T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:27:56.081183  9884 raft_consensus.cc:2368] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 15. Current term is 16.
I20260709 12:27:56.081434  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:56.039624 14473 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:56.079458  9813 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:27:56.079847 10496 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:56.080376  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.060446 14503 raft_consensus.cc:697] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:56.086520 14554 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:56.086735 14435 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:56.087191 14435 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.087141 14554 raft_consensus.cc:697] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:56.088194 14476 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:56.088753 14554 consensus_queue.cc:237] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.087667 14435 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:56.078411 14439 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:27:56.086760  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:56.092981  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.094061  9963 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:27:56.096146  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:56.097240  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.097726  9963 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
W20260709 12:27:56.099565  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:56.105043  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 47212.1us
I20260709 12:27:56.105075  9927 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:56.105355  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:56.106029  9928 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:56.106195  9881 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:56.109638 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:56.110885 10496 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:56.113526 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:56.083011 14443 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:27:56.118098 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:56.118774  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 216323us
I20260709 12:27:56.119573 10496 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:56.107136 14571 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:56.121610 14301 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:56.123454  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.112233 14439 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:56.115270 14559 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:56.134598 14559 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:56.135040 14559 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:56.115165 14402 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:56.122120 14571 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.140036 14571 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:56.114409 14473 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:27:56.142693 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:56.143121 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:56.146646 14402 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:56.125738  9928 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:56.133106 14503 consensus_queue.cc:237] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.117949 14448 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:56.157934  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:56.161307  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:56.171767  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.172430  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:56.175040  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 49364.1us
I20260709 12:27:56.158615 14443 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:27:56.177177  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 45423.8us
I20260709 12:27:56.177984  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.176373 14473 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:56.178639  9961 raft_consensus.cc:2376] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10. Re-sending same reply.
I20260709 12:27:56.178791 14473 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:56.179173 14473 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:56.179976 14469 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:56.178200 10532 raft_consensus.cc:1240] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:56.181244  9963 raft_consensus.cc:2368] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 15. Current term is 16.
I20260709 12:27:56.178334  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:56.180444  9927 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:56.169829 14572 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:56.184610  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.186686 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:56.189553  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:56.187574 14565 raft_consensus.cc:2764] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:27:56.197297  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.197919  9964 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:56.198937 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:56.199515 10529 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:56.199975 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:56.200340 10533 raft_consensus.cc:1240] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:56.201159 10525 raft_consensus.cc:1240] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:56.202160 10532 raft_consensus.cc:1240] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:56.204408  9927 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:56.205523  9927 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:56.206064 14469 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:56.206189 14564 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:56.206651 14472 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:56.186610 14301 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:56.207221 14472 raft_consensus.cc:697] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:56.208164 14472 consensus_queue.cc:237] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.206851 14564 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.209909 14564 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:56.211413 14502 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:56.177584 14443 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.209364  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:56.213333  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:56.233692 10532 raft_consensus.cc:1240] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:56.236651  9928 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:56.254866 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:27:56.255822 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 136293us
W20260709 12:27:56.257109  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:56.258097  9928 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:56.257599 10496 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:56.257895  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.234642 14443 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:56.264889 10496 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:56.232939 14565 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:56.256925  9927 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:56.272619 14301 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:56.273222 14301 raft_consensus.cc:697] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:56.273608  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.274137 14301 consensus_queue.cc:237] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.277017 10496 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:56.278324 10496 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:56.279597  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:56.279953  9963 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
W20260709 12:27:56.282939  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:56.262456 14469 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:27:56.302147  9779 leader_election.cc:336] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 2.173s (SENT)
I20260709 12:27:56.264948 14553 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:56.304386  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:27:56.305557  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 48709.2us
I20260709 12:27:56.306571  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:56.254813 14542 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.308948  9927 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:56.308897 14448 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:56.309607 14439 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:27:56.280385 14402 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:56.279248 14446 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:56.294872 14503 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:27:56.322314 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:56.316895 14402 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.326823 14402 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:56.311455 14534 consensus_queue.cc:1059] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:27:56.331182 14534 raft_consensus.cc:3055] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:56.331540 14534 raft_consensus.cc:740] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:56.314842  9854 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:56.305239 14553 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.319466 10496 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:56.319701 14538 raft_consensus.cc:3055] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:56.334897 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:56.313009 14539 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:56.337406  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.338732  9963 raft_consensus.cc:2393] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:56.339512 14439 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:56.338025 14490 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:56.339968 14439 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.340255 14490 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.340431 14439 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:56.340710 14490 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:56.335688 14538 raft_consensus.cc:740] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:56.343055 14538 consensus_queue.cc:260] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.344599 14538 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:56.344931 14473 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.337920 14576 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:27:56.311029 14410 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:27:56.350217  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 48110.1us
I20260709 12:27:56.353914  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:56.354717  9888 raft_consensus.cc:2410] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:27:56.346597 14565 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:56.356062 14565 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:56.335748 14553 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:56.358623  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:56.361604  9888 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:56.335748 14446 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:56.351500 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:56.364395  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:56.365383 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:56.366094 10533 raft_consensus.cc:2410] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:27:56.367141  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.368355  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:56.368955  9889 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:56.338042 14503 raft_consensus.cc:697] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:56.371094  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:56.371639  9890 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:56.371421  9963 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 15. Current term is 16. Ops: []
W20260709 12:27:56.360293 14578 log.cc:927] Time spent T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:27:56.360646 14534 consensus_queue.cc:260] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.389765 14534 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:56.394925  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:56.397234  9778 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:56.381618 14573 log.cc:927] Time spent T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:27:56.382172  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.360473 14565 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:56.386554  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.387698 14435 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.357108 14502 consensus_queue.cc:1059] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:27:56.388453 14542 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:56.387568 14503 consensus_queue.cc:237] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.414513  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:56.382503  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 73631.2us
I20260709 12:27:56.403079  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.423480  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:56.404548 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 69740us
I20260709 12:27:56.427398 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:56.406507  9961 raft_consensus.cc:2393] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 6: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:56.428653  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.430078  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:56.430723  9813 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:56.438124  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:56.438942  9814 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:56.445341  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:56.446198  9808 raft_consensus.cc:3060] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:56.446632  9809 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 14. Current term is 15. Ops: []
I20260709 12:27:56.403724  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.349345 14576 consensus_queue.cc:1243] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer 4104e34a61b7448281d6d91ce23ebf71 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:27:56.412716  9778 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:56.448647  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.449364  9956 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:27:56.414155  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:56.450947  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:56.414819  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.451639  9810 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:56.452152  9958 raft_consensus.cc:2393] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 12: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:56.452376  9778 leader_election.cc:400] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 15. Current term is 16.
I20260709 12:27:56.452683  9778 leader_election.cc:403] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:56.453064  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.453406 14572 raft_consensus.cc:2804] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:56.417205  9888 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
W20260709 12:27:56.453480  9853 leader_election.cc:336] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 1.516s (SENT)
I20260709 12:27:56.451653  9960 raft_consensus.cc:2368] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15.
I20260709 12:27:56.454813  9853 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:56.455819  9808 raft_consensus.cc:2468] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:27:56.456126  9960 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:27:56.456264 14521 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:56.454268  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:56.393647 14443 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.460879  9813 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:27:56.421917  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.460279  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:27:56.459956 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 49233.3us
I20260709 12:27:56.462025  9956 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:56.462374  9960 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:27:56.465610  9890 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:27:56.362834 14540 consensus_queue.cc:1059] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:27:56.461757  9955 raft_consensus.cc:2376] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13. Re-sending same reply.
W20260709 12:27:56.472959 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 45647.2us
I20260709 12:27:56.472016 14473 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:56.479728  9779 leader_election.cc:336] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 2.784s (SENT)
W20260709 12:27:56.480679  9779 leader_election.cc:336] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 3.212s (SENT)
I20260709 12:27:56.483908  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:56.484644  9813 raft_consensus.cc:2376] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11. Re-sending same reply.
I20260709 12:27:56.457803 14476 raft_consensus.cc:3055] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:27:56.370841 14564 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:56.487749 10524 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 16: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:56.494738  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:56.420109 14577 raft_consensus.cc:2764] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:27:56.494830  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:56.495482  9955 raft_consensus.cc:2376] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12. Re-sending same reply.
I20260709 12:27:56.494448 14476 raft_consensus.cc:740] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:56.501776  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:56.502122  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.469534 14301 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:56.403461 14559 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:56.485772 14580 log.cc:927] Time spent T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:27:56.517094  9955 raft_consensus.cc:1240] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:56.493899 14439 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.519366  9960 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:27:56.521166  9959 raft_consensus.cc:2368] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
I20260709 12:27:56.486050 14446 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:56.494163 14490 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.530542 10525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:60770
I20260709 12:27:56.531432  9963 raft_consensus.cc:2368] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 12. Current term is 13.
I20260709 12:27:56.533447  9889 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:27:56.541852 10525 raft_consensus.cc:606] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
W20260709 12:27:56.545207  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 92977.4us
I20260709 12:27:56.545552  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:56.546337  9813 raft_consensus.cc:2368] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13.
I20260709 12:27:56.548596  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:56.549436  9812 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:27:56.550179  9853 leader_election.cc:336] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 1.613s (SENT)
I20260709 12:27:56.458887 14571 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:56.556629  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:56.557291  9964 raft_consensus.cc:2393] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:56.557550  9959 raft_consensus.cc:2368] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13.
I20260709 12:27:56.559041  9955 raft_consensus.cc:1240] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:56.567633  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:56.568449  9955 raft_consensus.cc:2376] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9. Re-sending same reply.
I20260709 12:27:56.573494  9813 raft_consensus.cc:1240] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:27:56.573932  9957 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
I20260709 12:27:56.552312 14576 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.575853  9810 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:27:56.576249  9808 raft_consensus.cc:2368] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12.
I20260709 12:27:56.552482 14446 raft_consensus.cc:697] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:56.530944 14301 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.592254  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:56.595273  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:56.622033  9957 raft_consensus.cc:2368] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 15. Current term is 16.
I20260709 12:27:56.581634 14542 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 15. Current term is 16.
W20260709 12:27:56.643935  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:56.674432  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 128528us
I20260709 12:27:56.683794 14572 raft_consensus.cc:697] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:56.571040 14476 consensus_queue.cc:260] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.585364 14576 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:56.748274  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:56.760982  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 300542us
W20260709 12:27:56.857645  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:56.859592 14576 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:56.860965 14564 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:56.864583  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:56.865480  9810 raft_consensus.cc:2410] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:27:56.870680  9778 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:56.878087 10497 leader_election.cc:400] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10.
I20260709 12:27:56.878321  9812 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:27:56.879633  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.881055  9956 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:27:56.883118  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:56.884775  9962 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:56.884820  9814 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:56.886708  9927 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:56.889457  9927 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:56.890852  9927 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:56.898344 10525 raft_consensus.cc:1240] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:56.899276 14572 consensus_queue.cc:237] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:56.902266 14539 consensus_meta.cc:287] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.009s
I20260709 12:27:56.902884 14391 raft_consensus.cc:2804] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:56.903198 14539 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:56.903506 14391 raft_consensus.cc:697] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:27:56.884354 14553 consensus_meta.cc:287] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.515s	user 0.019s	sys 0.000s
I20260709 12:27:56.904522 14391 consensus_queue.cc:237] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:56.899788 14476 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:56.906394 14564 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:56.906786 14521 raft_consensus.cc:3055] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:56.906929 14564 raft_consensus.cc:697] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:56.907168 14521 raft_consensus.cc:740] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:56.907891 14564 consensus_queue.cc:237] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:56.908038 14521 consensus_queue.cc:260] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.909018 14521 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:56.911415 14595 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:56.911775 14402 consensus_meta.cc:287] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.584s	user 0.017s	sys 0.007s
I20260709 12:27:56.911908 14595 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.912228 14402 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.912734 14446 consensus_queue.cc:237] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:56.914091  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:56.911408 14584 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
W20260709 12:27:56.914546  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:56.914448 14443 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:56.904569 14553 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.916183  9813 raft_consensus.cc:1240] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 12:27:56.916247  9853 leader_election.cc:336] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 1.783s (SENT)
I20260709 12:27:56.871233 14448 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.917701  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:56.941823  9810 raft_consensus.cc:2393] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 11: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:56.917120  9927 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:56.948242  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 77783.8us
I20260709 12:27:56.949975  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.943923  9927 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:56.953639  9956 raft_consensus.cc:1275] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:56.954012 14554 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:56.954720 14554 raft_consensus.cc:697] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:56.955822 14554 consensus_queue.cc:237] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:56.959321  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.959987  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:56.961724  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:56.962029  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:56.962667  9962 raft_consensus.cc:2368] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
I20260709 12:27:56.962913  9812 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:56.963593 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 85618.3us
I20260709 12:27:56.965147 10497 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:56.966426  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:56.959321 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:56.969146 10525 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:56.916977 14577 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:56.971745  9958 raft_consensus.cc:2393] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 12: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:56.972074  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:56.976399  9815 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:56.978137 14553 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:56.886072 14565 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:56.979941  9963 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 11: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:56.980897 14565 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:56.919546 14490 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:56.971594 14597 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:27:56.953226 14435 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:27:56.988821 14538 consensus_meta.cc:287] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.644s	user 0.014s	sys 0.000s
I20260709 12:27:56.991525  9883 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:27:56.993290  9889 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:56.994588  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:56.999002 10497 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:56.999135  9960 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 13. Ops: []
I20260709 12:27:56.999161  9853 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:57.000705 10497 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:57.001340  9962 raft_consensus.cc:1275] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:27:56.960839 14410 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:27:57.004750 14410 raft_consensus.cc:697] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:57.004738  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:57.006425  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:57.006592  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:57.007718 14490 consensus_queue.cc:1059] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:57.008656 14490 raft_consensus.cc:3055] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:27:57.008674  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:57.009094 14490 raft_consensus.cc:740] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:57.009738  9888 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 11: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:56.921015 14592 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:27:57.002401  9778 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:57.015128  9956 raft_consensus.cc:1240] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:57.039275 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:57.041770  9778 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:57.045259 10529 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:27:57.048630 10527 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:27:57.048815 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:57.050633 10533 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:27:56.959486 14448 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:57.054008  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 54926.5us
I20260709 12:27:57.056070  9853 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:57.057386  9778 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:57.005888 14410 consensus_queue.cc:237] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:57.030982 14435 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:57.040762 14590 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:57.040910 14534 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:57.009981 14490 consensus_queue.cc:260] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:57.065908  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:57.073691  9808 raft_consensus.cc:2393] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 13: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:57.054770  9812 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:27:57.068600 14594 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:57.072414 10532 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:57.044250 14584 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:27:57.078430 14590 raft_consensus.cc:697] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:57.060222 14439 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:57.080592  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:57.085176  9813 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:57.075423 14538 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:57.178918 14565 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.081445  9778 leader_election.cc:400] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15.
I20260709 12:27:57.179961  9778 leader_election.cc:403] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:27:57.081547  9812 raft_consensus.cc:1240] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:27:57.041195 14597 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:27:57.064956 14571 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:57.067668  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:27:57.124795 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 124177us
W20260709 12:27:57.084856  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 51424.4us
I20260709 12:27:57.174427 14591 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:57.177157 14600 log.cc:927] Time spent T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:27:57.198333  9812 raft_consensus.cc:1240] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:27:57.080813 14540 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.194800  9928 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:57.188841  9813 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 16.
I20260709 12:27:57.084559 14490 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:57.227161 10497 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:57.268842  9812 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 13. Ops: []
I20260709 12:27:57.179440 14565 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:57.270509  9814 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 15. Current term is 16. Ops: []
I20260709 12:27:57.271438  9808 raft_consensus.cc:1275] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:27:57.269598 14609 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 12:27:57.273999  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:57.223820 14594 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:57.275947  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 81237us
I20260709 12:27:57.277508  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:57.225222 14538 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15.
W20260709 12:27:57.289469  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 221866us
I20260709 12:27:57.294457 14610 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:57.288630  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:57.325224  9811 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:57.300920 10525 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:27:57.290655  9779 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:57.307219  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 225869us
I20260709 12:27:57.315486  9815 raft_consensus.cc:2368] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12.
W20260709 12:27:57.333825 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 107308us
I20260709 12:27:57.226215 14540 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:57.346139  9778 leader_election.cc:400] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 12. Current term is 13.
I20260709 12:27:57.346521  9778 leader_election.cc:403] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:27:57.350972 14553 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:27:57.351754 14410 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:57.353160 14616 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:57.353252  9854 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:57.355736  9888 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:27:57.358765  9778 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:57.361213  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 70654.5us
I20260709 12:27:57.328650 14592 raft_consensus.cc:697] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:57.362445  9778 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:57.347965 14591 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:57.327519 14601 raft_consensus.cc:2764] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:27:57.363166  9811 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:27:57.363991  9853 leader_election.cc:400] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 pre-election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
I20260709 12:27:57.333479 14584 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:57.370038  9779 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:57.366482 14538 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:27:57.365577 14571 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 12. Current term is 13.
I20260709 12:27:57.382421  9853 leader_election.cc:400] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13.
I20260709 12:27:57.382750  9853 leader_election.cc:403] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:27:57.383469 14448 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:57.354931 14594 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.368721 10497 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:57.456849  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:57.353760 14616 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:57.459591  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 106403us
I20260709 12:27:57.411271 14448 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:57.430552 14539 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:57.449927 14571 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.326987 14590 consensus_queue.cc:237] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:57.396175 14584 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 12:27:57.456287 14591 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:57.468999 14448 raft_consensus.cc:697] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:57.475322 14448 consensus_queue.cc:237] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:57.470676  9882 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:57.469034 14571 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:57.480566  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:57.481237  9881 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:27:57.471689 14539 raft_consensus.cc:697] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:57.423084 14609 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:27:57.484805 14539 consensus_queue.cc:237] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:57.488199 14565 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:57.493310  9882 raft_consensus.cc:1275] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:57.466864 14490 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:57.500553  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:57.517119 10497 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:57.423678 14594 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:57.525581  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 143294us
I20260709 12:27:57.527112  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:57.536604  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:57.525393 14584 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:27:57.539546  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:57.548956 14617 log.cc:927] Time spent T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.200s	user 0.014s	sys 0.000s
I20260709 12:27:57.550670 14623 raft_consensus.cc:2749] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13.
I20260709 12:27:57.478528 14592 consensus_queue.cc:237] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:57.553236 14301 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:57.560823  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:57.561775  9882 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 16: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:57.566881  9883 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:27:57.567247  9883 pending_rounds.cc:85] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 10
I20260709 12:27:57.567497  9883 pending_rounds.cc:107] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:27:57.567767  9883 raft_consensus.cc:2889] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:57.572341 14616 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:57.572736  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:57.573513  9811 raft_consensus.cc:2393] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 12: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:57.573599 14540 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:57.527163 14609 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:27:57.577062 14571 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:57.577520  9961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1771) took 1193 ms. Trace:
I20260709 12:27:57.577872  9961 rpcz_store.cc:276] 0709 12:27:56.383914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:56.429477 (+ 45563us) service_pool.cc:224] Handling call
0709 12:27:56.429791 (+   314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:56.430183 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:56.430216 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:56.546075 (+115859us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b2c0013c378. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8ce15a11 00007f2f8ce25372 00007f2f8e557a01 00007f2f8e51c43a 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2
0709 12:27:56.560041 (+ 13966us) log.cc:844] Serialized 52 byte log entry
0709 12:27:57.010501 (+450460us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:57.010539 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:57.010603 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:57.576838 (+566235us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b240025cdd8. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b2b59c4 00007f2f8b2b3acb 00007f2f8b46edc9 00007f2f8b46ea55 00007f2f8b46dfb0 00007f2f8e0e4488 00007f2f8e0e4be8 00007f2f8e0bc398 00007f2f8e0b776a 00007f2f8e0b6bb6
0709 12:27:57.577278 (+   440us) raft_consensus.cc:1685] finished
0709 12:27:57.577299 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:57.577441 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4651,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":120231424,"thread_start_us":424591,"threads_started":1,"wal-append.queue_time_us":507171}
I20260709 12:27:57.579317  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:57.580025  9815 raft_consensus.cc:2368] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12.
I20260709 12:27:57.580791 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:57.581672 14534 consensus_meta.cc:287] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.504s	user 0.005s	sys 0.002s
I20260709 12:27:57.520090 14490 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:57.526546 14619 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:57.582012  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:57.602330  9963 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:57.585708  9958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 920) took 1145 ms. Trace:
I20260709 12:27:57.602767  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:57.599049  9927 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:27:57.569023  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:57.587838  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:57.601063  9853 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:57.604228  9883 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:57.582894  9808 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:27:57.605361  9927 leader_election.cc:400] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12.
I20260709 12:27:57.603546  9809 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:27:57.603338  9958 rpcz_store.cc:276] 0709 12:27:56.439933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:56.454023 (+ 14090us) service_pool.cc:224] Handling call
0709 12:27:57.585496 (+1131473us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54000b31d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:27:57.585625 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179180800}
I20260709 12:27:57.605826  9927 leader_election.cc:403] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 12:27:57.545428 14521 consensus_meta.cc:287] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.629s	user 0.013s	sys 0.000s
W20260709 12:27:57.583766 14615 log.cc:927] Time spent T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.233s	user 0.003s	sys 0.007s
I20260709 12:27:57.625393  9809 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:27:57.625542 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:57.544775 14584 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:57.596652 14540 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:57.627966  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 258011us
I20260709 12:27:57.597728 14565 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:57.669075  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 50507.3us
I20260709 12:27:57.693030 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:57.693496 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:57.721235  9927 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:57.721532 10530 raft_consensus.cc:2393] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 11: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:57.626168 10531 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:27:57.582077 14534 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:57.723973 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:57.588029 14594 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:57.724685 10531 raft_consensus.cc:2393] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 14: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:57.724575 14472 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:57.724952  9885 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:57.678859  9809 raft_consensus.cc:1240] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:57.725606 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:57.725919 14472 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:57.726150 10531 raft_consensus.cc:2376] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13. Re-sending same reply.
I20260709 12:27:57.682569 14590 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:57.726699 14590 consensus_queue.cc:1243] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer f5208640a51f493e930ce4f64ceeed0b log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:27:57.684693  9811 pending_rounds.cc:85] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71: Aborting all ops after (but not including) 10
I20260709 12:27:57.726997 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:57.727334  9811 pending_rounds.cc:107] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:27:57.727594  9811 raft_consensus.cc:2889] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:57.727744 14490 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:57.686046 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:57.727996 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:57.728597 10525 raft_consensus.cc:2393] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:57.685279  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:57.687916  9815 raft_consensus.cc:1275] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:27:57.607056 14473 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:57.675223 14584 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:57.592666 14443 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 12:27:57.618844 14619 raft_consensus.cc:697] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 13 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:57.675698 14521 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:57.627575 14538 raft_consensus.cc:697] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:57.692688 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:57.692165 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:57.722249  9963 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:57.723453 10528 raft_consensus.cc:2393] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 15: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:57.685285 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:57.730880 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:27:57.732352  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 205911us
I20260709 12:27:57.741006  9853 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:57.728605 10531 raft_consensus.cc:2368] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 11. Current term is 12.
I20260709 12:27:57.741631 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:57.739074  9778 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:57.744841  9815 raft_consensus.cc:1275] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:27:57.692487 14620 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:57.749456  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:57.729876 14609 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.733566 14472 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:57.690248 14540 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:57.741930 14502 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12.
I20260709 12:27:57.744627 14473 raft_consensus.cc:697] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:57.730199 14565 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:57.778910 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:57.782253 10524 raft_consensus.cc:2410] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:27:57.780283  9853 leader_election.cc:400] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 15. Current term is 16.
I20260709 12:27:57.758543 14521 raft_consensus.cc:697] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:57.789013 14473 consensus_queue.cc:237] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:57.792222 14622 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:57.793483 14558 consensus_queue.cc:1048] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:27:57.796707 14619 consensus_queue.cc:237] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:57.765220 14564 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:27:57.759910 14620 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:57.776381 14472 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:57.818782 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:57.821343  9815 raft_consensus.cc:1275] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:27:57.823112 14592 consensus_queue.cc:1048] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:57.840034 14624 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.840627 14624 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:57.843135  9853 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:57.848690  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 68474.3us
I20260709 12:27:57.756312 14612 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 12:27:57.811769 14554 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.767735 14609 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:57.873454 14565 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:57.878459 14443 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:57.879041 14443 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:57.894660 14628 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:57.912549 14595 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:57.916960 14443 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:27:57.917414  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 100542us
I20260709 12:27:57.933347  9853 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:57.862905 14622 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:57.894202 14521 consensus_queue.cc:237] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:57.941881  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 61457.3us
I20260709 12:27:57.943025  9853 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:57.951239  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:57.957790 14621 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:57.959779 14609 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:57.849710 14538 consensus_queue.cc:237] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:57.967592 14540 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:57.871621 14554 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:57.973522  9779 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:57.944365 14628 raft_consensus.cc:697] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:57.984054  9853 leader_election.cc:400] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
I20260709 12:27:57.984521  9853 leader_election.cc:403] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:27:57.988382  9779 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:57.991127  9853 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:57.998363  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:57.974963 14621 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:58.038501  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:58.042922 14624 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.053478 10525 pending_rounds.cc:85] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b: Aborting all ops after (but not including) 9
I20260709 12:27:58.053828 10525 pending_rounds.cc:107] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:27:58.054065 10525 raft_consensus.cc:2889] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:58.054987  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 66701.9us
I20260709 12:27:58.055637  9779 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:58.056969  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 65971.2us
I20260709 12:27:58.060163 14624 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:57.995728 14540 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:58.077819  9853 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:58.039763 14622 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 5. Current term is 6.
I20260709 12:27:58.079720 14490 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.045578 14595 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.052037 14577 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:58.087159  9779 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:58.090205 14538 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:58.091399  9779 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:58.092206 14538 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:58.092923  9779 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:58.093732 14538 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:58.062144 14610 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:27:58.103905  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 46394.5us
I20260709 12:27:58.105400 14616 consensus_queue.cc:1059] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:58.107420 10524 raft_consensus.cc:1240] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:58.103669  9779 leader_election.cc:400] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 11. Current term is 12.
I20260709 12:27:58.106066  9853 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:58.086033 14621 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:58.088263 14553 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.101271 14623 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:58.087913 14490 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.112000 14538 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.141539  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.100878 14595 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.109957 14534 consensus_queue.cc:1059] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:27:58.108865 14540 consensus_queue.cc:1048] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:27:58.132663 14542 raft_consensus.cc:2764] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:27:58.126614 14553 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.106853 14610 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.155400 14534 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:58.156162 14534 raft_consensus.cc:3055] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:58.156427 14553 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.156515 14534 raft_consensus.cc:740] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:58.147884  9808 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:27:58.159003  9927 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:27:58.165546 14644 log.cc:927] Time spent T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:27:58.165621 14534 consensus_queue.cc:260] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:58.167011 14534 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:58.139878 14538 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.172103 14538 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.173468 14472 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:58.173842 14490 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:58.174939 14645 log.cc:927] Time spent T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:27:58.175663 14472 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:58.176119  9955 raft_consensus.cc:2393] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:58.176214 14472 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.179010  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:58.179703  9809 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:58.127650 14621 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:58.176793 14472 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.112490 14628 consensus_queue.cc:237] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:27:58.211530  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:58.201069 14554 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.207048 14559 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:58.216375 14518 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:27:58.225572  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 118988us
I20260709 12:27:58.229364 14472 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.227483 14518 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.241303 14518 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:58.247313 14621 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:58.251681  9928 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:58.253894 14610 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.229434 14584 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.256793 10496 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:27:58.258323  9853 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 2.111s (SENT) [suppressed 103 similar messages]
I20260709 12:27:58.267676  9928 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:58.272559  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 75731.4us
I20260709 12:27:58.288882  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.288592  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:58.291980  9808 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:27:58.293982 10532 raft_consensus.cc:2393] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 14: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:58.293650 14448 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:58.300741  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.274333 14594 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.305658  9885 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:27:58.310191  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.288591 14553 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:58.307124  9887 raft_consensus.cc:1275] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:27:58.288846 14472 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:27:58.317865  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 59581.8us
I20260709 12:27:58.314051  9885 raft_consensus.cc:1275] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:27:58.256409 14619 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:58.317571  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:58.330628  9961 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:27:58.274470 14620 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.326664  9957 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:27:58.306990 14448 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.326241  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.299847 14632 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 12:27:58.329241  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 50862.3us
W20260709 12:27:58.318994  9853 leader_election.cc:336] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 2.149s (SENT)
I20260709 12:27:58.293188 14469 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:27:58.332954  9958 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:27:58.332831  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.334293 14619 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:58.337028  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.364487  9812 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:27:58.367590 14619 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:58.372035 14518 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.374827  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:58.375434  9812 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:58.318207 14594 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.378711 14594 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.307494 14576 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:27:58.291644 14610 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:27:58.382659 14610 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.383134 14610 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.340987  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:58.340543  9853 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:27:58.385425  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 66461.5us
I20260709 12:27:58.362196 14448 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:27:58.386003  9853 leader_election.cc:336] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Timed out: RequestConsensusVote RPC to 127.8.111.65:38995 timed out after 2.228s (SENT)
W20260709 12:27:58.386533  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:58.349332  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.387333  9814 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:27:58.350620 14595 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:58.310007 14476 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:27:58.387213 14594 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:58.354811 14584 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:58.314625 14609 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:27:58.355651 14402 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:58.332271 14664 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:27:58.392330  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.363255  9808 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:58.357386  9809 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:27:58.338850 14670 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.393620 14670 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:58.386906  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:58.394474  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:58.395691 14623 raft_consensus.cc:3055] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:58.396071 14623 raft_consensus.cc:740] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:58.396497  9812 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:27:58.396898 14623 consensus_queue.cc:260] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:58.384429 14605 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:58.398674 14594 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.399201 14594 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.399931 14565 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.400425 14565 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.401427 14594 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.388342 14610 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.397315 14670 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:27:58.412909 14641 log.cc:927] Time spent T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.324s	user 0.002s	sys 0.000s
I20260709 12:27:58.395723  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:58.414736  9853 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:58.415894  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:58.417164  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.418002  9809 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:27:58.418507 14534 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:58.419263 14594 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:58.419955 14594 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:58.422477 14518 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.423269 14565 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.398069 14623 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:27:58.427289 14448 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.429240 14448 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:58.381497  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:58.433168  9854 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:58.433909 14620 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.434383 14620 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.436389 14620 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.436861 14620 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:58.437187 14620 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.437501 14620 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:58.438684  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.439327  9890 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:58.440284  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.440950 14539 consensus_queue.cc:1059] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:27:58.441363  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.442107  9890 raft_consensus.cc:2393] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:58.455790 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.457820 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.453286 14518 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.458427 10524 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:58.462682 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.464154  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.466399  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:27:58.475550  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:58.478564 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 177946us
I20260709 12:27:58.479451 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.480363 10524 raft_consensus.cc:2393] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 14: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:58.481704  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:58.482409  9884 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:58.442574 14672 raft_consensus.cc:3055] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:58.420866  9853 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:58.445539  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.447757 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.449050 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.451570  9881 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:27:58.453706  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.454502 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.487404  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.489044  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.489430 10533 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:27:58.486881  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.484733  9779 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:58.492959  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 72159.8us
I20260709 12:27:58.493396  9812 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:27:58.493705  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:58.498071  9808 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:58.494729  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.497985  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.493717 10526 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:27:58.501958  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.501070  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:58.503026  9955 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:58.503147  9807 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:27:58.503993  9806 raft_consensus.cc:2393] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 11: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:58.504453  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:58.504997  9883 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:58.504805  9778 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:58.506851  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.507540  9890 raft_consensus.cc:2393] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:58.507668  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:58.508234  9956 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:58.509430  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:58.509572  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:58.509608  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:58.510325  9814 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 16: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:58.510598  9881 raft_consensus.cc:2368] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 12. Current term is 13.
I20260709 12:27:58.510869  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:58.512959  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:58.514541  9853 leader_election.cc:400] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12.
I20260709 12:27:58.514854  9853 leader_election.cc:403] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:27:58.515893  9853 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:58.516531  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.517004  9886 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:58.517892  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.477764 14518 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.487804 14448 consensus_queue.cc:1059] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:27:58.531215 14597 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.531728 14518 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.533224  9964 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:27:58.537861  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:58.538475  9960 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:58.538512  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:58.539222  9963 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:27:58.539928 14572 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:27:58.542129  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:58.542315 14558 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.542701  9885 raft_consensus.cc:2376] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13. Re-sending same reply.
I20260709 12:27:58.542753 14558 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.543599  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.545207 14558 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.547823  9885 raft_consensus.cc:2393] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 12: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:27:58.531771 14597 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.548617  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.550957 14597 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:58.519057  9957 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:27:58.519737  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:58.497393 14623 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:27:58.523975 14577 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:27:58.562513  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.553722  9853 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:58.524333 14534 consensus_queue.cc:1048] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:58.517845 14542 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:58.571041  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:58.571681  9957 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:27:58.524964  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.526242  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.526778 14671 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.574918  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:58.526849  9807 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:27:58.528059  9810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2846) took 1569 ms. Trace:
I20260709 12:27:58.552577  9962 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:58.523568  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:58.500185 14590 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:58.557826  9808 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
I20260709 12:27:58.577629  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:58.578254  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:58.537849  9884 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
I20260709 12:27:58.563872  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.579106  9885 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 11: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:27:58.570196  9853 leader_election.cc:336] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 2.228s (SENT)
I20260709 12:27:58.553527 14605 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.491746 14584 consensus_queue.cc:1059] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:27:58.574357  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:58.492638 14672 raft_consensus.cc:740] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:27:58.576077  9810 rpcz_store.cc:276] 0709 12:27:56.958900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:56.959229 (+   329us) service_pool.cc:224] Handling call
0709 12:27:57.003959 (+ 44730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:57.582678 (+578719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:57.582705 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:57.582745 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:57.582774 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:58.527804 (+945030us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b5400140354. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:58.527852 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:58.527977 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1330502016}
I20260709 12:27:58.574663  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.559041  9960 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
I20260709 12:27:58.573706  9883 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 16.
I20260709 12:27:58.583801  9890 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:27:58.585665  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:58.579578  9853 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:58.580003  9806 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:27:58.586819  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:58.580830  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.493364 14576 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:27:58.576504  9958 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 6.
I20260709 12:27:58.560997 14594 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12.
I20260709 12:27:58.588919  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:58.583771  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.572137 14670 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.562772 14402 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.572336 14669 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:58.595184  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.595290  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:58.571285 14542 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.574362 14619 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:58.610839 14619 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:58.611070  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.611290 14619 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:58.611699  9814 raft_consensus.cc:2376] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13. Re-sending same reply.
I20260709 12:27:58.612577  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.612680  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:58.613103  9814 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:58.588618 14539 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:27:58.593151  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.614945 14672 consensus_queue.cc:260] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.616302 14672 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:58.593691  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.576263 14628 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.618316  9810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:27:58.618884  9810 raft_consensus.cc:606] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:27:58.618600 14628 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.619407  9810 raft_consensus.cc:614] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:58.580874 14671 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.621770 14671 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:58.614008  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.622700  9814 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:58.623399 14542 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:58.623728 14402 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.625759 14402 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:58.589133  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:58.626350 14670 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.626730 14661 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:58.596022 14538 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.628299 14670 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.582625 14590 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.628870 14590 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:58.574100 14623 raft_consensus.cc:697] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 16 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:27:58.630506  9806 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 16.
I20260709 12:27:58.630168 14623 consensus_queue.cc:237] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.629952  9955 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:27:58.597311 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:58.600797  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:58.600970  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.633505  9813 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:58.588143 14605 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.638087 14605 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.610384 14657 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:58.648710  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.649328  9884 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:58.615414  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.597303  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:27:58.650240  9885 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:58.628201 14538 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:58.585008 14597 consensus_queue.cc:1059] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:27:58.655089  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.657547  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.660066 14538 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:58.662418 14502 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.662926 14502 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.664518  9885 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:27:58.664883 14502 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.626181 14402 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.669766 14402 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.672212 14402 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:58.672873 14402 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:58.640646 14669 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.677328 14669 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.681681 14620 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.683142  9886 raft_consensus.cc:2393] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 12: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:27:58.684072 14620 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.691324  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:27:58.692445  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 123765us
W20260709 12:27:58.634847  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 64693.7us
I20260709 12:27:58.634429 10496 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:27:58.695472 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 61106.8us
I20260709 12:27:58.696272 10496 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:58.697235 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:58.595664  9962 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
I20260709 12:27:58.641192  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.642088  9779 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:58.698729  9883 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:27:58.698930 14443 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:27:58.699069  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 57084.8us
I20260709 12:27:58.699801 14538 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:58.700965  9779 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:58.701251  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.701969  9883 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:27:58.702108 14625 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:58.643570 10497 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:58.613164  9888 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:58.703619  9853 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:27:58.652412  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.706622 14620 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:58.706800  9815 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:27:58.707147 14620 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.707623 14620 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:58.708086  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:58.708850  9815 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:58.715365  9779 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:58.715958  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.716517 14625 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:58.716889  9883 raft_consensus.cc:2410] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 12:27:58.717039  9779 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:58.717993 14538 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:58.731033  9888 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
I20260709 12:27:58.731379 14620 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.734772  9815 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:58.735826  9779 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:58.731877  9888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54428 (request call id 1125) took 1265 ms. Trace:
W20260709 12:27:58.740981  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 52785.8us
I20260709 12:27:58.744315  9813 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:27:58.766249  9813 raft_consensus.cc:606] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:27:58.745189  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.766652  9927 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:58.653316 14657 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:58.686128 14584 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:58.772908 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.747756 14576 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:58.739089 14620 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:58.766719  9813 raft_consensus.cc:614] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:58.767557  9927 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:58.786677  9927 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:58.788291  9927 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:58.789554 14676 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:27:58.790232 14676 raft_consensus.cc:697] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:58.790405 14518 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:58.790972 14518 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.791385 14518 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:58.791371 14676 consensus_queue.cc:237] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.768549  9779 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:58.765203  9888 rpcz_store.cc:276] 0709 12:27:57.466070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:57.518326 (+ 52256us) service_pool.cc:224] Handling call
0709 12:27:58.612541 (+1094215us) spinlock_profiling.cc:243] Waited 82.4 ms on lock 0x7b5800043598. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7a22 00007f2f943108d9 00007f2f9346aee0 00007f2f935340ab 00007f2f93534131 00007f2f934e20a0 00007f2f934e1984 00007f2f8ca5c6d4 00007f2f8ca5c662
0709 12:27:58.731765 (+119224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189521152}
I20260709 12:27:58.773561 10525 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:27:58.773645 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.775862 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:58.796442 10532 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:58.778786  9853 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:58.797763  9853 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:58.783118 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.798364  9779 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:58.801416  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:58.802101  9806 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
I20260709 12:27:58.806269 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.743492 14558 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:27:58.811811  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.812604  9883 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:27:58.770653 14538 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:58.773375 14584 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.774133 14657 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:58.775039 14605 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:58.784471 14576 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.815284  9853 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:58.800134 14669 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:58.849836  9888 raft_consensus.cc:1275] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:27:58.838375 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.906572 10525 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:27:58.906881  9883 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:27:58.868856 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.817160 14572 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:58.804289 14625 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:58.820475 14620 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:58.914952 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.836556 14595 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:58.902352  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.900851 10532 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:27:58.821082  9779 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:58.822707 14584 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:58.916740  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.916651  9883 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:27:58.918414  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.923494  9886 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:27:58.915666 10525 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
W20260709 12:27:58.903630  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 88404.3us
I20260709 12:27:58.925629  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:58.936000  9928 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:58.904510 14576 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:58.944621 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.941442  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:58.866127 14534 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:58.912696 14590 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:58.946156 14534 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:58.948477  9812 raft_consensus.cc:2393] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 12: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:27:58.942324 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.909560 14669 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.943924 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.908001 14594 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:58.955312 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.949335 10532 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:58.956696 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.958457 10532 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:58.906127 14443 raft_consensus.cc:697] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:58.912261 14402 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:27:58.953318  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 132324us
I20260709 12:27:58.911448 14605 raft_consensus.cc:697] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:58.962745 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:58.963541  9779 leader_election.cc:400] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 12. Current term is 13.
W20260709 12:27:58.952301  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 48320us
W20260709 12:27:58.959859 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 316365us
I20260709 12:27:58.960969 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.966853 10531 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:27:58.944438 14595 raft_consensus.cc:697] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:58.954691 14669 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:58.990856 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.955318 14620 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:58.957546 14625 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:58.964882 14594 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:58.949347 14664 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:58.993947 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:58.962854 14402 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:27:58.965963  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:58.964310 14534 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:59.009737 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:59.011015 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:59.014580 10525 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:59.025772 10525 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
W20260709 12:27:59.031206  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 65329.1us
I20260709 12:27:59.032150  9779 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:59.032473  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:59.034042  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:59.038045  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:59.011822 14590 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:59.027644 14402 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:59.054114 14684 log.cc:927] Time spent T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:27:59.012039 14620 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:59.057124 14620 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:59.034907 14572 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:59.059695 14619 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.042544 14518 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.026541 14542 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.063973 14518 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:59.064468 14542 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:59.065327  9808 raft_consensus.cc:2393] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 14: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
W20260709 12:27:59.066308 14683 log.cc:927] Time spent T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:27:59.067262 14681 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.067539 14448 raft_consensus.cc:3055] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:59.067917 14448 raft_consensus.cc:740] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:59.067780 14681 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.068715 14448 consensus_queue.cc:260] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.069834 14681 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:59.069897 14448 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:59.070365 14631 log.cc:927] Time spent T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:27:59.078701 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:59.078639  9928 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:59.083034  9814 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:27:59.083161 14572 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:59.083670 14572 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:59.084043  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:59.084539  9814 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:59.085740 14542 raft_consensus.cc:2764] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
W20260709 12:27:59.085999 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 44575.3us
I20260709 12:27:59.087492 10497 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:59.088595 14695 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:59.088991 14695 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.089125  9806 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:27:59.089290 10497 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:59.090109 10497 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:59.092036 10497 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:59.102810  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:59.093127 10497 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:59.088186 14619 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:59.091303 14691 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:27:59.085754 14572 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:59.089355 14695 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:59.097046 14502 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:59.078394 14553 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:27:59.122157  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:59.161330  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:59.102922 14518 consensus_queue.cc:1048] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:27:59.172533  9955 raft_consensus.cc:2410] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
W20260709 12:27:59.174096  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 248502us
I20260709 12:27:59.120623  9814 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
W20260709 12:27:59.141175  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 109121us
I20260709 12:27:59.177603  9779 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:59.045970 14605 consensus_queue.cc:237] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:59.102202 14622 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.178781  9779 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:59.182776 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:59.189455  9854 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:59.184983  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:27:59.204778  9884 raft_consensus.cc:1240] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 13. Current term is 14. Ops: []
I20260709 12:27:59.212730  9854 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:59.215673  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:59.229611  9854 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:59.188432 14619 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:59.106379 14443 consensus_queue.cc:237] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.241953  9779 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:59.249773  9779 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:59.213559 14542 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:59.114507 14595 consensus_queue.cc:237] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.238041 14590 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:27:59.258142 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 122310us
I20260709 12:27:59.260803 14576 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.266212 10533 raft_consensus.cc:2393] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 7: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:59.207962 14622 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:59.254845 14672 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:59.256825 14664 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:59.293973  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:59.292276  9779 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:59.295763  9955 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:59.288471 14661 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:59.244869 14619 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:59.300414 14694 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:27:59.301007 14694 raft_consensus.cc:697] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:59.301875 14694 consensus_queue.cc:237] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.289705 14697 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:59.291601 14576 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:59.306007  9955 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
W20260709 12:27:59.306509 14688 log.cc:927] Time spent T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:27:59.307964 14685 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 12:27:59.308439 10496 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:59.305605 14697 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.266651 14682 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:27:59.305567 14680 log.cc:927] Time spent T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:27:59.328629  9779 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:27:59.348057  9779 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:59.289099 14693 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:27:59.310163 14697 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:59.354509  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 251735us
I20260709 12:27:59.310243 14685 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:59.369614 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:59.370415 10526 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:27:59.327330 14590 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:59.371381 14577 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:59.376648 14700 log.cc:927] Time spent T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:27:59.377156 14622 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:59.381189  9960 raft_consensus.cc:1240] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:27:59.382242  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:59.289073 14674 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.267s
I20260709 12:27:59.353917 14538 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:59.375774 14690 log.cc:927] Time spent T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.335s	user 0.000s	sys 0.003s
I20260709 12:27:59.357949  9928 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:27:59.373618 14693 raft_consensus.cc:697] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 16 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:59.369400 14691 raft_consensus.cc:697] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:59.404163 14685 raft_consensus.cc:697] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:59.434994 14685 consensus_queue.cc:237] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.435405 14710 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:27:59.436259  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:27:59.437038  9958 raft_consensus.cc:2393] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 14: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:59.439612 10496 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:59.440804 14710 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:27:59.444952 14704 log.cc:927] Time spent T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:27:59.435664 14592 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:59.446162 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:59.445716 14710 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:27:59.447191  9958 raft_consensus.cc:1275] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:27:59.448805 14632 raft_consensus.cc:3055] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:59.449224 14632 raft_consensus.cc:740] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:27:59.450064 14671 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:59.450295 14691 consensus_queue.cc:237] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.344843 14402 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.454501 14402 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:59.455355  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:59.456713  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:27:59.457969 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:27:59.450109 14632 consensus_queue.cc:260] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.460683 14632 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:59.463092 14661 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:59.463595 14661 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:59.466989  9778 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
W20260709 12:27:59.467339 14651 log.cc:927] Time spent T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 1.249s	user 0.004s	sys 0.000s
I20260709 12:27:59.468003 10496 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:59.468820 14448 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:59.469273 10496 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:59.469470  9811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2867) took 1515 ms. Trace:
I20260709 12:27:59.470088 14597 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:59.469970  9811 rpcz_store.cc:276] 0709 12:27:57.953807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:57.953954 (+   147us) service_pool.cc:224] Handling call
0709 12:27:57.965631 (+ 11677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:57.971748 (+  6117us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:27:58.090646 (+118898us) log.cc:844] Serialized 14 byte log entry
0709 12:27:58.128108 (+ 37462us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:58.130258 (+  2150us) log.cc:844] Serialized 26 byte log entry
0709 12:27:58.130415 (+   157us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:58.130447 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:58.130525 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:58.863933 (+733408us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b18001ab900. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f3f3 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:27:59.466735 (+602802us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:27:59.469245 (+  2510us) raft_consensus.cc:1685] finished
0709 12:27:59.469294 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:59.469412 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14713,"prepare.queue_time_us":139581,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":248,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":8176,"spinlock_wait_cycles":45502208,"thread_start_us":132922,"threads_started":2,"wal-append.queue_time_us":106890}
I20260709 12:27:59.454101 10532 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:59.478683 10496 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:59.489814 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:27:59.412328 14625 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:27:59.470985 14711 log.cc:927] Time spent T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:27:59.475999 14622 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:27:59.433020  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 75141.5us
I20260709 12:27:59.524573 10532 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:59.470498 14590 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:59.527392  9814 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:27:59.531243  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:59.501510 14597 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.525516 14538 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:59.535719 14706 log.cc:927] Time spent T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 12:27:59.535567 14622 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.525723 14534 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:59.535588 14714 log.cc:927] Time spent T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:27:59.538460  9928 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:59.538775 14703 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:27:59.542389  9889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 1134) took 1949 ms. Trace:
I20260709 12:27:59.544777  9961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 934) took 1009 ms. Trace:
I20260709 12:27:59.594399  9961 rpcz_store.cc:276] 0709 12:27:58.535703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.552731 (+ 17028us) service_pool.cc:224] Handling call
0709 12:27:58.555235 (+  2504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:58.639185 (+ 83950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:58.639243 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:58.639807 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 12:27:58.782880 (+143073us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:58.782915 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:59.544451 (+761536us) spinlock_profiling.cc:243] Waited 83.5 ms on lock 0x7b5400114754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:59.544493 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:59.544535 (+    42us) raft_consensus.cc:1685] finished
0709 12:27:59.544547 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:59.544724 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9826,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":26254,"spinlock_wait_cycles":192041728,"thread_start_us":142700,"threads_started":1,"wal-append.queue_time_us":304306}
I20260709 12:27:59.547747 14594 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.552908 14682 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:27:59.554868  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:27:59.600311  9806 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:59.503750 14448 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:59.569213  9815 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:27:59.570115 14590 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.500073 14623 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.573657  9813 raft_consensus.cc:2368] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 11. Current term is 12.
I20260709 12:27:59.586865  9958 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:27:59.580794 14597 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:59.598475  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 60092.8us
I20260709 12:27:59.605971  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:59.500289 14577 consensus_queue.cc:1048] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:27:59.592988  9889 rpcz_store.cc:276] 0709 12:27:57.592690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.097852 (+505162us) service_pool.cc:224] Handling call
0709 12:27:58.098189 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:59.068451 (+970262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:59.068483 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:59.068983 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 12:27:59.201366 (+132383us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:59.201420 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:59.542019 (+340599us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b5400218754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:27:59.542063 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:59.542104 (+    41us) raft_consensus.cc:1685] finished
0709 12:27:59.542118 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:59.542316 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3317,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4006,"spinlock_wait_cycles":2230594432,"thread_start_us":131978,"threads_started":1,"wal-append.queue_time_us":185019}
I20260709 12:27:59.606791  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:59.618646  9928 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:27:59.603304 14473 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:59.620343  9882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 1127) took 2153 ms. Trace:
I20260709 12:27:59.601843 14682 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:59.588555 14538 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.627604  9882 rpcz_store.cc:276] 0709 12:27:57.466651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:57.608390 (+141739us) service_pool.cc:224] Handling call
0709 12:27:57.618070 (+  9680us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:57.690575 (+ 72505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:57.690624 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:57.691025 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 12:27:59.210154 (+1519129us) spinlock_profiling.cc:243] Waited 28.4 ms on lock 0x7b1800362860. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b411e07 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f8e0b620b 00007f2f8e0bbd23 00007f2f8e0bc0d1 00007f2f8e4d7a0f
0709 12:27:59.288217 (+ 78063us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:59.288280 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:59.288420 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:59.611081 (+322661us) raft_consensus.cc:1685] finished
0709 12:27:59.611103 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:59.620262 (+  9159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2612,"raft.queue_time_us":5445,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":9751,"spinlock_wait_cycles":65441408,"thread_start_us":77801,"threads_started":1,"wal-append.queue_time_us":1654170}
I20260709 12:27:59.624255  9928 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:27:59.625912 10496 leader_election.cc:400] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 11. Current term is 12.
I20260709 12:27:59.604063 14448 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.646206  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:59.656765 14619 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:59.646438  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:27:59.673228  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 49045.9us
W20260709 12:27:59.669127 14584 consensus_meta.cc:287] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.000s
I20260709 12:27:59.648717 14518 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:59.609481 14590 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:59.609113 14623 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:59.653736  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:59.602051 14594 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:59.629721 14476 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:27:59.626784 14612 consensus_queue.cc:1048] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
W20260709 12:27:59.649048  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 419508us
I20260709 12:27:59.624724 14402 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:27:59.670660 10496 leader_election.cc:403] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 12:27:59.719743 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 93962.2us
I20260709 12:27:59.718323  9854 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:27:59.656335 14473 raft_consensus.cc:697] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:27:59.603940 14693 consensus_queue.cc:237] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.659394  9806 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:27:59.683766  9889 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:27:59.722827  9889 pending_rounds.cc:85] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 8
I20260709 12:27:59.723002  9889 pending_rounds.cc:107] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:27:59.723274  9889 raft_consensus.cc:2889] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:59.709338  9964 raft_consensus.cc:1240] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:59.711865  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:27:59.672916 14448 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:59.671691 14674 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:59.721279  9814 raft_consensus.cc:1240] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: []
W20260709 12:27:59.717626 14717 log.cc:927] Time spent T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:27:59.724555  9887 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:27:59.732196 14671 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:27:59.725365 14657 consensus_meta.cc:287] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.821s	user 0.007s	sys 0.005s
I20260709 12:27:59.722147 14694 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 11. Current term is 12.
I20260709 12:27:59.708886 14584 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.745040  9854 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:27:59.735630 14712 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.724730 14402 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.770637 14622 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:59.790776 14728 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:59.750521 14611 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.171s
I20260709 12:27:59.822523 10529 raft_consensus.cc:2393] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 12: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:27:59.743458 14721 raft_consensus.cc:2764] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:27:59.750761 14698 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:59.745805 14657 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:59.843631 10524 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 1176) took 1074 ms. Trace:
I20260709 12:27:59.750973 14730 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:27:59.844337 14669 consensus_meta.cc:287] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.815s	user 0.009s	sys 0.003s
I20260709 12:27:59.860877  9928 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:27:59.861030 10524 rpcz_store.cc:276] 0709 12:27:58.756828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.756977 (+   149us) service_pool.cc:224] Handling call
0709 12:27:58.757262 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:59.012670 (+255408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:59.012715 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:59.032924 (+ 20209us) log.cc:844] Serialized 26 byte log entry
0709 12:27:59.393506 (+360582us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:59.393559 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:59.393647 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:59.831156 (+437509us) raft_consensus.cc:1685] finished
0709 12:27:59.831177 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:59.831311 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2462,"raft.queue_time_us":202838,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":14258,"thread_start_us":545860,"threads_started":2,"wal-append.queue_time_us":563061}
I20260709 12:27:59.858804 14728 raft_consensus.cc:697] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
W20260709 12:27:59.879985 14731 log.cc:927] Time spent T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:27:59.879670 14728 consensus_queue.cc:237] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:27:59.881008 14726 log.cc:927] Time spent T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
W20260709 12:27:59.881251 14542 consensus_meta.cc:287] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.000s
I20260709 12:27:59.881660 14542 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:59.882208  9957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 936) took 1289 ms. Trace:
I20260709 12:27:59.883879 14402 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:27:59.835670 14712 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.882601  9957 rpcz_store.cc:276] 0709 12:27:58.592830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.622632 (+ 29802us) service_pool.cc:224] Handling call
0709 12:27:58.622935 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:58.686598 (+ 63663us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:58.686640 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:58.742736 (+ 56096us) log.cc:844] Serialized 26 byte log entry
0709 12:27:59.370203 (+627467us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b1800198ee0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b411e07 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f8e0b620b 00007f2f8e0bbd23 00007f2f8e0bc0d1 00007f2f8e4d7a0f
0709 12:27:59.482791 (+112588us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:59.482864 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:59.483001 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:59.881934 (+398933us) raft_consensus.cc:1685] finished
0709 12:27:59.881952 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:59.882149 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69430,"raft.queue_time_us":69106,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":45821,"spinlock_wait_cycles":4117888,"thread_start_us":112185,"threads_started":1,"wal-append.queue_time_us":853561}
I20260709 12:27:59.888757 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:59.877882 14538 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:59.844839 14661 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.877157 14473 consensus_queue.cc:237] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:27:59.888645 14669 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:27:59.875262 14730 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:59.915472  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 170515us
I20260709 12:27:59.908373  9884 raft_consensus.cc:1240] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:00.016353 10524 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:28:00.009142 14542 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:00.028240 14657 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:00.028584 14542 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:00.030645 14542 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:00.009606 14443 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:28:00.031278 14695 consensus_meta.cc:287] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.870s	user 0.012s	sys 0.000s
I20260709 12:28:00.031428 10531 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:28:00.031771 14695 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.031316 14443 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.035109 10525 raft_consensus.cc:2393] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 12: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:00.036257 14695 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:27:59.891031 14674 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.037322 14674 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:00.040225  9779 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:00.040572 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:27:59.893728  9928 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:00.017076 10497 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:00.023887 14682 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.024447 14518 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:27:59.908080 14469 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:00.026562 14597 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.044912 14402 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:00.028057 14628 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:27:59.960091 14594 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:00.042694 10531 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:28:00.049495 10533 raft_consensus.cc:1240] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:00.021803 14448 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.052493  9962 raft_consensus.cc:2393] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 15: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:28:00.041841  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 148185us
W20260709 12:28:00.055063 10529 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 1177) took 1292 ms (client timeout 1505 ms). Trace:
W20260709 12:28:00.061772 10529 rpcz_store.cc:269] 0709 12:27:58.758467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.758604 (+   137us) service_pool.cc:224] Handling call
0709 12:28:00.051091 (+1292487us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b54002ee0d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:00.051211 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2247072128}
I20260709 12:28:00.052899 14745 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.051564 14469 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:00.063120 14469 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:00.063055 14745 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:00.062083  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:00.039599 14730 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:00.045110 14611 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:00.051693 14518 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:00.039753 14712 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:00.058543 14590 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:00.049324 14622 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:00.049998 14657 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.052037 14542 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:28:00.075302  9812 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 851) took 1572 ms (client timeout 2004 ms). Trace:
I20260709 12:28:00.059784 14594 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:00.050104 14623 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:00.085777 14682 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:00.072729 14611 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.048262 14595 consensus_queue.cc:1059] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:28:00.092502  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:00.093320 14577 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.093904  9778 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:00.095191 14733 log.cc:927] Time spent T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.137s	user 0.004s	sys 0.004s
I20260709 12:28:00.096179  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:00.049150 14597 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:00.098850  9812 rpcz_store.cc:269] 0709 12:27:58.497639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.497766 (+   127us) service_pool.cc:224] Handling call
0709 12:28:00.069672 (+1571906us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b54004510d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:00.069811 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1030701824}
I20260709 12:28:00.074132 14410 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:28:00.096275 14697 consensus_meta.cc:287] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.000s
I20260709 12:28:00.127363  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:00.068799  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:00.141239  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:00.142855  9883 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:28:00.144832  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:00.145758  9889 raft_consensus.cc:2368] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 11. Current term is 12.
I20260709 12:28:00.147037  9890 raft_consensus.cc:1275] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:28:00.120751 14611 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:28:00.148303 14729 log.cc:927] Time spent T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.177s	user 0.001s	sys 0.006s
I20260709 12:28:00.150609 14745 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:00.153167  9807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:00.153995  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:00.154610  9881 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:00.154893 14410 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:00.112177 14622 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.154959 14674 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:00.110906 14584 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:00.138881 14682 raft_consensus.cc:3055] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:00.109413 14619 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:28:00.160576  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 65071us
I20260709 12:28:00.139962 14542 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:00.164968  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:00.166457  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:00.166841  9779 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:00.102288 14657 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:00.175509 10497 leader_election.cc:400] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 11. Current term is 12.
I20260709 12:28:00.111197 14594 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:00.184423  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:00.172698  9927 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:00.180883  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:00.186632  9889 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:28:00.182963  9807 raft_consensus.cc:606] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Received request to transfer leadership to TS b011791796d1457284b857d7d3422195
I20260709 12:28:00.187721  9807 raft_consensus.cc:614] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:00.162248 14682 raft_consensus.cc:740] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:00.108839 14469 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.144863 14697 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.195775 14682 consensus_queue.cc:260] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.196164 14695 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:00.139851 14577 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.145002 14538 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:28:00.213141  9881 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 7.
I20260709 12:28:00.181747 14590 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:00.217988  9881 raft_consensus.cc:1240] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:00.160223 14721 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:28:00.192523 14476 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:00.181407 14674 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:28:00.224936 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:00.225865  9888 raft_consensus.cc:2393] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 12: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
W20260709 12:28:00.226742  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 158055us
I20260709 12:28:00.189769 14597 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:28:00.182776 14628 consensus_queue.cc:1048] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:28:00.192258 14745 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:28:00.181948 14619 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.220717 14443 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:00.219620 14661 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:00.246560  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:00.237425 14756 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.238323 14594 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:00.234964 14448 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:00.233863 14758 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:00.239382 14622 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:00.243342 14577 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:00.212406 14749 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:28:00.345183 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:00.355805 10531 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:28:00.230715 14669 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:00.226122 14682 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:00.282119 14628 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:00.351836 14619 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:00.345929 14590 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:00.228015 14476 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:00.367818 14518 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.369735 14657 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:00.243999 14730 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:00.362799 14743 log.cc:927] Time spent T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 12:28:00.362244 14758 raft_consensus.cc:697] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:00.390033  9883 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 12: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:00.396839  9964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 2356) took 1459 ms. Trace:
I20260709 12:28:00.397336  9964 rpcz_store.cc:276] 0709 12:27:58.937900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.938754 (+   854us) service_pool.cc:224] Handling call
0709 12:27:58.956778 (+ 18024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:59.723691 (+766913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:00.396557 (+672866us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b540014d7d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:00.396770 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1730193152}
I20260709 12:28:00.399967 14469 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:00.401226 14752 log.cc:927] Time spent T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:28:00.372537 14628 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:00.404096 14628 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:00.394763 14542 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.363206 14756 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.404947 14542 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.407088 14542 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:00.286413 14611 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.409269 14611 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:00.409382  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:00.410696 14697 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:00.412986 14758 consensus_queue.cc:237] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.407049 14756 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:00.275774 14693 consensus_queue.cc:1059] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 12:28:00.415815  9963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 2351) took 1848 ms. Trace:
I20260709 12:28:00.415748  9960 raft_consensus.cc:1240] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:28:00.416450  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:00.415288 14518 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:00.421105  9963 rpcz_store.cc:276] 0709 12:27:58.567187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.596673 (+ 29486us) service_pool.cc:224] Handling call
0709 12:27:58.596917 (+   244us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:58.649276 (+ 52359us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:58.654479 (+  5203us) log.cc:844] Serialized 14 byte log entry
0709 12:27:58.872042 (+217563us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b18002ef360. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f3f3 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:28:00.067366 (+1195324us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b18002ef360. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b411e07 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f8e0b620b 00007f2f8e0bbd23 00007f2f8e0bc23a 00007f2f8e526a2a
0709 12:28:00.162396 (+ 95030us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:00.191165 (+ 28769us) log.cc:844] Serialized 52 byte log entry
0709 12:28:00.191323 (+   158us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:28:00.191370 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:00.191461 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:00.415626 (+224165us) raft_consensus.cc:1685] finished
0709 12:28:00.415644 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:00.415762 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51990,"prepare.queue_time_us":5021,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":44,"raft.queue_time_us":92091,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":129,"spinlock_wait_cycles":143437440,"thread_start_us":92037,"threads_started":2,"wal-append.queue_time_us":1539720}
I20260709 12:28:00.377095 14590 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:00.485284 14757 log.cc:927] Time spent T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:28:00.489840 14577 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.490099 14745 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:00.488888 14691 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:00.499341 14749 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:00.584343 14697 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.490453 14542 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:28:00.651592  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 375095us
I20260709 12:28:00.663573  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:00.664572  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:00.666512  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:00.644483 14691 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.641232 14577 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.641590 14745 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.654415 14697 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.649266 14749 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.665594 14628 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:00.694697 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:00.695341 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:00.670094 14590 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:00.664911 14664 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:28:00.703229 10531 raft_consensus.cc:2393] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 15: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:00.656677 14542 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.688647 14622 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:00.693089 14657 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.719515 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:00.720546 10530 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:28:00.721403 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:00.737284 10531 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:28:00.757524  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 436269us
I20260709 12:28:00.707844 14770 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.840011 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:00.844162 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:00.838585  9854 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:00.845832 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:00.847079 14728 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:00.847520 14728 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:00.847927 14728 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:00.848484 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:00.850818 10530 raft_consensus.cc:1240] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:00.726106 14590 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:00.733935 14759 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.723464 14730 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:00.806705 14757 log.cc:927] Time spent T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:28:00.705152 14628 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.723152 14657 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.723887 14622 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:00.871992  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 135309us
I20260709 12:28:00.889922  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2902) took 1376 ms. Trace:
I20260709 12:28:00.894979  9884 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2642) took 1217 ms. Trace:
I20260709 12:28:00.808321 14772 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.142s
I20260709 12:28:00.914022  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:00.890403  9815 rpcz_store.cc:276] 0709 12:27:59.513307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:59.513454 (+   147us) service_pool.cc:224] Handling call
0709 12:27:59.517297 (+  3843us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:59.601770 (+ 84473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:00.889702 (+1287932us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b540033f754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:00.889864 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118629120}
I20260709 12:28:00.871960 14775 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:00.958952  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:00.933037 10531 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:28:00.895577  9884 rpcz_store.cc:276] 0709 12:27:59.677361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:59.686468 (+  9107us) service_pool.cc:224] Handling call
0709 12:27:59.717653 (+ 31185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:00.014399 (+296746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:00.894676 (+880277us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54002c56d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:00.894902 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438171392}
I20260709 12:28:00.940517  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:00.960644  9812 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:28:00.961694  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:00.962437  9812 raft_consensus.cc:2393] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 12: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:28:00.944613  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:00.946152  9806 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:28:00.966387  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:00.967022  9815 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:00.867161 14759 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.972471  9809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2896) took 1999 ms. Trace:
I20260709 12:28:00.971107  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:00.865427 14590 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:00.976647  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:00.857410 14770 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:00.979126  9814 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:28:00.970225 14775 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:00.977931  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:00.975184 14572 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:00.980984  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:00.975381 14672 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:00.966848 14773 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.011142  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:00.884215 14779 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:28:00.970489 14737 log.cc:927] Time spent T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 1.092s	user 0.006s	sys 0.000s
I20260709 12:28:00.978330  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:00.977676 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:00.988667  9963 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:28:00.970261 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:00.879777  9698 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d1e4bd6e7a424475b1d707bfa268d54e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f5208640a51f493e930ce4f64ceeed0b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
W20260709 12:28:01.034577  9698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 158454us
I20260709 12:28:01.012254 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:01.033252 10528 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 16.
I20260709 12:28:00.977206  9809 rpcz_store.cc:276] 0709 12:27:58.974618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.974920 (+   302us) service_pool.cc:224] Handling call
0709 12:27:58.975533 (+   613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:58.975934 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:58.992283 (+ 16349us) log.cc:844] Serialized 14 byte log entry
0709 12:28:00.891084 (+1898801us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b1800461b00. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b411e07 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f8e0b620b 00007f2f8e0bbd23 00007f2f8e0bc23a 00007f2f8e526a2a
0709 12:28:00.971325 (+ 80241us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:00.971589 (+   264us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:00.971908 (+   319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:00.972265 (+   357us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:00.972405 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16113,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":14913,"spinlock_wait_cycles":3976960,"thread_start_us":77979,"threads_started":1}
I20260709 12:28:01.038039  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:01.039408  9806 raft_consensus.cc:3060] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:01.037700  9884 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:01.030875  9815 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:28:01.029160  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:01.041497  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:01.047043  9809 raft_consensus.cc:2393] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 12: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:01.050209 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:01.051093 10528 raft_consensus.cc:2393] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 14: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:28:01.040161 14765 log.cc:927] Time spent T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.375s	user 0.001s	sys 0.001s
I20260709 12:28:01.036566 14745 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:01.058043 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:01.058751 14759 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:01.058683  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:28:01.051807 14769 log.cc:927] Time spent T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.364s	user 0.001s	sys 0.000s
I20260709 12:28:01.011777 14773 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:01.035301 14779 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:01.086437  9964 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:28:01.041814 14672 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:01.090011 14672 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.061493 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:01.052067  9815 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
W20260709 12:28:01.044025 14674 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.053s	sys 0.093s
I20260709 12:28:01.091603  9815 pending_rounds.cc:85] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: Aborting all ops after (but not including) 10
W20260709 12:28:01.091727 14674 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.053s	sys 0.093s
I20260709 12:28:01.091913  9815 pending_rounds.cc:107] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:28:01.092188  9815 raft_consensus.cc:2889] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:01.092262 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:01.093631 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:01.097834  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:01.098529  9889 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:28:01.068969 14622 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.047580 14697 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:01.069770  9806 raft_consensus.cc:2468] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 15.
I20260709 12:28:01.069950 14782 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:01.099354  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:01.099498 14782 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:01.099908  9889 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:28:01.101142 10497 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:01.072947  9956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1788) took 1590 ms. Trace:
I20260709 12:28:01.101717 10525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 882) took 1732 ms. Trace:
I20260709 12:28:01.077016 10533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 1192) took 1036 ms. Trace:
I20260709 12:28:01.102205 14443 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:01.102823 14443 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:01.102514 10533 rpcz_store.cc:276] 0709 12:28:00.040183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:00.040287 (+   104us) service_pool.cc:224] Handling call
0709 12:28:00.042737 (+  2450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:00.053859 (+ 11122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:01.076693 (+1022834us) spinlock_profiling.cc:243] Waited 6.57 ms on lock 0x7b5400832054. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:01.076934 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15121792}
I20260709 12:28:01.103516 14443 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:01.104467 10533 raft_consensus.cc:1240] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:28:01.106657  9962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48438 (request call id 939) took 2073 ms. Trace:
I20260709 12:28:01.107034  9962 rpcz_store.cc:276] 0709 12:27:59.033727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:59.033838 (+   111us) service_pool.cc:224] Handling call
0709 12:28:01.106476 (+2072638us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400413054. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:01.106600 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2340241152}
W20260709 12:28:01.109396 14763 log.cc:927] Time spent T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.416s	user 0.003s	sys 0.000s
I20260709 12:28:01.112046 14773 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:01.101891  9956 rpcz_store.cc:276] 0709 12:27:59.482469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:59.528843 (+ 46374us) service_pool.cc:224] Handling call
0709 12:27:59.529202 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:59.591378 (+ 62176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:59.591409 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:59.594897 (+  3488us) log.cc:844] Serialized 26 byte log entry
0709 12:27:59.739028 (+144131us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:59.739079 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:59.739138 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:00.889102 (+1149964us) spinlock_profiling.cc:243] Waited 7.54 ms on lock 0x7b240025ccb8. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b2b59c4 00007f2f8b2b3acb 00007f2f8b46edc9 00007f2f8b46ea55 00007f2f8b46e09d 00007f2f8e0a010e 00007f2f8e0b788c 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221
0709 12:28:01.072587 (+183485us) raft_consensus.cc:1685] finished
0709 12:28:01.072617 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:01.072874 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61777,"raft.queue_time_us":63285,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":863,"spinlock_wait_cycles":17343232,"thread_start_us":123421,"threads_started":1,"wal-append.queue_time_us":238136}
I20260709 12:28:01.039912 14656 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:01.080175 10528 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:28:01.082733  9884 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:01.087859 14779 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.168743  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:01.169409  9884 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:28:01.170220  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:01.171468  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:01.051230 14691 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.174737  9957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1790) took 1083 ms. Trace:
I20260709 12:28:01.128736  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:01.102171 10525 rpcz_store.cc:276] 0709 12:27:59.369209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:59.369322 (+   113us) service_pool.cc:224] Handling call
0709 12:28:01.101544 (+1732222us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b54004e43d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:01.101660 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1528197888}
I20260709 12:28:01.175091 10496 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:01.181123  9957 rpcz_store.cc:276] 0709 12:28:00.091535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:00.097044 (+  5509us) service_pool.cc:224] Handling call
0709 12:28:00.110232 (+ 13188us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:00.172850 (+ 62618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:00.172882 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:00.173239 (+   357us) log.cc:844] Serialized 26 byte log entry
0709 12:28:00.434771 (+261532us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:28:00.434810 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:00.435179 (+   369us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:01.108657 (+673478us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:28:01.116188 (+  7531us) raft_consensus.cc:1685] finished
0709 12:28:01.116214 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:01.174676 (+ 58462us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43993,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":9583872,"thread_start_us":279160,"threads_started":2,"wal-append.queue_time_us":458685}
I20260709 12:28:01.170692 14773 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.079526 14577 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:01.204694 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:01.101723 14782 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.176154 14779 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:01.205487 10525 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:28:01.223237  9854 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:01.196563 14691 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.115789 14542 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:01.204890 14749 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:01.215035 14783 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:01.228878 14783 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:01.217988  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:01.230608  9886 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:28:01.231057 14783 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.195263 14697 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:01.172530 14656 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:01.201921 14622 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:01.259529 14656 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.260617 14622 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:01.233592 14745 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:01.206180 14773 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:01.269939 14622 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:01.275998  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 245141us
I20260709 12:28:01.233287 14779 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:01.265933 14693 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:01.240516 14691 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:01.259572 14584 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:28:01.282011  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:01.291174  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:01.292040  9809 raft_consensus.cc:2393] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 15: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:01.294941  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:01.295714  9957 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
W20260709 12:28:01.296196  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 331270us
I20260709 12:28:01.297573  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:01.299499  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:01.241295 14657 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:01.274740 14745 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:01.313239 14745 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:01.277892 14656 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:01.314630 14656 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:01.315382 14691 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:01.316697 14656 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.317225 14656 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.317662 14656 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:01.273393 14675 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:28:01.311204 14728 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:01.278895 14693 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:01.278646 14789 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:01.339680  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:01.289719 14542 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.326963  9888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1685) took 1200 ms. Trace:
I20260709 12:28:01.343461  9888 rpcz_store.cc:276] 0709 12:28:00.126618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:00.127069 (+   451us) service_pool.cc:224] Handling call
0709 12:28:01.326755 (+1199686us) spinlock_profiling.cc:243] Waited 81.8 ms on lock 0x7b5400217d54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:01.326898 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188186496}
I20260709 12:28:01.344960  9888 raft_consensus.cc:1240] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:28:01.304322 14783 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:01.297395  9928 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:01.335718  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:01.336820  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:28:01.347949  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 50615.1us
I20260709 12:28:01.348520  9888 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:28:01.349061  9778 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:01.351747  9888 raft_consensus.cc:1240] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:01.330847 14745 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:01.339555  9889 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:28:01.306907 14628 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:01.337580  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:01.356195  9962 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:28:01.340876  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:01.341409  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:01.339306  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:01.323776 14779 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.361334  9778 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:01.277463 14697 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:01.341390  9809 raft_consensus.cc:1240] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:28:01.347257  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:01.358234  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:01.359215  9928 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:28:01.361639 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 160826us
I20260709 12:28:01.339283 14693 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:01.355237 14472 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:01.372025  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:01.377067  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:01.357538 14770 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:01.354851 14783 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:01.353657 14542 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:01.395874  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:01.404917  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:01.400039 14783 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.395529 14410 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:28:01.406024 14410 raft_consensus.cc:697] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:01.402510  9887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2644) took 1724 ms. Trace:
I20260709 12:28:01.396844 14794 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:01.407773 14794 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:01.406989 14410 consensus_queue.cc:237] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:01.396026  9886 raft_consensus.cc:1240] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:01.409976 14794 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.393733 14676 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.411327 14676 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:01.411875 10531 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:28:01.410420 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:01.406723  9887 rpcz_store.cc:276] 0709 12:27:59.677871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:59.678014 (+   143us) service_pool.cc:224] Handling call
0709 12:27:59.714713 (+ 36699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:59.727637 (+ 12924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:01.402298 (+1674661us) spinlock_profiling.cc:243] Waited 9.52 ms on lock 0x7b54002c51d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:01.402452 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21888768}
I20260709 12:28:01.417757 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:01.418550 10531 raft_consensus.cc:2393] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 12: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:01.392669 14472 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:01.426702 14472 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:01.426920  9887 raft_consensus.cc:3055] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:01.427356  9887 raft_consensus.cc:740] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:01.428087  9887 consensus_queue.cc:260] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:01.429021  9887 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:01.364878 14606 consensus_queue.cc:1059] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:28:01.431509 14606 raft_consensus.cc:3055] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:01.431847 14606 raft_consensus.cc:740] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:01.391911 14779 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:01.370817 14793 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:01.347728 14789 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:01.401893 14542 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:01.483029 10496 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:01.486652  9887 raft_consensus.cc:1275] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:28:01.487150  9887 pending_rounds.cc:85] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 6
I20260709 12:28:01.488521  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:01.438757 14779 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:01.443617 14793 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:01.489661  9887 pending_rounds.cc:107] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:28:01.486146 14682 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:28:01.493163  9887 raft_consensus.cc:2889] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:01.475690 14709 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:01.493781 14779 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:01.495594 14793 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:01.519338  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:01.487414 14443 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:01.533293 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 50350.7us
I20260709 12:28:01.509598 14676 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:01.521170 14773 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.538656 10530 raft_consensus.cc:1240] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:01.541241 10496 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:01.555935 10496 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:01.529456 14728 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:01.561559  9962 raft_consensus.cc:1240] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:01.562572 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:01.563674  9883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54428 (request call id 1159) took 1398 ms. Trace:
I20260709 12:28:01.565201  9882 raft_consensus.cc:1240] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:28:01.564106  9883 rpcz_store.cc:276] 0709 12:28:00.165411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:00.166229 (+   818us) service_pool.cc:224] Handling call
0709 12:28:01.563471 (+1397242us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b540029aed4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:01.563615 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":500738432}
I20260709 12:28:01.534544 14656 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:01.595057 14671 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:01.502182 14709 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:01.503479 14606 consensus_queue.cc:260] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:01.599512 14606 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:28:01.599777 14734 log.cc:927] Time spent T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 1.756s	user 0.004s	sys 0.003s
I20260709 12:28:01.603147 14789 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.604282  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:28:01.605543 14801 log.cc:927] Time spent T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:28:01.614975 14443 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.616101  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:01.616788  9808 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:28:01.618778  9811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 867) took 2115 ms. Trace:
I20260709 12:28:01.578298 14697 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.557207 14790 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:28:01.619195  9811 rpcz_store.cc:276] 0709 12:27:59.503109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:59.509687 (+  6578us) service_pool.cc:224] Handling call
0709 12:27:59.517635 (+  7948us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:59.517950 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:59.517989 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:59.518547 (+   558us) log.cc:844] Serialized 26 byte log entry
0709 12:27:59.683953 (+165406us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:59.719261 (+ 35308us) log.cc:844] Serialized 14 byte log entry
0709 12:27:59.719507 (+   246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:59.719612 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:01.216107 (+1496495us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b180010bac0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f3f3 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:28:01.599192 (+383085us) spinlock_profiling.cc:243] Waited 8.7 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:28:01.618579 (+ 19387us) raft_consensus.cc:1685] finished
0709 12:28:01.618601 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:01.618722 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6703,"prepare.queue_time_us":35144,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":1287,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":12473,"spinlock_wait_cycles":24529152,"thread_start_us":147209,"threads_started":1,"wal-append.queue_time_us":231089}
I20260709 12:28:01.557444 14799 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:28:01.625042 14472 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:01.627655 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:01.636793 10496 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:01.635584 14671 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:28:01.645489 14790 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:01.645686 14799 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:28:01.595829 14794 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:28:01.633984 14791 log.cc:927] Time spent T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.137s	user 0.000s	sys 0.005s
I20260709 12:28:01.595669 14691 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:01.633428 14745 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:01.669356 10496 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:01.691617  9928 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:01.634184 14797 log.cc:927] Time spent T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.213s	user 0.005s	sys 0.001s
I20260709 12:28:01.703200  9928 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:01.698508 14799 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:01.707376 14799 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:01.707779 14799 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:28:01.707980 14807 log.cc:927] Time spent T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:28:01.708047  9807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55720 (request call id 38) took 1585 ms. Trace:
I20260709 12:28:01.708520  9807 rpcz_store.cc:276] 0709 12:28:00.123109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:00.123262 (+   153us) service_pool.cc:224] Handling call
0709 12:28:01.707851 (+1584589us) spinlock_profiling.cc:243] Waited 29.2 ms on lock 0x7b54001f4854. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e516853 00007f2f934e460a 00007f2f8ca6a7d4 00007f2f8ca6a762 00007f2f8ca6a691 00007f2f8ca6a60c 00007f2f8ca698c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:01.707970 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67261824}
I20260709 12:28:01.709077 14558 consensus_queue.cc:1059] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:28:01.710023 14558 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:01.710769 14675 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:01.710928  9881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2647) took 1042 ms. Trace:
I20260709 12:28:01.711338 14675 raft_consensus.cc:697] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:01.711818  9815 raft_consensus.cc:1275] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:28:01.712435 14675 consensus_queue.cc:237] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:01.713501 14725 log.cc:927] Time spent T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 1.870s	user 0.023s	sys 0.010s
I20260709 12:28:01.713610 14772 raft_consensus.cc:3055] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:01.713896 14472 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:01.714025 14772 raft_consensus.cc:740] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:01.710041 14666 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:01.715473 14666 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:01.714979 14772 consensus_queue.cc:260] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:01.715852 14666 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:01.716284 14772 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:01.666823 14789 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.718747 14789 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:01.666411 14790 raft_consensus.cc:2804] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:28:01.722958 14790 raft_consensus.cc:697] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 15 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:01.723626 14779 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:01.724118 14790 consensus_queue.cc:237] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:01.725850 14779 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.709785  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:01.702872 14592 consensus_queue.cc:1059] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:28:01.727820 14592 raft_consensus.cc:3055] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:01.728153 14592 raft_consensus.cc:740] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:01.728932 14592 consensus_queue.cc:260] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:01.729398  9885 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2637) took 2053 ms. Trace:
I20260709 12:28:01.727156  9807 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:28:01.666051 14542 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.738703  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:01.711367  9881 rpcz_store.cc:276] 0709 12:28:00.668308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:00.682635 (+ 14327us) service_pool.cc:224] Handling call
0709 12:28:00.693482 (+ 10847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:00.700255 (+  6773us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:28:00.708819 (+  8564us) log.cc:844] Serialized 14 byte log entry
0709 12:28:00.804638 (+ 95819us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:00.804715 (+    77us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:28:00.804779 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:01.710704 (+905925us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b5400216954. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:01.710751 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:01.710877 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9200,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":3634,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":95,"spinlock_wait_cycles":90211584,"thread_start_us":94611,"threads_started":1,"wal-append.queue_time_us":336279}
I20260709 12:28:01.731937  9807 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:28:01.749419  9962 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:01.668828 14783 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.741550 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:01.729760  9885 rpcz_store.cc:276] 0709 12:27:59.675700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:59.675828 (+   128us) service_pool.cc:224] Handling call
0709 12:27:59.676142 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:59.742778 (+ 66636us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:27:59.775436 (+ 32658us) log.cc:844] Serialized 14 byte log entry
0709 12:28:00.041317 (+265881us) log.cc:844] Serialized 14 byte log entry
0709 12:28:00.212517 (+171200us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:00.213059 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 12:28:00.213966 (+   907us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:00.214087 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:01.729035 (+1514948us) spinlock_profiling.cc:243] Waited 50.1 ms on lock 0x7b54003c5354. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:01.729094 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:01.729210 (+   116us) raft_consensus.cc:1685] finished
0709 12:28:01.729225 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:01.729346 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60754,"prepare.queue_time_us":31533,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":5269,"raft.queue_time_us":63854,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":19269,"spinlock_wait_cycles":115168000,"thread_start_us":293681,"threads_started":2,"wal-append.queue_time_us":196608,"wal-append.run_cpu_time_us":2770,"wal-append.run_wall_time_us":1324487}
I20260709 12:28:01.754757 14691 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:01.755204 14691 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:01.755614 14691 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:01.766013  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:01.766912  9881 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:01.730021 14592 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:01.734475 14775 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.732317 14760 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:28:01.778236  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:01.781101  9881 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:28:01.782953  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:01.775998  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:28:01.760831 14542 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:01.764397 14783 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:01.776623 14671 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
W20260709 12:28:01.802496 10532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 1098) took 2858 ms (client timeout 1538 ms). Trace:
W20260709 12:28:01.805094 10532 rpcz_store.cc:269] 0709 12:27:58.958977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:58.962528 (+  3551us) service_pool.cc:224] Handling call
0709 12:28:01.802211 (+2839683us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b5400556254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:01.802384 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127931648}
I20260709 12:28:01.813331  9962 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
W20260709 12:28:01.816915 14738 log.cc:927] Time spent T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 1.809s	user 0.026s	sys 0.000s
I20260709 12:28:01.833292 14691 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:01.836671  9961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1789) took 2353 ms. Trace:
W20260709 12:28:01.822751  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:01.824481  9885 raft_consensus.cc:1240] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:01.786190 14760 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:01.837447 14691 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.833246 14693 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:01.834013 14789 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.834731 14542 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.837059  9961 rpcz_store.cc:276] 0709 12:27:59.483327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:59.596681 (+113354us) service_pool.cc:224] Handling call
0709 12:27:59.599993 (+  3312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:59.600219 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:59.600242 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:59.600684 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 12:27:59.731580 (+130896us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:59.731926 (+   346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:59.739513 (+  7587us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:01.816261 (+2076748us) spinlock_profiling.cc:243] Waited 4.32 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:28:01.836386 (+ 20125us) raft_consensus.cc:1685] finished
0709 12:28:01.836410 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:01.836609 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9946496,"thread_start_us":104118,"threads_started":1,"wal-append.queue_time_us":232916}
I20260709 12:28:01.826390 14712 raft_consensus.cc:3055] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:01.842029  9885 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:28:01.864779  9778 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:28:01.848508  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:01.844354  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:01.871796 14542 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:01.875072  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:01.881222 14693 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:01.882907  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:01.889066  9811 raft_consensus.cc:2410] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:28:01.889344  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:28:01.890383  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:01.872414 14542 raft_consensus.cc:697] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:01.891883  9957 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:28:01.894704  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:01.864195 14712 raft_consensus.cc:740] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:01.864029 14795 consensus_queue.cc:1059] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.033s
W20260709 12:28:01.903812  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:01.905709  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:01.906316  9808 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:01.907509  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:28:01.909188  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 200924us
I20260709 12:28:01.906602  9927 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:01.912233  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:01.912777  9814 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:01.926556 14542 consensus_queue.cc:237] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:01.927690 14712 consensus_queue.cc:260] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:01.933362  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:01.942545  9853 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:01.946470 14715 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:01.947233 14715 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:01.950201 14697 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:01.953517 14715 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:01.931216 14669 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:28:01.989795  9814 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:28:01.991143 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:01.957918 14715 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:28:02.007426 14693 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:02.007961 14693 raft_consensus.cc:697] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:02.008224 14503 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.008785 14503 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:02.008904 14693 consensus_queue.cc:237] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:02.011494  9808 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
I20260709 12:28:02.012692 10496 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:01.968339 14712 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:02.059870  9808 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:02.061578  9808 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:28:01.954700 14606 consensus_queue.cc:1048] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:28:01.968638 14666 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:02.067447 14503 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:02.068670 14666 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:02.075834  9957 raft_consensus.cc:1240] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 12. Current term is 13. Ops: []
W20260709 12:28:02.082093 14793 consensus_meta.cc:287] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.002s
I20260709 12:28:02.082777 14793 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:02.083602 14819 log.cc:927] Time spent T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:28:02.084532  9809 raft_consensus.cc:2393] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 13: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:28:02.060894 14790 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:02.010419 14783 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:02.086640  9807 raft_consensus.cc:1240] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:28:02.096212 14760 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:02.098853 14821 log.cc:927] Time spent T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 12:28:02.103165 14826 log.cc:927] Time spent T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:28:02.104039 14790 raft_consensus.cc:697] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:02.138496 14476 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:02.140902 14793 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:02.133442 14799 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:02.204177  9958 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 947) took 2700 ms. Trace:
I20260709 12:28:02.204661  9958 rpcz_store.cc:276] 0709 12:27:59.504039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:59.606174 (+102135us) service_pool.cc:224] Handling call
0709 12:27:59.625459 (+ 19285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:01.221801 (+1596342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:01.221836 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:01.221878 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:01.221911 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:02.203943 (+982032us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54003bb354. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:02.203986 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:02.204120 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3670733568}
I20260709 12:28:02.209707  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:02.210907  9958 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:02.204769 14793 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.214509  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:02.215224  9813 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:02.229264  9882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2646) took 1561 ms. Trace:
I20260709 12:28:02.229678  9960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1795) took 1865 ms. Trace:
I20260709 12:28:02.230018  9960 rpcz_store.cc:276] 0709 12:28:00.363915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:00.364031 (+   116us) service_pool.cc:224] Handling call
0709 12:28:00.364476 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:00.421209 (+ 56733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:02.229444 (+1808235us) spinlock_profiling.cc:243] Waited 51 ms on lock 0x7b54003bae54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:02.229621 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117407744}
I20260709 12:28:02.229681  9882 rpcz_store.cc:276] 0709 12:28:00.667404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:00.667517 (+   113us) service_pool.cc:224] Handling call
0709 12:28:01.564836 (+897319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:01.565685 (+   849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:02.229033 (+663348us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b540029aed0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:02.229197 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2033955712}
I20260709 12:28:02.212589 14793 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:02.238479  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:02.248880  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 274680us
I20260709 12:28:02.198040 14790 consensus_queue.cc:237] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:02.228063 14799 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:28:02.268519  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 331122us
I20260709 12:28:02.276680  9813 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:28:02.278002 10496 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:02.280167 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:02.286046 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:02.286720 10530 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:02.236763 14783 consensus_queue.cc:1059] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:28:02.360141 10527 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:28:02.361935 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:02.367285  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 98084.6us
I20260709 12:28:02.246918 14697 raft_consensus.cc:697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:02.371217  9927 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:02.323035 14799 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:02.266656 14391 consensus_queue.cc:1059] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.100s
I20260709 12:28:02.321899 14476 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 12:28:02.397377  9890 raft_consensus.cc:1275] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:28:02.400772  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:02.404075  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.406140  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:28:02.415973  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 471476us
I20260709 12:28:02.421818  9853 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:02.422075  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:28:02.426062 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:02.427515  9958 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:28:02.392293 14605 raft_consensus.cc:3055] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:02.430418  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:02.430555  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:02.391126 14799 raft_consensus.cc:697] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:28:02.433357  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 62204.3us
I20260709 12:28:02.442830  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.281075 14721 consensus_queue.cc:1059] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.111s
W20260709 12:28:02.451572  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 52939.5us
I20260709 12:28:02.433990 14472 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:28:02.461586  9778 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:02.432623 14605 raft_consensus.cc:740] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:28:02.471055 14835 log.cc:927] Time spent T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:28:02.487288 10532 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:02.486553 14793 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:02.496860 14773 consensus_queue.cc:1059] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:28:02.518255 14773 raft_consensus.cc:3055] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:02.518620 14773 raft_consensus.cc:740] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:02.519408 14773 consensus_queue.cc:260] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:02.520965 14472 consensus_queue.cc:1048] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:02.523108 14799 consensus_queue.cc:237] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:02.526794 14839 log.cc:927] Time spent T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:28:02.505378  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:02.486474 14558 consensus_queue.cc:1059] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 12:28:02.526818  9853 connection.cc:256] RPC call timeout handler was delayed by -1.8652291489997879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
W20260709 12:28:02.500686  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 59465.5us
W20260709 12:28:02.530390  9853 connection.cc:256] RPC call timeout handler was delayed by -1.7797291489996496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
I20260709 12:28:02.488517 14840 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:02.499806 10533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 890) took 1590 ms. Trace:
I20260709 12:28:02.457508 14661 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:28:02.533740 14715 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.533629 14840 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:02.451172 14682 consensus_queue.cc:1059] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:28:02.452873 14691 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:28:02.536312  9853 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:02.571254  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:02.520524 14773 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:02.487811 14542 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:02.446779 14697 consensus_queue.cc:237] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:02.534408 14715 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:02.626008  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:02.580430 14760 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:02.577618 14793 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:02.603083 14803 raft_consensus.cc:3055] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:28:02.599200 14837 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:02.666061  9813 raft_consensus.cc:1275] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:28:02.669409  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:02.669914  9814 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:28:02.671020  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:02.624321 14542 raft_consensus.cc:697] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:02.583371 14503 consensus_queue.cc:1048] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:28:02.576588 14841 consensus_queue.cc:1059] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.112s
I20260709 12:28:02.689126 10530 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:28:02.650724 14661 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:02.650462 14803 raft_consensus.cc:740] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:28:02.699137 14844 log.cc:927] Time spent T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:28:02.699275 14803 consensus_queue.cc:260] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:02.696156 14848 log.cc:927] Time spent T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.160s	user 0.000s	sys 0.003s
I20260709 12:28:02.700275 14854 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:28:02.650573 14793 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:02.702553 14793 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:02.638293 14653 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:28:02.707259 14715 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:02.707409 14802 raft_consensus.cc:3055] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:28:02.711591 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 275477us
I20260709 12:28:02.677919 14759 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:28:02.711483 14842 log.cc:927] Time spent T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.280s	user 0.000s	sys 0.001s
I20260709 12:28:02.712767 14759 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:02.709208  9958 raft_consensus.cc:1275] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:28:02.713114 14802 raft_consensus.cc:740] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:28:02.715197 14846 log.cc:927] Time spent T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:28:02.715538 14783 consensus_queue.cc:1048] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:02.715706 14802 consensus_queue.cc:260] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:02.634341 14823 consensus_queue.cc:1059] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:28:02.718532 14823 raft_consensus.cc:3055] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:02.718896 14823 raft_consensus.cc:740] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:28:02.719283 14829 log.cc:927] Time spent T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.764s	user 0.008s	sys 0.000s
I20260709 12:28:02.719635 14823 consensus_queue.cc:260] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:02.720850 14823 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:28:02.713915 14725 log.cc:927] Time spent T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.075s	user 0.001s	sys 0.001s
I20260709 12:28:02.531724 10533 rpcz_store.cc:276] 0709 12:28:00.908963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:01.105342 (+196379us) service_pool.cc:224] Handling call
0709 12:28:01.105626 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:01.105826 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:28:01.352802 (+246976us) log.cc:844] Serialized 14 byte log entry
0709 12:28:02.499132 (+1146330us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b18001cd1a0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b3a9c0a 00007f2f94ae9219 00007f2f8b431a40 00007f2f8b42c4e4 00007f2f8b42c455 00007f2f91f143c7 00007f2f8e5269a7 00007f2f8e5360bf 00007f2f8e536038
0709 12:28:02.499308 (+   176us) log.cc:844] Serialized 14 byte log entry
0709 12:28:02.499493 (+   185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:02.499537 (+    44us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:28:02.499594 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:02.499653 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:02.499754 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80145,"prepare.queue_time_us":108604,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":34127,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":7561,"spinlock_wait_cycles":9591680,"thread_start_us":286509,"threads_started":2,"wal-append.queue_time_us":201988}
I20260709 12:28:02.722714 14774 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:28:02.717782 14712 consensus_meta.cc:287] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.654s	user 0.008s	sys 0.003s
I20260709 12:28:02.723253 14774 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:02.727183 14849 log.cc:927] Time spent T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:28:02.728339 14843 log.cc:927] Time spent T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:28:02.741971  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.691604 14808 consensus_queue.cc:1048] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:28:02.746656  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.766019  9884 raft_consensus.cc:2393] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
W20260709 12:28:02.763576  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:02.753902  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.774524  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:02.770370  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.775632  9884 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:02.776748  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.777477  9884 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:28:02.778496  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.779877  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.781936 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:02.783456  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:02.742741 14802 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:02.801134  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:02.808593 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:02.812481  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.813235  9887 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 7.
I20260709 12:28:02.814515 14774 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:02.818262 14813 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.818804 14813 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:02.819850 14853 log.cc:927] Time spent T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:28:02.820607 14693 raft_consensus.cc:3055] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:02.820951 14813 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:02.821007 14693 raft_consensus.cc:740] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:02.774673 14542 consensus_queue.cc:237] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:02.825714 14803 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:02.826942 10497 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:02.828126 10497 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:02.828838 14813 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:02.829474 14813 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:02.829923 14813 raft_consensus.cc:697] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:02.830803 14813 consensus_queue.cc:237] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:02.832852  9881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 1181) took 1099 ms. Trace:
I20260709 12:28:02.834741 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:02.835597 10527 raft_consensus.cc:2410] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:28:02.835767 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:02.835062 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:02.833290  9881 rpcz_store.cc:276] 0709 12:28:01.733640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:01.840501 (+106861us) service_pool.cc:224] Handling call
0709 12:28:02.832145 (+991644us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b5800043598. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f7eee 000000000036eb39 00007f2f9346b1e0 00007f2f935340c4 00007f2f93534131 00007f2f934f5fc0 00007f2f934e0929 00007f2f934e03d2 00007f2f8ca57bd4
0709 12:28:02.832304 (+   159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:02.832474 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:02.832510 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:02.832559 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:02.832591 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:02.832658 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:02.832790 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45028224}
I20260709 12:28:02.838207  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.839938  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.784829 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:02.788095 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:02.802531  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:02.848115 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:02.746582 14840 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:02.787274  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.804811  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.852174  9815 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:28:02.853112 10529 raft_consensus.cc:2368] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8.
I20260709 12:28:02.853554  9881 raft_consensus.cc:2393] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 14: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:02.840566  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:28:02.843465 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 153121us
W20260709 12:28:02.854175  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:02.854187 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:02.856146  9887 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:28:02.864776 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:02.866149  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.867012 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:02.875208  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.875799  9882 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 16.
I20260709 12:28:02.876632  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.858597 14590 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:02.822185 14693 consensus_queue.cc:260] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:02.882696  9889 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 2654) took 2180 ms (client timeout 2465 ms). Trace:
I20260709 12:28:02.883136 14693 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:28:02.883082  9889 rpcz_store.cc:269] 0709 12:28:00.702382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:01.100566 (+398184us) service_pool.cc:224] Handling call
0709 12:28:02.882547 (+1781981us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54001e3554. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:02.882643 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335493376}
I20260709 12:28:02.886384 14715 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:02.886970 14715 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:02.889142 14715 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:02.889664 14715 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:02.891304 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:02.892992 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:02.893711 10527 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:28:02.877864  9882 raft_consensus.cc:3055] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:02.895596  9882 raft_consensus.cc:740] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:02.903492  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.904701 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:02.907774  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.786334 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:02.853992 14759 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:02.783725  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.910089  9882 consensus_queue.cc:260] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:02.914930  9882 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:02.788686  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.917969  9890 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
W20260709 12:28:02.911194  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 232518us
I20260709 12:28:02.853190 14852 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 12:28:02.919785  9927 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:02.906813  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:02.925222 10525 raft_consensus.cc:1240] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:02.890199 14715 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:02.949179  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:02.960897  9810 raft_consensus.cc:2410] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:28:02.948377  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:02.962116  9964 raft_consensus.cc:1240] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:28:02.966306 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:02.967777  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:02.968511  9810 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:28:02.969547  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:02.971449  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:02.973917  9812 raft_consensus.cc:2393] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 12: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:28:02.976111  9810 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:28:02.976814  9882 raft_consensus.cc:1275] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:28:02.978566  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:02.963172  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:28:02.980921  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:02.982618  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:02.962921 14674 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:02.994504  9807 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 12: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
W20260709 12:28:02.995431 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 139675us
I20260709 12:28:02.996904  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:03.054539  9810 raft_consensus.cc:1240] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:02.928073 14759 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:28:02.975739 14671 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:03.084136  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:03.083146  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:03.084978  9813 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:28:03.085250  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:03.081315  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:03.085819  9807 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 16.
I20260709 12:28:03.086668  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:03.085894  9810 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
W20260709 12:28:03.077806 14850 log.cc:927] Time spent T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.399s	user 0.004s	sys 0.001s
I20260709 12:28:03.099911  9779 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:03.106892  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:03.108291  9779 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:03.110348  9961 raft_consensus.cc:1240] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:03.110232  9779 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:03.113022  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:03.118541  9779 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:03.078426 14836 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:03.075347 14728 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:03.091346 14790 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.113601 14774 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:03.125849 14783 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:28:03.194164 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:03.109833 14773 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:03.102475 14671 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.125804 14758 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:03.197634 14758 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.198648  9809 raft_consensus.cc:1240] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:03.199844 14758 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:03.130941 14823 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.200707 14823 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.202455  9810 raft_consensus.cc:1240] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 12:28:03.186537 14855 log.cc:927] Time spent T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.233s	user 0.001s	sys 0.001s
I20260709 12:28:03.137388 14542 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:03.173674 14774 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:03.210840  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 92398.6us
W20260709 12:28:03.194705 14857 log.cc:927] Time spent T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
W20260709 12:28:03.188199 14862 log.cc:927] Time spent T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 12:28:03.188668 14865 log.cc:927] Time spent T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.102s	user 0.002s	sys 0.000s
I20260709 12:28:03.219007  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 895) took 1345 ms. Trace:
W20260709 12:28:03.206363  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:03.175964 14837 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:03.177022 14590 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:28:03.190543 14863 log.cc:927] Time spent T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:28:03.213435  9779 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:03.134975 14836 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.137045 14728 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.135823 14790 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.195760 14783 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:03.219412  9808 rpcz_store.cc:276] 0709 12:28:01.873429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:02.065199 (+191770us) service_pool.cc:224] Handling call
0709 12:28:02.065534 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:02.065869 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:02.065912 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:02.075206 (+  9294us) log.cc:844] Serialized 26 byte log entry
0709 12:28:02.413280 (+338074us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:28:02.413337 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:02.413425 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:02.914082 (+500657us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:28:03.212229 (+298147us) raft_consensus.cc:1685] finished
0709 12:28:03.212258 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:03.218940 (+  6682us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":13155072,"thread_start_us":298132,"threads_started":1,"wal-append.queue_time_us":498369}
I20260709 12:28:03.227211  9779 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:03.214516 14774 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:03.240465  9779 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:03.245208  9779 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:03.238351 14783 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:03.249750 14790 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:03.257369 14823 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:03.233174 14590 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.233812 14715 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:03.225031 14682 consensus_queue.cc:1059] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:28:03.245888 14542 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:03.246891 14793 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:28:03.270242 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 66276.7us
I20260709 12:28:03.267554  9779 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:03.246721 14661 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:03.279897  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:03.231230 14773 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:03.229058 14837 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.282493 14876 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:03.290681 14871 raft_consensus.cc:3055] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:03.291972 14542 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:03.298822 10496 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:03.297781  9779 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:03.340167 10496 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:03.340816  9779 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:03.353912  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:03.296902 14793 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:03.304215 14876 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:03.337489 14871 raft_consensus.cc:740] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:03.287503 14661 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:03.362712 14870 log.cc:927] Time spent T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.176s	user 0.001s	sys 0.001s
I20260709 12:28:03.351689 14715 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:03.393478 14773 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:03.393910 14876 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:03.413722  9961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 962) took 1530 ms. Trace:
W20260709 12:28:03.371172 14860 log.cc:927] Time spent T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:28:03.414098  9961 rpcz_store.cc:276] 0709 12:28:01.883784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:01.886537 (+  2753us) service_pool.cc:224] Handling call
0709 12:28:01.891581 (+  5044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:03.111044 (+1219463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:03.413489 (+302445us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54001dd154. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:03.413664 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2802132864}
I20260709 12:28:03.395843 14783 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.339293 14590 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:03.416268 14774 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.398633 14558 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:03.417951 14876 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:03.407178 14715 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.418690 14558 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.420286  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:03.420521 14715 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:03.420537 14558 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:03.350476 14542 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:03.360000 14712 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:03.357172 14790 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:28:03.393340 14872 log.cc:927] Time spent T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 12:28:03.404620  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 63892.5us
I20260709 12:28:03.401033 14793 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:03.431012  9779 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:03.438058  9779 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:03.427420 14542 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:03.428820 14790 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.427608 14712 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:03.447249  9779 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:03.434170 14836 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:03.436023 14671 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:03.441175 14773 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:03.445282 14875 log.cc:927] Time spent T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:28:03.447741 14712 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:03.443269 14728 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:03.445472 14790 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:03.443503 14884 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:03.459007  9779 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:03.471585  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:03.478149  9779 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:03.472182 14793 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:03.456926 14813 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:03.473557 14672 raft_consensus.cc:2749] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:03.483412 14672 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:03.483805 14672 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.461858 14836 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:03.483300 14813 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.443114 14871 consensus_queue.cc:260] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.472754 14884 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:03.486500  9883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 2661) took 2112 ms. Trace:
I20260709 12:28:03.486863  9883 rpcz_store.cc:276] 0709 12:28:01.374481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:01.818144 (+443663us) service_pool.cc:224] Handling call
0709 12:28:01.818504 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:01.866859 (+ 48355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:01.866908 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:01.866991 (+    83us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:28:01.867040 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:03.486241 (+1619201us) spinlock_profiling.cc:243] Waited 48.1 ms on lock 0x7b540013c4d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:03.486310 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:03.486443 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110634240}
I20260709 12:28:03.484187 14672 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:03.479688 14590 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:03.494747  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:03.484740 14873 log.cc:927] Time spent T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:28:03.496174 14882 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:03.497211  9779 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
W20260709 12:28:03.499173 14732 log.cc:927] Time spent T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195: Append to log took a long time: real 3.656s	user 0.016s	sys 0.025s
I20260709 12:28:03.482733 14793 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:03.515781 14590 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:03.515641 14605 consensus_queue.cc:260] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.516750 14605 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:03.520000 14793 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:03.527665  9779 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:03.489109 14884 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:28:03.512825 14693 consensus_meta.cc:287] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.002s
I20260709 12:28:03.541406  9779 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:03.495301 14837 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:03.512992 14871 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:03.545995  9779 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:03.489737 14836 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.547147  9779 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:03.542809 14890 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.558523 14891 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:03.560257 14836 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:03.567305 14813 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:03.569355 14887 log.cc:927] Time spent T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:28:03.572453 14868 log.cc:927] Time spent T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.383s	user 0.005s	sys 0.007s
I20260709 12:28:03.573487 14837 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:03.576670  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.547782 14590 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:03.577929  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.580371  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.581216  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.660656  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.610926 14661 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:03.582986  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.666568  9962 raft_consensus.cc:2368] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8.
I20260709 12:28:03.667554  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.668279  9962 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
I20260709 12:28:03.583806  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.587262 14783 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:03.596680  9888 raft_consensus.cc:1240] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:28:03.671854 14783 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:03.596931  9854 leader_election.cc:400] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8.
I20260709 12:28:03.672423  9854 leader_election.cc:403] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:28:03.672550 14783 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:28:03.672942  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 76136.2us
I20260709 12:28:03.673156 14783 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:03.649165 14780 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.597292  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:03.597810 14709 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:03.598421 14698 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:03.599179  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:03.683045  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.541919 14882 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:03.684062  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:03.632589  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:28:03.611114  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:03.642695 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:03.645352  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.686460  9960 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:28:03.688649 14709 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:03.689157 14709 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.691864  9811 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:28:03.648918  9812 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:28:03.590502 14774 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:03.694393 14698 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:03.694778 14671 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:28:03.609813 14802 consensus_meta.cc:287] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.806s	user 0.007s	sys 0.003s
I20260709 12:28:03.577322  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:03.695849 14882 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:03.706755 14882 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:03.678740 14697 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:03.710330  9958 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:28:03.696169 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:03.606195 14803 consensus_meta.cc:287] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.780s	user 0.012s	sys 0.001s
I20260709 12:28:03.654994  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:03.661003  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:03.582087  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:03.643658 14891 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:03.669237  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.648562 14861 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:03.675899 10529 raft_consensus.cc:1240] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:03.728434 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:03.597111 14728 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:03.677352 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:03.679291 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:03.679689  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.680569  9882 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
I20260709 12:28:03.681408  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.693243 14888 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:03.718581  9959 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:03.718209  9955 raft_consensus.cc:2368] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8.
I20260709 12:28:03.718811  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:28:03.722556 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:03.735932  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:03.730381  9963 raft_consensus.cc:2410] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 12:28:03.731778 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:03.660048 14837 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.748836 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:03.700915 14709 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:03.752097  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:28:03.753347  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 206263us
I20260709 12:28:03.652354 14890 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.754254  9779 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:03.760687  9779 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:03.726994 14891 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:03.762701  9779 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:03.772697  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.684289 14780 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.762071 14803 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:03.741998 14836 consensus_queue.cc:1059] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:28:03.765214 14802 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:03.737905 14861 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.786693  9957 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
I20260709 12:28:03.798290  9961 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
I20260709 12:28:03.803115 14669 raft_consensus.cc:3055] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:03.803303 14894 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:03.803049  9779 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:03.738024 14728 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.795588 14780 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:03.809624  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.814776  9779 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:03.808602 14836 consensus_queue.cc:1243] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer f5208640a51f493e930ce4f64ceeed0b log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:28:03.820652  9957 raft_consensus.cc:1240] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:03.823189  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.824950  9962 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:28:03.825029  9853 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:03.808211 14698 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:03.810395 14669 raft_consensus.cc:740] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:03.839217  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:03.839946  9882 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:03.840658  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:03.840658 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:03.841894 10529 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:03.829873  9853 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:03.831050 14590 consensus_queue.cc:1048] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:03.831950 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:03.834415 14836 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:03.819048 14802 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:03.853708  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:03.836061 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:03.836670 14671 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.855834 14671 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.857987 14671 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:03.837911  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.817934 14803 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:28:03.858981 14877 log.cc:927] Time spent T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.425s	user 0.002s	sys 0.000s
I20260709 12:28:03.846589 14698 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:03.859692 14698 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.860065 14698 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:03.858932  9962 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 13: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:03.850487  9882 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:28:03.851663 10529 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:28:03.868333  9885 raft_consensus.cc:3055] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:03.868806  9885 raft_consensus.cc:740] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:03.869752  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:03.870522  9889 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:28:03.870728  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:03.870229  9812 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
I20260709 12:28:03.871585  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:03.872900  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:03.853147  9853 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:03.835275 14697 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8.
I20260709 12:28:03.854907  9815 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 13: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:03.854941  9814 raft_consensus.cc:1275] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:28:03.879863  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:03.880628  9889 raft_consensus.cc:2393] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 14: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:03.881050  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.881543  9962 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:28:03.882205 14836 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:03.885800  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:03.887096 14836 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:28:03.889881  9887 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:28:03.872895  9779 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:03.874084  9890 raft_consensus.cc:3055] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:03.891337  9890 raft_consensus.cc:740] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:03.875828  9885 consensus_queue.cc:260] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.845901 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:03.876542  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:03.892755 10528 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:03.892777  9885 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:03.858999 14783 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:03.898598 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:03.892040  9890 consensus_queue.cc:260] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.902705  9890 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:03.902532 14813 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:03.909540 10528 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:03.910522 14837 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:03.911779 10497 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:03.913534 14854 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:03.913803 14876 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:03.913949 14854 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.914453 14854 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:03.916939 10532 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 1206) took 1644 ms. Trace:
I20260709 12:28:03.917312 10532 rpcz_store.cc:276] 0709 12:28:02.272470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:02.272606 (+   136us) service_pool.cc:224] Handling call
0709 12:28:02.272885 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:02.514738 (+241853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:03.916696 (+1401958us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b5400670f54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:03.916878 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":491440512}
I20260709 12:28:03.918475 14861 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:03.919381 14890 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:03.854146 14802 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:03.925053  9890 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:28:03.922953 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:03.925786 14876 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:03.925784  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:03.927598 14876 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:03.928018 14876 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:28:03.928407  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:03.928907  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:03.931608  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.932170  9962 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 6.
I20260709 12:28:03.933368  9885 raft_consensus.cc:1275] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:28:03.933694  9885 pending_rounds.cc:85] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 10
I20260709 12:28:03.933924  9885 pending_rounds.cc:107] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:28:03.934141  9885 raft_consensus.cc:2889] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:03.935365 10525 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36672 (request call id 1118) took 1077 ms. Trace:
I20260709 12:28:03.935708 10525 rpcz_store.cc:276] 0709 12:28:02.857657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:02.857796 (+   139us) service_pool.cc:224] Handling call
0709 12:28:02.858065 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:02.938828 (+ 80763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:03.935159 (+996331us) spinlock_profiling.cc:243] Waited 67 ms on lock 0x7b5400690354. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:03.935312 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":153996032}
I20260709 12:28:03.905853 14712 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.944016 14391 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:03.944535 14391 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.949487  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:03.949913  9959 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:28:03.950843  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:03.953217  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.953996  9962 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:28:03.930625 14802 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:03.961251  9957 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:28:03.962303  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:03.933004 14773 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:03.930476 14890 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:28:03.941948 14661 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:28:03.963546  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:03.885684 14669 consensus_queue.cc:260] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.917012 14542 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:03.971876 14391 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:03.965207 14724 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.987257 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:03.965934 14691 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.988045 10524 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:28:03.988340 14691 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:03.942159 14813 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:28:03.990525  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:28:03.992419  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:03.997758  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:03.981046 14890 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:04.003221 14790 consensus_meta.cc:287] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.000s
I20260709 12:28:04.003648 14790 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:04.009006 10531 raft_consensus.cc:2368] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15.
I20260709 12:28:04.010820 14728 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:03.973912 14669 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:03.974819  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:04.016983  9882 raft_consensus.cc:1240] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:28:04.019717 10526 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:28:04.020066 10526 pending_rounds.cc:85] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b: Aborting all ops after (but not including) 10
I20260709 12:28:04.020299 10526 pending_rounds.cc:107] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:28:04.020527 10526 raft_consensus.cc:2889] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:03.938462 14861 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:28:03.983717 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:03.984833 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:03.986327 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:03.978928 10525 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 16. Current term is 17. Ops: [14.12-16.13]
I20260709 12:28:03.987329 14724 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:04.040452 14882 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:04.057286  9957 raft_consensus.cc:1275] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:28:04.058030 14882 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:04.042749 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 56069.1us
I20260709 12:28:04.045542 14698 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:04.058655 14724 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:04.059038  9962 raft_consensus.cc:1240] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:28:04.060222 14698 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:04.034108 14691 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:04.048883 14890 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:04.033016  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:04.061959  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:04.062599  9963 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
I20260709 12:28:04.064661  9955 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:28:04.065080 14672 consensus_meta.cc:287] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.000s
I20260709 12:28:04.065557 14672 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:04.066220  9955 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:28:04.066453 14793 consensus_meta.cc:287] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.000s
I20260709 12:28:04.066852  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:04.061971 14542 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:04.066980 14793 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:04.069165  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:04.037671 14891 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:04.077965 14891 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:04.075062 14884 consensus_meta.cc:287] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.000s
I20260709 12:28:04.071934 14712 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:04.078753 14790 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:04.070235 14793 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:04.103247 14884 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:04.113565 14884 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:04.115620 14854 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:04.118678 14854 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:04.120846 14672 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:04.213304 14672 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.162688  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:04.215269  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:04.216037  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:04.216322  9888 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
W20260709 12:28:03.924002  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 51189.9us
I20260709 12:28:04.164834  9707 catalog_manager.cc:5697] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 10 to 14, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 14 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:04.221133 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:04.168907  9813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 2940) took 1182 ms. Trace:
I20260709 12:28:04.222385 10532 raft_consensus.cc:2393] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 15: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:04.222438  9813 rpcz_store.cc:276] 0709 12:28:02.986062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:03.087678 (+101616us) service_pool.cc:224] Handling call
0709 12:28:03.087941 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:03.726569 (+638628us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:28:03.726608 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:03.726665 (+    57us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:28:03.726708 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:04.168132 (+441424us) spinlock_profiling.cc:243] Waited 638 ms on lock 0x7b5400183dd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:04.168250 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:04.168603 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":602,"raft.queue_time_us":1049,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":11232,"spinlock_wait_cycles":1466528512}
I20260709 12:28:04.224771 14542 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.220645  9707 catalog_manager.cc:5697] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 5 to 10, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 10 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:04.201875  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:04.225665 14542 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:04.227361  9707 catalog_manager.cc:5697] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 5 to 6, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 6 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
W20260709 12:28:04.228552  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.229043 14542 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:04.232048  9779 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:04.233579  9779 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:04.235563 14672 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:04.238838  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:04.240362  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:28:04.172362  9712 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56416 (request call id 249) took 50098 ms (client timeout 15000 ms). Trace:
I20260709 12:28:04.175576  9806 raft_consensus.cc:1240] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:04.176751  9807 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:28:04.176682  9809 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 16. Current term is 17. Ops: []
W20260709 12:28:04.179016  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 300066us
I20260709 12:28:04.248988  9853 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:04.250324 14698 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:04.250841 14672 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:04.181094  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:03.992154  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:04.185648  9886 raft_consensus.cc:1240] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:28:04.071308  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:04.072891  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:04.078909  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:04.199085 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:04.200877 10525 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:28:04.202981  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:04.073486  9961 raft_consensus.cc:1275] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:28:04.279464  9959 raft_consensus.cc:2393] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 14: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:04.204799  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:04.206032  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:04.281728  9964 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:28:04.207377 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:04.208433  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:04.259724 14590 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:28:04.283540 14590 raft_consensus.cc:697] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:28:04.244712  9712 rpcz_store.cc:269] 0709 12:27:14.287668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.352355 (+ 64687us) service_pool.cc:224] Handling call
0709 12:28:04.172077 (+49819722us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:55.865273 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:55.909508 (+ 44235us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:55.909559 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:27:55.909578 (+    19us) tablet.cc:662] Decoding operations
0709 12:27:55.910735 (+  1157us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:55.910824 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:55.910849 (+    25us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:27:55.911805 (+   956us) tablet.cc:701] Row locks acquired
0709 12:27:55.911852 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:27:55.912022 (+   170us) write_op.cc:270] Start()
0709 12:27:55.912163 (+   141us) write_op.cc:276] Timestamp: P: 1783600075911964 usec, L: 0
0709 12:27:55.912195 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:27:55.912847 (+   652us) log.cc:844] Serialized 4334 byte log entry
0709 12:27:56.269227 (+356380us) op_driver.cc:464] REPLICATION: finished
0709 12:27:56.506005 (+236778us) write_op.cc:301] APPLY: starting
0709 12:27:56.532017 (+ 26012us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:57.082781 (+550764us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:57.177816 (+ 95035us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:57.530177 (+352361us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:57.597777 (+ 67600us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 12:27:57.597846 (+    69us) write_op.cc:312] APPLY: finished
0709 12:27:57.598476 (+   630us) log.cc:844] Serialized 105 byte log entry
0709 12:27:57.815152 (+216676us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:57.820744 (+  5592us) write_op.cc:454] Released schema lock
0709 12:27:57.820810 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:57.823756 (+  2946us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:57.823782 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7029,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":191387,"apply.run_cpu_time_us":49558,"apply.run_wall_time_us":1338003,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50063,"num_ops":11,"prepare.queue_time_us":80892,"prepare.run_cpu_time_us":24909,"prepare.run_wall_time_us":217465,"raft.queue_time_us":56700,"raft.run_cpu_time_us":15620,"raft.run_wall_time_us":46463,"replication_time_us":356872,"spinlock_wait_cycles":73984,"thread_start_us":462498,"threads_started":5,"wal-append.queue_time_us":512335,"wal-append.run_cpu_time_us":14870,"wal-append.run_wall_time_us":2148500}]]}
I20260709 12:28:04.284806  9957 raft_consensus.cc:2393] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 14: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:04.285075 14590 consensus_queue.cc:237] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:04.122036 14788 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.000s	sys 0.009s
I20260709 12:28:04.276127  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:28:04.286832 14788 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.000s	sys 0.009s
I20260709 12:28:04.077276 14802 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:04.260218 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:04.261337  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.257066  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:04.262791  9779 leader_election.cc:400] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15.
I20260709 12:28:04.288847  9779 leader_election.cc:403] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:04.260253 14542 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:04.081480 14876 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:04.260879  9887 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:04.253414  9707 catalog_manager.cc:5697] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 10 to 11, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 11 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:04.276026  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 76402.8us
I20260709 12:28:04.291697  9813 raft_consensus.cc:1240] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:28:04.293578 10532 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:28:04.291272 14542 raft_consensus.cc:697] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:04.304829  9707 catalog_manager.cc:5697] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:04.306572  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:04.307497  9812 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:28:04.308159 14884 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:28:04.308518 14891 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:28:04.310492  9885 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:28:04.312747 14802 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:04.307253  9707 catalog_manager.cc:5697] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 7 to 9, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 9 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:04.322139  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:04.323729  9881 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:28:04.323410  9707 catalog_manager.cc:5697] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 reported cstate change: config changed from index 3 to 5, term changed from 6 to 11, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to <none>, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65), VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66), VOTER b011791796d1457284b857d7d3422195 (127.8.111.67), VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 11 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:04.329932  9812 raft_consensus.cc:1275] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:28:04.331250  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:04.334887  9806 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
I20260709 12:28:04.335043  9807 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:28:04.336915  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:04.337713  9806 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:28:04.337848 14542 consensus_queue.cc:237] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:04.339087  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:04.339198  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:04.338538  9707 catalog_manager.cc:5697] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:28:04.345469  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.343796  9707 catalog_manager.cc:5697] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 4 to 9, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 9 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:04.358975  9927 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:04.361888 14721 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:04.362558 14721 raft_consensus.cc:697] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:04.354423  9707 catalog_manager.cc:5697] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 9 to 10, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 10 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:04.363842 14721 consensus_queue.cc:237] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:04.366080  9707 catalog_manager.cc:5697] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 12 to 15, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 15 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:04.369918 14903 log.cc:927] Time spent T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.094s	user 0.002s	sys 0.002s
I20260709 12:28:04.370795  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:04.380251  9807 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:28:04.381163  9890 raft_consensus.cc:1240] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
W20260709 12:28:04.381917  9928 connection.cc:256] RPC call timeout handler was delayed by -1.0910710190000827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2465s for a response
W20260709 12:28:04.362568 14904 log.cc:927] Time spent T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.089s	user 0.002s	sys 0.000s
I20260709 12:28:04.370723  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:04.371362 14876 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:04.372469 14907 log.cc:927] Time spent T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 12:28:04.373013  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.393340  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:04.394235  9882 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:28:04.376936  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:04.383136  9928 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:04.434381  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 57605.5us
I20260709 12:28:04.458673 14890 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.459817 14890 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:04.460791  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:28:04.461839 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.463042 14836 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:04.463160  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:04.463842 14836 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:04.464097  9882 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:28:04.464516 14836 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:28:04.472095  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.498588  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:04.499984 14767 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.500893 14767 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:04.510556  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.389568  9707 catalog_manager.cc:5697] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:04.515440  9707 catalog_manager.cc:5697] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 12 to 13, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 13 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:04.521136 14808 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:04.523056  9853 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:04.524572 14899 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:28:04.528254  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 145287us
I20260709 12:28:04.536449 14780 consensus_queue.cc:1059] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:28:04.519371  9707 catalog_manager.cc:5697] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 6 to 9, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 9 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:04.544097  9882 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 15.
I20260709 12:28:04.557578  9890 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:04.564644  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:04.567344  9778 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:04.564842  9853 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:04.574548 14888 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.575263 14888 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:04.583956  9707 catalog_manager.cc:5697] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:04.589643  9815 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:04.581650 14888 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:04.603986  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 73521.8us
I20260709 12:28:04.601519  9928 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:04.587167 14890 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:04.592309 14590 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:04.610376 14590 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:04.610850 14590 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:04.586285 14476 consensus_queue.cc:1059] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:28:04.613404 14899 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:28:04.625368  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 107244us
W20260709 12:28:04.625908  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 61224.1us
I20260709 12:28:04.627352 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:04.628212 14921 raft_consensus.cc:3055] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:04.622433 14767 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:04.637840  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 65209.4us
I20260709 12:28:04.641515  9853 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:04.642489 14728 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:04.643519 14728 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:04.644089  9853 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:04.645133 14728 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:04.645574  9853 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:04.646474 14698 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:04.608168  9707 catalog_manager.cc:5697] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:04.634433 14899 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:04.649505 14899 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:04.651501  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:04.653350  9928 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:04.654330 14802 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:28:04.658489 14698 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:04.658967 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:04.659238 14698 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:04.634668 14921 raft_consensus.cc:740] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:04.660871  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:04.661835  9957 raft_consensus.cc:2410] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 16 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:28:04.662484 14698 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:04.662811  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:04.663448  9955 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
I20260709 12:28:04.663259 14922 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:28:04.663959 14884 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15.
I20260709 12:28:04.649298  9707 catalog_manager.cc:5697] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:04.676515  9812 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 15.
I20260709 12:28:04.681695 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:04.682390 10532 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:28:04.683403 14767 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:04.684916 14919 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:04.685496 14919 raft_consensus.cc:697] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:04.685814  9815 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 17.
I20260709 12:28:04.700942  9890 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 15.
I20260709 12:28:04.702251  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:04.686604 14919 consensus_queue.cc:237] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:04.707495  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:04.709039  9779 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:04.710420 14802 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.711042 14802 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:04.713392  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:04.713747 14802 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:04.714453  9928 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:04.714656 14836 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:04.715634  9928 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:04.717259 14836 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:04.708180  9707 catalog_manager.cc:5697] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 8 to 10, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 10 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:04.721544  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:04.722680  9890 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:28:04.722702 14922 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:04.727245 14721 raft_consensus.cc:3055] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:28:04.727735 14721 raft_consensus.cc:740] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:04.728790 14721 consensus_queue.cc:260] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:04.729877 14721 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:04.722432 14391 consensus_queue.cc:1059] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:04.738888 14922 raft_consensus.cc:3055] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:04.739324 14922 raft_consensus.cc:740] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:04.740479 14922 consensus_queue.cc:260] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:04.741922 14922 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:04.743126 14669 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:04.743558 14669 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.743898 14669 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:04.746469 14921 consensus_queue.cc:260] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:04.747872 14921 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:04.766378  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:04.767095  9884 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
I20260709 12:28:04.772293  9707 catalog_manager.cc:5697] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
W20260709 12:28:04.774401  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 58886.9us
I20260709 12:28:04.776762  9928 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:04.778102 14391 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:28:04.778604 10496 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:04.778975  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:04.779913  9955 raft_consensus.cc:2410] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:28:04.781168  9815 raft_consensus.cc:1240] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:04.781085 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:04.781937 14590 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:04.783998  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 75116.7us
I20260709 12:28:04.784113 14590 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:04.784842 10497 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:04.782562  9807 raft_consensus.cc:1240] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:04.785866 14899 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:04.786759  9853 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.111.67:42253 timed out after 1.500s (SENT) [suppressed 2 similar messages]
I20260709 12:28:04.762431 14836 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:04.721614 14767 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:04.790699  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:04.793553  9812 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:28:04.789728  9778 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:04.769951 14669 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:04.799134  9779 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:04.720952 14788 consensus_queue.cc:1059] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 12:28:04.787626 14884 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:04.792965 14391 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:04.787533 14542 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.797317 14876 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:04.814491  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:28:04.815835  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.766197 14920 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:04.823729  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:04.825268  9885 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:04.825281  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:28:04.826997 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 46023.3us
I20260709 12:28:04.828935  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:04.818797 14876 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.818744 14590 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:04.834322  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:04.806901 14836 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:04.838481  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:04.827674 14888 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:04.851409 14888 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:04.851940 14888 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:04.854588 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:04.855319 10529 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:04.858589 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:04.859305 10528 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:28:04.859800  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:04.862143  9890 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:28:04.863372  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:04.835166 14876 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:04.869731  9888 raft_consensus.cc:2393] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 8: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:04.805745 14780 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
W20260709 12:28:04.869714 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 85076.6us
I20260709 12:28:04.881042  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:04.881886  9882 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:28:04.884099  9885 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 16.
I20260709 12:28:04.869164 14788 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:04.886732  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:04.880287 14890 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:04.890846  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:04.889032  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:04.895671  9807 raft_consensus.cc:2393] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 8: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:28:04.888056 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:04.787919  9707 catalog_manager.cc:5697] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:04.903649  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 116903us
I20260709 12:28:04.868187 14590 raft_consensus.cc:697] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:04.912545  9883 raft_consensus.cc:1240] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:04.915215  9890 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
I20260709 12:28:04.893908 14788 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.916589  9807 raft_consensus.cc:1240] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:28:04.861567 14542 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:04.927552 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 84488.3us
I20260709 12:28:04.896675 14930 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:28:04.933344  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:28:04.936241  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 137729us
I20260709 12:28:04.927218 14788 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:04.935992  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:04.938957  9779 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:04.939998  9807 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 16.
I20260709 12:28:04.940208 14891 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:04.945236 10529 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:28:04.946949  9707 catalog_manager.cc:5697] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 4 to 9, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 9 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:04.949149  9707 catalog_manager.cc:5697] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:04.951548 14836 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:04.956185  9814 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:04.958010 14669 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:04.931042 14605 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:04.925122 14691 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.149s
I20260709 12:28:04.974951 14605 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:04.963191 14542 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:04.967272 14902 raft_consensus.cc:3055] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:28:04.979643 14902 raft_consensus.cc:740] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:04.980688 14902 consensus_queue.cc:260] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:04.970083 14899 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:04.971480  9964 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:28:04.991262  9964 pending_rounds.cc:85] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 12
W20260709 12:28:04.998566  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 59652.6us
I20260709 12:28:04.982072 14902 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:04.957584  9853 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:04.991497  9964 pending_rounds.cc:107] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:28:05.000866  9964 raft_consensus.cc:2889] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:05.002300  9779 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:05.003005 14590 consensus_queue.cc:237] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:05.010581  9779 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:05.010720  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:05.011833 14605 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:05.013314  9806 raft_consensus.cc:1240] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:05.014474 10496 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:05.009967 14542 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:28:05.014904  9809 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:05.015471 10496 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:05.015321 14876 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:05.020599  9814 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:28:05.021412  9815 raft_consensus.cc:1240] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:04.984681 14890 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:05.026176  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:05.023712  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:28:05.024540 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 105582us
I20260709 12:28:05.028450  9779 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
W20260709 12:28:05.030652  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 45899.1us
I20260709 12:28:05.031870  9813 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:05.034710  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:05.038316  9885 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:28:05.027177 14890 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:05.040910  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:05.041386  9957 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:05.026219 14605 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.042641 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:05.029742 14542 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:05.044747  9963 raft_consensus.cc:2410] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:28:05.046804  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:05.047672  9811 raft_consensus.cc:2393] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 15: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
W20260709 12:28:05.047942  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 112501us
I20260709 12:28:05.048789  9853 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:05.050770 14728 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:05.032994 14899 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:28:05.053246  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:05.050227  9853 leader_election.cc:400] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8.
I20260709 12:28:05.054854  9779 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:05.056530  9808 raft_consensus.cc:1240] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:05.042339 14891 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:28:05.057982 14605 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:05.080021 14935 log.cc:927] Time spent T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.124s	user 0.000s	sys 0.002s
W20260709 12:28:05.089846 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 44500.3us
W20260709 12:28:05.090193  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 52749.2us
I20260709 12:28:05.053267 14691 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:28:05.101015  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 50923.9us
I20260709 12:28:05.118983 14542 raft_consensus.cc:697] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:05.080102 14605 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:05.123076  9813 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:28:05.094148 14930 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:28:05.140347  9813 pending_rounds.cc:85] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71: Aborting all ops after (but not including) 12
I20260709 12:28:05.140735  9813 pending_rounds.cc:107] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 12:28:05.140998  9813 raft_consensus.cc:2889] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:05.141119 14788 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:05.147028  9957 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 15.
I20260709 12:28:05.128526 14691 raft_consensus.cc:697] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 17 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:05.152230  9963 raft_consensus.cc:3055] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:05.152478  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:05.152695  9963 raft_consensus.cc:740] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:05.153021 14788 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:05.153636 14876 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:05.157768  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 112102us
I20260709 12:28:05.153122  9962 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:05.123348 14780 consensus_queue.cc:1059] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
W20260709 12:28:05.168213  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 78622.7us
I20260709 12:28:05.153614  9963 consensus_queue.cc:260] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:05.160068 14930 raft_consensus.cc:697] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 15 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:05.159991  9779 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:05.163568 14941 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:28:05.163781  9811 raft_consensus.cc:1240] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:05.164963 14669 consensus_queue.cc:1059] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:05.173784 10497 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:05.174340  9963 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:05.176704  9928 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:05.175343  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:05.188503  9814 raft_consensus.cc:1275] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:28:05.189463 14888 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:05.190359 14691 consensus_queue.cc:237] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:05.184366  9779 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:05.195299 14919 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:05.196163  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:05.197086 14391 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:05.197616 14391 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:05.197696  9928 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:05.193764 14941 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:28:05.196338 14788 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:05.199270 14721 consensus_queue.cc:1059] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:05.199560 14788 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:05.200734 14788 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:05.200325 14605 raft_consensus.cc:3055] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:05.207177 14605 raft_consensus.cc:740] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:05.208271 14605 consensus_queue.cc:260] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:05.209623 14605 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:05.210546 10529 raft_consensus.cc:1240] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:05.213455  9882 raft_consensus.cc:1240] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:05.198063 14391 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:05.197014 10497 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:05.202267 14476 consensus_queue.cc:1059] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:28:05.202913 14780 consensus_queue.cc:1059] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:05.223963 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:05.226301  9889 raft_consensus.cc:1240] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:05.203821 14564 consensus_queue.cc:1059] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:28:05.204602 14921 raft_consensus.cc:2764] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:28:05.227352  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:05.228127  9882 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:05.229707 10529 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:05.205737  9779 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:05.204770  9963 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:28:05.199812 14930 consensus_queue.cc:237] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:05.185300 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 169930us
I20260709 12:28:05.224381  9885 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:05.224728 10525 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 12:28:05.225294  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 97201.6us
I20260709 12:28:05.120576 14542 consensus_queue.cc:237] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:05.230501  9962 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:05.231105  9779 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:05.206377 14941 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:05.228806 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:05.213471 14888 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:05.246721  9778 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:05.250986  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:05.258980  9779 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:05.260689  9883 raft_consensus.cc:1240] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:05.261193  9812 raft_consensus.cc:1240] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:05.267794  9885 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:05.267865  9807 raft_consensus.cc:2368] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15.
I20260709 12:28:05.278169 10527 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:28:05.256382 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:05.258251 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:05.267948  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:05.281839  9813 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:05.282428  9853 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:05.281723  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:05.283861  9962 raft_consensus.cc:2368] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15.
I20260709 12:28:05.259548 14920 raft_consensus.cc:3055] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:05.257123 14669 raft_consensus.cc:3055] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:05.258548 14802 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:28:05.290647  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:28:05.299120 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:05.299437 10529 raft_consensus.cc:1275] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:28:05.286633 14884 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:28:05.306926  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 48061.8us
I20260709 12:28:05.309551 14882 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:28:05.309854 14938 log.cc:927] Time spent T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.369s	user 0.000s	sys 0.010s
I20260709 12:28:05.310173 14882 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:05.313779  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:05.314630  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:28:05.315284  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 65351.8us
I20260709 12:28:05.255914 14890 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:05.309675 14931 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:28:05.281538 14922 consensus_queue.cc:1048] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:28:05.288280 14920 raft_consensus.cc:740] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:05.249590 14947 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 12:28:05.297436 14476 raft_consensus.cc:3055] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:28:05.323732  9964 raft_consensus.cc:2410] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:28:05.289934 14669 raft_consensus.cc:740] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:05.309600  9779 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:05.306535 14728 raft_consensus.cc:2749] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:05.329540  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:05.329509 10532 raft_consensus.cc:1240] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:05.330631  9813 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:28:05.331784  9883 raft_consensus.cc:1275] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:28:05.324139 14882 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:05.302892 14590 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:28:05.334792  9962 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:28:05.338231 14956 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.334360 14564 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.328788 14884 raft_consensus.cc:697] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:05.328949 14476 raft_consensus.cc:740] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:05.329854 14931 raft_consensus.cc:697] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 15 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:05.354715 14920 consensus_queue.cc:260] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:05.352751 14944 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:28:05.355836  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:05.334748 14891 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:05.365875 14564 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:05.368240 14949 log.cc:927] Time spent T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:28:05.351027 14957 consensus_queue.cc:1059] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:28:05.348703 14956 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:05.334540 14926 consensus_queue.cc:1059] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.138s
I20260709 12:28:05.370512  9853 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:05.524906 10527 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:28:05.551699  9885 raft_consensus.cc:1275] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:28:05.551702  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 242209us
I20260709 12:28:05.552146  9882 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:28:05.552863  9779 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:05.526684 14944 raft_consensus.cc:697] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:05.567646 10529 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:28:05.568904 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:05.570807 10524 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:05.547111 14891 raft_consensus.cc:697] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:05.564811 14728 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:05.589465 10526 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:28:05.592414  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 292925us
I20260709 12:28:05.579330 14920 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:28:05.593881  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 278614us
I20260709 12:28:05.597496  9928 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:05.598140 10528 raft_consensus.cc:1240] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 17 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 16. Current term is 17. Ops: []
W20260709 12:28:05.608788  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 275152us
I20260709 12:28:05.587010 14590 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:28:05.610854 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 328358us
I20260709 12:28:05.645946  9853 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:05.580958 14669 consensus_queue.cc:260] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:05.608150 14890 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:05.633131 14728 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.634217 14590 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:05.644572 14927 raft_consensus.cc:3055] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:28:05.670137  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:05.659183 14590 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:05.658932 14721 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.697593 10497 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:05.638131 14944 consensus_queue.cc:237] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:05.666638 14927 raft_consensus.cc:740] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:05.636293 14931 consensus_queue.cc:237] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:05.662739 14788 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:05.698864 14391 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:05.675052 14728 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:05.776844  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:05.737723 14721 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:05.781224 14958 log.cc:927] Time spent T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 12:28:05.774770 14956 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:05.775235 14936 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:05.775161 14968 raft_consensus.cc:2764] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:28:05.790097  9808 raft_consensus.cc:1240] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:05.793438 14961 consensus_queue.cc:1059] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
W20260709 12:28:05.794269 14959 log.cc:927] Time spent T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 12:28:05.802021  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 195534us
W20260709 12:28:05.939152 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 123524us
W20260709 12:28:05.812326  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:05.824589 14882 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:05.840265 10524 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:05.639873 14884 consensus_queue.cc:237] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:05.969939  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 302522us
I20260709 12:28:05.914491 14975 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:05.923758  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 285684us
I20260709 12:28:05.925355 14926 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.928875 14767 raft_consensus.cc:3055] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:28:05.930994 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 226565us
I20260709 12:28:05.978833 10497 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:05.967913  9928 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:05.972005 14970 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:05.973037 14721 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:05.673759 14891 consensus_queue.cc:237] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:05.973219 14728 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:05.932530 14936 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:05.932294 14542 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:05.980870  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:28:05.930752 14899 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.000s	sys 0.020s
I20260709 12:28:05.989491  9853 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:05.982883 14767 raft_consensus.cc:740] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:06.004771 14391 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.005606  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:06.006372 14963 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:28:06.008664 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:06.010020  9883 raft_consensus.cc:2410] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:28:05.987303 14920 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:05.971063 14956 consensus_queue.cc:1048] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:28:05.994302 14936 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:28:06.002926 14899 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.000s	sys 0.021s
I20260709 12:28:06.027246  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:06.008919 14721 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:28:06.028723 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 52179.1us
I20260709 12:28:06.032073  9884 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:28:06.030993  9888 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:28:06.012266 14968 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.021160 14728 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:05.996002 14691 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:28:05.984817 14926 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:06.060781 14925 raft_consensus.cc:3055] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:06.061340 14925 raft_consensus.cc:740] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:06.062249 14882 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.062495 14977 consensus_queue.cc:1048] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:28:06.062304 14925 consensus_queue.cc:260] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:06.064499 14984 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:06.064822 14969 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:06.065090 14984 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.065402 14969 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.065660 14899 consensus_queue.cc:1059] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:06.006199 14927 consensus_queue.cc:260] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:06.066525 14899 consensus_queue.cc:1059] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:28:06.067225 14899 consensus_queue.cc:1243] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer f5208640a51f493e930ce4f64ceeed0b log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:28:06.067413 14927 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:06.067523 14984 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.067735 14899 raft_consensus.cc:3055] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:06.068137 14980 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:06.068450 14982 raft_consensus.cc:3055] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:28:06.068892 14982 raft_consensus.cc:740] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:06.013345 14542 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:05.989655 14975 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:06.001746 14970 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:06.053057 14721 raft_consensus.cc:697] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:06.083580 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:06.087539 10524 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
W20260709 12:28:06.087404 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 108671us
I20260709 12:28:06.064530 14925 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:06.064509 14976 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 12:28:06.091179  9890 raft_consensus.cc:1275] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:28:06.093396 14542 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.095064  9853 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:06.095916 14728 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:06.096341 14728 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:06.096421  9853 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:06.096854 14728 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:06.091065 10496 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:06.068142 14899 raft_consensus.cc:740] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
W20260709 12:28:06.108199  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 120003us
I20260709 12:28:06.105823  9854 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:28:06.102286  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:06.086117 14969 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.090687 14984 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:06.089973 14891 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:06.158617  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:06.088325 14882 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:06.159703  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:06.161166  9886 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:28:06.161999  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:06.162482  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:06.056676 14968 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.180560 14891 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.086269 14767 consensus_queue.cc:260] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:06.182849 14891 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.182929 14767 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:06.183290 14691 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:06.186444 14721 consensus_queue.cc:237] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.163414 14957 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.169158 14564 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.169651 14986 consensus_queue.cc:1059] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
W20260709 12:28:06.173162  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:06.085351 14590 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:06.178790 14981 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.122s
I20260709 12:28:06.179625 14926 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:06.180124 14975 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:06.180001 14984 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:06.195077  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:06.229908  9928 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:06.233150  9812 raft_consensus.cc:1240] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:28:06.182936 14968 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.208551 14927 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:06.248473 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 173890us
I20260709 12:28:06.234779 14975 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:06.249562 14956 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:06.195638 14957 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.250075 14808 consensus_queue.cc:1048] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:28:06.234407 14882 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.273646  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:06.277783  9811 raft_consensus.cc:1240] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:06.277064  9928 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:06.267691 14564 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.281997  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:06.254434 14927 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:06.254820 14968 consensus_queue.cc:1048] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:28:06.286851  9815 raft_consensus.cc:1240] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:06.279452  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:06.238353 14899 consensus_queue.cc:260] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.290385  9808 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
W20260709 12:28:06.330075  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 46099.1us
I20260709 12:28:06.330190  9814 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:28:06.291762 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:06.274718 14946 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:06.340850  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:06.341683  9811 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 13: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:28:06.351763 15008 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:06.352833 15008 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.360949  9882 raft_consensus.cc:1240] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:06.364916  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:06.365741  9889 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:06.362943 14956 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:06.368822 14956 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.378954 14946 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.380932 14956 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.381398 14780 consensus_queue.cc:1059] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:06.382143 14961 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:06.382771 14946 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.384413 15006 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:06.384636 14882 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.385036 15006 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:06.385519 15006 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:06.370638 14995 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:06.386986  9927 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:06.387656 15002 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:06.388144 15002 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:06.388495 15002 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:06.388562 14968 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:06.388924 10530 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 1227) took 1161 ms. Trace:
I20260709 12:28:06.387281 14995 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.389385 10530 rpcz_store.cc:276] 0709 12:28:05.227287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:05.273496 (+ 46209us) service_pool.cc:224] Handling call
0709 12:28:05.307253 (+ 33757us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:05.329356 (+ 22103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:05.329392 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:05.993264 (+663872us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b2c0010bbf8. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8ce15a11 00007f2f8ce25372 00007f2f8e557a01 00007f2f8e51c43a 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2
0709 12:28:06.017182 (+ 23918us) log.cc:844] Serialized 26 byte log entry
0709 12:28:06.196660 (+179478us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:28:06.196696 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:06.196772 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:06.388473 (+191701us) raft_consensus.cc:1685] finished
0709 12:28:06.388496 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:06.388727 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13400,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":4194,"spinlock_wait_cycles":4096768,"thread_start_us":143278,"threads_started":1,"wal-append.queue_time_us":246101}
I20260709 12:28:06.391711 14780 consensus_queue.cc:1243] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [LEADER]: Peer 4104e34a61b7448281d6d91ce23ebf71 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:28:06.392131 14995 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.275607 14936 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.338629 14975 raft_consensus.cc:697] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
W20260709 12:28:06.402940 14992 log.cc:927] Time spent T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
W20260709 12:28:06.403555  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 307202us
I20260709 12:28:06.382807 14961 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.361337 14931 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:06.364013 14899 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:06.292295 14564 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.414309  9886 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:28:06.389219 14968 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:06.363055 14962 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:06.415983 14590 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:06.408299  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:06.422972  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:28:06.426117 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 145940us
I20260709 12:28:06.429644  9882 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
W20260709 12:28:06.426290  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 320527us
I20260709 12:28:06.433331  9887 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
W20260709 12:28:06.436373 14996 log.cc:927] Time spent T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259: Append to log took a long time: real 0.144s	user 0.000s	sys 0.003s
I20260709 12:28:06.428400 14968 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:06.437840 14564 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.439335 10496 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:06.439700 14957 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.442513  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:06.444404  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:06.444650 14931 consensus_queue.cc:1048] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:28:06.445561 14476 consensus_queue.cc:260] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:06.447000 14476 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:06.447515 14985 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:06.447019 10496 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:06.449194 14990 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:06.449909 14990 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.451131 10496 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:06.451627 14927 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:06.451339 14985 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:06.455899  9853 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:06.456117 14961 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.456985  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:06.457197 14936 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:06.457774  9806 raft_consensus.cc:2393] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 13: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:28:06.462980  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:06.457288  9853 leader_election.cc:400] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 7. Current term is 8.
I20260709 12:28:06.465996  9887 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 6.
I20260709 12:28:06.466933 15009 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:06.467264  9886 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:28:06.467497 15009 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.468108 14669 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:06.469609 15009 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.471874  9853 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:06.472765 14728 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.473199  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:06.473783 15009 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:28:06.475224  9915 heartbeater.cc:646] Failed to heartbeat to 127.8.111.126:43135 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.8.111.126:43135 timed out after 15.000s (SENT)
I20260709 12:28:06.490765 14975 consensus_queue.cc:237] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:06.476791  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:06.497207 15004 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:06.497560  9885 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:06.498711  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:06.483312  9889 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:06.494841  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:06.507736  9885 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
W20260709 12:28:06.509873 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 44544.6us
I20260709 12:28:06.503567  9888 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:28:06.514024  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:06.508536  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:06.515455 10496 leader_election.cc:400] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15.
I20260709 12:28:06.515756 10496 leader_election.cc:403] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:28:06.517508 14902 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15.
I20260709 12:28:06.519626 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:06.508504 15004 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:06.523125 15012 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:06.523672 15012 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.529875  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:06.530483  9881 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:28:06.531231 15012 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.531415  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:06.532004  9881 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:06.533262  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:06.535828  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:06.540993  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:06.541859  9955 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:28:06.542861  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 44211.8us
I20260709 12:28:06.546454  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:06.547261  9886 raft_consensus.cc:2393] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 15: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:06.548017  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:28:06.545123  9854 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:06.548542  9886 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:28:06.549437  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:06.550580  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:06.554394 10496 leader_election.cc:400] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15.
I20260709 12:28:06.556563  9853 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:06.555015 10531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 1225) took 1328 ms. Trace:
I20260709 12:28:06.543136 14947 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:06.544436 14888 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:06.569814 15008 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.573912  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:06.574654  9890 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 13: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:28:06.580020 15020 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:06.582906 15013 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:06.536105 15006 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:06.583570 10496 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:06.559104 10531 rpcz_store.cc:276] 0709 12:28:05.226530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:05.227027 (+   497us) service_pool.cc:224] Handling call
0709 12:28:05.227506 (+   479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:05.238994 (+ 11488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:05.239024 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:06.418218 (+1179194us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b1800408160. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b3fd2a6 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b3fd2a6 00007f2f8b3fd240
0709 12:28:06.420966 (+  2748us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b2c0010bbf8. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8ce15a11 00007f2f8ce25372 00007f2f8e557a01 00007f2f8e51c43a 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2
0709 12:28:06.421516 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:28:06.542962 (+121446us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:28:06.543013 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:06.543097 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:06.553486 (+ 10389us) raft_consensus.cc:1685] finished
0709 12:28:06.553504 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:06.554839 (+  1335us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15656,"raft.queue_time_us":18064,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":13744,"spinlock_wait_cycles":7055104,"thread_start_us":121022,"threads_started":1,"wal-append.queue_time_us":123897}
W20260709 12:28:06.606806  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 50360.2us
I20260709 12:28:06.564034 14721 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:06.568173 14947 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:06.612566  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:06.610774  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:06.586447 14946 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:06.559821 14985 consensus_queue.cc:1059] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:28:06.585175 15006 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:06.608160 14986 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:06.627638  9881 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
I20260709 12:28:06.616209 14947 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:06.637012  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:06.638451 15000 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:06.639032 15011 log.cc:927] Time spent T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:28:06.573275 14968 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:06.630601 14989 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:06.651278  9886 raft_consensus.cc:1240] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 12:28:06.647203 15014 log.cc:927] Time spent T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:28:06.657961  9853 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:06.652432  9881 raft_consensus.cc:1240] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:06.659636 14780 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:06.661506 14922 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:06.664683  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:06.666007  9881 raft_consensus.cc:1240] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:06.662245  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:06.664507 14780 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:06.619823 14721 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.673890 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:06.687822  9958 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
I20260709 12:28:06.673534  9779 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:06.666891 14989 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.676819 14946 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.692219 14981 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:06.692610  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:06.692763 14989 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.693205  9779 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:06.693332  9814 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 13: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:28:06.693419 14946 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.660293 14986 raft_consensus.cc:697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:06.676687  9810 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:28:06.689030 14721 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.664691 14922 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:06.669515  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:06.698153  9813 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:06.695381  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:06.666227 14968 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:28:06.679979 14925 consensus_meta.cc:287] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.581s	user 0.007s	sys 0.002s
I20260709 12:28:06.675788  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:06.709831  9887 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:06.694247  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:06.694478  9815 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:06.688248 10531 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 17.
I20260709 12:28:06.701308 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:06.714717  9955 raft_consensus.cc:2410] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:28:06.715131  9854 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:28:06.704352 14960 log.cc:927] Time spent T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.945s	user 0.012s	sys 0.001s
I20260709 12:28:06.683634 14931 raft_consensus.cc:3055] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:06.707497 14691 raft_consensus.cc:3055] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:28:06.708611 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 139711us
W20260709 12:28:06.680521 14972 log.cc:927] Time spent T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.866s	user 0.002s	sys 0.001s
I20260709 12:28:06.673134  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:06.698848 14590 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:06.660523 15000 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.694025 14946 consensus_queue.cc:1048] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:28:06.687283 14962 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:28:06.719045  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:06.720074  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:06.692646 14981 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:06.678056 14990 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.782464  9813 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:28:06.700404 14899 raft_consensus.cc:2764] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:28:06.732740 14939 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:28:06.782965  9815 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:28:06.737339  9962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1860) took 1169 ms. Trace:
I20260709 12:28:06.720423 15013 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:06.784458 15013 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:06.785189 15013 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:06.784292  9962 rpcz_store.cc:276] 0709 12:28:05.567873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:05.567985 (+   112us) service_pool.cc:224] Handling call
0709 12:28:05.576783 (+  8798us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:05.577113 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:05.577142 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:05.577543 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 12:28:05.703233 (+125690us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:28:05.703275 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:05.703344 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:06.654911 (+951567us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:28:06.737018 (+ 82107us) raft_consensus.cc:1685] finished
0709 12:28:06.737041 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:06.737254 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1922,"raft.queue_time_us":711,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":2932,"spinlock_wait_cycles":61338496,"thread_start_us":112229,"threads_started":1,"wal-append.queue_time_us":209672}
I20260709 12:28:06.720119 14944 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:06.741302 14962 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:06.744370 14590 raft_consensus.cc:697] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:06.795071 14590 consensus_queue.cc:237] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:06.745896 14788 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:06.801424 14788 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:06.801528 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:06.755224 14984 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.756733 14970 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:06.759470 14982 consensus_queue.cc:260] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.803297 14982 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:06.762457 14946 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:06.767813  9881 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:28:06.768991  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:06.807574  9888 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:28:06.771431  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:28:06.775260 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 46607us
I20260709 12:28:06.718530 14931 raft_consensus.cc:740] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:06.777652  9887 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:28:06.721100 14691 raft_consensus.cc:740] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:06.662164 15002 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.780308 15000 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.780821  9959 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:28:06.742029  9961 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:28:06.781325  9955 raft_consensus.cc:1275] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:28:06.695228 14986 consensus_queue.cc:237] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:06.781795  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 136236us
I20260709 12:28:06.782519 14981 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:06.700455 14728 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:06.789600 14944 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:06.812180  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:06.816871 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:06.857738 10524 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 13: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:06.822958 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:06.859481 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:06.860322 10526 raft_consensus.cc:2393] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 11: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:06.865408 15000 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:28:06.867743 14931 consensus_queue.cc:260] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.869331 14931 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:28:06.869591 15024 log.cc:927] Time spent T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:28:06.817576 14941 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:06.884537  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 59749.4us
I20260709 12:28:06.843694  9779 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:06.802019 14788 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.845970  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:06.850469 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:06.851141 14985 consensus_queue.cc:1059] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:28:06.851330 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:06.853181  9853 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:06.844748 15006 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:06.854008 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:06.915009 10532 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 17.
I20260709 12:28:06.854069 14925 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:28:06.854733  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:06.855486 14995 consensus_queue.cc:1048] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:06.823511 14984 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:06.845211 14882 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:06.906823 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 321845us
I20260709 12:28:06.911916  9955 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:28:06.886601  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:28:06.950773  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 64279.7us
I20260709 12:28:06.951126  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:06.951527  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:06.952530  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:06.953528  9928 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:06.913874  9882 raft_consensus.cc:1240] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:28:06.920940  9883 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:28:06.922209  9964 raft_consensus.cc:2393] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 10: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:06.856098 14969 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:06.875779 14944 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:06.810850 14946 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.970405  9959 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:28:06.987196 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:06.982788  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:06.988142  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:06.988554  9807 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:06.988729  9881 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:06.984141 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:06.986790 14564 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:06.945698 14970 raft_consensus.cc:2764] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:28:06.942065 14728 raft_consensus.cc:2764] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 12:28:07.004606  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 149218us
I20260709 12:28:06.857565 14691 consensus_queue.cc:260] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.987603 14961 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:06.914067 14884 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:28:06.992489 14721 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:07.058406 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:06.992151 14780 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:06.996594 14564 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:07.077790 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:07.081748 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 81083.9us
I20260709 12:28:06.992100 14882 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.074687  9853 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:06.990047 14984 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.089551 10496 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:07.089883  9881 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
W20260709 12:28:07.070441  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 76367.3us
W20260709 12:28:07.086530  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:07.078709 10526 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:28:07.097903 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:07.075091 14961 raft_consensus.cc:697] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:07.099442  9928 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:07.081276 14564 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:07.081549 14922 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:28:07.105720  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 46151.6us
I20260709 12:28:07.011775 15006 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.107082  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:07.092636 14691 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:07.106809  9883 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:28:07.094866 14902 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:28:07.111586  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:07.113405 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:07.098497 14728 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:07.122820  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:07.126132  9885 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:28:07.081418 14936 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:28:07.104095 14925 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:07.131687 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:07.136044  9960 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:28:07.138460 10532 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 13: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:07.103689 14391 consensus_queue.cc:1059] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:28:07.165021  9853 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:07.168335 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 77248.9us
W20260709 12:28:07.138190 15023 log.cc:927] Time spent T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:28:07.169245 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:07.160773 14947 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:06.871690 14941 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.134938 14965 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:07.178385 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 87288.2us
I20260709 12:28:07.181797 10497 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:07.161836 14967 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:07.126302 14962 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.134842 14948 consensus_queue.cc:1059] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.234s
I20260709 12:28:07.203965  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:07.204618  9813 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:28:07.205928 15038 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:28:07.207581  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 69052.6us
I20260709 12:28:07.208660  9853 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:07.209658 14899 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:28:07.210040 14899 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:28:07.197314  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 353652us
I20260709 12:28:07.227327 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:07.248577  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:07.210179  9853 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:07.163337 14968 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:28:07.274806 14925 raft_consensus.cc:697] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:07.177410 14788 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:07.211339 15043 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:07.282929  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:07.234943 14888 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:28:07.188364 14965 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:07.289523 14590 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:07.290040 15037 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:07.236829 15035 log.cc:927] Time spent T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:28:07.187700 14728 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:28:07.213091 15029 log.cc:927] Time spent T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:28:07.319969 15006 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:07.321386 14981 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.309433 14808 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:07.322450 14965 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:07.322985 14946 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:07.322813 14808 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:07.270907 15013 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.323347 15037 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:07.323889 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:07.324623 10525 raft_consensus.cc:2393] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 13: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:07.324884 14808 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:07.325280 15013 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:07.325445 15037 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:07.213635 15032 log.cc:927] Time spent T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:28:07.333295 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:07.317106 14728 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:07.334698 14728 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:07.340620 10524 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:07.340695  9927 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:07.341270 14968 consensus_queue.cc:1059] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:07.297178  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:07.342137 14968 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:07.342303 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:07.342576 14968 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:07.342952 14968 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:07.210474 14999 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:07.239322 14948 raft_consensus.cc:3055] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:07.235970 14962 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:07.264990 14899 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:07.200054 14967 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:07.353269 14948 raft_consensus.cc:740] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:07.362432 14999 raft_consensus.cc:697] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:07.186580 14721 consensus_queue.cc:1059] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.116s
I20260709 12:28:07.189365 14961 consensus_queue.cc:237] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.315007 10527 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:28:07.226586 14941 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:07.316411 14947 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:07.325664 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:07.298134 15020 raft_consensus.cc:2764] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:28:07.384120 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:07.298153  9884 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:28:07.294867  9807 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:28:07.351073 14981 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:07.349943 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:07.360769  9963 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:28:07.364861  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 154765us
I20260709 12:28:07.362665 14967 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:07.383222  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:07.352411 14564 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.404449 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:07.404518  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:07.416975 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:07.343482 14590 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.427210 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:07.309052 15043 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.399030 15002 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:07.428820  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:07.448802  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:07.449636  9890 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:28:07.446623 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:07.452966 14999 consensus_queue.cc:237] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.454186 15052 raft_consensus.cc:3055] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:07.454593 15052 raft_consensus.cc:740] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:28:07.455010 15030 log.cc:927] Time spent T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.354s	user 0.000s	sys 0.003s
I20260709 12:28:07.455438 15052 consensus_queue.cc:260] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.456668 15052 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:07.459858 15043 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:07.447921 14780 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:07.466771 14780 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.468758 14780 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:07.473305 14728 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:07.474933 15045 log.cc:927] Time spent T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:28:07.476822  9882 raft_consensus.cc:1240] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 11. Current term is 12. Ops: []
W20260709 12:28:07.459873 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:07.483166  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:07.489486  9958 raft_consensus.cc:2393] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 11: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:07.496423 10524 raft_consensus.cc:1240] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:07.509915 10527 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 17.
W20260709 12:28:07.513116  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 90827.9us
I20260709 12:28:07.517484 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:07.518901  9928 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:07.524948  9928 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:07.526683 15051 log.cc:927] Time spent T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:28:07.527834 14936 consensus_queue.cc:1059] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:28:07.529191 14936 raft_consensus.cc:3055] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:07.529563 14936 raft_consensus.cc:740] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:07.530767 14956 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:07.543040  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:07.546489 14983 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:28:07.552269 14590 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:07.431862 14948 consensus_queue.cc:260] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:07.557577  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:07.558928 14931 consensus_meta.cc:287] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.689s	user 0.006s	sys 0.007s
I20260709 12:28:07.559497 10529 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:28:07.562858 14882 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:07.565616  9882 raft_consensus.cc:1240] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:07.567991  9890 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:28:07.571298 14948 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:07.573778 14984 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:07.506095 14669 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:07.575902 14669 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:07.577852 14669 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:28:07.579674  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 54828.5us
I20260709 12:28:07.580854  9928 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:07.586371  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:07.590752 10496 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:07.590011  9928 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:07.592903  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:07.594909  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:07.595243 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:07.596275 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:28:07.650360 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 59684.5us
I20260709 12:28:07.652403  9853 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:28:07.653941  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 64015.6us
I20260709 12:28:07.654654  9928 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:07.662726  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:07.663619  9882 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:28:07.676358  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:07.677556 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:07.539803 14968 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:07.413208 14925 consensus_queue.cc:237] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:07.702005  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 47410.9us
I20260709 12:28:07.702888  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:07.682143  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:07.703454  9928 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:07.703577  9955 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
I20260709 12:28:07.699775  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:07.682523 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:28:07.683878  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 96055.9us
I20260709 12:28:07.683107 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:07.706652 10524 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:07.703727  9885 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:07.685627 15057 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:07.713624  9779 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:07.589002 14669 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:07.721005  9928 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:07.711143  9854 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:07.730147  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:07.730443  9957 raft_consensus.cc:1240] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:07.736114  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:07.650166 15037 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:07.736661 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:07.607864 15042 consensus_queue.cc:1059] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.134s
I20260709 12:28:07.754753  9806 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:07.714134 14969 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:07.756731 14969 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:07.758773 14728 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:07.759050 14969 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:07.650031 14983 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 12:28:07.678689 15052 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:07.761154 15054 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:07.761593 15054 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:07.761938 15054 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:07.762077  9812 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:28:07.692340 15056 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:07.772755 14926 raft_consensus.cc:3055] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:07.773206 14926 raft_consensus.cc:740] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:07.774011 14926 consensus_queue.cc:260] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:07.775143 14926 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:28:07.775496 15048 log.cc:927] Time spent T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 12:28:07.777505 15040 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:07.778043 15040 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.780156 15040 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:07.694425 14564 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:07.698963 15027 raft_consensus.cc:3055] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:07.752205  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:07.678503 15006 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:07.731227 15002 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:28:07.704874 14962 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:07.746031  9853 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:07.796856  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 66513.7us
I20260709 12:28:07.803062 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:28:07.807406  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 93864.6us
I20260709 12:28:07.808197  9779 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:07.810333  9928 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:07.812840  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:07.815975 15002 raft_consensus.cc:697] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 17 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:07.732951  9810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:07.816903  9810 raft_consensus.cc:606] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:07.817255  9810 raft_consensus.cc:614] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:28:07.817627  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 86963.3us
I20260709 12:28:07.731432 14956 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:07.826205  9779 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:07.831979  9814 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:28:07.836229  9779 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:07.795226 15056 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:07.838893  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:07.839927  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:07.840521  9884 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:28:07.842154  9778 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:07.843546  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:07.844708  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:28:07.821902  9853 connection.cc:256] RPC call timeout handler was delayed by -1.7472860230000151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1505s for a response
I20260709 12:28:07.596642 14936 consensus_queue.cc:260] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.794595 14968 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:07.744138 14967 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.795461 15027 raft_consensus.cc:740] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:28:07.846148  9853 connection.cc:256] RPC call timeout handler was delayed by -1.7157860229999642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
I20260709 12:28:07.846110  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:07.851342  9885 raft_consensus.cc:1240] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:28:07.851516  9779 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:07.851936  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:07.853614  9928 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:07.854075  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:07.799285 15006 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:07.852807  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:07.850344  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:07.857079  9778 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:07.858593  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:07.867033  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:07.862035  9853 connection.cc:256] RPC call timeout handler was delayed by -1.5024860230000741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
W20260709 12:28:07.869460  9853 connection.cc:256] RPC call timeout handler was delayed by -1.2882860229997277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
I20260709 12:28:07.870014  9853 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:07.864524  9955 raft_consensus.cc:2410] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:28:07.825331 14962 raft_consensus.cc:697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:07.836594 14669 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:07.870652  9959 raft_consensus.cc:2368] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 14. Current term is 15.
I20260709 12:28:07.880131  9815 raft_consensus.cc:1240] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:28:07.848402 15020 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:07.905476  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:28:07.905879  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:07.848735 14590 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:07.886821  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:07.805598 14961 consensus_queue.cc:1059] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:28:07.893208 14968 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:07.894969  9853 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:07.895996 14984 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:07.921576 14984 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:07.922519 14728 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:28:07.896315 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:07.897130 15047 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:07.897586 14994 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:07.898046 14982 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:07.898207  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:07.929119  9890 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:28:07.899271 15027 consensus_queue.cc:260] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.900300  9927 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:07.904808  9960 raft_consensus.cc:1240] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:07.855696 14969 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:07.803897 15037 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:07.912961  9808 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:28:07.934887  9927 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:07.862663 14981 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 12:28:07.916687  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:07.918519  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:07.905572 15020 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:28:07.920034 14899 consensus_meta.cc:287] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.000s
I20260709 12:28:07.920087  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:07.920670  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:07.946444  9815 raft_consensus.cc:3060] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:07.946722 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:07.858301 15046 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:07.870136 15006 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:07.968532  9927 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:07.926927 10496 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:07.872429 14946 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:07.890888 14669 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:07.887351  9928 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:07.939528  9888 raft_consensus.cc:2393] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 11: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:07.911348  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:07.974825  9806 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:07.912770 14590 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:07.915393 15013 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:28:07.975466 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 48635.1us
I20260709 12:28:07.856539 15056 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:07.816905 15002 consensus_queue.cc:237] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.948731 14728 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:07.948822 14962 consensus_queue.cc:237] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.951198 15027 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:07.934458 14961 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:07.952991 14899 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:07.945870 14968 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:07.977751 14590 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:07.911700 14691 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:28:07.961091 14967 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:07.975690  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 88406.5us
I20260709 12:28:07.945438 15020 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:07.965167 15046 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:07.976140 14669 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:08.013149  9890 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:07.977105 14937 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:28:07.959206  9815 raft_consensus.cc:2468] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:07.978344 14927 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:07.955222 15012 raft_consensus.cc:3055] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:28:07.997905 10525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:60770
I20260709 12:28:08.002269  9957 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:28:08.005163  9889 raft_consensus.cc:1240] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:08.008562  9928 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:07.963343  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:08.018260 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:07.985208 14728 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:08.006577 14899 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:08.032429  9927 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:08.039791  9928 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:08.038229  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 74992.7us
I20260709 12:28:07.984737 15013 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:08.012841 14968 raft_consensus.cc:697] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:08.021827 15046 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:08.064932 14998 consensus_queue.cc:1059] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:08.034114 14927 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:08.068751 14956 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:08.074309  9883 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:28:08.045228 14728 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:08.041234 14564 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:28:08.077939 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:08.036193 15012 raft_consensus.cc:740] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:08.042927 14967 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:08.042753 14982 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:28:08.061816 14888 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.011s	sys 0.009s
I20260709 12:28:08.070971 15038 raft_consensus.cc:2804] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:08.073856 14927 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:08.086076 14956 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:08.103456 14888 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.012s	sys 0.009s
W20260709 12:28:08.146778  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 264549us
W20260709 12:28:08.131623 15050 log.cc:927] Time spent T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.595s	user 0.001s	sys 0.004s
W20260709 12:28:08.176854  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 319848us
I20260709 12:28:08.194945  9778 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:08.129469 15037 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:08.133486 14564 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:08.211086 14564 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:08.132915 15013 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:08.206414 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:08.122236 15006 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:08.140800 15038 raft_consensus.cc:697] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:08.129308 15020 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:08.128733 14956 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:08.187933  9779 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:08.135002 15056 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:08.218780  9778 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:08.221944  9779 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:08.133697 14728 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:08.146646 15054 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:08.229825  9889 raft_consensus.cc:1275] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:28:08.233378  9778 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:08.218360 15037 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:08.258037  9778 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:08.223132 14994 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:28:08.281275  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:08.232632 14981 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:08.281508 14728 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:08.281913 14981 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:08.281446 15054 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:08.282512 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:08.284145 10533 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:28:08.140908 14968 consensus_queue.cc:237] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:08.291226  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:08.295516  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:08.304577  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:08.220892 14946 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 12:28:08.245285 15040 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:08.330164 10526 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 930) took 1197 ms. Trace:
I20260709 12:28:08.309692  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:08.323948  9814 raft_consensus.cc:2393] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 12: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:28:08.293286 14981 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:08.282910 14882 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:08.326489  9890 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:28:08.329108  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:08.329188  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:08.331676  9883 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:08.349758  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:08.305022 14970 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.324010 14994 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:08.375509 10525 raft_consensus.cc:606] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:08.330696 10526 rpcz_store.cc:276] 0709 12:28:07.132520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.132659 (+   139us) service_pool.cc:224] Handling call
0709 12:28:07.142805 (+ 10146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:07.143182 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:28:07.170442 (+ 27260us) log.cc:844] Serialized 14 byte log entry
0709 12:28:07.334869 (+164427us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b18003e12e0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f3f3 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:28:07.359150 (+ 24281us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:07.360723 (+  1573us) log.cc:844] Serialized 26 byte log entry
0709 12:28:07.360892 (+   169us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:28:07.360937 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:07.361032 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:07.565003 (+203971us) spinlock_profiling.cc:243] Waited 9.14 ms on lock 0x7b4800180258. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f93445aa1 00007f2f9343cb37 00007f2f9343c9ca 00007f2f9353426f 00007f2f93533f37 00007f2f9354855c 00007f2f93548508 00007f2f93548488 00007f2f93548443 00007f2f935476ec 00007f2f92471a96
0709 12:28:08.130932 (+565929us) spinlock_profiling.cc:243] Waited 48.9 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:28:08.329808 (+198876us) raft_consensus.cc:1685] finished
0709 12:28:08.329839 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:08.330083 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4679,"prepare.queue_time_us":31457,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":45,"raft.queue_time_us":1376,"raft.run_cpu_time_us":2610,"raft.run_wall_time_us":214306,"spinlock_wait_cycles":139023616,"thread_start_us":179074,"threads_started":1,"wal-append.queue_time_us":304934}
I20260709 12:28:08.376364  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:08.376637  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:08.378604  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:08.330433 15040 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:08.372558  9806 raft_consensus.cc:1240] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 11. Current term is 12. Ops: []
W20260709 12:28:08.380681 15058 log.cc:927] Time spent T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:28:08.391996  9810 raft_consensus.cc:1240] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:08.382536 14994 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:08.375967 14990 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:08.384099 14961 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:08.386070 15040 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:08.415411  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:28:08.416245 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 305926us
I20260709 12:28:08.418627  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:08.423099 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 129445us
I20260709 12:28:08.424754  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:08.415270  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 303817us
I20260709 12:28:08.430580  9958 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:28:08.413529 14994 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:28:08.430912 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:08.443910  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:08.382747 14970 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:08.460412  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:08.461737  9883 raft_consensus.cc:1240] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:08.464215  9853 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:08.339579 15038 consensus_queue.cc:237] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:08.465994  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:08.469887  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:08.470214  9958 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 16.
I20260709 12:28:08.470496  9853 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:08.472719  9882 raft_consensus.cc:2393] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 7: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:08.473863  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:08.475500  9959 raft_consensus.cc:1275] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:28:08.475857  9959 pending_rounds.cc:85] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 7
I20260709 12:28:08.476064  9959 pending_rounds.cc:107] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:28:08.476293  9959 raft_consensus.cc:2889] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:08.427268 14969 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:28:08.428661 15069 log.cc:927] Time spent T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 12:28:08.478632  9853 leader_election.cc:400] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 14. Current term is 15.
I20260709 12:28:08.486435  9853 leader_election.cc:403] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:08.487208  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:08.490522  9778 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:08.418916 14990 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:08.497752 14899 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 14. Current term is 15.
W20260709 12:28:08.501744 15072 log.cc:927] Time spent T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:28:08.503927 15012 consensus_queue.cc:260] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:08.508492 14937 raft_consensus.cc:3055] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:28:08.508910 14937 raft_consensus.cc:740] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:08.509780 14969 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:08.511140 14969 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:08.511590 14969 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:08.512028 14969 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:08.509682 14937 consensus_queue.cc:260] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:08.498852 15020 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:08.495579 15006 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:08.520228 14970 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:08.521085 14970 consensus_queue.cc:1048] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:08.481832 15074 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:08.526255  9887 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:28:08.528729 14990 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:08.531028 14590 consensus_meta.cc:287] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.518s	user 0.006s	sys 0.002s
I20260709 12:28:08.531476 14590 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:08.535717 15081 log.cc:927] Time spent T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:28:08.482870 15056 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:28:08.536629  9883 raft_consensus.cc:2393] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 11: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:08.482384 14963 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:08.537384 14963 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:08.539525 14963 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:08.488643 15013 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:08.543035 14590 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:08.543776  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:08.548969 10525 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:28:08.549647 14936 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:08.554575 14927 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:08.511212 14669 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:08.466460 14982 raft_consensus.cc:697] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:08.560772 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:08.554575 14986 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.563102 10527 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:28:08.564597 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:08.567008 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:08.576524  9887 raft_consensus.cc:2393] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 9: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:08.597023 10528 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
W20260709 12:28:08.606840  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 146486us
I20260709 12:28:08.608307  9779 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:08.609529 14590 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:28:08.613137  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 134617us
I20260709 12:28:08.614813  9853 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:08.619206 14982 consensus_queue.cc:237] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:08.622591  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:08.587646 14564 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:08.624650 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:08.628403  9960 raft_consensus.cc:2393] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 13: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:08.631608  9853 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:08.633320  9853 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:08.633545 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:08.634433  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 137446us
I20260709 12:28:08.635684  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:08.636545  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:08.576987 15046 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:08.624671 14564 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:08.615970 14986 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:08.637017 14728 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:28:08.640352 15013 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:08.634879 15087 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:08.666687 15020 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:08.698622  9887 raft_consensus.cc:2393] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 15: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:08.675382 15094 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.675151 14899 consensus_queue.cc:1059] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:28:08.711982 14899 raft_consensus.cc:3055] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:08.712469 14899 raft_consensus.cc:740] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:08.724167 14986 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:08.731072 14669 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:08.730613 15094 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:08.677205 15056 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:08.756595  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:08.757555  9886 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:28:08.760350 10528 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:08.635365 14941 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 12:28:08.713538 14899 consensus_queue.cc:260] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:08.950887 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:28:08.952102 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 183014us
I20260709 12:28:08.733791 15094 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:08.995280 15108 consensus_queue.cc:1048] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:28:08.996584 15103 log.cc:927] Time spent T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.228s	user 0.000s	sys 0.000s
I20260709 12:28:09.000422 15013 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:08.992483 15076 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:09.002909 15076 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:09.005136 15076 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:08.950846 15020 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.718086 14994 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:08.765528 14963 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.226s
W20260709 12:28:09.039028 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 84502.9us
I20260709 12:28:08.956514 14728 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:08.735358 15056 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:08.768791 14788 consensus_queue.cc:1059] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.240s
I20260709 12:28:08.966041 14982 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:08.992858 14998 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:28:09.044581 15040 consensus_meta.cc:287] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.617s	user 0.005s	sys 0.005s
W20260709 12:28:09.086519  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 334051us
I20260709 12:28:09.087399  9779 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:09.040772 15105 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:09.113988 14982 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:09.043596 15020 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.075682 14927 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:09.032847 15013 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:09.063166 15027 consensus_queue.cc:1059] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:28:09.064603 14728 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:09.116060 14984 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:09.096709 14998 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.101205 15040 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:09.133970 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 82265.9us
I20260709 12:28:09.145833 15056 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:09.142477 14981 consensus_meta.cc:287] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.763s	user 0.013s	sys 0.000s
I20260709 12:28:09.128399 14941 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:28:09.146713 15046 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:09.124753 15105 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:09.152295 14994 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:09.151705 14981 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.161548  9808 raft_consensus.cc:2368] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 17. Current term is 18.
I20260709 12:28:09.139031  9779 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:09.158511 14982 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:09.134783 15013 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.180404  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:09.182528 15040 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:09.188606 14888 raft_consensus.cc:3055] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:09.188998  9812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34802 (request call id 963) took 1403 ms. Trace:
I20260709 12:28:09.189054 14888 raft_consensus.cc:740] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:28:09.189988 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:09.193192 14946 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:28:09.192862 15078 log.cc:927] Time spent T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.770s	user 0.002s	sys 0.008s
I20260709 12:28:09.189574  9812 rpcz_store.cc:276] 0709 12:28:07.786007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.786325 (+   318us) service_pool.cc:224] Handling call
0709 12:28:07.811393 (+ 25068us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:28:07.827213 (+ 15820us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:28:08.145333 (+318120us) log.cc:844] Serialized 14 byte log entry
0709 12:28:08.496021 (+350688us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:28:09.183416 (+687395us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b2c000fc3c8. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8ce15a11 00007f2f8ce25372 00007f2f8e557a01 00007f2f8e51c43a 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2
0709 12:28:09.184088 (+   672us) log.cc:844] Serialized 52 byte log entry
0709 12:28:09.184286 (+   198us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:28:09.184541 (+   255us) log.cc:844] Serialized 14 byte log entry
0709 12:28:09.188654 (+  4113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:09.188728 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:09.188828 (+   100us) raft_consensus.cc:1685] finished
0709 12:28:09.188841 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:09.188949 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67861,"prepare.queue_time_us":570137,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":86,"raft.queue_time_us":73627,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":18855,"spinlock_wait_cycles":7292416,"thread_start_us":518486,"threads_started":2,"wal-append.queue_time_us":374704}
I20260709 12:28:09.202687 14981 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:09.203107 15105 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:09.190125 14888 consensus_queue.cc:260] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.205464 14888 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:09.179059 14998 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:09.194832 14728 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:09.191445 15020 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:09.192574 14969 consensus_meta.cc:287] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.680s	user 0.011s	sys 0.000s
I20260709 12:28:09.207753 14969 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:09.207701 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:09.211843 14936 consensus_meta.cc:287] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.003s
I20260709 12:28:09.175972 15110 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:09.212811 15110 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:09.213099  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:09.214094 15110 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:09.214365  9883 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:28:09.222088 10532 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:28:09.228039  9883 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:09.232254  9959 raft_consensus.cc:1240] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:09.233273 15013 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:09.235994  9956 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 17. Current term is 18. Ops: []
I20260709 12:28:09.238672 14669 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:09.239200 14669 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.241295 14669 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:09.242810  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:09.245198  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:09.245834  9958 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:09.248445 14937 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:28:09.251178  9927 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:09.256038  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:09.296317  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:09.256965  9928 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:28:09.299906  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 55070.6us
I20260709 12:28:09.301256  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:09.301525  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:09.302335  9955 raft_consensus.cc:2393] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 7: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:28:09.259845  9853 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:09.303591  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:09.307790  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:09.209880 14969 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:09.297719  9779 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:09.311170  9958 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
I20260709 12:28:09.254244 14921 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:28:09.256369 14899 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:09.256763 15038 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.319234  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:09.256368 15054 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:09.256867 14925 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.256647 14564 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:28:09.319394  9955 raft_consensus.cc:1240] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:09.277705 15006 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:28:09.293514 15002 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.021s	sys 0.033s
I20260709 12:28:09.322861  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:09.323334  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:09.334404 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:09.334903  9806 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:28:09.323717  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:09.335064 10527 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
I20260709 12:28:09.335532  9890 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:28:09.265565 14970 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:09.277966 14669 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.326238 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:09.266767 14981 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:09.289814 15013 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.256490 14922 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:09.331529 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:09.255328 14967 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 12:28:09.337023  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:09.338897 10528 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 15.
I20260709 12:28:09.316257 14968 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:09.255124 14927 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 12:28:09.316219 15040 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:28:09.343039  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:09.342655  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:09.353008  9853 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
W20260709 12:28:09.336742 15002 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.022s	sys 0.033s
I20260709 12:28:09.316151 15115 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:09.360478  9854 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:09.361748  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:09.363054 10524 raft_consensus.cc:2393] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 15: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:09.364176  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:09.365331  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:09.371637  9811 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:09.390486  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:09.391244  9812 raft_consensus.cc:2368] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 13. Current term is 14.
I20260709 12:28:09.396803  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:09.397045  9890 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:09.397574  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:09.397974  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:09.360705 14968 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:09.398576  9779 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:09.335866 14925 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:09.330585 15054 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.406456  9812 raft_consensus.cc:1275] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:28:09.338109 15006 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.375044 14921 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:09.415257 14921 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.417057  9810 raft_consensus.cc:1275] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:28:09.417430 14921 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:09.377000 14728 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:09.350366 14970 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:09.411154  9927 leader_election.cc:400] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 13. Current term is 14.
I20260709 12:28:09.430442  9927 leader_election.cc:403] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:28:09.350543 15013 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:09.432695 15013 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:09.433451 15085 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 13. Current term is 14.
I20260709 12:28:09.332167 15038 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.414048  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:09.357072 14981 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:09.441509 14981 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:09.393939 14780 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:09.442585 14780 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.361413 14922 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.396373 14963 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.398969 15020 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:09.444988 14963 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.445290 15020 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:09.445847 15020 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:09.354347 14669 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.448750 14963 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:09.449882  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:09.424669  9811 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:28:09.453945  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:09.454749  9882 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:28:09.458689  9809 raft_consensus.cc:1240] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:09.460675  9779 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:09.462162  9779 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:09.463665 15108 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:09.464404 15108 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:28:09.464912 15108 raft_consensus.cc:697] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:09.465032 14922 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:09.465919 15108 consensus_queue.cc:237] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.469277  9961 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:28:09.473013 15002 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:09.473531 15002 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:09.475672 15002 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:09.488081  9889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1752) took 1229 ms. Trace:
I20260709 12:28:09.488623  9889 rpcz_store.cc:276] 0709 12:28:08.258706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.258880 (+   174us) service_pool.cc:224] Handling call
0709 12:28:09.487773 (+1228893us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b540013c4d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:09.487978 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1524530560}
I20260709 12:28:09.495748 14947 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:09.496423 14947 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.507347  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:09.508530  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:09.499053  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:09.514536 14780 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:09.515575  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:09.516173  9961 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:09.501377  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:09.517611  9955 raft_consensus.cc:2393] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 15: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:28:09.502803 10532 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 1142) took 1703 ms (client timeout 1902 ms). Trace:
W20260709 12:28:09.518401 10532 rpcz_store.cc:269] 0709 12:28:07.798948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:07.799773 (+   825us) service_pool.cc:224] Handling call
0709 12:28:09.502626 (+1702853us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b540069ebd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:09.502724 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3235855744}
I20260709 12:28:09.520097 15012 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:09.504495 15037 consensus_queue.cc:1059] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:28:09.505371  9812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:09.521441  9812 raft_consensus.cc:606] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:09.441465 15038 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:09.523420  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:09.525843 15106 consensus_queue.cc:1059] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:28:09.526949 14969 raft_consensus.cc:3055] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:28:09.527179  9958 raft_consensus.cc:1240] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 6. Current term is 7. Ops: []
I20260709 12:28:09.527318 14969 raft_consensus.cc:740] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:09.528239 14969 consensus_queue.cc:260] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.533224 14981 raft_consensus.cc:3055] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:09.534099 14981 raft_consensus.cc:740] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:09.535743 15013 consensus_queue.cc:1059] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:09.536340  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:09.537305 15002 raft_consensus.cc:3055] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:09.537703 15002 raft_consensus.cc:740] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:09.538553 15002 consensus_queue.cc:260] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:09.539616 15002 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:09.540439 14969 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:09.554844 14947 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:09.556236  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:09.556913  9958 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 9.
I20260709 12:28:09.560453  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:09.561131  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:09.565016  9809 raft_consensus.cc:1275] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:28:09.566615  9812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:09.567246  9812 raft_consensus.cc:606] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Received request to transfer leadership to TS b011791796d1457284b857d7d3422195
I20260709 12:28:09.545096 14981 consensus_queue.cc:260] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.557053  9778 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:09.568591  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:09.569219  9809 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:28:09.571280  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:09.571565 15108 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:09.576373 14981 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:09.582484  9812 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:28:09.359934 15110 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.407684 14968 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:09.585311  9807 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 17. Current term is 18. Ops: []
I20260709 12:28:09.614082  9961 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:09.599706  9812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:09.615134  9812 raft_consensus.cc:606] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Received request to transfer leadership to TS b011791796d1457284b857d7d3422195
I20260709 12:28:09.615645  9812 raft_consensus.cc:614] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:09.611160  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46496 (request call id 2428) took 1255 ms. Trace:
W20260709 12:28:09.614409 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:09.581877  9778 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:09.579802 15020 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.616168  9808 rpcz_store.cc:276] 0709 12:28:08.329044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.329615 (+   571us) service_pool.cc:224] Handling call
0709 12:28:09.583681 (+1254066us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b5400252bd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:09.583821 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1791276288}
I20260709 12:28:09.411522 15040 raft_consensus.cc:697] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:09.523277 14669 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:09.633411  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:09.634459 15054 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:09.635591  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:09.636938 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:09.634892 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:09.642648 10533 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:09.649257  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:09.650236  9853 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:09.655969 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:09.426995 14728 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:09.639734  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:28:09.421223 15111 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:28:09.713948  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:09.714705  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:09.726471  9853 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:09.728531  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:09.392925 15115 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:09.738130  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:09.727591  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 95487.1us
I20260709 12:28:09.628330 15106 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:09.624642 15087 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:09.728410  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:09.792665  9885 raft_consensus.cc:2393] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 15: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:28:09.784603 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:09.628726 14936 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.624257 14999 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:09.736999  9810 raft_consensus.cc:2393] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 18: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:28:09.790853 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:09.720630 14728 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:09.814844 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:09.720059 14963 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.815436 10531 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:28:09.815279  9927 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:09.828338 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:09.828761 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:09.735103 15105 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:09.712345 14721 consensus_queue.cc:1048] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 12:28:09.832283 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:09.866214  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:09.812062 15108 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:09.819818 15037 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:09.823328 15102 log.cc:927] Time spent T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:28:09.878741  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:09.883939 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:09.885541 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:09.886030 15108 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.888896 15108 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:09.891971 15127 log.cc:927] Time spent T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.232s	user 0.000s	sys 0.000s
I20260709 12:28:09.896459 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:09.852079 15106 raft_consensus.cc:697] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:09.851373 14994 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:09.862988 14925 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:09.818063 14936 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:09.917182  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 101965us
I20260709 12:28:09.878124 15027 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:09.922645 15112 log.cc:927] Time spent T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:28:09.918648  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:09.878338 15105 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.820803 14999 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.851712 15057 consensus_queue.cc:1048] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:28:09.935873 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:09.916141 15099 log.cc:927] Time spent T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:28:09.916538  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 49145.4us
I20260709 12:28:09.934551  9927 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:09.831492 14963 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.843116 15087 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:09.933342 14669 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:09.967744 10527 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:28:09.988533  9959 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.014s	sys 0.022s
W20260709 12:28:10.004621  9959 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.014s	sys 0.022s
I20260709 12:28:09.932627 14941 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.903460 15037 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:10.011858  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 46438.2us
I20260709 12:28:09.933494 15054 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:28:09.988297 15086 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.013s	sys 0.022s
I20260709 12:28:10.023891 10532 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:28:10.002051 14967 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:09.968652 14925 consensus_queue.cc:1048] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:28:10.038100 14780 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:10.038805 14780 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:10.039865 14899 consensus_meta.cc:287] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.720s	user 0.007s	sys 0.004s
I20260709 12:28:10.041302 14780 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:10.023973 14941 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.044476 14970 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:09.936703 15027 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.045766 15020 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:10.047694 14936 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:28:10.044075 15087 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:10.046106 15006 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:10.056334 14888 consensus_meta.cc:287] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.850s	user 0.005s	sys 0.006s
I20260709 12:28:09.906360 15040 consensus_queue.cc:237] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:10.035544 14967 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:28:10.052940 15125 log.cc:927] Time spent T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:28:10.055035 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:10.052146 14963 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:10.054193 15131 log.cc:927] Time spent T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:28:09.963266 14994 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:10.065143  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:10.029215 15054 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.161082 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:10.144429 15020 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.078815 10527 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
I20260709 12:28:10.045778 14968 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.160171 15135 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:09.967583 15105 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.023447 15053 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:28:10.195250 15135 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.147886 10528 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:28:10.151880  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:10.156418  9886 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
W20260709 12:28:10.071141  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 344718us
I20260709 12:28:10.204649  9853 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:10.155720  9881 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.005s	sys 0.015s
I20260709 12:28:10.079942 15110 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:10.150323 14967 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:10.160468 14899 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:28:10.205365  9881 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.005s	sys 0.016s
I20260709 12:28:10.206015  9887 raft_consensus.cc:2393] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 8: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
W20260709 12:28:10.161155 15002 consensus_meta.cc:287] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.621s	user 0.020s	sys 0.001s
W20260709 12:28:10.214504 10533 consensus_meta.cc:287] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.000s
I20260709 12:28:10.208729  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:10.215672  9888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1764) took 1002 ms. Trace:
W20260709 12:28:10.037339 15086 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.013s	sys 0.023s
I20260709 12:28:10.207849  9853 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:10.218809 10533 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 18.
I20260709 12:28:10.219620  9884 raft_consensus.cc:2410] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:28:10.215152  9886 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:10.117681 15106 consensus_queue.cc:237] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.198724 15115 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:10.218698  9885 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:28:10.161404 15087 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:10.180428 15020 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:10.217734  9888 rpcz_store.cc:276] 0709 12:28:09.213655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.214530 (+   875us) service_pool.cc:224] Handling call
0709 12:28:09.214934 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:09.215280 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:09.215306 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:09.324251 (+108945us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b2c0005c2d8. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8ce15a11 00007f2f8ce25372 00007f2f8e557a01 00007f2f8e51c43a 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2
0709 12:28:09.324652 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 12:28:09.400058 (+ 75406us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:09.831956 (+431898us) log.cc:844] Serialized 14 byte log entry
0709 12:28:10.158791 (+326835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.158865 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:10.209205 (+ 50340us) raft_consensus.cc:1685] finished
0709 12:28:10.215451 (+  6246us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:10.215607 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32999,"prepare.queue_time_us":320082,"prepare.run_cpu_time_us":211,"prepare.run_wall_time_us":11992,"raft.queue_time_us":285581,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":29014,"spinlock_wait_cycles":26128256,"thread_start_us":592815,"threads_started":3,"wal-append.queue_time_us":399594}
I20260709 12:28:10.221944  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:10.235983 15054 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:10.242801 14941 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:10.245362 15132 log.cc:927] Time spent T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:28:10.250541  9853 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:10.252718  9853 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:10.253948 15135 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:10.254628 15074 raft_consensus.cc:993] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower b011791796d1457284b857d7d3422195 to start an election
I20260709 12:28:10.255251 15074 raft_consensus.cc:1081] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Signalling peer b011791796d1457284b857d7d3422195 to start an election
I20260709 12:28:10.255978 15105 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:10.256531 15105 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:28:10.256804 15123 log.cc:927] Time spent T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.436s	user 0.006s	sys 0.000s
I20260709 12:28:10.257175 15105 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:10.254550 15138 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:10.260351 15027 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:10.260905  9960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1895) took 1041 ms. Trace:
W20260709 12:28:10.072767 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 335421us
I20260709 12:28:10.221714 15002 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:10.268311  9853 leader_election.cc:400] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 17. Current term is 18.
I20260709 12:28:10.261340  9960 rpcz_store.cc:276] 0709 12:28:09.219883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.220002 (+   119us) service_pool.cc:224] Handling call
0709 12:28:09.220335 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:09.220707 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:09.220747 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:09.230432 (+  9685us) log.cc:844] Serialized 26 byte log entry
0709 12:28:09.371300 (+140868us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:09.371341 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:09.372139 (+   798us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:10.241978 (+869839us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:28:10.260625 (+ 18647us) raft_consensus.cc:1685] finished
0709 12:28:10.260646 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:10.260843 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14322,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":139,"spinlock_wait_cycles":8620416,"thread_start_us":139678,"threads_started":1,"wal-append.queue_time_us":398853}
I20260709 12:28:10.249032 15115 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:28:10.281441  9887 raft_consensus.cc:1240] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 16. Current term is 17. Ops: []
I20260709 12:28:10.260996 14999 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:10.278254 14937 consensus_meta.cc:287] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 1.026s	user 0.008s	sys 0.005s
W20260709 12:28:10.302060  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 288438us
I20260709 12:28:10.303192  9928 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:28:10.304869 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:10.274132 15135 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:10.264472 15111 raft_consensus.cc:697] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:10.346156 15111 consensus_queue.cc:237] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:10.318146  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:10.320173  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:10.323803  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:10.334892  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:10.339232 15138 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:10.367803  9957 raft_consensus.cc:2410] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 14 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:28:10.335260 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 56456.4us
I20260709 12:28:10.274782 15002 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:10.339293  9854 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.111.68:37417 timed out after 1.902s (SENT)
I20260709 12:28:10.342674 10527 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 17. Current term is 18. Ops: []
I20260709 12:28:10.282861 15037 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:10.316161  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:10.348299  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:10.349993  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:10.351132  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:10.273528 15087 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.393254 15087 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:10.352521  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:10.340193 14921 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:10.396436 14921 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.396842 14921 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:10.353179 15144 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:10.363498  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55952 (request call id 1901) took 1119 ms. Trace:
I20260709 12:28:10.348788 15006 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:28:10.353967 15012 consensus_meta.cc:287] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.833s	user 0.011s	sys 0.000s
I20260709 12:28:10.380095 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:10.381314 15002 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:10.439639 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 59620us
I20260709 12:28:10.440627 10496 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:10.381165 15142 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:28:10.390368 15138 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.358755 15115 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.362610  9928 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:10.348903 14999 consensus_queue.cc:1059] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:28:10.361307 15141 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:10.445822  9962 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 15.
W20260709 12:28:10.450947  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 87755.6us
I20260709 12:28:10.413460  9959 rpcz_store.cc:276] 0709 12:28:09.244487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.256125 (+ 11638us) service_pool.cc:224] Handling call
0709 12:28:09.256450 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:09.256687 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:28:10.005014 (+748327us) log.cc:844] Serialized 14 byte log entry
0709 12:28:10.362950 (+357936us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:10.363044 (+    94us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:10.363117 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.363281 (+   164us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:10.363427 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9867,"prepare.queue_time_us":161961,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":10076,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":7907,"thread_start_us":1095485,"threads_started":2}
I20260709 12:28:10.461374  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:10.461715  9779 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:10.462306  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:10.464923  9928 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:10.465936  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:10.467300  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:10.464929  9808 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 16.
W20260709 12:28:10.441794 14728 consensus_meta.cc:287] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.001s
I20260709 12:28:10.467988  9809 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:28:10.468508  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:10.469631  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:10.469717 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:10.468273 10530 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.017s	sys 0.032s
I20260709 12:28:10.476150 10527 raft_consensus.cc:2393] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 12: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:10.478015  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:10.481632  9807 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 17.
W20260709 12:28:10.478099 10530 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.017s	sys 0.033s
I20260709 12:28:10.484989  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:10.447999 15093 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:10.490440  9928 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:10.447736 14941 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:10.439280 15087 consensus_queue.cc:1059] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:28:10.511118 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:10.496798 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:10.474792 15141 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:10.464409 15115 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:10.516491 14970 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:10.516866 15115 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:10.474014 15012 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:10.517062 14970 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.498355 15138 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:10.498631 15139 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:10.519125 15141 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:10.519169 15139 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:10.519788 15139 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:10.432040 14967 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.522087 14967 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:10.474450 14986 consensus_queue.cc:1059] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:28:10.523540 14986 raft_consensus.cc:3055] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:10.523869 14986 raft_consensus.cc:740] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:10.499804 14994 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:10.524979 10528 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:28:10.524712 14986 consensus_queue.cc:260] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:10.516450  9962 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55946 (request call id 2406) took 1173 ms (client timeout 1531 ms). Trace:
W20260709 12:28:10.525736  9962 rpcz_store.cc:269] 0709 12:28:09.342529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.342751 (+   222us) service_pool.cc:224] Handling call
0709 12:28:10.516275 (+1173524us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001dd154. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:10.516370 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2473615104}
I20260709 12:28:10.501407  9779 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:10.465204 15052 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.473011 14669 raft_consensus.cc:697] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:10.530623 15052 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.459173 14925 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:28:10.507524 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:10.467485 15042 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:10.514745 14969 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.474246 14926 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:10.500855 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:10.509809 14927 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:10.528221 14970 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:10.529198 10496 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:10.529700 15146 raft_consensus.cc:3055] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:10.538262  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:10.507010 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:10.538615  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:10.538177  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:10.532681  9927 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:10.554592  9884 raft_consensus.cc:2393] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 12: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:10.561031  9808 raft_consensus.cc:1240] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:10.464576 15114 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 12:28:10.526072 14986 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:10.551712 15146 raft_consensus.cc:740] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:10.489986 14968 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:10.438724 15144 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:10.575723  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:10.448176 15006 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:10.573560 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:10.575721  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:10.575940  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:10.581398  9888 raft_consensus.cc:1240] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:28:10.576964  9810 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:28:10.532236  9779 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:10.571379 15140 log.cc:927] Time spent T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:28:10.569108 15105 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.571291 14890 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:28:10.487236 14728 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:10.584862  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 94487.6us
W20260709 12:28:10.576992  9856 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.006s	sys 0.010s
W20260709 12:28:10.592911  9856 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.006s	sys 0.010s
W20260709 12:28:10.585137  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 52978.5us
I20260709 12:28:10.594969  9779 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:10.595628 14899 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.596109 14899 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:10.585893  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 53275.4us
I20260709 12:28:10.597486 15138 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:10.548713 14927 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:10.598469 14927 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:10.598137 15138 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:10.600762 15138 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:10.532449 15074 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:10.601184  9853 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:10.577803 15020 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:10.535444 14941 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.614025 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:10.604228 10496 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:10.616381 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:10.603473  9963 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:28:10.607460  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:10.604068  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:10.582773 15115 raft_consensus.cc:3055] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:28:10.608525  9853 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:10.601951 15002 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.609763  9882 raft_consensus.cc:1275] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:28:10.611714  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:10.614207  9884 raft_consensus.cc:1275] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:28:10.625326  9884 pending_rounds.cc:85] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 4
I20260709 12:28:10.624861 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:10.625671  9884 pending_rounds.cc:107] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:28:10.625942  9884 raft_consensus.cc:2889] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:10.591547  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:10.568866 14969 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.620965  9853 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:10.622303 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:10.531136 14669 consensus_queue.cc:237] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:10.588966 14967 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:10.640363 14967 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.640805 14967 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:10.630775 15002 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.622906  9885 raft_consensus.cc:1240] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:10.602969 15027 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:28:10.643410  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:10.644130  9886 raft_consensus.cc:2393] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 11: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:10.644708 15148 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:10.608218 15149 raft_consensus.cc:2749] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:10.647414 14969 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:10.633824 14963 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:10.648011 14946 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:28:10.649616 14967 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.628679 15020 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:10.650426 10526 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 7.
I20260709 12:28:10.621825 15147 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:10.651296 15147 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:10.651749 15147 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:10.623596  9889 raft_consensus.cc:1275] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:28:10.588847 15037 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:28:10.593930 14926 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:10.631450  9853 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:10.598075 14899 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:10.635542 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:10.636674  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:10.664774  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:10.637639 15141 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:10.628813 15052 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:10.622094 15115 raft_consensus.cc:740] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
W20260709 12:28:10.654811  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 44374.8us
I20260709 12:28:10.619078 14994 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:28:10.666215  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:10.682049  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:10.636910 14921 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.666210  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:10.647215 15139 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:10.618992  9958 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb"
dest_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55952
I20260709 12:28:10.687961  9958 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:28:10.687373  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 348085us
I20260709 12:28:10.688455  9958 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:10.676883  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:10.679739 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:10.683780  9853 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:10.643711 15002 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:10.684772  9806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46504 (request call id 3042) took 1313 ms (client timeout 1579 ms). Trace:
I20260709 12:28:10.591502 15105 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.698414  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:10.698671  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:28:10.693460  9806 rpcz_store.cc:269] 0709 12:28:09.371886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.372035 (+   149us) service_pool.cc:224] Handling call
0709 12:28:10.684528 (+1312493us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54002d7154. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:10.684697 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2775810432}
I20260709 12:28:10.668210 15093 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.704303  9962 raft_consensus.cc:2393] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 14: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:28:10.704171  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:10.706779  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:10.669478 15141 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:10.678056 15149 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:10.707939 15013 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:10.710876  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:10.655332 14967 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:10.691026 14899 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:10.709368  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:10.717535  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:10.721503  9887 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:28:10.711910  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:10.721909  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:10.722502  9884 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:10.723217  9957 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 14: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:10.719574  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:10.662894 14890 consensus_queue.cc:1059] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:28:10.711048 15087 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:10.713243  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:10.724649  9810 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:10.727222 10496 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:10.730358  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:10.705639 15138 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:10.714906 15141 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:10.738085  9806 raft_consensus.cc:1240] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:10.715493 14981 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.746652  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:10.736531  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:10.715197 15149 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:10.744544  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:10.751362  9964 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 15.
I20260709 12:28:10.701690 14927 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.730391 15002 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:10.756896 10526 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36670 (request call id 1252) took 2193 ms (client timeout 1844 ms). Trace:
W20260709 12:28:10.757398 10526 rpcz_store.cc:269] 0709 12:28:08.548363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.564305 (+ 15942us) service_pool.cc:224] Handling call
0709 12:28:10.741666 (+2177361us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54005c4254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:10.741809 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3931897216}
I20260709 12:28:10.731451 15087 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:10.682914 15146 consensus_queue.cc:260] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.745213  9854 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:10.744560  9889 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:28:10.735133 15155 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:10.765401  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:10.723315 15013 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.714296 15093 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:10.745085  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 141943us
I20260709 12:28:10.754949 15149 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:10.784741  9928 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:10.760089 15152 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:10.790186 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:10.793586 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:10.790782  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:10.791011 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:10.793578  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:10.765702 15110 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.763561 15087 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:10.757136 14780 consensus_queue.cc:1059] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:28:10.743956 15138 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.773720 15135 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:10.808061 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:10.756155 14981 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.812561 15176 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.813988 10524 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:28:10.814797 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:10.847834  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:10.841420  9958 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.817719 10525 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:28:10.738503 15115 consensus_queue.cc:260] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.849745  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:10.852926 15006 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:10.855294 15013 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:10.856441 15163 log.cc:927] Time spent T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:28:10.765275 15002 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.865442  9958 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:10.872151  9928 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:10.860121 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:10.864298  9883 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:28:10.847463 15144 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:10.857764  9886 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:28:10.869426 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:10.847049 15135 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:10.810155 14669 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:10.880041 15135 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:10.880532 14669 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:10.881120 14669 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:10.879954 10529 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:28:10.886656 15151 consensus_queue.cc:1059] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:28:10.888300 15151 consensus_queue.cc:1048] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:10.891384 14564 consensus_queue.cc:1048] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:28:10.893581 14564 consensus_queue.cc:1059] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:10.894656 14925 raft_consensus.cc:3055] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:28:10.895133 14925 raft_consensus.cc:740] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:10.901942  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:10.889953 15151 consensus_queue.cc:1048] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:28:10.903908  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:10.905018  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:10.915971  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:10.775624 15155 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.914179  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:10.914625  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:10.813555 15110 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.864897 14941 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:10.910089 14994 raft_consensus.cc:697] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 18 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:10.897854 14990 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:10.925349  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:10.924772 15135 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.911902 14921 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:10.931093 15158 log.cc:927] Time spent T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
W20260709 12:28:10.931200 15161 log.cc:927] Time spent T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:28:10.931658 15093 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:10.809808 15152 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:10.957348  9854 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:10.917937  9928 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:10.874593 14780 consensus_queue.cc:1059] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
W20260709 12:28:10.947124 15159 log.cc:927] Time spent T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:28:10.896162 14925 consensus_queue.cc:260] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:10.927461  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:10.960119  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:28:10.954638 15157 log.cc:927] Time spent T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 12:28:10.944533 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:10.861255 14899 consensus_queue.cc:1059] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:28:10.947132 14728 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:11.000131  9959 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
W20260709 12:28:10.938444 15156 log.cc:927] Time spent T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:28:10.915686 15105 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:11.032411  9881 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1767) took 1734 ms. Trace:
I20260709 12:28:10.925876  9957 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 13. Current term is 14. Ops: []
W20260709 12:28:10.936834 15160 log.cc:927] Time spent T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:28:11.033313 15057 raft_consensus.cc:3055] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:11.033785 15057 raft_consensus.cc:740] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:10.921962 15038 raft_consensus.cc:3055] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:28:11.012363  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 94534us
I20260709 12:28:11.035059 15038 raft_consensus.cc:740] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:11.034693 15057 consensus_queue.cc:260] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:11.035697  9928 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:11.032789  9881 rpcz_store.cc:276] 0709 12:28:09.298489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:09.298627 (+   138us) service_pool.cc:224] Handling call
0709 12:28:09.322797 (+ 24170us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:09.442517 (+119720us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:28:10.213790 (+771273us) log.cc:844] Serialized 14 byte log entry
0709 12:28:10.585310 (+371520us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:10.585726 (+   416us) log.cc:844] Serialized 26 byte log entry
0709 12:28:10.585837 (+   111us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:28:10.585866 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.686559 (+100693us) spinlock_profiling.cc:243] Waited 9.42 ms on lock 0x7b180035bde0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b3fd2a6 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419
0709 12:28:10.732201 (+ 45642us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54001e4454. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:10.732253 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:11.032178 (+299925us) raft_consensus.cc:1685] finished
0709 12:28:11.032201 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.032331 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160474,"prepare.queue_time_us":294667,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":34834,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":4722,"spinlock_wait_cycles":295933568,"thread_start_us":925050,"threads_started":2,"wal-append.queue_time_us":486523}
W20260709 12:28:11.014457  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 57280us
I20260709 12:28:11.036152 15057 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:11.036019 15038 consensus_queue.cc:260] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:11.037207 15038 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:11.037659  9854 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:10.929381 15138 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:10.928432 15002 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:11.038501 15105 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:11.038962 15105 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.927165 15139 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:10.935891 15155 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:11.039625 15105 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:10.935338 14981 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:11.028965 15164 log.cc:927] Time spent T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.176s	user 0.002s	sys 0.000s
I20260709 12:28:11.040169 14890 raft_consensus.cc:3055] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:10.860368 15176 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:11.040549 14890 raft_consensus.cc:740] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:11.017764 15175 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:11.041348 15175 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.041441 14890 consensus_queue.cc:260] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.042570 15176 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:11.043498 15175 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:11.043707 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 316588us
W20260709 12:28:11.045253 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:11.020462 15144 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:28:11.046906 14936 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:11.046128 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:11.052028 14994 consensus_queue.cc:237] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.053565 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:11.054139 10526 raft_consensus.cc:2376] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12. Re-sending same reply.
I20260709 12:28:11.055141 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:11.056252 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:11.038951  9854 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:11.056921 14998 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.035140 10533 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 1268) took 1143 ms. Trace:
I20260709 12:28:11.057791 15114 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:11.057462 14998 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.057871 10533 rpcz_store.cc:276] 0709 12:28:09.891835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.233408 (+341573us) service_pool.cc:224] Handling call
0709 12:28:10.249513 (+ 16105us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:10.264291 (+ 14778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:10.264334 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:10.267098 (+  2764us) log.cc:844] Serialized 26 byte log entry
0709 12:28:10.626786 (+359688us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:28:10.660594 (+ 33808us) log.cc:844] Serialized 14 byte log entry
0709 12:28:10.690393 (+ 29799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.690462 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:10.937138 (+246676us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b180045cee0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f522 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:28:11.034816 (+ 97678us) raft_consensus.cc:1685] finished
0709 12:28:11.034963 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.035082 (+   119us) inbound_call.cc:177] Queueing success response
0709 12:28:11.039575 (+  4493us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b180045cee0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b3a9c0a 00007f2f94ae9219 00007f2f923f058f 00007f2f8b42f571 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd
Metrics: {"mutex_wait_us":36334,"prepare.queue_time_us":33622,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":7122,"raft.queue_time_us":34509,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":14062,"spinlock_wait_cycles":17768064,"thread_start_us":348764,"threads_started":1,"wal-append.queue_time_us":464272}
I20260709 12:28:11.059990 14998 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:11.060273 10531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 1267) took 1168 ms. Trace:
I20260709 12:28:11.060937 10531 rpcz_store.cc:276] 0709 12:28:09.891461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.164330 (+272869us) service_pool.cc:224] Handling call
0709 12:28:10.164714 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:10.175527 (+ 10813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:10.175559 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:10.205887 (+ 30328us) log.cc:844] Serialized 26 byte log entry
0709 12:28:10.576776 (+370889us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:28:10.576811 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:10.576870 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:11.060085 (+483215us) raft_consensus.cc:1685] finished
0709 12:28:11.060103 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.060220 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10454,"raft.queue_time_us":10710,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":19523,"thread_start_us":344968,"threads_started":1,"wal-append.queue_time_us":473258}
I20260709 12:28:11.060257 14990 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:11.065228 14990 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.066514 14899 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:11.067355 14990 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:11.014963 15054 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:11.069257 10497 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:11.070788 15146 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:11.072403 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:11.073038 10531 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:28:11.072422 14999 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:11.052003 15105 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.074090 14999 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.074515 14999 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:11.075804 15152 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:11.057271 15052 raft_consensus.cc:3055] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:28:11.078565 15052 raft_consensus.cc:740] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:11.079386 14890 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:11.079491 15052 consensus_queue.cc:260] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:11.080909 15052 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:11.082767 14927 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:11.084087 15105 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:11.002969 15020 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.084868 15020 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:11.086738  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:11.087376  9890 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 15.
I20260709 12:28:11.088588  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:11.089157  9890 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:28:11.092698 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:11.093374  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 57737.5us
I20260709 12:28:11.093670 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:11.096356  9928 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:11.097882  9928 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:11.095500 10496 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:11.091339  9854 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:11.104187  9854 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:11.105232  9928 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:11.106081  9810 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:11.108891 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:11.110551  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:11.111652  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:11.114880  9854 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:10.934247 15141 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.011617 15153 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.128948  9854 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:11.138548 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:11.062047 15110 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:11.132964  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 345449us
I20260709 12:28:11.133138 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:11.134235 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:11.141204  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:11.147642  9779 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:11.141728  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:11.103263 14926 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:11.103878 15152 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:11.150754  9853 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:11.151072  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:11.151852  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:11.132265 15013 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:11.110409 14899 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:11.118533 15105 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.160516  9958 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:28:11.197134 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:11.199445 10530 raft_consensus.cc:2376] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b011791796d1457284b857d7d3422195 in term 7. Re-sending same reply.
I20260709 12:28:11.172119  9962 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 18.
I20260709 12:28:11.156661  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:11.144724 15175 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:11.127095 14888 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:11.187847 10497 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:11.172637  9853 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:11.173941 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:11.203504  9853 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:11.147892 15106 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.205413  9853 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:11.173156  9779 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:11.132040 14990 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:11.127928 14967 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:28:11.175156  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:11.176234 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:11.172585  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:11.136101 15144 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:11.177968 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:11.178716 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:11.135807 14925 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:11.206627  9881 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 14: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:11.203986 10497 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:11.207221  9884 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
I20260709 12:28:11.252693 10524 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:11.253836  9882 raft_consensus.cc:1240] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:11.253299  9889 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:11.255703  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:11.266094  9884 raft_consensus.cc:2393] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 8: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:11.179479 15169 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:11.139638 15087 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.177671 15002 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:11.177874 14998 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:28:11.280779  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 107719us
W20260709 12:28:11.210801 15173 log.cc:927] Time spent T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:28:11.206334 15115 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:11.197077 15040 raft_consensus.cc:2749] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:11.274405 14899 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.295758  9809 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:11.280221  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:28:11.257874 15147 consensus_meta.cc:287] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.000s
I20260709 12:28:11.297914  9959 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:11.205199 15148 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:11.204708 14888 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.209340 15138 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:11.207772 15155 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:11.287277 15144 raft_consensus.cc:697] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:11.198868 14669 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.203365 15175 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.178442 15139 consensus_queue.cc:1059] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.101s
I20260709 12:28:11.308418 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:11.297931 15169 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.318846 15137 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:11.212217 15141 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:11.292640  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:11.337509  9885 raft_consensus.cc:1240] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 17. Current term is 18. Ops: []
I20260709 12:28:11.206202 15105 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.147320 15149 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.306141 15177 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:11.144443 15153 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.340282  9881 raft_consensus.cc:1240] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:11.350720  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:11.378193  9779 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:11.361853  9956 raft_consensus.cc:1240] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:11.380772  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:11.366751 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:11.351715  9778 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:11.359452 15144 consensus_queue.cc:237] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.389703 15105 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:11.362928 15135 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:11.390573  9888 raft_consensus.cc:2393] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 17: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:11.391443 15149 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:11.391927 15185 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:28:11.392422 15185 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.349712 15148 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.392786 15185 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:11.394353 15148 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:11.384759 15177 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.354682 14888 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:11.395502  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:11.344485 15147 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.396570  9962 raft_consensus.cc:2393] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 13: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:11.396806 15184 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:11.397759 15147 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:11.360167 14899 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:11.401885 10532 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:11.401944  9779 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:11.353868 15110 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:28:11.306614 14990 raft_consensus.cc:697] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:11.415570  9779 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:11.365906 15139 raft_consensus.cc:3055] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:11.363746 14941 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:11.263017 15106 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.335532 14936 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:11.440965 15153 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:11.385310 14969 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:11.365337 15087 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:11.365530 15175 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:11.445921 14946 raft_consensus.cc:993] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:11.367966 15169 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:11.361686 14669 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:11.482520  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:11.476825 10527 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:28:11.429188  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:11.339193  9889 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:28:11.486783  9889 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:28:11.489657  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:11.490406  9814 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:28:11.505998 10525 raft_consensus.cc:2410] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:28:11.507380  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:11.508342  9814 raft_consensus.cc:2393] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 12: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:28:11.511159  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:11.512046  9814 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 14: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:11.446532 14946 raft_consensus.cc:1081] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:11.466969 10524 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:11.524255 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:11.524894 10524 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 12.
I20260709 12:28:11.429332 14941 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:11.525823 14888 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.526571 14941 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:11.527040 10529 raft_consensus.cc:2393] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 16: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:11.468149 14990 consensus_queue.cc:237] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.469393 15106 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:11.469996 14994 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:11.470368  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:11.325837 14998 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.535893  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:11.536563 14998 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:11.403119 14981 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:11.422528 15139 raft_consensus.cc:740] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:11.471055 14999 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.538784 15139 consensus_queue.cc:260] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.539808 14941 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:11.540233 14999 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:11.540287 15139 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:11.541126 10533 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 14: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:11.542063 14941 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:11.446346 15186 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:11.367009 15137 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.543846 15186 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:11.543968 15137 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:11.544296 15186 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:11.471925 15177 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:11.568473 10531 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:28:11.572157 10532 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:28:11.482985  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:28:11.588897  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 107160us
I20260709 12:28:11.589433  9962 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
I20260709 12:28:11.597446  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:11.597579  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:11.602969  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:11.604130 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:11.604898 10530 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:11.606009 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:11.653865  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 108795us
I20260709 12:28:11.654685  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:11.655447  9813 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:28:11.660758  9778 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:11.662284 15106 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:11.662710 15106 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.663074 15106 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:11.666417 15139 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:11.675680  9881 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:57658
I20260709 12:28:11.676787  9881 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:11.677232  9881 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:11.684105  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:11.686579  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:11.687391 15106 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.687831  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:11.690577  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:11.691609  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:11.692366  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:11.693181  9961 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 14: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:11.697217  9881 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:11.693878  9962 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
I20260709 12:28:11.672829 15186 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.429546 15184 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.279s
I20260709 12:28:11.702591 15106 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:11.705494  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:11.713013  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:11.706508  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:11.694000  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:11.713088 10531 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:11.717896  9928 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:11.608237 14669 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.727092  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:11.607455 14994 raft_consensus.cc:697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:11.727794  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:11.732754  9958 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 15.
I20260709 12:28:11.737502  9928 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:11.742110 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:11.744451  9881 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:11.744143 14968 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:11.728572 15176 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:11.751818  9814 raft_consensus.cc:1240] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:11.719731 15038 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:28:11.746850  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:11.753054  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:11.763731  9812 raft_consensus.cc:2393] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 15: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:28:11.744484 14967 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:28:11.768008  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:11.768599 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:11.769137 10531 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:28:11.769477  9927 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:11.773263  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:28:11.771765 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 432098us
I20260709 12:28:11.774770  9779 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:11.776873 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:11.736367 14669 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.782604  9928 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:11.778081  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:11.745918 14927 consensus_queue.cc:1059] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:28:11.787786 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:11.784420  9779 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:11.791858 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:11.791941 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:11.792310 15106 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:11.792718 15106 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.793035 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:11.793332 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:28:11.795930 14925 consensus_meta.cc:287] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.001s
I20260709 12:28:11.795876 10528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36676 (request call id 979) took 1129 ms. Trace:
I20260709 12:28:11.797309 10528 rpcz_store.cc:276] 0709 12:28:10.666954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.667137 (+   183us) service_pool.cc:224] Handling call
0709 12:28:10.692715 (+ 25578us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:11.049409 (+356694us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:11.049441 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:11.049952 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:28:11.316093 (+266141us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:28:11.316150 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.391499 (+ 75349us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b54002ec554. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:11.391561 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:11.795584 (+404023us) raft_consensus.cc:1685] finished
0709 12:28:11.795606 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:11.795811 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":200779,"raft.queue_time_us":201468,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":357569920,"thread_start_us":265698,"threads_started":1,"wal-append.queue_time_us":558352}
I20260709 12:28:11.794029 10526 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:11.804211 14994 consensus_queue.cc:237] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.808645  9887 raft_consensus.cc:1275] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:28:11.808740 10526 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 16.
I20260709 12:28:11.809095  9887 pending_rounds.cc:85] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 8
I20260709 12:28:11.809417  9887 pending_rounds.cc:107] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:28:11.809666  9887 raft_consensus.cc:2889] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:11.766129 15038 raft_consensus.cc:697] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:11.814810  9779 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:11.822151 10524 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:28:11.794168 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:11.822984  9955 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:11.787659 15040 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:28:11.830545 10497 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.002s	sys 0.011s
W20260709 12:28:11.830955 10497 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.002s	sys 0.011s
W20260709 12:28:11.831429 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 627947us
I20260709 12:28:11.793062 15106 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:11.835323  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:11.846318  9810 raft_consensus.cc:1275] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:28:11.840752  9779 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:11.824599 14925 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:28:11.876035 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:11.877358  9955 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:11.878237  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:11.896795 14925 raft_consensus.cc:697] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:11.822665 14564 consensus_queue.cc:1059] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 12:28:11.883917 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 45850.9us
I20260709 12:28:11.839448 15182 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:11.897737 14925 consensus_queue.cc:237] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.898401 15149 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:11.898895 15149 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:11.900990 15149 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:11.885388 14986 consensus_queue.cc:1059] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:28:11.887403 10527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 978) took 1220 ms. Trace:
I20260709 12:28:11.902379 10527 rpcz_store.cc:276] 0709 12:28:10.666599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.679424 (+ 12825us) service_pool.cc:224] Handling call
0709 12:28:11.887197 (+1207773us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b540052bcd4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:11.887329 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1772459776}
I20260709 12:28:11.902925  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:11.888125 14936 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:11.903653  9813 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 14: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:11.888899  9882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 1303) took 1074 ms. Trace:
I20260709 12:28:11.904587  9882 rpcz_store.cc:276] 0709 12:28:10.814887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.815003 (+   116us) service_pool.cc:224] Handling call
0709 12:28:11.253647 (+438644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:11.275578 (+ 21931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:11.888714 (+613136us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b540043b2d0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:11.888844 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1008049920}
I20260709 12:28:11.905853 14888 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:11.826416 15146 consensus_queue.cc:1059] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:28:11.906174  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:11.907114  9882 raft_consensus.cc:2368] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10.
I20260709 12:28:11.907994  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:11.908365 15181 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:11.908854  9882 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 14: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:11.908931 15181 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:11.877890 15054 consensus_meta.cc:287] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.809s	user 0.010s	sys 0.002s
I20260709 12:28:11.910138 15054 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:11.911105  9960 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:28:11.832266 14899 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.896224  9854 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:11.914489 15176 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:11.915069 15176 raft_consensus.cc:697] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 16 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:11.916076 15176 consensus_queue.cc:237] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:11.883337 15057 consensus_meta.cc:287] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.846s	user 0.013s	sys 0.004s
I20260709 12:28:11.903604 14936 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:11.921241 15186 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:11.926625  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:11.930543  9882 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:11.883683 15038 consensus_queue.cc:237] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:11.940145 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:11.942988 10529 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:11.940459  9960 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:28:11.945147  9778 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:11.951017  9957 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
W20260709 12:28:11.952108 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 53876.4us
I20260709 12:28:11.958914  9809 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:11.888711 10531 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:11.931309 15040 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:11.983762  9882 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 16.
I20260709 12:28:11.931133 14899 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:12.001318 15196 log.cc:927] Time spent T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:28:12.008104 14936 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.010437 14780 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:28:12.011891 10497 leader_election.cc:400] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10.
I20260709 12:28:12.012235 10497 leader_election.cc:403] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:28:12.014357 14999 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 9. Current term is 10.
I20260709 12:28:12.016520 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:11.971957 15094 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:28:12.018570 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:11.971418 15186 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:28:12.019163 10527 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:12.019312 15186 raft_consensus.cc:697] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:12.019515 14669 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:12.020156 15186 consensus_queue.cc:237] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.020980 15181 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:12.021515 10533 raft_consensus.cc:1240] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:12.023825  9963 raft_consensus.cc:1275] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:28:12.013085 10497 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:28:12.025825 15185 consensus_meta.cc:287] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71: Time spent flushing consensus metadata: real 0.633s	user 0.007s	sys 0.000s
I20260709 12:28:12.026309 15198 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:12.026854 15198 raft_consensus.cc:697] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 16 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:12.027674 15198 consensus_queue.cc:237] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.034921  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:12.035905  9955 raft_consensus.cc:2393] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 14: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:12.039016 10529 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:28:12.040843  9854 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:28:11.994671 15115 consensus_meta.cc:287] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: Time spent flushing consensus metadata: real 0.614s	user 0.008s	sys 0.001s
I20260709 12:28:11.918147 15175 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.047932  9889 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:28:12.048368  9889 pending_rounds.cc:85] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 12
I20260709 12:28:12.048640  9889 pending_rounds.cc:107] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:28:12.048905  9889 raft_consensus.cc:2889] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:28:12.057054  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 274528us
I20260709 12:28:12.056938 15042 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:12.060997 15042 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.062034 15175 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:12.062597 15040 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:12.062569 14946 consensus_queue.cc:1048] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:28:12.063138 15042 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:12.063946  9885 raft_consensus.cc:2393] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 13: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:12.064790 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:12.065505 10533 raft_consensus.cc:3060] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:12.044600 14899 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:12.079471  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:28:12.081676  9888 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57658 (request call id 1772) took 1375 ms (client timeout 1697 ms). Trace:
W20260709 12:28:12.082211  9888 rpcz_store.cc:269] 0709 12:28:10.706418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.706555 (+   137us) service_pool.cc:224] Handling call
0709 12:28:12.081398 (+1374843us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b540027a954. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:12.081601 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1570675072}
I20260709 12:28:12.085237  9883 raft_consensus.cc:2393] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 15: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:12.044040 15181 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:12.086521  9886 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 16. Current term is 17. Ops: []
I20260709 12:28:12.089741 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:12.090708 10532 raft_consensus.cc:2393] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 15: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:28:12.091878  9812 raft_consensus.cc:1240] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:12.026229 15185 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.095276 10496 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:12.109977 10533 raft_consensus.cc:2468] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:28:12.064172 15187 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:12.111429  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:12.111610  9854 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:12.095135 15181 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:12.115782 15175 raft_consensus.cc:2804] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:12.116436 15175 raft_consensus.cc:697] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 13 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:12.117761 15181 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:12.117434 15175 consensus_queue.cc:237] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.127764 15114 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:28:12.147832  9886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 1314) took 1236 ms. Trace:
I20260709 12:28:12.128458 15020 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:12.115046  9928 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:12.153391  9808 raft_consensus.cc:2368] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 18. Current term is 19.
I20260709 12:28:12.148365  9886 rpcz_store.cc:276] 0709 12:28:10.911861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:10.916304 (+  4443us) service_pool.cc:224] Handling call
0709 12:28:12.083550 (+1167246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:12.087888 (+  4338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:12.147560 (+ 59672us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540027a950. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:12.147751 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2683673984}
I20260709 12:28:12.154696  9928 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:12.130604  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 352087us
I20260709 12:28:12.152284  9853 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:12.093006 15137 consensus_meta.cc:287] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.549s	user 0.007s	sys 0.003s
I20260709 12:28:12.075551 14999 consensus_queue.cc:1059] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:28:12.157125  9927 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:12.160372  9927 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:12.146948 15187 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.093993 14899 raft_consensus.cc:697] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:12.169659 14899 consensus_queue.cc:237] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.170413 14936 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:12.162528 15137 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.153527 15115 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.162568 14999 raft_consensus.cc:3055] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:12.163829 14990 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:12.164992  9928 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:12.165551 14921 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:12.166102 15020 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:12.177093  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:12.183516  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:12.167303  9853 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:12.184357  9928 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:12.160131 15053 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:12.154383 15153 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:12.189787  9853 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:12.188731  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:12.191386  9959 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:12.191987  9853 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:12.190492 15149 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:28:12.199150 15087 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:12.153302 14926 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:28:12.177965 14780 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:12.171391 14986 consensus_queue.cc:1059] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 12:28:12.201280  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:12.200703  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:12.178148 14999 raft_consensus.cc:740] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:12.199918 15149 raft_consensus.cc:2764] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
W20260709 12:28:12.212215  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 371540us
I20260709 12:28:12.218848  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:12.220238  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:12.221333  9889 raft_consensus.cc:2393] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 17: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:12.221845  9885 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:12.239591 10533 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:28:12.243884  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:12.246184  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:12.246834  9813 raft_consensus.cc:3055] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:28:12.247123  9813 raft_consensus.cc:740] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:12.185353 15115 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.203639 15087 raft_consensus.cc:697] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 14 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:12.247864  9813 consensus_queue.cc:260] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:12.255460  9813 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:12.255384  9779 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:12.255800  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:12.251524  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:12.252185  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:12.212641 14956 consensus_queue.cc:1048] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:28:12.257512  9809 raft_consensus.cc:2393] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 11: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:28:12.227859 14926 raft_consensus.cc:697] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:12.240980 15020 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.260131  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:12.203512 15153 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.250263 15006 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:28:12.270402  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:12.216820 14968 consensus_queue.cc:1059] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 12:28:12.274956  9779 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:12.254889 15149 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.294127 15153 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:12.244607 15042 consensus_queue.cc:1059] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 12:28:12.294780 15114 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.294562 15149 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.295835 15106 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.296937 15149 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:12.297920 15106 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:12.291462 15137 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:12.295697 14926 consensus_queue.cc:237] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.296075 14986 raft_consensus.cc:3055] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:28:12.299683  9806 raft_consensus.cc:2393] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 13: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:28:12.286530 15094 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:28:12.290366 15054 consensus_queue.cc:1048] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
W20260709 12:28:12.333353 15204 log.cc:927] Time spent T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:28:12.334057 14780 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:12.300248 14941 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:12.301517  9779 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:12.302343 14999 consensus_queue.cc:260] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.307617  9813 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 15.
I20260709 12:28:12.271536 14970 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:12.295317 15114 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.315119  9959 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 15.
I20260709 12:28:12.316670 14986 raft_consensus.cc:740] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:12.327642 14990 raft_consensus.cc:3055] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:12.271770 15020 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:12.360328  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 58915.4us
I20260709 12:28:12.376101  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:12.385702 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:12.386730 10533 raft_consensus.cc:2393] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 13: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:12.389226 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:12.390064 10532 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:28:12.361758 15037 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:28:12.374184 14990 raft_consensus.cc:740] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:12.369757 15185 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 19 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:12.421775 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:12.426680 15144 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.430547 10532 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 19.
I20260709 12:28:12.394901 15057 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:12.431903  9779 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:12.382979 15211 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:12.377259 14994 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 12:28:12.447149  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 252993us
W20260709 12:28:12.450380  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 258524us
I20260709 12:28:12.451126  9853 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:12.454099  9853 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:12.456022  9853 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:12.458491 10532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:60770
I20260709 12:28:12.459445 10532 raft_consensus.cc:606] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:12.459911 10532 raft_consensus.cc:614] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:28:12.462163  9957 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55952 (request call id 1926) took 1311 ms (client timeout 1690 ms). Trace:
I20260709 12:28:12.397472 15094 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:28:12.446292 15211 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:12.462584  9957 rpcz_store.cc:269] 0709 12:28:11.150719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.150853 (+   134us) service_pool.cc:224] Handling call
0709 12:28:12.461985 (+1311132us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b540014d7d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:12.462102 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1726061440}
I20260709 12:28:12.378907 15087 consensus_queue.cc:237] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:12.444941 15106 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:28:12.463358 10533 raft_consensus.cc:1240] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:12.437521 15144 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:12.472390  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:12.455483 15149 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:12.478360  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:12.477842  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:12.472429 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:12.475207  9883 raft_consensus.cc:1240] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:12.481348  9956 raft_consensus.cc:2393] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 18: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:12.464082 15175 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:12.477200  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:12.459028 15053 raft_consensus.cc:697] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:12.477689  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:12.485167 10533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:60770
I20260709 12:28:12.491609 10533 raft_consensus.cc:606] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:12.491974 10533 raft_consensus.cc:614] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:12.474795 15106 raft_consensus.cc:697] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 19 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:12.482017  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:12.476881  9853 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:12.438076 14986 consensus_queue.cc:260] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.471462 15115 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:12.471869 15153 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.482177  9958 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:12.489883  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:12.469476 15211 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:12.487828  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:12.519181  9956 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:12.483321 15208 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.473819 14941 consensus_queue.cc:1059] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:28:12.479171 14899 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:12.469111 14990 consensus_queue.cc:260] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:12.493491 15149 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:12.500602 10496 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:12.497315  9853 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:12.497079 15213 log.cc:927] Time spent T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:28:12.596745 15053 consensus_queue.cc:237] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:12.598112 15219 log.cc:927] Time spent T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:28:12.578117 15214 log.cc:927] Time spent T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:28:12.578193 15020 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:12.590157 15212 log.cc:927] Time spent T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:28:12.507439 15115 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:12.501901 15153 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:12.617535 15149 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:12.625738 14986 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:12.626199 14990 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:12.604960 15205 log.cc:927] Time spent T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.222s	user 0.002s	sys 0.000s
W20260709 12:28:12.618618  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 121357us
I20260709 12:28:12.647040 10529 raft_consensus.cc:1240] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:12.647526  9853 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:12.634109 14899 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:12.618221 15114 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:12.631891 15137 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:12.598889 15208 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:12.623955 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 123442us
I20260709 12:28:12.649798  9853 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:12.720657  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 70904.9us
I20260709 12:28:12.721416  9853 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:12.658951 15211 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:12.670367 15218 log.cc:927] Time spent T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:28:12.673661 15187 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:12.625492 15210 consensus_queue.cc:1175] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "963185e117384b2085d7cea02a64478b" responder_term: 9 status { last_received { term: 9 index: 6 } last_committed_idx: 4 last_received_current_leader { term: 9 index: 6 } }
I20260709 12:28:12.680510 15153 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:28:12.681389  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:12.689952  9960 raft_consensus.cc:2393] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 14: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:12.652454 15175 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:12.741731  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:28:12.691902 10525 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36672 (request call id 1159) took 1638 ms (client timeout 1761 ms). Trace:
I20260709 12:28:12.703100 15052 raft_consensus.cc:3055] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:28:12.704234 15147 raft_consensus.cc:3055] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:28:12.704485 15222 log.cc:927] Time spent T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:28:12.633677 15106 consensus_queue.cc:237] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.710947 15144 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:12.713557 15217 log.cc:927] Time spent T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.266s	user 0.008s	sys 0.001s
W20260709 12:28:12.716603  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:12.717258  9956 raft_consensus.cc:2468] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:28:12.642527 15149 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:12.724241  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:12.727483  9881 raft_consensus.cc:1275] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:12.732818  9853 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:12.737900  9962 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 15.
W20260709 12:28:12.731529 14921 consensus_meta.cc:287] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.004s
I20260709 12:28:12.738821  9815 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:12.690174 15086 raft_consensus.cc:3055] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:28:12.743474 10525 rpcz_store.cc:269] 0709 12:28:11.053769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.056036 (+  2267us) service_pool.cc:224] Handling call
0709 12:28:12.691669 (+1635633us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b5400556254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:12.691822 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1031977344}
I20260709 12:28:12.750120  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:12.752511  9811 raft_consensus.cc:1240] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:12.733989 15020 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:28:12.755396 15147 raft_consensus.cc:740] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:28:12.785624  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:12.766247 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:12.767596  9807 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:28:12.771809 10529 raft_consensus.cc:1275] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:28:12.753432 15052 raft_consensus.cc:740] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:12.801723  9927 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:12.767642  9853 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:12.779363 10496 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:12.787889  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:12.788866  9815 raft_consensus.cc:606] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:12.755514 15187 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.806808  9815 raft_consensus.cc:614] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:12.806898  9813 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:28:12.763027  9890 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 17.
I20260709 12:28:12.799991 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:12.808269 10531 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:12.781919 15144 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:28:12.808416  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:12.819710  9809 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 16.
I20260709 12:28:12.819909  9928 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:12.808574  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:12.806038  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:12.812878 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:12.813755 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:12.821796  9853 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:12.822451 10525 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 7.
I20260709 12:28:12.814611 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:12.770166 15211 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:12.823829 10526 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 8.
I20260709 12:28:12.830755 10531 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:28:12.789398 14921 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:12.789300 15086 raft_consensus.cc:740] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:12.839838 14927 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:12.840240 14927 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:12.840583 14927 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:12.842161  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:12.842033  9961 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 16.
I20260709 12:28:12.843446  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:12.844782  9964 raft_consensus.cc:1240] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:12.845769  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:12.848278 15232 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:12.851305 10531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:60770
I20260709 12:28:12.818996 14564 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:28:12.851920 10531 raft_consensus.cc:606] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:12.779634 15137 consensus_queue.cc:1059] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:28:12.855410 14968 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:12.836706 15233 raft_consensus.cc:2804] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:12.857482 15233 raft_consensus.cc:697] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:12.833462 15223 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:12.858862 15223 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:12.860950 15223 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:12.832438 14970 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:12.832243 15226 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:12.837065 15142 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:12.831378 15187 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.863272 15142 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.831859 15020 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:28:12.864770 15020 raft_consensus.cc:697] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 15 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:12.865402 15142 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:12.865653 15020 consensus_queue.cc:237] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:12.772768 15206 consensus_queue.cc:1059] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:28:12.868229 15226 raft_consensus.cc:3055] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:12.870980  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:12.873368  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:12.892314  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:12.892931  9964 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:12.898576  9956 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:12.902439  9956 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:28:12.904703  9854 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:12.797151 15177 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:12.909477  9854 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:28:12.917363  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 95660.5us
I20260709 12:28:12.865310 15187 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:12.835933 15175 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:28:12.836830 15224 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:12.928972  9854 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:12.868583 15226 raft_consensus.cc:740] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:12.935096  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:12.933550  9812 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:12.940165  9778 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
W20260709 12:28:12.942703  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 107698us
I20260709 12:28:12.943461  9927 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:12.945870  9812 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 16. Current term is 17. Ops: []
I20260709 12:28:12.947288  9778 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:12.948061  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:12.948670  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:12.923633 15223 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:12.938555 15242 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:28:12.949951 15232 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:12.955837 14967 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:28:12.924608 15177 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.958806  9890 raft_consensus.cc:1275] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:28:12.958949 15208 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:12.911991 15149 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:12.960392 15086 consensus_queue.cc:260] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.961109 15149 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:12.918701 15233 consensus_queue.cc:237] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.961794  9888 raft_consensus.cc:1240] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:28:12.940831 15224 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.964407 15224 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:12.967754  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:12.843801 15052 consensus_queue.cc:260] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:12.978678  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:12.979923  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:12.972923  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:12.981752  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:12.959254 15115 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:12.950255 15206 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:12.952512 15176 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:12.950709 14994 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:12.954334 15242 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:12.993016  9882 raft_consensus.cc:1240] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 16. Current term is 17. Ops: []
W20260709 12:28:12.981143 15235 log.cc:927] Time spent T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:28:13.000398  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:12.976927 14941 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:13.003619  9964 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 19.
I20260709 12:28:13.005415  9884 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:28:13.022833 15238 log.cc:927] Time spent T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:28:12.993508 15226 consensus_queue.cc:260] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:13.026285 15226 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:12.998335 15176 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.027344 15176 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:28:13.030393 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:13.010111 14994 raft_consensus.cc:697] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:28:13.034909  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:13.040977  9885 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:28:13.044529  9882 raft_consensus.cc:1240] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 17. Current term is 18. Ops: []
I20260709 12:28:13.062062 15115 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.062690 15115 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:13.064980 15115 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:13.003304 15242 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:13.068259  9884 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:28:13.071007 10533 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:28:13.072610  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:13.074824 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:13.075910 10533 raft_consensus.cc:2410] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:28:13.033694 14994 consensus_queue.cc:237] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:13.084257 10528 raft_consensus.cc:1240] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:13.076691 14927 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:13.116786  9958 raft_consensus.cc:2393] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 18: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:13.119254 14927 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:13.134464 15177 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:13.085148 15199 consensus_queue.cc:1059] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 12:28:13.188331 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:13.189692  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:13.136080 14937 raft_consensus.cc:993] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:13.120265 15115 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
W20260709 12:28:13.141851 15221 log.cc:927] Time spent T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.637s	user 0.001s	sys 0.000s
I20260709 12:28:13.196085 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:13.196894 10529 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:13.199493  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:13.199957  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:28:13.172705 15245 log.cc:927] Time spent T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.201s	user 0.000s	sys 0.000s
I20260709 12:28:13.176905 15232 consensus_queue.cc:1059] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:28:13.177848  9808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34802 (request call id 992) took 1343 ms. Trace:
I20260709 12:28:13.187139 10533 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:28:13.197827  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:13.193033 14937 raft_consensus.cc:1081] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:13.202409 10525 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:28:13.203279 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:13.190093 14999 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:13.212957 10526 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:28:13.198707  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:13.214054  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:13.214758  9886 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:28:13.204278 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:13.206065 15057 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:28:13.217510  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 235742us
I20260709 12:28:13.208738  9853 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:13.209378  9808 rpcz_store.cc:276] 0709 12:28:11.834704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.835071 (+   367us) service_pool.cc:224] Handling call
0709 12:28:13.177669 (+1342598us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54002d6c54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:13.177792 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":719771392}
I20260709 12:28:13.215200  9958 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:28:13.218714  9958 pending_rounds.cc:85] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 9
I20260709 12:28:13.219532  9958 pending_rounds.cc:107] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 11.10
W20260709 12:28:13.219725  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 234880us
I20260709 12:28:13.220031  9958 raft_consensus.cc:2889] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:13.230307 15115 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:28:13.230499  9853 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:13.234475 15115 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:13.229599  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:13.247599  9887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57658 (request call id 1796) took 1530 ms. Trace:
W20260709 12:28:13.249083 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 177845us
I20260709 12:28:13.221071 15057 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:13.212260 15244 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:13.254114  9778 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:13.253597  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:13.247988  9887 rpcz_store.cc:276] 0709 12:28:11.717329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:11.827933 (+110604us) service_pool.cc:224] Handling call
0709 12:28:11.829140 (+  1207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:11.829605 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:11.829646 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:11.830240 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 12:28:12.966455 (+1136215us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b180044eae0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b411e07 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f8e0b620b 00007f2f8e0bbd23 00007f2f8e0bc0d1 00007f2f8e4d7a0f
0709 12:28:13.229932 (+263477us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:28:13.229968 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:13.230038 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:13.247264 (+ 17226us) raft_consensus.cc:1685] finished
0709 12:28:13.247297 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:13.247525 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":15456,"spinlock_wait_cycles":4869376,"thread_start_us":263295,"threads_started":1,"wal-append.queue_time_us":1404457}
I20260709 12:28:13.260941  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:13.264705  9809 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:28:13.247421 14963 raft_consensus.cc:3055] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:28:13.246582 14899 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:13.271935 15242 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:13.278822  9885 raft_consensus.cc:2393] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 8: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:13.283794 15176 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:13.285789 15147 consensus_queue.cc:260] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:13.269192 14963 raft_consensus.cc:740] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:13.289186 14963 consensus_queue.cc:260] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:13.296960  9928 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:13.301980  9886 raft_consensus.cc:1240] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 8. Current term is 9. Ops: []
I20260709 12:28:13.224234 15223 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:28:13.264187 15244 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:13.328653 15248 log.cc:927] Time spent T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.098s	user 0.000s	sys 0.004s
I20260709 12:28:13.335600 14963 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:28:13.342137  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 45283.2us
I20260709 12:28:13.344310  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:13.345600  9809 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 18.
I20260709 12:28:13.348006 14564 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:13.348515 14564 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:13.348932 14564 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:13.351191 10532 raft_consensus.cc:1275] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:28:13.326936 14925 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:13.352209 14925 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.352571 14925 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:13.344424 15254 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:28:13.353598 15252 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:13.355065  9927 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:13.355837 14780 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:28:13.356305 15020 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:13.356351 14780 raft_consensus.cc:697] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 18 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:13.357540 14780 consensus_queue.cc:237] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:13.362375 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:13.329804 14998 consensus_queue.cc:1059] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:28:13.329664 14956 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:28:13.375365  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:28:13.379384 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:13.379853 15223 consensus_queue.cc:1059] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:28:13.379900 14890 consensus_queue.cc:1059] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:28:13.380689 15223 consensus_queue.cc:1243] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer f5208640a51f493e930ce4f64ceeed0b log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:28:13.381278 15258 raft_consensus.cc:3055] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:28:13.342710 15241 log.cc:927] Time spent T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:28:13.363677 15094 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:13.382490 15094 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:13.384112 15057 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:13.384894 15094 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:13.386010 15176 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:13.381311 10496 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:13.389999 15137 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:13.342900 15244 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:13.390435  9881 raft_consensus.cc:1240] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:28:13.391335 10527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:60770
I20260709 12:28:13.394829  9887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:54428
I20260709 12:28:13.395488  9887 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:13.395920  9887 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:13.269749 15093 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.094s
I20260709 12:28:13.404505  9962 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:13.405200  9956 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:28:13.406034 10497 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:13.409006  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:13.419313 10528 raft_consensus.cc:1275] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:28:13.422571 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:13.424837 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:13.425565 10526 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:13.390450 15137 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:13.381706 15258 raft_consensus.cc:740] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:13.386184 15057 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:13.440272 10526 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
W20260709 12:28:13.440965  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 248068us
I20260709 12:28:13.412461 15042 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:13.447662  9854 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:13.417586 15038 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:13.448406  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 194443us
I20260709 12:28:13.417802 14937 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:28:13.481447  9957 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:28:13.446058 15137 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:13.485215  9887 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:13.490669  9889 raft_consensus.cc:1240] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:13.474015 14956 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.497773 14956 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:13.489873  9779 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:13.474330 15229 consensus_queue.cc:1059] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:28:13.463771 14899 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:28:13.508431  9887 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:13.510296  9779 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:13.446630 15210 consensus_queue.cc:1059] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:28:13.516008 10496 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:13.519155 14925 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:13.523972  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:13.524781  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:13.526234  9960 raft_consensus.cc:1240] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:13.460230 15020 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:28:13.446753 15153 consensus_queue.cc:1059] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
W20260709 12:28:13.511607 15256 log.cc:927] Time spent T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.281s	user 0.000s	sys 0.004s
I20260709 12:28:13.511094 15037 raft_consensus.cc:3055] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:28:13.542578  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:13.577106  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:13.577556  9958 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:13.515360 15094 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:28:13.464522 15038 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:13.579838  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:28:13.584985  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 150345us
I20260709 12:28:13.519999 14999 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.532727 15199 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:28:13.587342  9853 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:13.530107 14994 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:13.530900 14899 raft_consensus.cc:697] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:13.586951  9808 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:28:13.606954  9887 raft_consensus.cc:1240] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 16 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:13.621531  9809 raft_consensus.cc:1275] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:28:13.619098 15268 log.cc:927] Time spent T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:28:13.626082  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 91755.2us
I20260709 12:28:13.627246  9778 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:13.629307  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:13.576588 15037 raft_consensus.cc:740] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:13.532130 14998 consensus_queue.cc:1059] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.091s
I20260709 12:28:13.634016 14946 consensus_queue.cc:1059] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:28:13.642782 15266 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:28:13.645280 14564 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:13.646385 15244 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:13.648672  9883 raft_consensus.cc:2393] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 18: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
W20260709 12:28:13.648940  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 62589.7us
I20260709 12:28:13.654453 15251 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:13.669487  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:13.626291 15176 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:28:13.673297  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:13.628340 14941 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:13.677837  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:13.678642  9778 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:13.686755  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:13.687361  9807 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:28:13.676242 15087 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:13.622471 14999 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:13.696368 10529 raft_consensus.cc:1275] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:28:13.696748 10529 pending_rounds.cc:85] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: Aborting all ops after (but not including) 10
I20260709 12:28:13.696952 10529 pending_rounds.cc:107] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:28:13.697166 10529 raft_consensus.cc:2889] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:13.697824 10526 raft_consensus.cc:1240] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:13.700461 10525 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:28:13.630686 15057 consensus_queue.cc:1048] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:28:13.707043 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:13.676218 15175 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:13.709440 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:13.680006 15094 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:13.712491  9963 raft_consensus.cc:1275] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:28:13.719457  9963 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:28:13.720105  9960 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:28:13.686842 15232 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:28:13.722302  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:13.722944  9964 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:28:13.726811 15271 log.cc:927] Time spent T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:28:13.703212 14941 raft_consensus.cc:697] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:13.731457 14941 consensus_queue.cc:237] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:13.733716 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:13.734488 10533 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:28:13.701547 15184 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:13.733866 14994 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:13.720602  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:13.709797 15254 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.747723  9964 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:28:13.655025 15251 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:13.753489  9779 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:13.688704 15223 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:28:13.722334 15244 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:13.734414 14921 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.757511  9811 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:28:13.691079 15087 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:13.742209 15184 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.742862 14956 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:28:13.761704  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 44171.7us
I20260709 12:28:13.751159 14990 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:13.538616 15258 consensus_queue.cc:260] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:13.803467  9964 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:28:13.810663  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:13.815954  9807 raft_consensus.cc:2393] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 18: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:13.709626 15037 consensus_queue.cc:260] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:13.797647 15261 log.cc:927] Time spent T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:28:13.753702 15267 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:28:13.798933 15184 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:13.793982 14994 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:13.742529 14899 consensus_queue.cc:237] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:13.847805 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 267025us
I20260709 12:28:13.814602 15276 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:13.848611 10496 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:13.752990 15254 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:13.796406 15185 consensus_queue.cc:1048] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:28:13.761497 15269 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 12:28:13.814179 14925 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:13.854827  9928 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:13.961153  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 106362us
I20260709 12:28:13.896552 15154 consensus_queue.cc:1059] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.110s
I20260709 12:28:13.936661  9960 raft_consensus.cc:1240] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13. Ops: [12.12-12.12]
W20260709 12:28:13.904874 15270 log.cc:927] Time spent T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 12:28:13.825505 15252 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 12:28:13.814169 14990 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:13.908269 15042 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:13.909073 14999 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:13.915248 15087 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:13.799829 14921 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:13.892233 10496 leader_election.cc:400] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 18. Current term is 19.
I20260709 12:28:13.982350 10496 leader_election.cc:403] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:28:13.983230 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 91138.2us
I20260709 12:28:13.984041 10533 raft_consensus.cc:1240] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
W20260709 12:28:13.985302 10496 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:13.907776 15274 log.cc:927] Time spent T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:28:13.893776 15277 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:13.962337  9928 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:13.978724 15254 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:13.972265 15053 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:28:13.988996 15287 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:13.990372 15053 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:13.990614 15287 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:13.991202 15053 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:13.991593 15053 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:13.992267 15038 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:13.992862 15038 consensus_queue.cc:1059] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:28:13.993208 15287 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:13.993584 15038 consensus_queue.cc:1243] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Peer 963185e117384b2085d7cea02a64478b log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:28:13.994351 15251 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:13.996727 15224 raft_consensus.cc:3055] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:13.997205 15224 raft_consensus.cc:740] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:13.998605 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:13.988093 15042 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 18. Current term is 19.
W20260709 12:28:13.999672 15278 log.cc:927] Time spent T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:28:14.001010  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:14.001588  9886 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:14.002111 15258 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:14.007606  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:14.008754  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:14.011979 10524 raft_consensus.cc:1275] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:28:14.008682  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:13.937223 15137 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.026608  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:14.027300  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:14.028396  9853 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:14.033107  9961 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:28:13.855839 15276 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.022750  9886 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:28:14.034828  9955 raft_consensus.cc:2393] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 15: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:14.049794 15042 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.053440  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:14.053941  9964 raft_consensus.cc:1240] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:14.054024  9961 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:28:14.054168 10528 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:14.044878  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:28:14.056962 10530 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.004s	sys 0.024s
W20260709 12:28:14.057350 10530 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.004s	sys 0.024s
I20260709 12:28:14.055299  9961 raft_consensus.cc:1240] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:14.033255 15087 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:14.058422  9778 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:14.069303 10528 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:28:14.072434  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:14.057401 14936 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:14.032280 15115 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:28:14.107606  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:14.118463 15267 consensus_queue.cc:1059] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:28:13.998044 15224 consensus_queue.cc:260] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.119632 15267 raft_consensus.cc:3055] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:28:14.050565 15042 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.120043 15267 raft_consensus.cc:740] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:14.110993  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:14.124130  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:14.111678 15294 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:14.112792 15286 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.117209 15149 raft_consensus.cc:3055] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:14.121910 15042 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:14.110595 14936 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.123025 15251 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.076037 15094 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:14.112155 15253 consensus_queue.cc:1059] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:28:14.051123 14899 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:28:14.125944 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:28:14.129647  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:14.071676 15210 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:14.032631 15287 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:28:14.140354 15294 raft_consensus.cc:697] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:14.071913 15006 consensus_queue.cc:1048] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:28:14.140461 15267 consensus_queue.cc:260] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.141710 14936 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:28:14.075754 15087 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:14.132063 15149 raft_consensus.cc:740] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
W20260709 12:28:14.147258 15283 log.cc:927] Time spent T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:28:14.148597 15137 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:14.153751 15250 raft_consensus.cc:3055] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:14.154670 15242 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 8 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:14.159574 15276 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:14.162817 15184 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.164772 14921 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:14.169534 15094 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:14.178000 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 52134.2us
I20260709 12:28:14.188921 14990 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:28:14.182703  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 154437us
W20260709 12:28:14.191953  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 114755us
I20260709 12:28:14.219882  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:14.225472  9886 raft_consensus.cc:1275] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:28:14.138615 15286 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:14.191768 15250 raft_consensus.cc:740] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:14.169430 15251 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.184831 15210 raft_consensus.cc:697] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:14.231947  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:14.245594  9886 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:14.230726  9853 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:14.234807  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:14.253634 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:14.217694 15094 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:14.258087 15210 consensus_queue.cc:237] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.260300 15250 consensus_queue.cc:260] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:14.263175 15300 log.cc:927] Time spent T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:28:14.192296 15053 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.254348 10530 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:14.244227 14899 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.274866 15303 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:14.275435 15303 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.264905 15287 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:14.298736  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:14.299345  9884 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:28:14.300686  9928 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:14.301478 15197 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:14.303085 14926 raft_consensus.cc:3055] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:28:14.303483 14926 raft_consensus.cc:740] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:14.254839 15294 consensus_queue.cc:237] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.251458 14925 consensus_queue.cc:1059] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:28:14.277127 15037 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:14.307631 15086 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:28:14.313360  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:14.314204  9882 raft_consensus.cc:1275] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:28:14.314602  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:14.281406 15250 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:14.316901  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:14.268749 15208 consensus_queue.cc:1048] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:28:14.282086 15287 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:14.324041  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:14.250077 15149 consensus_queue.cc:260] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.297550 15286 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:14.327646  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:14.318328 15206 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:14.332252 15304 log.cc:927] Time spent T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:28:14.335428  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:14.279836 14899 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.341296 15147 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:14.343240  9957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48438 (request call id 1056) took 1623 ms. Trace:
I20260709 12:28:14.355660  9957 rpcz_store.cc:276] 0709 12:28:12.720291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:12.720439 (+   148us) service_pool.cc:224] Handling call
0709 12:28:13.475047 (+754608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:13.486840 (+ 11793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:14.343047 (+856207us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54001dd150. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51b8ad 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:14.343179 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1734266752}
I20260709 12:28:14.346839  9883 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57652 (request call id 2823) took 1117 ms. Trace:
I20260709 12:28:14.347728  9890 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:28:14.326009 15287 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:14.357134  9883 rpcz_store.cc:276] 0709 12:28:13.229006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:13.229146 (+   140us) service_pool.cc:224] Handling call
0709 12:28:14.346643 (+1117497us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b54002c6ad4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:14.346786 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":922852736}
I20260709 12:28:14.361141  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:28:14.366015  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:14.366559  9928 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:14.372982 15184 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:14.353513 15206 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.333329 15303 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:14.332302 15149 raft_consensus.cc:3060] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:28:14.378325  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 247447us
I20260709 12:28:14.382679 10531 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:14.377171 15289 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:14.399305  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:14.399914  9961 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:14.400318  9927 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:14.415762  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:14.416397  9883 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:14.412886 15251 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:14.428562  9928 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:14.430575 10527 raft_consensus.cc:606] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:14.431082 10527 raft_consensus.cc:614] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:28:14.435101  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:14.436662  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:14.437882  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:14.436585  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:14.438419  9957 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 15.
I20260709 12:28:14.438759  9964 raft_consensus.cc:2393] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 15: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:28:14.451498 15315 log.cc:927] Time spent T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:28:14.452354 10529 raft_consensus.cc:3055] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:14.452709 10529 raft_consensus.cc:740] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:14.453433 10529 consensus_queue.cc:260] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.441301 15208 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:14.454859 15208 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:14.455246 15208 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:28:14.455982 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:14.437394 15303 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:14.458726 15303 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.460306 10496 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:14.460788 15303 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:14.461190 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:14.462744 10529 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:14.463625 14986 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:28:14.462953 15258 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:14.468824 15206 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:14.455729 15094 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:14.462484 14899 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:14.463581 15086 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:14.476959 15287 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:14.478695  9961 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 16.
I20260709 12:28:14.551302  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:14.591135  9812 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:14.592633  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:14.552251  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:14.551339  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:14.594203  9807 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:14.553805  9808 raft_consensus.cc:2368] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 10. Current term is 11.
I20260709 12:28:14.553717  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:14.559088  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:14.600144  9810 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:28:14.560442  9884 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 10.
I20260709 12:28:14.601215  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:14.561721  9887 raft_consensus.cc:1240] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:28:14.575091  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:14.605633  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:14.606262  9814 raft_consensus.cc:2368] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 10. Current term is 11.
I20260709 12:28:14.576035  9811 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:28:14.557929  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:14.576438  9889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54428 (request call id 1350) took 1198 ms. Trace:
W20260709 12:28:14.588356  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:14.589480  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:14.593524  9958 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:14.481244 10529 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:28:14.478310 15086 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:14.650521 15086 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:14.483165 15094 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:14.497576 15208 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.655747 14564 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:14.613094  9889 rpcz_store.cc:276] 0709 12:28:13.377906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:13.395332 (+ 17426us) service_pool.cc:224] Handling call
0709 12:28:13.395568 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:13.491018 (+ 95450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:14.575870 (+1084852us) spinlock_profiling.cc:243] Waited 94.9 ms on lock 0x7b54003c6254. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:14.576228 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218310528}
I20260709 12:28:14.657480 15312 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:28:14.486148 15287 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:14.660800 15199 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:14.661746 15199 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.663785 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:14.619524  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 50751us
I20260709 12:28:14.621381 15147 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.625563 15176 consensus_queue.cc:1048] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:28:14.626081 15223 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:28:14.631085 15226 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:14.631570 14941 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:14.666352  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:14.673599  9887 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:14.632393 15149 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:14.635250 15184 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:14.638144 15186 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:14.639021 15185 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:14.639894 15187 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:14.640988 10531 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36676 (request call id 1005) took 1452 ms. Trace:
I20260709 12:28:14.644656 15250 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:14.657867 15208 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:14.495380 15258 raft_consensus.cc:2749] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:14.677460 10531 rpcz_store.cc:276] 0709 12:28:13.187976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:13.188109 (+   133us) service_pool.cc:224] Handling call
0709 12:28:14.640513 (+1452404us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540069f854. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:14.640748 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2745243008}
I20260709 12:28:14.687270 15243 consensus_queue.cc:1059] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:14.687517 15184 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.690935 15187 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.691836 15185 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.700377 10530 raft_consensus.cc:1217] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Deduplicated request from leader. Original: 11.11->[12.12-12.12]   Dedup: 12.12->[]
I20260709 12:28:14.701004 10530 raft_consensus.cc:1240] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:28:14.702101 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:14.702417 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:14.702811 10530 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:14.684109 14941 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.709362 15093 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.691249 15149 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.710127 15093 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.713397 15149 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:14.710434 15226 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.714685 15087 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:14.715235 15147 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.716081 15226 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:14.713725 15093 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:14.716923 15106 raft_consensus.cc:3055] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:28:14.717392 15106 raft_consensus.cc:740] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:14.718506 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:14.708616 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:14.725987 15139 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:14.726828 15139 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.729779 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:14.717940 15147 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:14.698068 15052 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:14.684600 15186 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.736747 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:14.737768 15186 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:14.739962  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:14.740849  9888 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:28:14.741081  9885 raft_consensus.cc:1240] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 12:28:14.742452 15258 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:14.743356 15258 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.744704 10529 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:28:14.746917 15258 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:14.758652 15106 consensus_queue.cc:260] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.760941 15106 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:14.761853 15233 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:14.747444 14941 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:14.729485 15199 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:14.763489 15139 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:14.751622 15184 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:14.775743  9927 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:14.776572 10525 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:28:14.777155  9927 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:14.777774 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:14.782907 15199 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.783418 15208 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:14.783851 15208 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:14.783597 15199 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.784227 15208 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:14.785015  9958 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:28:14.786612 15152 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:28:14.786619 10525 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:28:14.786137 15199 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:14.802472  9812 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:14.814450 15244 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:14.815223 15244 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.816586 15206 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:28:14.817516 15244 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:14.825790  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:14.839190 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:14.843111  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:14.840421  9778 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:14.807641 15233 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:14.855405  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 48792.8us
I20260709 12:28:14.859644  9854 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:14.863862 15289 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:14.864413 15289 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:14.869961  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:14.870801  9962 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:28:14.872179 15187 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:14.869233 15307 log.cc:927] Time spent T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.551s	user 0.003s	sys 0.000s
I20260709 12:28:14.873274 15185 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:14.879037 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:28:14.879709 15309 log.cc:927] Time spent T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.565s	user 0.001s	sys 0.000s
I20260709 12:28:14.880319 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:14.881601  9959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 2441) took 2040 ms. Trace:
I20260709 12:28:14.881901 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:14.882754 10533 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:14.884594 10527 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60770 (request call id 7) took 1493 ms. Trace:
I20260709 12:28:14.884934 10527 rpcz_store.cc:276] 0709 12:28:13.391093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:13.391215 (+   122us) service_pool.cc:224] Handling call
0709 12:28:14.884139 (+1492924us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400705154. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e516853 00007f2f934e460a 00007f2f8ca6a7d4 00007f2f8ca6a762 00007f2f8ca6a691 00007f2f8ca6a60c 00007f2f8ca698c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:14.884351 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2388704512}
I20260709 12:28:14.885296  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:14.886127  9883 raft_consensus.cc:2368] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 15. Current term is 16.
I20260709 12:28:14.887545  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:14.887935 10529 raft_consensus.cc:1275] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:28:14.891786 15323 consensus_queue.cc:1048] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:14.895758  9890 raft_consensus.cc:1275] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 12:28:14.896184  9890 pending_rounds.cc:85] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 11
I20260709 12:28:14.896471  9890 pending_rounds.cc:107] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 12:28:14.896833  9890 raft_consensus.cc:2889] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:14.898160  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:14.899497  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:28:14.902405 15243 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:14.903126 15243 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.896281 15232 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:14.904874 15053 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:14.905565 15232 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:14.906658 15327 log.cc:927] Time spent T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:28:14.908725 14926 consensus_queue.cc:260] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.914628  9887 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:28:14.917327  9956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55946 (request call id 2449) took 1198 ms. Trace:
I20260709 12:28:14.917726  9956 rpcz_store.cc:276] 0709 12:28:13.718946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:13.721430 (+  2484us) service_pool.cc:224] Handling call
0709 12:28:13.721768 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:14.183688 (+461920us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b18004193e0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8e0c44bc 00007f2f8b41248b 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42c455 00007f2f8e514060 00007f2f8e514bfb 00007f2f8e51f64b
0709 12:28:14.183826 (+   138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:14.183852 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:14.184332 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:28:14.213830 (+ 29498us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:14.213866 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:14.213932 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:14.868384 (+654452us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:28:14.910214 (+ 41830us) raft_consensus.cc:1685] finished
0709 12:28:14.910234 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:14.917145 (+  6911us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76071,"raft.queue_time_us":95808,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":15843,"spinlock_wait_cycles":7809152,"thread_start_us":73999,"threads_started":2,"wal-append.queue_time_us":89121}
I20260709 12:28:14.886262 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:14.957695  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:14.958806  9889 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 17.
I20260709 12:28:14.956810 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:14.965541 10524 raft_consensus.cc:1240] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:14.968747  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:14.969424  9889 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 18.
I20260709 12:28:14.915078 15232 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:14.970456  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 279637us
I20260709 12:28:14.970734 14946 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:14.882040  9959 rpcz_store.cc:276] 0709 12:28:12.840918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:12.846628 (+  5710us) service_pool.cc:224] Handling call
0709 12:28:12.846869 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:28:14.878557 (+2031688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:14.878606 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:28:14.878666 (+    60us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:28:14.878700 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:14.881157 (+  2457us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b5400242054. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:14.881206 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:14.881378 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18111,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":4671108864}
I20260709 12:28:14.971475 14946 raft_consensus.cc:697] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 16 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:14.972404 14926 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:28:14.972663 14946 consensus_queue.cc:237] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.976155  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:14.963225 15224 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:14.978084  9927 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:14.945937 10527 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 18.
I20260709 12:28:14.985091  9888 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:28:15.002676 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:15.016362 15208 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:14.990592 15176 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:15.032658 10533 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 16.
I20260709 12:28:15.020787  9778 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:15.019511 15208 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:15.036752 14921 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:15.048621  9854 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:15.048115  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:15.051028  9808 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:15.050410 15185 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:15.067322 15185 raft_consensus.cc:697] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:15.068511 15185 consensus_queue.cc:237] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:15.069413 10530 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:15.070223 10496 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:15.070423 15267 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:28:15.070981 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 64429.6us
I20260709 12:28:15.071774 14963 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:28:15.072242 15329 log.cc:927] Time spent T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:28:15.052874 14921 raft_consensus.cc:697] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:15.074710  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:15.064306 10497 leader_election.cc:400] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 15. Current term is 16.
I20260709 12:28:15.075551 10497 leader_election.cc:403] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 12:28:15.064601 15294 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.004s	sys 0.020s
I20260709 12:28:15.066591 14899 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:15.041859 15232 consensus_queue.cc:1048] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:28:15.063602 14927 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:28:15.075675  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 82962.7us
W20260709 12:28:15.078357  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:15.075845 15289 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:15.082258 15311 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:15.082849 15311 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:15.084007 15289 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:15.084981 15311 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:15.072269 14963 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:15.091475 14963 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:15.095257  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:15.095574  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:15.098080  9928 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:15.103641 15053 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:15.103909 15233 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:15.105870 15053 raft_consensus.cc:697] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:15.107342  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:15.110317  9928 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:15.119156  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 76713.7us
I20260709 12:28:15.122570 15311 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:15.123422  9853 leader_election.cc:400] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 10. Current term is 11.
W20260709 12:28:15.079293 15294 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.004s	sys 0.020s
I20260709 12:28:15.123579  9854 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:15.118497 15053 consensus_queue.cc:237] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.123775  9853 leader_election.cc:403] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:28:15.126677 14927 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.128943 14927 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:15.135183  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:15.135320 15267 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:15.130263  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:15.135954 15267 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.075232 14921 consensus_queue.cc:237] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:15.137493 15331 log.cc:927] Time spent T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 12:28:15.140295  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:15.142230  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:15.143127  9955 raft_consensus.cc:1240] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:15.143688  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:15.146754  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:15.147372  9811 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 17.
I20260709 12:28:15.147961  9928 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:15.149435  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 91338.3us
I20260709 12:28:15.150178 14899 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:28:15.150683  9853 leader_election.cc:400] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 10. Current term is 11.
I20260709 12:28:15.138105 15267 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:15.164274 15273 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:28:15.164875 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 171741us
I20260709 12:28:15.160787 15294 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 10. Current term is 11.
I20260709 12:28:15.166023 15232 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:15.166320 15277 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 15. Current term is 16.
I20260709 12:28:15.166675 15232 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.169010 15232 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:15.169333  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:15.162271 15243 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:15.170552 15321 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:15.169786 14970 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:28:15.172860 15326 log.cc:927] Time spent T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.278s	user 0.000s	sys 0.003s
I20260709 12:28:15.173219 15106 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.174363  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:15.173779 15106 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:15.151628 15086 consensus_meta.cc:287] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.500s	user 0.007s	sys 0.006s
I20260709 12:28:15.179138 15086 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.175112  9811 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 17.
I20260709 12:28:15.176069 15323 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:28:15.181401 15086 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:15.182331 10531 raft_consensus.cc:2393] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 16: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:15.179625  9779 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:15.185716 15177 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:15.186127 15177 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.186479 15177 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:15.188715  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:15.189373  9812 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 17.
I20260709 12:28:15.194732  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:15.207440  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:15.208503  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:15.150652 14899 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.199824  9809 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:28:15.235473  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:15.224849 14899 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:15.137480  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:15.246475  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:15.245203  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:15.244797  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:15.261111  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:15.261308 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:15.262434 10525 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:28:15.261837  9809 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
I20260709 12:28:15.271688  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:15.275285  9853 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:15.275524  9706 catalog_manager.cc:5697] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:15.281823  9853 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:15.298439  9808 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:28:15.223465 15277 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:15.171805 14970 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:15.311704  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:15.313613 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:15.311443 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:15.312158 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:15.202049 14963 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.324344 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:15.323556 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:15.302673 15087 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:15.328303 10528 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 18.
I20260709 12:28:15.304312 15106 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:15.333420 10530 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
I20260709 12:28:15.297657 15086 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:28:15.337647 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 135828us
I20260709 12:28:15.317076 15233 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:15.336992 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:15.345453  9854 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:28:15.357352  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 226635us
I20260709 12:28:15.359858 10533 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:28:15.360759 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:15.365731  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:15.333758 15087 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:15.371454 15087 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:15.371976  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:15.372092 15086 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.372012 15233 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:15.375100 15336 log.cc:927] Time spent T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:28:15.376003 15302 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:15.376752 15302 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:15.378989  9707 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59992 (request call id 301) took 19016 ms (client timeout 15000 ms). Trace:
I20260709 12:28:15.351233 15106 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:15.383749 15325 log.cc:927] Time spent T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.485s	user 0.005s	sys 0.000s
I20260709 12:28:15.383544 15106 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.338116 15277 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.385579 15106 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:15.386370 15242 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:15.386776 15242 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:15.387198 15242 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:15.365195  9706 catalog_manager.cc:5697] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 11 to 15, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 15 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:15.388477 14970 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:15.390630  9887 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:15.391427 15086 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:15.397956  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 52606.8us
I20260709 12:28:15.402688  9928 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:15.402120  9779 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:15.424255 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:15.419636  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:15.410233 15232 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:15.426420 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:15.426604 15232 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:15.427089 15232 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:15.428979  9779 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:15.432519  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:15.419234 14941 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:15.437844 14941 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:15.438249 14941 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:15.438405 15266 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:15.438820 15266 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:15.439213 15266 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:15.440753  9928 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:15.420651 15258 consensus_queue.cc:1048] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:28:15.443406 15106 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:15.446297 14941 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.448758 14941 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:15.456269 15266 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.451758  9706 catalog_manager.cc:5697] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 10 to 11, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 11 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:15.401273 15302 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:15.458817 14926 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:15.401194 15177 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.468890 15087 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.471056 10533 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 16.
I20260709 12:28:15.473896  9779 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:15.427639 15224 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:28:15.495299  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:15.496182  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:15.497316  9884 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:28:15.520800 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
W20260709 12:28:15.521865  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 48067.1us
I20260709 12:28:15.522662 10526 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:28:15.529428  9853 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:15.529457 10527 raft_consensus.cc:1240] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 7. Current term is 8. Ops: []
I20260709 12:28:15.492863 14963 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:15.538672 15177 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:15.479758 15106 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:28:15.539254  9812 raft_consensus.cc:2368] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 13. Current term is 14.
I20260709 12:28:15.540941  9706 catalog_manager.cc:5697] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 9 to 12, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 12 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:15.517375 15251 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:15.545063  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:15.545665  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:15.546684  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:15.547858 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:15.548277 15087 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:15.552367 15244 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:15.553124 15252 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:15.554297  9886 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:15.557271  9779 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:15.543596 15266 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:15.582661 10528 raft_consensus.cc:3060] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:28:15.609750 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 61990.5us
W20260709 12:28:15.609954  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 52785us
I20260709 12:28:15.610793 10496 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:15.591956 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:15.523097 15224 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:15.556481  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:15.616209 10496 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:15.611940 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:15.625169 14780 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.504880 14899 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.625691 14780 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.523814 15242 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.608729 15208 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:15.379496  9707 rpcz_store.cc:269] 0709 12:27:56.370348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:56.410359 (+ 40011us) service_pool.cc:224] Handling call
0709 12:28:15.378726 (+18968367us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:05.343690 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:05.640368 (+296678us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:05.640433 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:28:05.640460 (+    27us) tablet.cc:662] Decoding operations
0709 12:28:05.642779 (+  2319us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:05.642918 (+   139us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:05.642957 (+    39us) tablet.cc:685] Acquiring locks for 22 operations
0709 12:28:05.794856 (+151899us) tablet.cc:701] Row locks acquired
0709 12:28:05.794906 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:28:05.795102 (+   196us) write_op.cc:270] Start()
0709 12:28:05.795270 (+   168us) write_op.cc:276] Timestamp: P: 1783600085795021 usec, L: 0
0709 12:28:05.795308 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:28:05.820430 (+ 25122us) log.cc:844] Serialized 8722 byte log entry
0709 12:28:06.093589 (+273159us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8b4120ac 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f8e0b620b
0709 12:28:06.528318 (+434729us) op_driver.cc:464] REPLICATION: finished
0709 12:28:06.749656 (+221338us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8b4120ac 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f91f52ef0
0709 12:28:07.080917 (+331261us) write_op.cc:301] APPLY: starting
0709 12:28:07.095568 (+ 14651us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:07.282071 (+186503us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b18003370c0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8e0c44bc 00007f2f8b41248b 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42c455 00007f2f8e499190 00007f2f8e492ae7 00007f2f8e491dd9
0709 12:28:08.039363 (+757292us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:08.056757 (+ 17394us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:09.177492 (+1120735us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b18003370c0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8e25b0ec 00007f2f8e2a7c0a 00007f2f8e2a74f7 00007f2f8e2a7490 00007f2f8e25ef48 00007f2f91f731bb 00007f2f91fba5d4 00007f2f91e668da 00007f2f91e693cb
0709 12:28:10.855402 (+1677910us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:10.855844 (+   442us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=0,mrs_lookups=0
0709 12:28:10.855948 (+   104us) write_op.cc:312] APPLY: finished
0709 12:28:10.856587 (+   639us) log.cc:844] Serialized 196 byte log entry
0709 12:28:11.207105 (+350518us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:11.298464 (+ 91359us) write_op.cc:454] Released schema lock
0709 12:28:11.342794 (+ 44330us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:11.343525 (+   731us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:11.343576 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":751095,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":457608,"apply.run_cpu_time_us":90038,"apply.run_wall_time_us":4306852,"cfile_cache_hit":90,"cfile_cache_hit_bytes":95999,"num_ops":22,"prepare.queue_time_us":150144,"prepare.run_cpu_time_us":53904,"prepare.run_wall_time_us":844572,"raft.queue_time_us":63440,"raft.run_cpu_time_us":23710,"raft.run_wall_time_us":442188,"replication_time_us":705920,"spinlock_wait_cycles":127874176,"thread_start_us":1102111,"threads_started":5,"wal-append.queue_time_us":762325,"wal-append.run_cpu_time_us":38018,"wal-append.run_wall_time_us":3063359}]]}
I20260709 12:28:15.622756 15147 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:15.636729  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:15.646684  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:15.627606 15224 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:15.631275  9706 catalog_manager.cc:5697] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:15.627460 15177 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:15.659720  9889 raft_consensus.cc:2368] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 18. Current term is 19.
I20260709 12:28:15.662672 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:15.633388 15086 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:28:15.667905 15286 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:15.668138 15006 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.668550 15286 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.668630 15006 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.668687 15208 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.634119 15087 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:15.671953 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 332770us
I20260709 12:28:15.678459  9962 raft_consensus.cc:1275] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:28:15.681249 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:15.678879  9962 pending_rounds.cc:85] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195: Aborting all ops after (but not including) 7
W20260709 12:28:15.682819  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 53101.1us
I20260709 12:28:15.684078  9778 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:15.683117  9962 pending_rounds.cc:107] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:28:15.684916  9962 raft_consensus.cc:2889] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:15.662177 15177 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.665642 15086 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.696908 15276 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:15.697413 15276 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.697786 15276 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:15.694444 14970 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:15.691656 10497 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:15.705152  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:15.691869 15177 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:15.710738 14970 consensus_queue.cc:1059] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:28:15.703696 15086 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:15.694319 15087 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:15.745795 15343 log.cc:927] Time spent T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:28:15.740127 15147 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:15.740782 15006 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:15.748142 14780 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:15.778863 10528 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
W20260709 12:28:15.778621 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 105888us
I20260709 12:28:15.820394  9886 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:28:15.820421  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:15.821579  9812 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:28:15.816387 15232 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.779484 15242 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:15.778697  9706 catalog_manager.cc:5697] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:15.781687 15087 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:15.785141 15337 log.cc:927] Time spent T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.492s	user 0.007s	sys 0.000s
I20260709 12:28:15.786470 15208 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:15.792315 15233 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:15.797010 15086 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:15.801432 14899 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 19 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:15.747123 15286 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:15.809937 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:15.812145 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:15.865317 10527 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:15.842056  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:15.867254 10533 raft_consensus.cc:2368] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 18. Current term is 19.
I20260709 12:28:15.867321  9706 catalog_manager.cc:5697] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 4 to 10, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 10 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:15.868319 15086 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 19 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:15.861954  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:15.863121  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:15.869731  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:15.870414  9885 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:15.870354  9884 raft_consensus.cc:2368] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 18. Current term is 19.
I20260709 12:28:15.857518  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:15.873864  9890 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:28:15.878408  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:15.874601 14899 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.895470  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:15.902245 15348 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:15.902987 15348 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:15.905193 15348 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:15.893429 14899 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:15.933894 15232 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:15.946127 10527 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
W20260709 12:28:15.956415  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 244668us
W20260709 12:28:15.947418  9883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.008s	sys 0.012s
W20260709 12:28:15.962517  9883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.008s	sys 0.012s
I20260709 12:28:15.967442 10496 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:28:15.969350 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 145079us
I20260709 12:28:15.970860  9928 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:28:15.972643  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 187946us
I20260709 12:28:15.979053 10497 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:15.973858 15347 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:15.968536 15006 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 12:28:15.987879  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:28:15.984589 14921 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.007s	sys 0.014s
W20260709 12:28:16.004786 14921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.008s	sys 0.014s
I20260709 12:28:15.986726 14780 raft_consensus.cc:2804] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:28:16.026872  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:16.027479  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:16.020287 15137 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:16.028267  9890 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 19: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:16.019649  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:16.020591  9887 raft_consensus.cc:1240] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:16.020787  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:16.016777  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:16.031374  9889 raft_consensus.cc:2393] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 16: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:28:16.052489  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 59069.2us
W20260709 12:28:16.052438  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 55896.3us
W20260709 12:28:16.055061  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 442541us
I20260709 12:28:16.057097  9928 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:16.058202  9927 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:16.059047 15353 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:16.059693 15353 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:16.024402 15177 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.053194 14780 raft_consensus.cc:697] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:16.083204  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:16.085935  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:16.086647  9808 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 16.
I20260709 12:28:16.088519 15177 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:16.077229 14899 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:16.089224 15363 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.089740  9811 raft_consensus.cc:2368] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 16. Current term is 17.
I20260709 12:28:16.086324  9928 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:16.091012 14780 consensus_queue.cc:237] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.097559  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:28:16.090123 15340 log.cc:927] Time spent T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.712s	user 0.009s	sys 0.005s
I20260709 12:28:16.079017 15006 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:16.104897 15053 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:16.089800 15363 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.106679  9815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46504 (request call id 3142) took 1027 ms. Trace:
I20260709 12:28:16.107096  9815 rpcz_store.cc:276] 0709 12:28:15.078848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:15.080281 (+  1433us) service_pool.cc:224] Handling call
0709 12:28:15.080650 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:15.134204 (+ 53554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:15.134236 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:15.134760 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:28:15.316243 (+181483us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:28:15.316310 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:15.316594 (+   284us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:15.984900 (+668306us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:28:16.106362 (+121462us) raft_consensus.cc:1685] finished
0709 12:28:16.106391 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:16.106619 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39029,"raft.queue_time_us":47611,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":113,"spinlock_wait_cycles":2304256,"thread_start_us":180455,"threads_started":1,"wal-append.queue_time_us":242411}
I20260709 12:28:16.109521  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:16.110728 15363 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:16.110817 15053 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:16.111320 15053 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:16.111663 15053 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:16.093226 15353 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:16.116609 15350 consensus_queue.cc:1059] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:28:16.117749 15365 raft_consensus.cc:3055] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:16.118203 15365 raft_consensus.cc:740] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:16.119170 15365 consensus_queue.cc:260] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.117487  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:16.124368 15277 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:16.091966 15370 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:16.126566 15370 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:16.126914 15370 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:16.128136  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:16.128859  9808 raft_consensus.cc:3060] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:16.132825  9885 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
I20260709 12:28:16.135082  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:16.080003 15286 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.054s
W20260709 12:28:16.147289 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 87959.2us
I20260709 12:28:16.148257 10497 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:16.136466 15052 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:16.163369 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:16.165108 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:16.165714 10527 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 8.
I20260709 12:28:16.167698  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:16.166760 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:16.123827 15053 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.172647  9808 raft_consensus.cc:2468] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 19.
I20260709 12:28:16.173115  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:16.174639 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:16.176337  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 120324us
I20260709 12:28:16.178555  9890 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 8.
I20260709 12:28:16.181617 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:16.182612 10496 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:16.179029 10525 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:28:16.186326  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:16.190026  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:16.210749 15373 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:16.226922 15373 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:16.227398 15373 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:16.222215 15375 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:28:16.231527  9928 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:16.213491 15286 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:16.224582 10497 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:16.226222 15292 raft_consensus.cc:3055] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:16.222594 15366 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:28:16.226257 15276 consensus_meta.cc:287] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.528s	user 0.005s	sys 0.006s
I20260709 12:28:16.241892  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:16.242815  9960 raft_consensus.cc:2393] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 16: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:16.244611 15374 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:16.247475 15372 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:16.248065 15372 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:16.253799  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:28:16.231748 15224 consensus_meta.cc:287] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.003s
I20260709 12:28:16.250826 15372 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:16.251307 15276 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.255337 15350 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:16.264092  9961 raft_consensus.cc:2393] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
W20260709 12:28:16.267414 15377 log.cc:927] Time spent T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:28:16.268187 15276 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:16.272161 15370 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.281311  9779 leader_election.cc:400] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 18. Current term is 19.
I20260709 12:28:16.281769  9779 leader_election.cc:403] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:28:16.234266 15292 raft_consensus.cc:740] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:16.282998 15292 consensus_queue.cc:260] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:16.284571 15292 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:16.286876 15053 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:16.287372 15206 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.287920 15206 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:16.289939 15206 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:16.264320 15224 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.292305 15224 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:16.305615  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 49574.7us
W20260709 12:28:16.306209 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 43600.7us
I20260709 12:28:16.310801 10532 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:28:16.307121 10497 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:16.295475  9779 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:16.312408  9778 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:16.319756 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:16.320578 10524 raft_consensus.cc:2393] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 12: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:16.321362 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:16.321882 10530 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:16.326943 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:16.327651  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:16.328239  9884 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:16.329131  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:16.329831  9815 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:16.336309  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:16.336889  9885 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:28:16.338421  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:16.340080 10524 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:28:16.323975 15251 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:16.342840 10525 raft_consensus.cc:1240] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:16.343988  9808 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:16.348454  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:16.349071  9882 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:16.349556 15358 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:16.353864  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:16.355521  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:16.356249  9808 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
W20260709 12:28:16.357033 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:16.360970  9884 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 18.
I20260709 12:28:16.370474 15385 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:16.371109 15385 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:16.371527 15385 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:16.374631  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:16.375416  9887 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:16.375910 15365 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:16.380375 15370 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:16.384807  9889 raft_consensus.cc:1275] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:28:16.318912 15185 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 18. Current term is 19.
I20260709 12:28:16.401798 10530 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:28:16.389127 10497 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:28:16.415512 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 199181us
I20260709 12:28:16.417492 10496 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:16.415542 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:16.429350  9887 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
W20260709 12:28:16.430871  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 80180.4us
I20260709 12:28:16.433406  9928 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:28:16.434864  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 43547.1us
I20260709 12:28:16.434907  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:16.438925 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:16.442786 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:16.439322  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:16.442975 10531 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:16.444329 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:16.448379 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:16.449977 10530 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 19: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:16.453452  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:16.431620 15350 raft_consensus.cc:2804] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:28:16.460543 15373 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.468508 14963 raft_consensus.cc:2804] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:28:16.471457 10496 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:16.472009  9890 raft_consensus.cc:1240] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:16.473877  9809 raft_consensus.cc:2393] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 19: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:16.422479 15302 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:16.476406  9928 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:16.438766 15370 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:16.492456  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:16.479795 15258 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:16.499028 14926 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:16.499571 14926 raft_consensus.cc:697] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:16.500484 14926 consensus_queue.cc:237] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.505834  9853 leader_election.cc:400] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 13. Current term is 14.
I20260709 12:28:16.492548 15350 raft_consensus.cc:697] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 18 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:16.510643 15302 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.511971 15350 consensus_queue.cc:237] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.512837 15302 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:16.455132 15286 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:28:16.514832 15384 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:28:16.528398  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 52063.9us
I20260709 12:28:16.522485  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:16.471503 15381 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:16.519001  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:16.534593  9960 raft_consensus.cc:1275] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:28:16.480847 14963 raft_consensus.cc:697] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 19 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:16.533753 10531 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:16.533715  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:16.532178  9961 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 16.
I20260709 12:28:16.543761  9927 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:16.541759  9885 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:16.548444  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:16.553148  9815 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:28:16.553371 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:16.557595  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
W20260709 12:28:16.559623  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 247317us
I20260709 12:28:16.560055 10532 raft_consensus.cc:2368] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 13. Current term is 14.
I20260709 12:28:16.533833 15381 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:16.565482  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:16.533890 15251 raft_consensus.cc:697] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:16.531255 15376 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:16.540361 15302 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:16.568893  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:16.546813 15384 raft_consensus.cc:697] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:16.572497  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:16.572669  9962 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:28:16.574182  9809 raft_consensus.cc:2410] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:28:16.574702  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:16.556919 15353 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.579370 15353 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.580333  9854 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:16.530972 15370 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.576422  9778 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:16.533689 15363 consensus_queue.cc:1059] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:28:16.587066  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:16.592504  9811 raft_consensus.cc:3060] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:16.599285  9854 leader_election.cc:400] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 13. Current term is 14.
I20260709 12:28:16.599704  9854 leader_election.cc:403] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:28:16.572013 15381 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:16.551522 15232 consensus_queue.cc:1048] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:28:16.556950 15288 consensus_queue.cc:1059] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 12:28:16.606968  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:16.608047 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:16.573014 15373 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:16.588249 15359 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:16.599579 15348 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:16.644249  9808 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 16.
I20260709 12:28:16.636551  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:28:16.644567  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 53660.7us
I20260709 12:28:16.582355 14941 consensus_queue.cc:1048] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:28:16.649488  9959 raft_consensus.cc:1240] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 11. Current term is 12. Ops: []
W20260709 12:28:16.656319  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 61170.6us
I20260709 12:28:16.656551  9779 leader_election.cc:400] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 18. Current term is 19.
I20260709 12:28:16.658409 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:16.637696 14921 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
W20260709 12:28:16.666286  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 107332us
I20260709 12:28:16.667261  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:16.650816 14970 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:28:16.675258  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:16.649377 15176 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 13. Current term is 14.
I20260709 12:28:16.655457 15390 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.609422 15302 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.679822 15251 consensus_queue.cc:237] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:16.695958  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 91254.4us
I20260709 12:28:16.672019 15347 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:16.702540  9779 leader_election.cc:400] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 18. Current term is 19.
I20260709 12:28:16.703193  9779 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:16.704329  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:16.705384  9957 raft_consensus.cc:2393] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 16: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:16.709362 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:16.709650  9854 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:16.649814 14963 consensus_queue.cc:237] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.674150 15385 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.695569 15353 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:16.726569  9779 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:16.686028 14921 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.735443  9814 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:28:16.739310  9779 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:16.739212 15251 consensus_queue.cc:1048] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:16.716362 15266 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:16.748041  9853 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:16.715090 15347 raft_consensus.cc:697] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 16 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:16.690575 15390 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:16.737962 15348 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:16.759081  9853 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:16.668879 15384 consensus_queue.cc:237] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.757576 10526 raft_consensus.cc:2393] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 9: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:16.742856 14946 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:16.769193  9881 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:28:16.769624 15391 log.cc:927] Time spent T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:28:16.774667 14981 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:28:16.774845 15370 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:16.775285 14981 raft_consensus.cc:697] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:16.776352 14981 consensus_queue.cc:237] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.780647 15302 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:16.774660 15388 log.cc:927] Time spent T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:28:16.788090 10524 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
I20260709 12:28:16.789314  9853 leader_election.cc:400] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 16. Current term is 17.
I20260709 12:28:16.789606  9853 leader_election.cc:403] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:16.752774 14941 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:28:16.790548 15302 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:28:16.790880 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:16.757929 15358 consensus_queue.cc:1059] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:28:16.757517 15353 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:16.795486  9853 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:16.765990 15401 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:28:16.800029 15176 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:16.810587 15400 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:16.811229 15400 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:16.812440 14970 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:16.812942 14970 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:16.813695 15400 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:16.797770 15302 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 16. Current term is 17.
I20260709 12:28:16.815023  9853 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:28:16.819111 15396 log.cc:927] Time spent T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:28:16.823236 15400 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:16.823649 14921 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:16.825418 15390 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:28:16.826151 15395 log.cc:927] Time spent T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 12:28:16.827597 15394 log.cc:927] Time spent T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:28:16.822418 15401 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:16.828919 15401 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:16.833073 15401 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:16.844357 15385 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:16.822692 15347 consensus_queue.cc:237] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.847579  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:16.848409  9883 raft_consensus.cc:2393] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 9: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:16.799526 15353 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:16.852491 15353 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:16.852993 15353 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:16.853464 15353 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.864748  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:16.866612 10496 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:16.867973 15277 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:16.870702 15353 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:16.873361  9811 raft_consensus.cc:2468] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 18.
W20260709 12:28:16.890458  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 136844us
I20260709 12:28:16.874032 15384 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:16.915580  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:16.916846  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:16.917461  9815 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:28:16.932312  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:16.932792  9853 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:16.936038  9853 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:16.946218  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:16.890025 15381 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:16.957412  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:16.917275 15384 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:16.960706 15384 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:16.962188  9958 raft_consensus.cc:2393] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 15: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:16.963481 15381 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:16.969118 15302 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:16.970170 15386 raft_consensus.cc:3055] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:28:16.970719 15386 raft_consensus.cc:740] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:16.969787 15302 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:16.969106 14970 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:16.975333 14899 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:16.945271 15353 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:17.005997 15353 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:17.006420 15353 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:17.027392  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:17.034266  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:17.036839  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:17.047847  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:17.048441  9812 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:28:17.033376 15052 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:28:17.045931 15386 consensus_queue.cc:260] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:17.053360 14927 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:17.053892 15386 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:17.053929 14927 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:17.056038 15224 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:17.056587 15224 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:17.058560 15224 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:17.066696 15226 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:17.067214 15226 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:17.069796 15226 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:17.071144 14927 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:17.076220  9812 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:28:17.052678  9881 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:28:17.084280 15421 log.cc:927] Time spent T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:28:17.085258  9809 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:17.100669 15353 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:17.105224 14970 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:17.123040 15353 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:17.135587  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:17.136310  9883 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:17.136682  9927 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:17.137300 15361 raft_consensus.cc:2804] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:28:17.139395 15384 consensus_queue.cc:1059] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:28:17.140106 15361 raft_consensus.cc:697] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:17.140295  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:17.141064 15361 consensus_queue.cc:237] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:17.149236  9778 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:17.150233  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:17.150611  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:17.150905  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:17.175818  9889 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:28:17.151747 15206 raft_consensus.cc:3055] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:28:17.177076 15206 raft_consensus.cc:740] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:17.177901 15206 consensus_queue.cc:260] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:17.179107 15206 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:17.152905  9854 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:17.182459 15353 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:17.182964 15353 raft_consensus.cc:697] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 14 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:17.183877 15353 consensus_queue.cc:237] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:17.159622 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:17.167284  9853 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:17.168516 15302 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:17.168521  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:17.189018  9956 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:17.193313 15392 raft_consensus.cc:3055] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:17.193739 15392 raft_consensus.cc:740] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:17.171887 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:17.171950 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:17.172251 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:17.164162  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:17.197213 15369 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:28:17.139556  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:17.200042 15390 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:17.200524 15390 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:17.202558  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:17.203244  9962 raft_consensus.cc:2393] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 12: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:17.204121 15390 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:17.137272  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:17.207587  9883 raft_consensus.cc:3060] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:17.208307 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:17.208894 15232 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:17.209578  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:28:17.207124 10497 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:17.213014  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 45819.5us
W20260709 12:28:17.213251  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 64095.5us
W20260709 12:28:17.231257  9927 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:17.221711  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:17.239907  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:17.249125  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:17.249728  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:17.242878  9854 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:17.238931 14970 raft_consensus.cc:2749] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:28:17.254423  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:17.239537 15185 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:17.266727  9956 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:17.254985 15401 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:17.287355 15292 consensus_queue.cc:1059] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:28:17.290177 15392 consensus_queue.cc:260] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:17.291533 15392 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:17.270047 15185 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:17.300207 15185 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:17.256385 15358 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:28:17.309435  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:17.262802 15382 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 12:28:17.313112  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:17.318053  9956 raft_consensus.cc:2393] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 12: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:17.316967  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:17.322474  9928 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:17.315518  9853 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:17.328974  9928 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:17.330914  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 59987.1us
I20260709 12:28:17.331310  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:17.333871 15398 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:17.334857 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:17.337888  9808 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:28:17.338433 14926 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:28:17.340142  9778 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:17.342715 15428 log.cc:927] Time spent T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:28:17.344103 15106 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:28:17.344638 15106 raft_consensus.cc:697] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:17.350401  9928 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:17.351366  9962 raft_consensus.cc:1240] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 16. Current term is 17. Ops: []
I20260709 12:28:17.351444  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:17.347057 10528 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:28:17.357231  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:17.360996  9806 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:28:17.361946 15232 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:17.362845 15232 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:17.363330 15232 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:17.347056 15426 log.cc:927] Time spent T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:28:17.382498  9883 raft_consensus.cc:2468] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:28:17.384810  9811 raft_consensus.cc:1275] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:28:17.395210  9928 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:17.399825  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:17.369377 15302 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:28:17.403124 10530 raft_consensus.cc:1240] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:17.410223  9888 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:28:17.411162  9887 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:28:17.371680 14927 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:17.386245 15401 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:17.419030 15232 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:17.413144 15384 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:17.394059 15375 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:28:17.429996  9928 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:17.434556 15369 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:17.372613 15347 consensus_queue.cc:1059] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:28:17.436760 15347 raft_consensus.cc:3055] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:28:17.437147 15347 raft_consensus.cc:740] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:17.440517  9807 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:28:17.451431 15208 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:17.451370  9928 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:17.453363  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:17.454105 15384 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:17.454905 15226 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:28:17.416612 14927 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:17.455715 14927 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:17.457372  9928 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:17.348299 15106 consensus_queue.cc:237] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:17.458207 15206 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:17.475936 15385 consensus_queue.cc:1048] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 12:28:17.437963 15347 consensus_queue.cc:260] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:17.487443 15226 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 12:28:17.501632 15052 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:17.495800 14926 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:28:17.547360 15347 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:17.548695 15052 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:17.575543  9779 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
W20260709 12:28:17.588387  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 201210us
I20260709 12:28:17.596415 15292 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:28:17.606828  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 101729us
I20260709 12:28:17.599642  9853 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:17.612890 15355 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:28:17.627763  9890 raft_consensus.cc:1275] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:28:17.629317 15434 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:17.629887 15434 raft_consensus.cc:697] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:17.633540 15226 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:17.633725 15434 consensus_queue.cc:237] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:17.638643  9890 raft_consensus.cc:1275] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:28:17.638996 15292 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:17.639557 15292 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:17.641983 15292 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:17.678603  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 79023.1us
I20260709 12:28:17.680796  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:17.611769 15392 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
W20260709 12:28:17.686815  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 75372.8us
I20260709 12:28:17.690639  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:17.663483 15226 consensus_queue.cc:1048] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 12:28:17.695825 15439 log.cc:927] Time spent T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:28:17.698582 15438 log.cc:927] Time spent T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 12:28:17.705865 15431 log.cc:927] Time spent T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:28:17.713865 10530 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:28:17.715178 10525 raft_consensus.cc:1275] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:28:17.746060 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:17.747014 10524 raft_consensus.cc:2393] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 14: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:17.721264 15384 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:17.752517 10530 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:28:17.757437 15429 log.cc:927] Time spent T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.213s	user 0.002s	sys 0.000s
I20260709 12:28:17.761523 15384 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:17.758086 10531 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:28:17.759819 15052 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:17.763604 15384 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:17.760423 10528 raft_consensus.cc:1275] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:28:17.770262 15433 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:28:17.767510 14927 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:17.775641  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:17.776130  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:17.776455  9808 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:28:17.782963  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:28:17.805214 15361 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.011s	sys 0.029s
W20260709 12:28:17.808444 15361 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.011s	sys 0.029s
I20260709 12:28:17.786825 14927 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:28:17.836290 15430 log.cc:927] Time spent T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.275s	user 0.002s	sys 0.002s
I20260709 12:28:17.847074 15232 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:17.847771 15232 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:17.854409 15232 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:17.857628  9927 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:17.860453 15376 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:17.861001 15376 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:17.861449 15376 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:28:17.873497  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:17.875771  9958 raft_consensus.cc:1240] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:17.895215  9779 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:17.906539  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 235156us
I20260709 12:28:17.916615 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:17.926265  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:17.937309  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:17.927995  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:17.959267  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:17.926077 15372 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:17.913039 15251 consensus_queue.cc:1059] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:28:17.972898 15251 raft_consensus.cc:3055] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:28:17.973294 15251 raft_consensus.cc:740] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:17.990289 15437 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:17.990927 15437 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:17.992962 15437 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:17.993963  9853 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:17.953070 15106 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:28:17.938077 14946 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:28:17.938035 15224 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:28:17.952299 15369 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:28:18.019604  9890 raft_consensus.cc:1275] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:28:18.020778  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:18.021126  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:18.010304 15353 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:17.930940 15376 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:17.998786 15386 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:18.042824  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 43628.3us
I20260709 12:28:18.054891  9955 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:28:18.040792 15386 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:18.058517 15386 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:18.022895 15437 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:28:18.060099  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 43480.5us
I20260709 12:28:17.974105 15251 consensus_queue.cc:260] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:18.062381  9928 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:18.078264 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:18.082327 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 94994.6us
I20260709 12:28:18.094534  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:18.099579  9928 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:18.064071 15252 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
W20260709 12:28:18.139470 15453 log.cc:927] Time spent T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:28:18.113682 15381 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:18.126765 15398 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:28:18.159965 15251 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:18.180676  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:18.181306  9815 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:28:18.182225 15459 log.cc:927] Time spent T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.266s	user 0.000s	sys 0.004s
W20260709 12:28:18.194087  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 82905.8us
I20260709 12:28:18.188941 15454 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:18.206847 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 73700.4us
W20260709 12:28:18.228121 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 87313.2us
I20260709 12:28:18.233712  9815 raft_consensus.cc:2468] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:28:18.240003  9927 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:18.243430 15347 consensus_queue.cc:1048] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:28:18.230729 15376 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:18.252620 15472 raft_consensus.cc:2804] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:18.218722 15454 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:18.258777  9708 catalog_manager.cc:5697] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 6 to 8, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 8 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
W20260709 12:28:18.295570 15460 log.cc:927] Time spent T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:28:18.295718 15373 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.287725 15472 raft_consensus.cc:697] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:28:18.331151 15468 log.cc:927] Time spent T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 12:28:18.354830 15462 log.cc:927] Time spent T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:28:18.369837 15454 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:18.370471  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:18.373072  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:18.375128  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:18.375733  9815 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:28:18.377242  9927 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:18.378492 14926 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:18.378891 14926 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:18.379283 14926 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:18.379012 15472 consensus_queue.cc:237] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:18.326193 15373 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:18.384794 15373 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:18.386631  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:18.389109 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:18.393091  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:18.389686 10529 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:28:18.397351  9853 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:18.399811  9853 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:18.400745 15437 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:18.401578 15433 raft_consensus.cc:2749] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:18.442740 15372 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:18.481769  9808 raft_consensus.cc:1275] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:28:18.439656 14926 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:18.485572 10525 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 12:28:18.486125 10525 pending_rounds.cc:85] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b: Aborting all ops after (but not including) 11
I20260709 12:28:18.486398 10525 pending_rounds.cc:107] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 12:28:18.486649 10525 raft_consensus.cc:2889] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:18.491338  9956 raft_consensus.cc:1240] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:18.510702  9955 raft_consensus.cc:2393] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 13: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:18.525923 15401 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:18.526458 15401 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:18.528650 15401 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:18.548359 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:18.548959 10531 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 15.
I20260709 12:28:18.565253 14926 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:18.566387 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:18.567090 10528 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:18.569885  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:18.570504  9807 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:28:18.572870 15485 log.cc:927] Time spent T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:28:18.588438 10528 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:28:18.589963  9928 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:28:18.591549 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 351581us
I20260709 12:28:18.593216  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:18.593879 15361 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:18.642522 10497 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:28:18.646726 15486 log.cc:927] Time spent T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:28:18.649459 15467 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:18.636016 15361 raft_consensus.cc:697] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:18.658232 15361 consensus_queue.cc:237] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:18.652245 15464 log.cc:927] Time spent T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.504s	user 0.008s	sys 0.001s
W20260709 12:28:18.670802  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:18.676002  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:18.677775 15482 consensus_queue.cc:1059] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:18.678676 15482 consensus_queue.cc:1243] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [LEADER]: Peer b011791796d1457284b857d7d3422195 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:28:18.679258 15482 raft_consensus.cc:3055] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:18.679849 15482 raft_consensus.cc:740] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:18.680866 15482 consensus_queue.cc:260] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:18.710310  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:18.712601 15385 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:18.713147 15385 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:18.715536 15385 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:18.716243  9807 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:28:18.724426  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:18.731462  9812 raft_consensus.cc:1240] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:18.731928  9854 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:18.741286 15482 raft_consensus.cc:3060] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:18.740439  9708 catalog_manager.cc:5697] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 7 to 8, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 8 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:18.760027 10496 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:18.761875  9962 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 15.
W20260709 12:28:18.770421 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 124286us
I20260709 12:28:18.794239  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:18.795491  9812 raft_consensus.cc:2393] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 15: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:28:18.799325 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:18.803996 15137 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:18.815654 15473 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:18.816344 15473 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:18.816793 15473 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:18.823467 15232 consensus_queue.cc:1048] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:28:18.772575 14899 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:18.838523 14899 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:18.858881  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 72190.1us
I20260709 12:28:18.859297 15292 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:18.860991 15292 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:18.783111  9706 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59972 (request call id 306) took 21087 ms (client timeout 15000 ms). Trace:
I20260709 12:28:18.872773 15292 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:18.862807 14899 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:28:18.886656 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 50749.6us
I20260709 12:28:18.871539  9708 catalog_manager.cc:5697] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 5 to 3, term changed from 11 to 10, leader changed from <none> to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from VOTER to NON_VOTER, now has a pending config: VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65), VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66), VOTER b011791796d1457284b857d7d3422195 (127.8.111.67), VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 10 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: NON_VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:18.909283  9708 catalog_manager.cc:5697] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 5 to 13. New cstate: current_term: 13 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:18.936061  9708 catalog_manager.cc:5697] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:18.879037 15266 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:28:18.943130 15473 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:18.949808  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:18.953190 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:18.954092 10529 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
W20260709 12:28:18.865317  9706 rpcz_store.cc:269] 0709 12:27:57.695676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:57.698446 (+  2770us) service_pool.cc:224] Handling call
0709 12:28:18.773201 (+21074755us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:16.221136 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:16.221809 (+   673us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:16.221865 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:28:16.221886 (+    21us) tablet.cc:662] Decoding operations
0709 12:28:16.249076 (+ 27190us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:16.249198 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:16.249229 (+    31us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:28:16.249905 (+   676us) tablet.cc:701] Row locks acquired
0709 12:28:16.249957 (+    52us) write_op.cc:260] PREPARE: finished
0709 12:28:16.250136 (+   179us) write_op.cc:270] Start()
0709 12:28:16.250321 (+   185us) write_op.cc:276] Timestamp: P: 1783600096250073 usec, L: 0
0709 12:28:16.250367 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 12:28:16.277708 (+ 27341us) log.cc:844] Serialized 2810 byte log entry
0709 12:28:16.791289 (+513581us) op_driver.cc:464] REPLICATION: finished
0709 12:28:16.868207 (+ 76918us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b18002a41e0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f3f3 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:28:16.868377 (+   170us) write_op.cc:301] APPLY: starting
0709 12:28:16.868483 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:16.956119 (+ 87636us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:16.956162 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:17.000462 (+ 44300us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:17.000745 (+   283us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 12:28:17.000803 (+    58us) write_op.cc:312] APPLY: finished
0709 12:28:17.001123 (+   320us) log.cc:844] Serialized 73 byte log entry
0709 12:28:17.019323 (+ 18200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:17.021622 (+  2299us) write_op.cc:454] Released schema lock
0709 12:28:17.030263 (+  8641us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:17.059948 (+ 29685us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:17.059985 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":859754,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":12653,"apply.run_cpu_time_us":11709,"apply.run_wall_time_us":191527,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33359,"num_ops":7,"prepare.queue_time_us":102769,"prepare.run_cpu_time_us":63319,"prepare.run_wall_time_us":356373,"raft.queue_time_us":101562,"raft.run_cpu_time_us":4654,"raft.run_wall_time_us":9707,"replication_time_us":540752,"spinlock_wait_cycles":2572160,"thread_start_us":371616,"threads_started":4,"wal-append.queue_time_us":377881,"wal-append.run_cpu_time_us":15834,"wal-append.run_wall_time_us":1339129}]]}
I20260709 12:28:18.965687 15473 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:18.967236 15492 log.cc:927] Time spent T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:28:18.969745  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:18.928480 14899 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:18.970553  9807 raft_consensus.cc:2393] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 15: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:28:18.970024  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:18.981109  9881 raft_consensus.cc:1275] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 12:28:18.981470  9881 pending_rounds.cc:85] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 8
I20260709 12:28:18.981701  9881 pending_rounds.cc:107] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:28:18.981949  9881 raft_consensus.cc:2889] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:18.999344 15052 consensus_queue.cc:1048] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:19.003399  9807 raft_consensus.cc:1275] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:28:19.007249  9962 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 15.
I20260709 12:28:19.007368 14926 consensus_queue.cc:1048] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:28:19.009644 14899 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:19.010636 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:19.023240 10525 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:19.010663 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:28:19.014930  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 53309us
I20260709 12:28:19.021759  9888 raft_consensus.cc:2368] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 15. Current term is 16.
I20260709 12:28:19.031291  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:19.056149  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:19.060402  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:19.061157  9779 leader_election.cc:400] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 15. Current term is 16.
I20260709 12:28:18.993502  9708 catalog_manager.cc:5697] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 8 to 11, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 11 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:19.066831  9708 catalog_manager.cc:5697] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 4 to 11. New cstate: current_term: 11 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:19.056857 15495 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:19.070552 15495 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:19.070947 15495 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:19.057767 15466 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:28:19.100710 15466 raft_consensus.cc:697] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 15 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:19.104187 10525 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 16.
I20260709 12:28:19.105499  9854 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:19.101684 15466 consensus_queue.cc:237] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:19.139220 15495 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:19.115062 15482 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:19.151398  9812 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:28:19.154044 15361 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:28:19.069684  9708 catalog_manager.cc:5697] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 8 to 11, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 11 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:19.158293 15482 raft_consensus.cc:697] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 16 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:19.171814  9809 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:19.169845 15482 consensus_queue.cc:237] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:19.192870  9809 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 16.
I20260709 12:28:19.228947 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:19.229744 10529 raft_consensus.cc:2368] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 15. Current term is 16.
I20260709 12:28:19.242498 15495 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:19.248785  9779 leader_election.cc:400] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 15. Current term is 16.
I20260709 12:28:19.249197  9779 leader_election.cc:403] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:28:19.252207 10529 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:28:19.255119  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:19.261404 15470 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:28:19.263581 15495 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 for earlier term 15. Current term is 16.
I20260709 12:28:19.323930 15358 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:19.339246 15358 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:19.364861 15358 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:19.365782  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:19.366554  9961 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:19.366983 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:19.371142  9778 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:19.374800 15416 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:19.375499 15416 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:19.383100 15416 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:19.412139  9961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:19.412919  9961 raft_consensus.cc:606] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:19.413282  9961 raft_consensus.cc:614] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:19.416144  9961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:19.416690  9961 raft_consensus.cc:606] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:19.417002  9961 raft_consensus.cc:614] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:19.422312 15232 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:19.422869 15232 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:19.424906 15232 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:19.428709  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:19.429484  9962 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 15: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:19.430611  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:19.431284  9807 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 15.
I20260709 12:28:19.428709  9961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:19.432706  9961 raft_consensus.cc:606] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:19.433073  9961 raft_consensus.cc:614] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:19.435545  9853 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:19.435853 10525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:60770
I20260709 12:28:19.436381 10525 raft_consensus.cc:606] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:19.436690 10525 raft_consensus.cc:614] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:19.436961 15232 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:19.437371 15232 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:19.437727 15232 raft_consensus.cc:3060] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:19.440085  9961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:19.440740  9961 raft_consensus.cc:606] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:19.443398  9961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f93660c342af47199c6cec5c0424043a"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:19.443921  9961 raft_consensus.cc:606] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:19.445019  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:28:19.446834  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:19.461177 15232 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:19.464181 15416 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:19.475379 15416 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:19.477717 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:19.479496  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:19.480160  9956 raft_consensus.cc:2393] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 15: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:19.480023  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:19.494588  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:19.495142  9961 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:19.477916 15232 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:19.502960  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:19.502965  9807 raft_consensus.cc:2468] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 15.
I20260709 12:28:19.510016 15463 raft_consensus.cc:993] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:19.509928  9853 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:19.510566 14926 raft_consensus.cc:1081] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:19.511509 15232 raft_consensus.cc:2804] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:28:19.512001 15232 raft_consensus.cc:697] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 15 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:19.512377  9890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:57652
I20260709 12:28:19.513062  9890 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:19.512868 15232 consensus_queue.cc:237] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:19.513451  9890 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:19.526625  9961 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 16.
I20260709 12:28:19.527748  9778 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:19.530612 15266 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:19.532487 15266 raft_consensus.cc:697] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 16 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:19.534101 15266 consensus_queue.cc:237] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:19.546494  9890 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:19.572829  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:19.573606  9807 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:19.595602  9890 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:19.607046  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:19.608366  9961 raft_consensus.cc:3055] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:19.608752  9961 raft_consensus.cc:740] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:19.609561  9961 consensus_queue.cc:260] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:19.616518  9807 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:28:19.617297  9809 raft_consensus.cc:1240] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:19.618682  9853 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:19.621735 15232 raft_consensus.cc:2804] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:19.627625  9961 raft_consensus.cc:3060] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:19.645783  9807 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 16 LEADER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:19.631239 15232 raft_consensus.cc:697] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 13 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:19.673055 15232 consensus_queue.cc:237] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:19.680578  9961 raft_consensus.cc:2468] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:28:19.723559  9812 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:28:19.742000 10529 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:28:19.755054 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 49471us
I20260709 12:28:19.725303 15467 consensus_queue.cc:1059] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:28:19.728132 15302 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:28:19.773339 15232 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:28:19.771188 15467 consensus_queue.cc:1243] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer 4104e34a61b7448281d6d91ce23ebf71 log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:28:19.867601 15208 raft_consensus.cc:993] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:19.868104  9961 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 15. Current term is 16. Ops: []
W20260709 12:28:19.875013  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 63091us
I20260709 12:28:19.877015 15466 consensus_queue.cc:1059] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:28:19.885207 15208 raft_consensus.cc:1081] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:19.891153  9881 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f93660c342af47199c6cec5c0424043a"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:57652
I20260709 12:28:19.891739  9881 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:19.892095  9881 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:19.930573 15516 raft_consensus.cc:3055] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:28:19.932111 15516 raft_consensus.cc:740] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:19.933285  9813 raft_consensus.cc:1275] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:28:19.933010 15516 consensus_queue.cc:260] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:19.944475 15232 consensus_queue.cc:1048] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:28:19.934351 15516 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:19.961907 15514 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:19.983933 15514 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:20.003633  9881 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:20.031275  9961 raft_consensus.cc:1275] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:28:20.033576  9881 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:20.038787  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:20.039290  9962 raft_consensus.cc:3055] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:20.039567  9962 raft_consensus.cc:740] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:20.038028  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:20.040952  9812 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:20.040282  9962 consensus_queue.cc:260] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:20.050678  9962 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:20.054035 15354 consensus_queue.cc:1048] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:28:20.071204 15514 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:20.085038  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:20.094765  9707 catalog_manager.cc:5697] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 12 to 15, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 15 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:28:20.096243  9707 catalog_manager.cc:5697] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 7 to 15, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 15 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:20.097504  9707 catalog_manager.cc:5697] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 11 to 13, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 13 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:20.102862 15520 log.cc:927] Time spent T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:28:20.115116  9962 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:28:20.117295  9812 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:28:20.123337  9853 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:20.126258  9707 catalog_manager.cc:5697] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 13 to 15, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 15 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:20.128895  9707 catalog_manager.cc:5697] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 10 to 15, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 15 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:20.130379  9707 catalog_manager.cc:5697] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 14 to 19, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 19 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:20.138393  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:20.143551  9962 raft_consensus.cc:1275] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:28:20.140017 15482 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:20.160470 15302 consensus_queue.cc:1048] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:28:20.163451  9708 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56416 (request call id 250) took 44848 ms (client timeout 15000 ms). Trace:
I20260709 12:28:20.159852  9707 catalog_manager.cc:5697] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 11 to 15, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 15 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:20.167379  9707 catalog_manager.cc:5697] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 9 to 13, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 13 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:20.169749  9707 catalog_manager.cc:5697] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 6 to 14, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 14 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:28:20.171569  9707 catalog_manager.cc:5697] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 6 to 13. New cstate: current_term: 13 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:28:20.169732  9927 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:20.177683  9962 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:28:20.173384  9707 catalog_manager.cc:5697] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 8 to 13, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 13 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:20.183185  9707 catalog_manager.cc:5697] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 15 to 16, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 16 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:20.185168 15518 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:20.184114 15416 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 12:28:20.176669 15482 raft_consensus.cc:697] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:20.203133 15482 consensus_queue.cc:237] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:20.208799 10525 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 12:28:20.209137 10525 pending_rounds.cc:85] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: Aborting all ops after (but not including) 13
I20260709 12:28:20.209374 10525 pending_rounds.cc:107] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 12:28:20.209617 10525 raft_consensus.cc:2889] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:20.184851  9707 catalog_manager.cc:5697] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 6 to 15, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 15 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:28:20.223380  9707 catalog_manager.cc:5697] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 9 to 11, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 11 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:20.225768  9707 catalog_manager.cc:5697] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index 3 to 5, term changed from 10 to 15, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to <none>, f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65), VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66), VOTER b011791796d1457284b857d7d3422195 (127.8.111.67), VOTER f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 15 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:20.248006  9707 catalog_manager.cc:5697] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 6 to 11, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 11 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:20.249644  9707 catalog_manager.cc:5697] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 11 to 14, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 14 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:20.256881  9707 catalog_manager.cc:5697] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:20.258980  9707 catalog_manager.cc:5697] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:28:20.260087 15519 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:28:20.274906  9707 catalog_manager.cc:5697] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 5 to 15, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 15 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:20.281055  9707 catalog_manager.cc:5697] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:28:20.282260  9707 catalog_manager.cc:5697] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 15 to 17, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 17 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:20.290248  9707 catalog_manager.cc:5697] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:20.303812  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 124062us
I20260709 12:28:20.306010  9807 raft_consensus.cc:1275] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:28:20.321919  9707 catalog_manager.cc:5697] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 14 to 18, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 18 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:20.323589  9707 catalog_manager.cc:5697] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 6 to 13. New cstate: current_term: 13 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:20.324739  9707 catalog_manager.cc:5697] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 10 to 11, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 11 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:20.326215  9707 catalog_manager.cc:5697] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:28:20.327353  9707 catalog_manager.cc:5697] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 10 to 14, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 14 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:20.328784  9707 catalog_manager.cc:5697] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:20.330083  9707 catalog_manager.cc:5697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 8 to 14, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 14 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:20.338480  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 54490.2us
I20260709 12:28:20.341550  9707 catalog_manager.cc:5697] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 9 to 10, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 10 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:20.349082 15354 consensus_queue.cc:1048] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:28:20.365854  9707 catalog_manager.cc:5697] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:20.374778  9707 catalog_manager.cc:5697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:20.376278  9707 catalog_manager.cc:5697] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 9 to 17. New cstate: current_term: 17 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:20.377439  9707 catalog_manager.cc:5697] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
W20260709 12:28:20.391423  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 51670.1us
W20260709 12:28:20.164569  9708 rpcz_store.cc:269] 0709 12:27:35.315095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:35.315348 (+   253us) service_pool.cc:224] Handling call
0709 12:28:20.163351 (+44848003us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:19.275231 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:19.275780 (+   549us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:19.275813 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:28:19.275830 (+    17us) tablet.cc:662] Decoding operations
0709 12:28:19.276694 (+   864us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:19.276768 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:19.276796 (+    28us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:28:19.277455 (+   659us) tablet.cc:701] Row locks acquired
0709 12:28:19.277480 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:28:19.277604 (+   124us) write_op.cc:270] Start()
0709 12:28:19.277701 (+    97us) write_op.cc:276] Timestamp: P: 1783600099277565 usec, L: 0
0709 12:28:19.277720 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:28:19.298068 (+ 20348us) log.cc:844] Serialized 3503 byte log entry
0709 12:28:19.443478 (+145410us) op_driver.cc:464] REPLICATION: finished
0709 12:28:19.523740 (+ 80262us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b18003a0f00. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f3f3 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:28:19.523886 (+   146us) write_op.cc:301] APPLY: starting
0709 12:28:19.523974 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:19.606890 (+ 82916us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:19.608314 (+  1424us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:19.745316 (+137002us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:19.745630 (+   314us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=0,mrs_lookups=0
0709 12:28:19.745700 (+    70us) write_op.cc:312] APPLY: finished
0709 12:28:19.746070 (+   370us) log.cc:844] Serialized 81 byte log entry
0709 12:28:19.746303 (+   233us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:19.746476 (+   173us) write_op.cc:454] Released schema lock
0709 12:28:19.746542 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:19.747049 (+   507us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:19.747092 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":560366,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":59758,"apply.run_cpu_time_us":18100,"apply.run_wall_time_us":223078,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37535,"num_ops":8,"prepare.queue_time_us":75876,"prepare.run_cpu_time_us":29295,"prepare.run_wall_time_us":65842,"raft.queue_time_us":30258,"raft.run_cpu_time_us":12217,"raft.run_wall_time_us":57544,"replication_time_us":165600,"spinlock_wait_cycles":43599744,"thread_start_us":204257,"threads_started":4,"wal-append.queue_time_us":77364}]]}
W20260709 12:28:20.455386  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 107332us
I20260709 12:28:20.658116  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:20.799528  9961 raft_consensus.cc:1275] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:28:20.801100 15302 consensus_queue.cc:1048] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:20.801069  9704 catalog_manager.cc:5697] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 9 to 18, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 18 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:20.815999  9704 catalog_manager.cc:5697] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 8 to 12, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 12 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:20.823432  9807 raft_consensus.cc:1275] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:28:20.825229 15302 consensus_queue.cc:1048] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:28:20.830916  9704 catalog_manager.cc:5697] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 4 to 9, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 9 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:20.837566  9707 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59972 (request call id 307) took 4489 ms. Trace:
I20260709 12:28:20.833971  9704 catalog_manager.cc:5697] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 8 to 11, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 11 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:20.838007  9707 rpcz_store.cc:276] 0709 12:28:16.346769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:16.346931 (+   162us) service_pool.cc:224] Handling call
0709 12:28:16.928593 (+581662us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54001abb54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e486090 00007f2f8e524f3a 00007f2f942dae9c 00007f2f943d904e 00007f2f9289a2a4 00007f2f9289a232 00007f2f9289a161 00007f2f9289a0dc 00007f2f92899392 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:20.835962 (+3907369us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:20.553857 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:20.554416 (+   559us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:20.554448 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:28:20.554466 (+    18us) tablet.cc:662] Decoding operations
0709 12:28:20.557184 (+  2718us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:20.557249 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:20.557280 (+    31us) tablet.cc:685] Acquiring locks for 35 operations
0709 12:28:20.583443 (+ 26163us) tablet.cc:701] Row locks acquired
0709 12:28:20.583465 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:28:20.583633 (+   168us) write_op.cc:270] Start()
0709 12:28:20.583766 (+   133us) write_op.cc:276] Timestamp: P: 1783600100583580 usec, L: 0
0709 12:28:20.583794 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:28:20.592790 (+  8996us) log.cc:844] Serialized 13554 byte log entry
0709 12:28:20.603279 (+ 10489us) op_driver.cc:464] REPLICATION: finished
0709 12:28:20.630067 (+ 26788us) write_op.cc:301] APPLY: starting
0709 12:28:20.630163 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:20.678524 (+ 48361us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:20.678622 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:20.698524 (+ 19902us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:20.698976 (+   452us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=70,key_file_lookups=70,delta_file_lookups=0,mrs_lookups=0
0709 12:28:20.699026 (+    50us) write_op.cc:312] APPLY: finished
0709 12:28:20.699640 (+   614us) log.cc:844] Serialized 300 byte log entry
0709 12:28:20.699818 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:20.700103 (+   285us) write_op.cc:454] Released schema lock
0709 12:28:20.700177 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:20.702986 (+  2809us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:20.703016 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":91032,"reported_tablets":47,"spinlock_wait_cycles":493028224,"child_traces":[["op",{"apply.queue_time_us":26501,"apply.run_cpu_time_us":37493,"apply.run_wall_time_us":72871,"cfile_cache_hit":142,"cfile_cache_hit_bytes":150287,"num_ops":35,"prepare.queue_time_us":50276,"prepare.run_cpu_time_us":8105,"prepare.run_wall_time_us":39250,"replication_time_us":11122,"thread_start_us":54435,"threads_started":2}]]}
I20260709 12:28:20.879071  9704 catalog_manager.cc:5697] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 reported cstate change: leader changed from <none> to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 15 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:20.884466  9704 catalog_manager.cc:5697] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:20.888285  9962 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:20.893775  9962 raft_consensus.cc:606] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:20.894268  9962 raft_consensus.cc:614] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:20.898506 10525 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "511405268634431e9bf729e0fc87c838"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:60770
I20260709 12:28:20.899062 10525 raft_consensus.cc:606] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 16 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:20.898313  9704 catalog_manager.cc:5697] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 6 to 15, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 15 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:20.905223  9813 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:20.905772  9813 raft_consensus.cc:606] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:20.906088  9813 raft_consensus.cc:614] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:20.929739  9812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:20.930461  9812 raft_consensus.cc:606] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Received request to transfer leadership to TS b011791796d1457284b857d7d3422195
I20260709 12:28:20.924983  9704 catalog_manager.cc:5697] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 7 to 16. New cstate: current_term: 16 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:20.949386  9704 catalog_manager.cc:5697] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:20.972776  9704 catalog_manager.cc:5697] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 6 to 10, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 10 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:20.993814  9962 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:20.994444  9962 raft_consensus.cc:606] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:20.997363  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:28:20.991674  9704 catalog_manager.cc:5697] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 10 to 12, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 12 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:20.999142  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:20.999929  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:21.000032  9704 catalog_manager.cc:5697] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 3 to 16, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 16 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:21.019013  9704 catalog_manager.cc:5697] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 11 to 16, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 16 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:21.063728  9704 catalog_manager.cc:5697] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 14 to 16, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 16 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:21.128929 15373 raft_consensus.cc:993] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:21.129474 15373 raft_consensus.cc:1081] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 16 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:21.132512  9890 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "511405268634431e9bf729e0fc87c838"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:54428
I20260709 12:28:21.133095  9890 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:21.133445  9890 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:21.141256 15551 raft_consensus.cc:993] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:21.138408  9704 catalog_manager.cc:5697] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 11 to 16, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 16 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:21.141790 15551 raft_consensus.cc:1081] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:21.155179  9812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46504
I20260709 12:28:21.155794  9812 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:21.156140  9812 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:21.174507  9812 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:21.177006  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:21.177626  9962 raft_consensus.cc:3055] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:28:21.177932  9962 raft_consensus.cc:740] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:21.178454  9890 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:21.178850  9962 consensus_queue.cc:260] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:21.180050  9962 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:21.181417  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:21.182021  9961 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:21.193044  9962 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:21.205909 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:21.206404  9812 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:21.206561 10525 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:21.207015  9778 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:21.202087  9890 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:21.198348  9961 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 17.
I20260709 12:28:21.209944 15553 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:28:21.227846 15553 raft_consensus.cc:697] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:21.228312  9853 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:21.229293 15302 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:28:21.229857 15302 raft_consensus.cc:697] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 17 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:21.230997 15302 consensus_queue.cc:237] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:21.228880 15553 consensus_queue.cc:237] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:21.219313 10525 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:21.199928 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:21.238624 10529 raft_consensus.cc:3055] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:28:21.238976 10529 raft_consensus.cc:740] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:21.239759 10529 consensus_queue.cc:260] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:21.241142 10529 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:21.254062 15372 raft_consensus.cc:993] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower b011791796d1457284b857d7d3422195 to start an election
I20260709 12:28:21.254606 15372 raft_consensus.cc:1081] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Signalling peer b011791796d1457284b857d7d3422195 to start an election
I20260709 12:28:21.258529 10529 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 17.
I20260709 12:28:21.265714  9961 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7"
dest_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55952
I20260709 12:28:21.271160  9961 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:21.276546  9961 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:21.305424  9961 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:21.309032  9961 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:21.310405  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:21.311045  9812 raft_consensus.cc:3055] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:28:21.311335  9812 raft_consensus.cc:740] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:21.312052  9812 consensus_queue.cc:260] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:21.313390  9812 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:21.316634 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:21.317308 10529 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:21.336724 10529 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:28:21.337817  9928 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:21.338624 15518 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:21.339119 15518 raft_consensus.cc:697] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:21.339933 15518 consensus_queue.cc:237] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:21.372354  9812 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:28:22.733639 15563 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:22.734378 15563 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.006987 15567 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:23.007506 15568 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.007767 15567 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.015383 15567 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:23.017158 15568 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.021202 15569 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:23.024269 15569 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.023098 15567 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.027937 15563 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.029206 15567 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.026396 15565 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:23.047924 15577 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.048676 15577 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.046573 15563 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:23.050695 15574 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.063539 15568 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.051576 15563 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.076457 15566 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.050515 15565 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.069155 15574 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.083030 15577 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.083549 15575 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:23.093475 15566 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.098081 15569 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.099750 15570 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:23.113611 15570 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.115878 15570 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.112555 15585 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.116690 15585 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.119354 15585 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.119470 15564 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:23.111702 15579 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.105572 15578 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.110247 15572 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.151687  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:23.120117 15564 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.165478 15554 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:23.144984 15579 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.178136 15584 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:23.178715 15584 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.179335 15563 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.170923 15582 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:23.180130 15582 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.180783 15584 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:23.181260 15584 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.183990 15581 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:23.121147 15575 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.190353 15581 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.192329 15574 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.193596 15565 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.195114 15588 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.181685 15584 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.152837 15572 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:23.208436  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 52624us
I20260709 12:28:23.211229  9812 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:28:23.211097 15590 raft_consensus.cc:493] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.212744 15590 raft_consensus.cc:515] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.214413 15595 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.214905 15590 leader_election.cc:290] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.144464 15578 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.214957 15595 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.182684 15582 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:23.196761 15579 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.228340 15595 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.220562  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:23.229941  9812 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:28:23.197338 15554 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.215582 15590 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.321530 15581 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.321687 15554 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.322104 15581 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:23.322713 15581 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.324026 15584 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:23.324550 15584 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:23.324982 15584 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.325397 15581 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.234588 15592 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.326579 15592 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.328869 15592 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.329365 15592 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.329838 15566 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.330056 15591 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.330642 15591 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.332988 15572 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.334034 15575 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:23.314919 15586 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.339828 15586 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.315383 15567 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.343621 15564 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.346045 15578 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:23.217998 15588 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.358069 15588 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.318024 15590 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.363958 15590 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.607045 15587 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:28:23.332990 15591 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:23.611665 15586 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:23.329842 15592 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:23.647323 10499 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.000s	sys 0.014s
W20260709 12:28:23.647836 10499 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.000s	sys 0.015s
I20260709 12:28:23.650720 15588 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.651126 15563 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.651425 15588 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.652032 15564 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:23.651871 15563 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.652586 15564 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.653666 15588 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:28:23.657335  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 437135us
I20260709 12:28:23.645807 15584 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.662496 15604 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.643922 15590 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.677349 15604 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.679672 15604 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.661844 15581 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:23.680580 15581 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.682682 15581 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.667929 15572 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.683645 15602 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:23.683768 15572 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.684289 15602 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.668080 15564 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.676357 15592 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.659365 15565 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.686532 15588 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.658814 15597 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:23.674460 15586 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.675154 15563 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.694258  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.674486 15599 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.676771 15600 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.698594 15589 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.698537 15600 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.699190 15589 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.677421 15590 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.701329 15589 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.701333 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.683169 15581 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:23.702296 15581 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.669766 15566 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.697269  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.687743 15565 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.692299 15588 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.696373 15572 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.697958 15601 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.691532 15591 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.703243 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.691910  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.728376  9961 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 16.
I20260709 12:28:23.690687 15592 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:23.730325 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.730942 10527 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 16.
I20260709 12:28:23.702905 15590 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.705173 15574 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.710754 15578 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:23.711071 15604 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.711360 15567 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:23.690475 15569 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:23.693480 15584 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.716326 15585 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.717723 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.698307 15599 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.746913 15605 raft_consensus.cc:493] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.747483 15605 raft_consensus.cc:515] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.748193 15599 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.720875  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.722186  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.749548  9956 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:28:23.749768 15605 leader_election.cc:290] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.722908  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.724854  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:23.733898 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.751696 15607 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.752238 10531 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 15.
I20260709 12:28:23.703641 15563 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:23.728283 10526 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:28:23.752260 15607 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.753342 15563 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.755096 15607 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.755635 15563 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.703956 15602 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.701400 15600 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.756796 15600 raft_consensus.cc:493] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:23.757231 15600 raft_consensus.cc:515] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.743963 15567 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.759191 15600 leader_election.cc:290] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.759697 15600 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.760125 15600 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.760494 15567 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:28:23.762142 15600 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.762079 15610 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.718614 15595 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.730633 15579 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:23.716583 15566 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.779510 15579 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.781001 15566 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.781540 15579 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.781692 15596 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:28:23.782588 10498 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.006s	sys 0.013s
W20260709 12:28:23.782915 10498 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.006s	sys 0.013s
I20260709 12:28:23.782397 15596 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.784699 15596 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.785212 15596 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.785732 15599 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.786401 15599 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.788537 15599 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.735227 15572 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.703701 15586 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.785666 15596 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.792407  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:23.730911 15564 raft_consensus.cc:493] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:23.736567 15590 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:23.798574 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.799013 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.799521 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.797067 15572 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.803627 15594 raft_consensus.cc:493] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:23.803941 15586 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:23.804602 15598 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.804430 15594 raft_consensus.cc:515] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.805380 15572 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.713449 15597 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.732303 15591 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.806478 15563 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:23.738605 15604 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.807335 15597 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.807164 15563 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.792328 15607 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.808554 15607 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.809028 15604 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.791363 15567 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:23.774603 15569 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.809801 15567 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.810639 15607 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.782092 15579 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.811828 15569 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.811723 15579 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.812318 15569 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.812546 15567 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.812804 15569 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.813762 15579 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.790566 15595 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.814688 15565 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.816074 15588 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.816704 15595 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.818382 15596 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.818794 15603 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:23.819360 15603 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.821133  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:23.821435 15603 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.822300  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:23.792621 15554 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.825274 15581 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.825542 15554 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.826601  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:23.827153  9882 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:28:23.827613 15554 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:23.788990 15599 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:23.828410 15599 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.830430 15599 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.805148 15598 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.775657 15600 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:23.807371 15591 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.777666 15584 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.737206 15601 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.781558 15566 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.778643 15585 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.843869 15590 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.734380 15592 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.738075 15578 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.736399 15574 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.872303  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:23.838106 15564 raft_consensus.cc:515] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.873766 15574 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.874512 15599 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.875114 15599 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.875579 15592 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.876164  9888 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:28:23.876900 10530 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:28:23.877286 15599 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.878054 15585 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:23.878578 15564 leader_election.cc:290] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.879180 15569 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:23.879958 15601 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:23.882506  9928 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:23.883958 15585 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:23.884382 15585 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.884757 15585 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:23.847321 15589 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.885627 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.886194 15589 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.887784 10533 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:28:23.888317 15589 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.888692 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.889071 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.889277 10533 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:28:23.890134 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.890195 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.890805 10532 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:28:23.890918 10533 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:28:23.802383 15610 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.848647 15572 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:23.891860 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.891841 15572 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.893234 15610 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.809780 15563 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.849347 15579 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.860865 15600 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.850770 15598 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.852017  9927 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:23.857806  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:28:23.900815  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 48910.4us
I20260709 12:28:23.857827  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:23.901563  9886 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:28:23.858680 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.859323  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.860131 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.904088  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:23.904899  9886 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:28:23.862149  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.864600  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:23.865649 15590 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.867203  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.912696  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.913842  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.867522 15584 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.867965 15566 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.868336  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.914968  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.915928  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.916085  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.916523  9964 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 15.
I20260709 12:28:23.917235  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.917358  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.919852 15566 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.833715 15603 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:23.869078  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.920920 15603 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.869535 15591 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:23.921871 15591 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.923964 15591 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.871551  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:23.924672  9885 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:28:23.925065 15580 raft_consensus.cc:493] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:23.925606 15580 raft_consensus.cc:515] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.926610  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:23.926699 15585 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.929164 15585 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:23.871935 15578 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:23.895007 15579 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:23.850016 15594 leader_election.cc:290] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.947841 15579 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.904235  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:23.905339  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:23.861975  9959 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:28:23.948539  9890 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 17.
I20260709 12:28:23.894066 15572 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.949427  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.950050  9959 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 16.
W20260709 12:28:23.950557  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 232780us
I20260709 12:28:23.950908  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.951463  9959 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 10.
I20260709 12:28:23.952131  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:23.952299  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.910424 15554 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:23.911326  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.952952 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.932657  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.948567  9888 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:28:23.953776  9958 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:28:23.954967  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.937369  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:23.955295 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.934795  9928 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:23.942715  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:23.943389  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:23.943720  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:23.944013  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:23.945226 15600 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:23.927629 15603 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:23.952534 10496 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:23.956302  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.980448  9959 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 17.
I20260709 12:28:23.980814 10496 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:23.933135  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.982610  9956 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 15.
I20260709 12:28:23.984344 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.984522  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.984982 10524 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 16.
I20260709 12:28:23.985170  9958 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 15.
I20260709 12:28:23.956212  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:23.986917 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:23.986810  9810 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
I20260709 12:28:23.988211  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:28:23.988413  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 53734.9us
I20260709 12:28:23.987735  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.988994  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:23.989517  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:23.989750  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.991667  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.998158 15584 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:24.000048 15584 raft_consensus.cc:493] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:24.000460 15571 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:24.000779  9958 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 17.
I20260709 12:28:24.000952 15571 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:24.001334 15571 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:24.001677  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.955742 15554 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:24.002295  9958 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 19.
I20260709 12:28:24.002611 15554 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:24.003185  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.003749  9958 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 17.
I20260709 12:28:24.004508  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.005477  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:23.981819 15597 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:24.006661 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.987422 15581 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:24.007539 15581 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:23.990659 10496 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:24.006771 15597 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.009375 10496 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:24.009477 15581 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:24.010648 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:23.999451 15580 leader_election.cc:290] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:24.011278 10525 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
I20260709 12:28:23.990427  9927 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:24.012639 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:23.987741 15578 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:24.000475 15584 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:24.018204 15578 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:24.014427 15581 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:24.013108 15605 raft_consensus.cc:493] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:24.019227 15581 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.019340 15605 raft_consensus.cc:515] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:24.013386 15574 raft_consensus.cc:2804] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:24.021363 15581 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:24.021739 15574 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:24.014134 15565 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:24.016769 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b844d67afb64319be2e7e6a8ec99319" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:24.022204 15574 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:24.022691 15565 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.023173  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.023782  9963 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 17.
I20260709 12:28:24.024737 15565 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:24.027294 15597 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:24.030661  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:28:24.032226 10554 debug-util.cc:398] Leaking SignalData structure 0x7b0800232700 after lost signal to thread 8640
W20260709 12:28:24.032784 10554 debug-util.cc:398] Leaking SignalData structure 0x7b0800332000 after lost signal to thread 9707
I20260709 12:28:24.034482 15614 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:24.034732  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.035039 15614 raft_consensus.cc:493] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:24.035434  9964 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:28:24.010042 15616 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:24.036160 15616 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:24.036553 15616 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:24.036762  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.034858  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.038314 15563 raft_consensus.cc:493] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:24.039048  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.038966 15563 raft_consensus.cc:515] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.018729 15578 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:24.043510 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:24.043634 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:24.044677 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:24.045082 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:24.045269 10530 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
I20260709 12:28:24.046171 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:24.035465 15614 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:24.047348 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:24.050416 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:24.051504 15563 leader_election.cc:290] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:24.053064 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:24.054494  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.055318  9955 raft_consensus.cc:2393] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 17: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:24.059223 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:24.054605 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:24.061105 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:24.062434  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 73487.9us
W20260709 12:28:24.064482 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 51916.7us
I20260709 12:28:24.060676  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.065269  9888 raft_consensus.cc:2468] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 15.
I20260709 12:28:24.066749 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:24.067783 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:24.021395 15605 leader_election.cc:290] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:24.026014 15584 raft_consensus.cc:515] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.070652 15598 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:24.071084 15598 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:24.071461 15598 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:28:24.071638  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 81281us
I20260709 12:28:24.072235 15602 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:24.072656 15602 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:24.073032 15602 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:24.075927 15554 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:24.077046  9961 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:24.078454 15570 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:28:24.078811 10554 debug-util.cc:398] Leaking SignalData structure 0x7b0800380620 after lost signal to thread 9747
I20260709 12:28:24.078878 15570 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:24.079473 15570 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:24.079892 15584 leader_election.cc:290] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:24.080251 10554 debug-util.cc:398] Leaking SignalData structure 0x7b08002ce9c0 after lost signal to thread 9839
W20260709 12:28:24.080602 10554 debug-util.cc:398] Leaking SignalData structure 0x7b08002ce980 after lost signal to thread 9840
W20260709 12:28:24.081650 10554 debug-util.cc:398] Leaking SignalData structure 0x7b0800289520 after lost signal to thread 9914
W20260709 12:28:24.081902 10554 debug-util.cc:398] Leaking SignalData structure 0x7b0800289480 after lost signal to thread 9915
I20260709 12:28:24.084139 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:24.089520  9707 catalog_manager.cc:5697] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:24.090889 10496 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:24.092098  9707 catalog_manager.cc:5697] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 10 to 17, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 17 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:24.094040 15599 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:24.094507 15599 raft_consensus.cc:493] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:24.094848 15599 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:24.078120 15554 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:24.100095  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:24.100734  9961 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:28:24.085457 10554 debug-util.cc:398] Leaking SignalData structure 0x7b08003e9ba0 after lost signal to thread 9988
I20260709 12:28:24.063127  9928 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:24.067313 10530 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:28:24.089216  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:24.101970  9808 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:24.083989 15598 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.084995 15571 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:24.101192 10554 debug-util.cc:398] Leaking SignalData structure 0x7b0800412540 after lost signal to thread 9989
I20260709 12:28:24.100241 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:28:24.108034 10554 debug-util.cc:398] Leaking SignalData structure 0x7b08003c6900 after lost signal to thread 10557
W20260709 12:28:24.108711 10554 debug-util.cc:398] Leaking SignalData structure 0x7b08002dcde0 after lost signal to thread 10558
I20260709 12:28:24.105079  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.103690  9928 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:24.110610  9888 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
I20260709 12:28:24.112020 15576 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:24.112454 15576 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:24.112892 15576 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:24.112740 15574 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.105168 15584 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:28:24.114362 15592 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:24.118508 15592 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:24.118878 15592 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:24.125624 15592 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.115250  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.127825  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.130255  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:24.135061  9888 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 18.
I20260709 12:28:24.135601  9928 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:24.117990  9961 raft_consensus.cc:2468] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 17.
I20260709 12:28:24.114887 15574 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:24.121539  9808 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:28:24.137141  9707 catalog_manager.cc:5697] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 11 to 13, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 13 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:24.137850 10496 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:24.140013  9779 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:24.141952  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:24.142693  9961 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:24.143003 15618 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:24.144641 15618 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:24.141314 15591 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:24.141734  9927 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:24.159979 15591 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:24.160188  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.160436 15591 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:24.160837  9888 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:28:24.161586 15569 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:24.162109 15569 raft_consensus.cc:697] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:24.162973 15569 consensus_queue.cc:237] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:24.147162 15612 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:24.147567 15606 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:24.148331  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.149688 15616 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.145254 15588 raft_consensus.cc:2804] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:28:24.151357  9960 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:28:24.151705 15599 raft_consensus.cc:515] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.152788 15571 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:24.153513  9961 raft_consensus.cc:2468] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:28:24.175879  9957 raft_consensus.cc:1240] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:24.176139  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.176460 15588 raft_consensus.cc:697] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 17 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:24.177191  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90aeaa3c967a48a4804d8960b26f02b5" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.177330 15588 consensus_queue.cc:237] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.178220  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.179260  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.180284  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.181286  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.153657  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.154145  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.154959 15602 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:24.156003  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.157009  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.157236  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.157377  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.139705  9707 catalog_manager.cc:5697] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:28:24.143997  9779 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:24.195499  9808 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
W20260709 12:28:24.195992  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 52063.2us
I20260709 12:28:24.166739  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.126463 15584 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:24.173928  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.197978 15584 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:28:24.198868  9960 raft_consensus.cc:1240] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 16. Current term is 17. Ops: []
I20260709 12:28:24.199457  9963 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 16. Current term is 17. Ops: []
I20260709 12:28:24.174254  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.182885  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.184172  9962 raft_consensus.cc:1240] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:24.202242 15592 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:24.185340 15578 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.204916 15578 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:24.205173 15584 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.166603 15618 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:24.182502  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.180379 15606 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:24.213603  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.212673  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.189261 10496 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:24.197480  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.206902  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.209064  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.183714  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.210059  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.211324  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:24.174117 15612 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:24.211014  9890 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
I20260709 12:28:24.217442  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:24.217743  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:24.221925  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:24.223790  9964 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:24.225554  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf7be2e7d02465d87ce4296e257c29b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.185384 15616 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:24.235448  9707 catalog_manager.cc:5697] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 14 to 16, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 16 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:24.236897  9707 catalog_manager.cc:5697] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 11 to 13, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 13 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
W20260709 12:28:24.226843  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 91326.7us
I20260709 12:28:24.238626  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.238076  9707 catalog_manager.cc:5697] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 10 to 11, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 11 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:28:24.239807  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.228662  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.229880  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.231911  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.232565  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.233831  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.234566  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.234267 15576 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:24.235191  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.240983  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.243700  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.252310  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.252727  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.251960  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:24.253155 15598 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:24.244114  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.253324  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.246446  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.210505 15563 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:24.222709 15612 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:24.246569  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.241411  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.244699  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.256107  9882 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 16.
I20260709 12:28:24.256522  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.214613 15614 raft_consensus.cc:515] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.257651  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.241569  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.259052  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.241130  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.259354  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.246812 15599 leader_election.cc:290] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995)
I20260709 12:28:24.260190  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.260390  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.261245  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.261607  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.259140 15584 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 20 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:24.254871 15563 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:24.255563  9810 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:28:24.253733  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.263079  9956 raft_consensus.cc:1240] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:24.262868  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.240504  9707 catalog_manager.cc:5697] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 12 to 14, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 14 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:24.260385  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.265314  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.262255  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.278738  9888 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 17.
W20260709 12:28:24.279743 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 56466.1us
I20260709 12:28:24.264495 15563 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:24.263108 15578 raft_consensus.cc:2804] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:24.281266 15578 raft_consensus.cc:697] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:24.275986 15591 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:24.265884 15614 leader_election.cc:290] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:24.282164 15578 consensus_queue.cc:237] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.283345 15591 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:24.275231  9928 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:24.284830  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.285240  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.254875  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.287221  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.213254 15606 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:24.279614  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:24.288848  9707 catalog_manager.cc:5697] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 13 to 14, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 14 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:24.286547  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:24.296211  9707 catalog_manager.cc:5697] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:24.299938  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.297601  9707 catalog_manager.cc:5697] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 14 to 15, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 15 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:28:24.264122 15576 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:28:24.343062  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 52353.7us
I20260709 12:28:24.343712  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.344025  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:24.344296  9884 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:24.345845  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.295058 15587 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:24.265228 15570 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.353226  9964 raft_consensus.cc:2468] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 18.
I20260709 12:28:24.349967  9928 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:24.351047  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:24.355868  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.364509 15612 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:24.368825 15618 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.370589  9812 raft_consensus.cc:1240] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:24.371160 15618 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:24.372434 15612 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:24.373188  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:24.374619 15602 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:24.375713  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.376560 15570 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:24.352586 15576 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:24.377302  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.379815  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.383689  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.355677 15588 consensus_queue.cc:1059] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:28:24.385294 15588 raft_consensus.cc:3055] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:28:24.385811 15588 raft_consensus.cc:740] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:24.386564  9963 raft_consensus.cc:1240] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:24.386996 15588 consensus_queue.cc:260] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.389010  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:24.389324  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:24.390506  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:24.394547  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:24.394541  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:24.347678 15554 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:28:24.398756  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.376579  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.401743  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.403035  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.373268 15612 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:24.388583 15588 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:24.407819  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:24.409245  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:24.409852  9707 catalog_manager.cc:5697] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 12 to 13, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 13 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:28:24.413103 15597 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:28:24.411789  9707 catalog_manager.cc:5697] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 14 to 16, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 16 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:24.414068  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:24.413520  9778 leader_election.cc:304] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:24.415391 15568 raft_consensus.cc:2749] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:24.415529  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:24.416383  9964 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:24.417218  9704 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59992 (request call id 302) took 6897 ms. Trace:
I20260709 12:28:24.415452  9707 catalog_manager.cc:5697] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 13 to 18, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 18 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:24.418859  9778 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:24.419688 15568 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:24.411546 10496 leader_election.cc:304] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:24.419878  9707 catalog_manager.cc:5697] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:24.423027  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.424643 15599 raft_consensus.cc:2804] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:28:24.427224  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.406041 15612 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:24.428431  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.429138 15565 consensus_queue.cc:1059] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 12:28:24.432559 15599 raft_consensus.cc:697] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 18 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:24.436221 15599 consensus_queue.cc:237] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.426501 15563 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.443717 15563 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:24.447968 10496 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:24.449107 15584 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:24.449618 15584 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:24.450146 15584 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:24.429834 15597 consensus_queue.cc:1059] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:28:24.451901 15597 raft_consensus.cc:3055] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:28:24.452294 15597 raft_consensus.cc:740] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:24.453145 15597 consensus_queue.cc:260] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:24.455209  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.456097  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.456333  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.457985  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.458581  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:24.458972 10526 raft_consensus.cc:1240] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 17 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 16. Current term is 17. Ops: []
I20260709 12:28:24.459090 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:24.460505 10524 raft_consensus.cc:1240] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:24.427089 15614 consensus_queue.cc:1059] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:28:24.463882 15614 raft_consensus.cc:3055] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:24.464207 15614 raft_consensus.cc:740] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:24.465061 15614 consensus_queue.cc:260] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.467958 10496 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:24.433037  9964 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 18.
W20260709 12:28:24.470410 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:24.474247 10524 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 16. Current term is 17. Ops: []
I20260709 12:28:24.485049 10496 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:24.488266 10496 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:24.489346  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.491796  9964 raft_consensus.cc:1240] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:28:24.493700  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:24.417629  9704 rpcz_store.cc:276] 0709 12:28:17.538430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:17.556979 (+ 18549us) service_pool.cc:224] Handling call
0709 12:28:24.417151 (+6860172us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:21.201734 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:21.202329 (+   595us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:21.202369 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:28:21.202391 (+    22us) tablet.cc:662] Decoding operations
0709 12:28:21.220146 (+ 17755us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:21.220238 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:21.220274 (+    36us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:28:21.233597 (+ 13323us) tablet.cc:701] Row locks acquired
0709 12:28:21.233619 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:28:21.233769 (+   150us) write_op.cc:270] Start()
0709 12:28:21.233890 (+   121us) write_op.cc:276] Timestamp: P: 1783600101233719 usec, L: 0
0709 12:28:21.233909 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:28:21.234599 (+   690us) log.cc:844] Serialized 5917 byte log entry
0709 12:28:21.267456 (+ 32857us) op_driver.cc:464] REPLICATION: finished
0709 12:28:21.278345 (+ 10889us) write_op.cc:301] APPLY: starting
0709 12:28:21.278436 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:21.289628 (+ 11192us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b18003ffe20. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8e0c44bc 00007f2f8b41248b 00007f2f9426c9a9 00007f2f8b42e69b 00007f2f8b42c93f 00007f2f8b42ec02 00007f2f91f52ef0 00007f2f91f53489 00007f2f91f5571a
0709 12:28:21.325059 (+ 35431us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:21.325096 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:21.369217 (+ 44121us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:21.369489 (+   272us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 12:28:21.369537 (+    48us) write_op.cc:312] APPLY: finished
0709 12:28:21.369896 (+   359us) log.cc:844] Serialized 139 byte log entry
0709 12:28:21.378439 (+  8543us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:21.378613 (+   174us) write_op.cc:454] Released schema lock
0709 12:28:21.378672 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:21.401599 (+ 22927us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:21.402266 (+   667us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":485868,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":2885,"apply.run_cpu_time_us":20569,"apply.run_wall_time_us":128390,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66767,"num_ops":15,"prepare.queue_time_us":27154,"prepare.run_cpu_time_us":4814,"prepare.run_wall_time_us":64592,"replication_time_us":33377,"spinlock_wait_cycles":2880384,"thread_start_us":47462,"threads_started":2}]]}
I20260709 12:28:24.484539 15577 consensus_queue.cc:1059] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:28:24.500286 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:24.501627 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:24.507515 10525 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:24.510166  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.469727 15612 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:24.529265 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:24.466259 15614 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:24.515818 10525 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:24.516520 10496 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:24.518214  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbfc8e9bdb244a4c8679e7585cce700c" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:24.520718  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:24.532009 10527 raft_consensus.cc:1240] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 10. Current term is 11. Ops: []
I20260709 12:28:24.531880  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.485759 15597 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:24.530151  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:24.530107  9853 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:24.506790 15567 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:24.539711 15596 consensus_queue.cc:1059] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:28:24.549685 15596 raft_consensus.cc:3055] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:28:24.550060 15596 raft_consensus.cc:740] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:24.550470 15563 consensus_queue.cc:1059] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:28:24.550940 15596 consensus_queue.cc:260] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:24.529986 15592 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:24.546268 15598 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:24.546514 15617 consensus_queue.cc:1059] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:28:24.552286 15596 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:24.552728 15617 raft_consensus.cc:3055] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:28:24.553089 15617 raft_consensus.cc:740] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:24.548030 15593 consensus_queue.cc:1059] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:28:24.548803  9808 raft_consensus.cc:1240] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:24.539631 15606 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:24.551523 15577 raft_consensus.cc:3055] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:28:24.507795 15574 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:24.515717 15571 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:28:24.557765  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 207888us
I20260709 12:28:24.558570  9928 leader_election.cc:304] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:24.559060  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.561642  9955 raft_consensus.cc:1240] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:24.562254 10531 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:24.507434 15618 consensus_queue.cc:1059] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:28:24.566618  9812 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:24.569065  9812 raft_consensus.cc:606] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:24.569407  9812 raft_consensus.cc:614] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:24.567663  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.554944 15609 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:24.556900 15577 raft_consensus.cc:740] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:24.560643 15611 raft_consensus.cc:3055] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:28:24.578598 10531 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 14.
I20260709 12:28:24.553856 15617 consensus_queue.cc:260] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.581686  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.585294  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
W20260709 12:28:24.587780 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 50822.8us
I20260709 12:28:24.588766  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:24.589386 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:24.655822  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78f05fa6f4406a81716ded4d302aee" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.655963 10530 raft_consensus.cc:1240] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 18 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 17. Current term is 18. Ops: []
W20260709 12:28:24.656073 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 66755.2us
I20260709 12:28:24.656914  9854 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:24.571693 15609 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:24.564074 15591 consensus_queue.cc:1059] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 12:28:24.664798 10496 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:24.659587  9854 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:28:24.661821  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:24.580163 15611 raft_consensus.cc:740] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
W20260709 12:28:24.672097  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 83405.7us
W20260709 12:28:24.703078 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:24.703490  9853 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:24.704000 15600 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:24.704517 15600 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:24.704928 15600 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:24.707237 15636 raft_consensus.cc:2749] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:24.707536  9853 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:24.709878 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:24.718784  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 163644us
I20260709 12:28:24.748296  9779 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:28:24.748742 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 84007.5us
W20260709 12:28:24.714538  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 55008.8us
I20260709 12:28:24.749504 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:28:24.753865  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 198944us
I20260709 12:28:24.589901 15628 raft_consensus.cc:2764] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 12:28:24.755072  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:24.661525 15573 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:24.750209  9854 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:24.665591 15617 raft_consensus.cc:3060] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:24.765116  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:24.665890 15609 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:24.783546  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:24.788123  9955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5bdaeb6ccf347499e2dff26efaf7deb"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:24.701293 15569 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:24.665431 15579 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:24.701967 15629 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:24.746703 15618 raft_consensus.cc:3055] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:24.806766  9955 raft_consensus.cc:606] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:24.813244  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:24.767515 15592 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:28:24.814036  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:24.816934  9955 raft_consensus.cc:614] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:28:24.794689 15620 log.cc:927] Time spent T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:28:24.814706  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:24.815258  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:24.815323  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:24.790503 15573 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:28:24.826181  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 77998.6us
I20260709 12:28:24.830853  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:24.807891 15636 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:24.840744  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:24.816828 15618 raft_consensus.cc:740] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:24.840553 15632 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:28:24.832283 15573 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:24.831230 15571 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:28:24.833808 15579 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:24.754529 15577 consensus_queue.cc:260] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:24.867268  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 158302us
I20260709 12:28:24.868376  9853 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:28:24.871255 15626 log.cc:927] Time spent T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 12:28:24.874239  9853 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:24.856134 15642 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:24.880445 15642 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:24.882846 15642 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:24.883575 15624 log.cc:927] Time spent T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 12:28:24.883570 15577 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:24.853339 15606 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:24.894994 15573 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.911422 15573 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:24.913810  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.914531  9964 raft_consensus.cc:2393] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 12: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:24.914831 15605 consensus_queue.cc:1059] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:24.915462  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:24.916360 15582 raft_consensus.cc:3055] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:24.916796 15582 raft_consensus.cc:740] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:24.917186 15572 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:28:24.918254  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 44098.3us
I20260709 12:28:24.920617 15593 raft_consensus.cc:3055] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:24.920986 15593 raft_consensus.cc:740] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:24.920945  9853 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:24.886035 15618 consensus_queue.cc:260] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:24.892830 15580 raft_consensus.cc:3055] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:24.922685 15580 raft_consensus.cc:740] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:24.857551 15579 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:28:24.904166 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:24.818740 15611 consensus_queue.cc:260] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.904989 15640 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:28:24.916232 15631 consensus_queue.cc:1059] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:28:24.923920 15568 consensus_queue.cc:1059] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:28:24.924376 15631 consensus_queue.cc:1243] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer f5208640a51f493e930ce4f64ceeed0b log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:28:24.924657 15568 consensus_queue.cc:1243] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer f5208640a51f493e930ce4f64ceeed0b log is divergent from this leader: its last log entry 17.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:28:24.917815 15582 consensus_queue.cc:260] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.927436 15582 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:24.921939 15593 consensus_queue.cc:260] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:24.929013 15579 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:24.923070 15618 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:24.889470 15584 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.934378  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:24.934640  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:24.941126 15584 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:24.941586 15600 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.939426  9928 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:28:24.947891 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 198433us
I20260709 12:28:24.950090 10496 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:24.950865 15584 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:28:24.952162 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:24.952818 15581 raft_consensus.cc:3055] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:28:24.953224 15581 raft_consensus.cc:740] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:24.954303 15581 consensus_queue.cc:260] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.955469 15581 raft_consensus.cc:3060] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:24.953167 15584 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:28:24.959438 10496 leader_election.cc:304] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:24.960319 15567 raft_consensus.cc:2804] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:28:24.960948 15567 raft_consensus.cc:697] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 18 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:24.961287 15611 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:24.962003 15567 consensus_queue.cc:237] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.936369 15632 raft_consensus.cc:697] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:24.974969 15612 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.977154 15612 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:24.978559 15580 consensus_queue.cc:260] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:24.984766 15579 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:24.970847 15588 consensus_meta.cc:287] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.000s
I20260709 12:28:24.986897 15579 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:24.986932 15600 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:25.024221  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 274198us
W20260709 12:28:25.024749  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 194887us
I20260709 12:28:25.026093  9854 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:25.031391  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 110343us
W20260709 12:28:25.024212  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 204693us
I20260709 12:28:25.032953  9853 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:25.034185  9854 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:25.039727  9811 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:28:25.040973  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:25.047283  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:25.060374  9888 raft_consensus.cc:1240] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 16. Current term is 17. Ops: []
I20260709 12:28:25.062986  9956 raft_consensus.cc:1275] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:28:25.063365  9963 raft_consensus.cc:1275] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:28:25.066208 15572 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:25.066870 15572 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:25.067420 15572 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:25.070677 15579 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:28:25.080778  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:25.081395 15615 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:25.082615 15611 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
W20260709 12:28:25.084848  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 145367us
I20260709 12:28:25.084203 15611 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:25.091593 10526 raft_consensus.cc:1240] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:25.093719 10527 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:25.094332  9886 raft_consensus.cc:1240] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:25.080462 15600 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:28:25.104763  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:25.106094 15580 raft_consensus.cc:3060] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:25.104756  9963 raft_consensus.cc:1240] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:25.108490 15611 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:25.079027  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:25.080714 15609 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:25.126617 15584 consensus_queue.cc:1048] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:28:25.128981 15584 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:28:25.130496 15596 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:25.124228 15582 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:28:25.136030 15609 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:25.142094  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:25.143357 15593 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:24.990546 15632 consensus_queue.cc:237] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:25.150068  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:25.145809 15649 consensus_queue.cc:1048] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:28:25.152200 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:25.152696 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:25.155273  9811 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:28:25.162752  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:25.164548 15573 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:28:25.167868  9928 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:25.168643 15631 consensus_queue.cc:1059] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:28:25.170708  9963 raft_consensus.cc:1240] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 17. Current term is 18. Ops: []
I20260709 12:28:25.179314  9955 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:28:25.179448 15605 raft_consensus.cc:3055] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:28:25.179872 15605 raft_consensus.cc:740] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:25.187175  9808 raft_consensus.cc:1240] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:25.181165 15605 consensus_queue.cc:260] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:25.190964 15605 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:25.194459 15618 consensus_queue.cc:1059] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
W20260709 12:28:25.201347  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 169614us
I20260709 12:28:25.201560 15618 raft_consensus.cc:3055] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:28:25.198799 10525 raft_consensus.cc:2468] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:28:25.216678 15648 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 12:28:25.218421 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:25.202364 15618 raft_consensus.cc:740] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:25.228585  9889 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:28:25.236878  9882 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:28:25.237397  9806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:25.238174  9806 raft_consensus.cc:606] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:25.232213  9854 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:25.210234 15573 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:28:25.255722 10527 raft_consensus.cc:2468] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:28:25.256470 15612 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:28:25.258462 15609 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:25.258854 15609 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting leader election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:25.259212 15609 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:25.263273  9779 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: b011791796d1457284b857d7d3422195
W20260709 12:28:25.264981  9779 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.8.111.66:34205 timed out after 1.527s (SENT) [suppressed 2 similar messages]
I20260709 12:28:25.266685  9812 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
W20260709 12:28:25.270695  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 223667us
I20260709 12:28:25.288484  9813 raft_consensus.cc:1275] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:28:25.290262  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 58241.3us
I20260709 12:28:25.291370  9854 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:25.292805 15618 consensus_queue.cc:260] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:25.294521 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:25.294616 15618 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:25.296803 10526 raft_consensus.cc:1240] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 20 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 19. Current term is 20. Ops: []
I20260709 12:28:25.283147 15572 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:25.298558 10527 raft_consensus.cc:1240] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 17. Current term is 18. Ops: []
I20260709 12:28:25.300256 15582 consensus_queue.cc:1059] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:28:25.301172 15582 consensus_queue.cc:1243] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Peer 4104e34a61b7448281d6d91ce23ebf71 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:28:25.302140 15585 raft_consensus.cc:3055] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:28:25.302563 15585 raft_consensus.cc:740] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:25.302935 15572 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:25.303647 15585 consensus_queue.cc:260] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:25.313249  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:25.316632 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:25.322400  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 57435.6us
W20260709 12:28:25.323448 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:25.316373 15593 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:25.318994 15572 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:25.325489  9959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:53218
W20260709 12:28:25.326960  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 159270us
I20260709 12:28:25.327348  9959 raft_consensus.cc:606] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:25.324687 15580 consensus_queue.cc:1059] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:28:25.359238 15593 raft_consensus.cc:697] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:25.361449  9853 leader_election.cc:304] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:25.367229 15593 consensus_queue.cc:237] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:25.369887 15585 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:25.374346 15573 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:25.374990 15573 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:25.375334 15641 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:25.376283 15641 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:25.379787 15652 consensus_queue.cc:1059] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 12:28:25.380331 15641 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:25.387287  9929 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:25.360504 15598 consensus_queue.cc:1048] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:28:25.396812  9779 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:25.398510 15581 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:25.407260  9812 raft_consensus.cc:1275] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:28:25.407717  9812 pending_rounds.cc:85] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71: Aborting all ops after (but not including) 12
I20260709 12:28:25.407953  9812 pending_rounds.cc:107] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:28:25.408217  9812 raft_consensus.cc:2889] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:25.411600  9928 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:28:25.412784  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 49554.4us
I20260709 12:28:25.414476 15612 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:28:25.413988  9928 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:25.377947 15573 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:25.420007 15606 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:28:25.421391 15605 raft_consensus.cc:3055] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:28:25.421821 15605 raft_consensus.cc:740] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:25.419013 15572 raft_consensus.cc:2749] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:28:25.425001  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 103099us
I20260709 12:28:25.419116 15598 consensus_queue.cc:1048] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 12:28:25.427192  9853 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:28:25.427567  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 53695.1us
I20260709 12:28:25.428819 15572 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:28:25.429986 15656 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:28:25.430457  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 139278us
I20260709 12:28:25.432106  9854 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:25.434038  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:25.434792 15596 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:25.435191 15596 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:25.435603 15596 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:25.437887 15605 consensus_queue.cc:260] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:25.439491 15605 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:28:25.439962  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:25.430469 15656 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:25.444088 15656 raft_consensus.cc:3060] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:25.448043 15653 raft_consensus.cc:3055] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:28:25.448547 15653 raft_consensus.cc:740] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:25.433960 15579 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:28:25.460151 15662 log.cc:927] Time spent T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:28:25.449643 15653 consensus_queue.cc:260] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:25.462154  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 48338.3us
I20260709 12:28:25.471690 15609 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:25.476411 15653 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:25.478935  9927 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:25.479974 15582 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:25.480777 15582 raft_consensus.cc:697] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:25.481832 15582 consensus_queue.cc:237] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:25.485185  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 58165.9us
W20260709 12:28:25.487511  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 44217.4us
I20260709 12:28:25.474239 15609 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:25.506470  9854 leader_election.cc:304] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:25.513181  9854 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:25.515107 15600 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:28:25.515803 15585 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:25.511096  9853 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:25.515156 15654 raft_consensus.cc:2749] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:25.516399 15585 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:25.521994 15585 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:25.523802  9853 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:28:25.526798  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 47976.7us
I20260709 12:28:25.524550 15573 consensus_queue.cc:1059] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:28:25.539116  9808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:25.539716  9808 raft_consensus.cc:606] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:25.540096  9808 raft_consensus.cc:614] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:25.542204  9854 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:25.538197 15572 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:25.537118 15609 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:25.554894  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:28:25.527736 15606 consensus_queue.cc:1059] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:28:25.531545 15585 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:28:25.562083  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:25.547808 15656 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:25.556602 15600 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:25.553201 15572 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:25.594689  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:25.596159  9928 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:25.614390 15609 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:25.614910 15609 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:25.615293 15609 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:28:25.623632  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:25.624595  9959 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:28:25.626259  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 67905.7us
I20260709 12:28:25.627071  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:25.628265 15654 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:25.628434  9853 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:25.628713 15654 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:25.629124 15654 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:25.629925  9853 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:25.630487 15579 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:25.631453 15645 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:28:25.568024 15572 raft_consensus.cc:3060] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:25.641561 15606 raft_consensus.cc:3055] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:28:25.645870  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:25.647974 15596 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:25.649569  9854 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:25.655627 15656 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:25.655627 15606 raft_consensus.cc:740] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:25.649501 15654 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:25.702000  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 169725us
W20260709 12:28:25.704535  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 47376.3us
I20260709 12:28:25.692049 15585 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:28:25.709630  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:25.711489  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:25.713894  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:25.695734 15579 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:28:25.721217  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 91407.8us
I20260709 12:28:25.720501  9808 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
W20260709 12:28:25.747673  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 98288.8us
I20260709 12:28:25.760851 15657 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:25.761711 15596 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:25.762470  9853 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:25.764581  9853 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:25.767051 15596 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:25.770539 15656 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:25.770607  9854 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:25.773402  9854 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:25.774413 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 172123us
I20260709 12:28:25.779930 15579 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:25.780831 15579 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:28:25.782727 15665 log.cc:927] Time spent T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:28:25.786602 15606 consensus_queue.cc:260] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:25.788498 15606 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:25.727275  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:25.748858 15645 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:25.810009 10499 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:25.815095 15569 raft_consensus.cc:3055] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:25.821381 15654 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:25.826567  9780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:25.837759 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 54067.3us
W20260709 12:28:25.855732  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 95006us
I20260709 12:28:25.862709 10526 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:28:25.842978 15569 raft_consensus.cc:740] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:25.866882 15569 consensus_queue.cc:260] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:25.868287 15569 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:25.865864  9955 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:28:25.864946 15645 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:25.880098  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
W20260709 12:28:25.881605 10498 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:25.880883  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:25.882332  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:25.881098  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:25.899907  9806 raft_consensus.cc:2468] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
I20260709 12:28:25.885957 15572 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:25.915235  9927 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:25.927497 15677 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:25.927986 15677 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:25.928334 15677 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:25.933830 15593 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 12:28:25.911103 15609 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:25.935326 15584 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:28:25.937283 15609 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:25.937953 15573 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:25.938550 15573 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:25.940683  9813 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 16.
I20260709 12:28:25.941195 15573 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:25.949071 15593 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:25.949723 15593 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:25.952966  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:25.955689 15593 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:25.955691  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 182431us
I20260709 12:28:25.955946  9964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:25.959421  9964 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 16.
I20260709 12:28:25.964011  9853 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:25.907459 15656 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:25.968554  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:25.969151  9812 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 17.
I20260709 12:28:25.966722  9853 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:25.964689 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:25.974115 10531 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:28:25.976586  9956 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:28:25.971109 15579 raft_consensus.cc:2804] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:25.984299 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:25.975493 15609 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:25.989264  9707 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59972 (request call id 308) took 5025 ms. Trace:
I20260709 12:28:25.987493  9778 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:25.991703  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:25.995648 10525 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:25.994907 15618 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:25.997557 15618 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:25.997830  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:25.998016 15618 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:25.995215 15609 raft_consensus.cc:697] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 16 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:25.999330 15609 consensus_queue.cc:237] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:25.994788 15605 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
W20260709 12:28:25.997648 15666 log.cc:927] Time spent T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:28:25.983668 15645 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:25.990031 15579 raft_consensus.cc:697] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 14 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:26.016264  9927 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:26.019550  9928 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:26.027690 15605 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:28:26.033355  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:26.033756 15674 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:26.034523  9779 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:26.050716  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:26.034266 15674 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:26.052439 15645 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:26.055814 15674 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:26.062685 15679 raft_consensus.cc:2804] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:26.067090 15679 raft_consensus.cc:697] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:26.068004 15679 consensus_queue.cc:237] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.072930 15680 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:28:26.081391 15572 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:26.082647  9928 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:26.082297 15579 consensus_queue.cc:237] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:26.089023  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:28:26.092473  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:25.989688  9707 rpcz_store.cc:276] 0709 12:28:20.963280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:20.963435 (+   155us) service_pool.cc:224] Handling call
0709 12:28:25.986117 (+5022682us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:24.704103 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:24.704727 (+   624us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:24.704780 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:28:24.704807 (+    27us) tablet.cc:662] Decoding operations
0709 12:28:24.706579 (+  1772us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:24.706686 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:24.706736 (+    50us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:28:24.707842 (+  1106us) tablet.cc:701] Row locks acquired
0709 12:28:24.707861 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:28:24.708015 (+   154us) write_op.cc:270] Start()
0709 12:28:24.708129 (+   114us) write_op.cc:276] Timestamp: P: 1783600104707960 usec, L: 0
0709 12:28:24.708149 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:28:24.708876 (+   727us) log.cc:844] Serialized 5875 byte log entry
0709 12:28:24.930055 (+221179us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b1800336ac0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f3f3 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:28:24.990793 (+ 60738us) op_driver.cc:464] REPLICATION: finished
0709 12:28:24.992370 (+  1577us) write_op.cc:301] APPLY: starting
0709 12:28:25.076369 (+ 83999us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:25.173394 (+ 97025us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:25.173431 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:25.553864 (+380433us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:25.567272 (+ 13408us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=0,mrs_lookups=0
0709 12:28:25.567337 (+    65us) write_op.cc:312] APPLY: finished
0709 12:28:25.637479 (+ 70142us) log.cc:844] Serialized 139 byte log entry
0709 12:28:25.637824 (+   345us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:25.638231 (+   407us) write_op.cc:454] Released schema lock
0709 12:28:25.638357 (+   126us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:25.639116 (+   759us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:25.639151 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2865818,"reported_tablets":29,"spinlock_wait_cycles":5376,"child_traces":[["op",{"apply.queue_time_us":1288,"apply.run_cpu_time_us":27839,"apply.run_wall_time_us":646646,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66767,"num_ops":15,"prepare.queue_time_us":147873,"prepare.run_cpu_time_us":6041,"prepare.run_wall_time_us":84264,"raft.queue_time_us":47446,"raft.run_cpu_time_us":1584,"raft.run_wall_time_us":1585,"replication_time_us":282481,"spinlock_wait_cycles":11076352,"thread_start_us":247371,"threads_started":4,"wal-append.queue_time_us":93462}]]}
I20260709 12:28:26.087863 15678 raft_consensus.cc:2804] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:26.102763 15678 raft_consensus.cc:697] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:28:26.102978 15684 log.cc:927] Time spent T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:28:26.103770 15678 consensus_queue.cc:237] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.106752 15677 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:26.126955  9810 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 18.
I20260709 12:28:26.128154 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:26.128290  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.128840 10525 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:26.129890  9882 raft_consensus.cc:1240] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 16. Current term is 17. Ops: []
I20260709 12:28:26.131040 10497 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:26.133049  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:26.134680 15574 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:26.133515 10497 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:26.142820 10525 raft_consensus.cc:2468] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 13.
I20260709 12:28:26.148500 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:26.149317 10530 raft_consensus.cc:2393] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 17: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:26.150151  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.153895 15654 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:28:26.156944 15654 raft_consensus.cc:697] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 18 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:26.157902 15654 consensus_queue.cc:237] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:26.152858 15618 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.169013  9886 raft_consensus.cc:1275] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:28:26.173280 15596 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:26.175654 10497 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:26.176975 15574 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:26.177724 15649 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:26.178136 15649 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:26.178579 15649 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:26.179134  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:26.177074 10497 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:26.186196 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:26.186823 10526 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:26.188511 15567 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:26.189244 15677 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:26.179649 15618 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:26.224524  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:26.225337  9806 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:26.221999 15605 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.235667 10497 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:26.239225 10526 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 18.
I20260709 12:28:26.248624  9806 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
W20260709 12:28:26.255304  9778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:26.255401 15653 raft_consensus.cc:993] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:26.256124 15653 raft_consensus.cc:1081] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:26.256229 15584 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:28:26.268687 15674 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.269820  9963 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:26.272473  9779 leader_election.cc:304] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:26.253441  9927 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:26.279538  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:26.280380 10531 raft_consensus.cc:1240] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:26.281525 10524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:26.282579 10529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:26.282974 10531 raft_consensus.cc:1217] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 18 LEADER]: Deduplicated request from leader. Original: 16.13->[17.14-17.14]   Dedup: 17.14->[]
I20260709 12:28:26.283313  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:26.283464 10531 raft_consensus.cc:1240] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 18 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:28:26.283924 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:26.285534 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:26.286569 15605 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:26.289680 15605 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:26.295095 15679 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:26.295833  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:26.296928  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:26.297216  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:26.298067  9961 raft_consensus.cc:2393] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 14: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:26.298761  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:26.298862  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:26.299620  9960 raft_consensus.cc:2393] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 18: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:26.299947  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:26.300557  9957 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:26.301759  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:26.302734  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:26.306840 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:26.277686 15653 raft_consensus.cc:2749] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:28:26.304366 15680 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:26.343451 15680 raft_consensus.cc:697] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:26.344369 15680 consensus_queue.cc:237] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:26.324401  9964 raft_consensus.cc:1217] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Deduplicated request from leader. Original: 16.13->[17.14-17.14]   Dedup: 17.14->[]
I20260709 12:28:26.324935  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:26.332794  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:26.351039  9964 raft_consensus.cc:1240] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:28:26.332891  9961 raft_consensus.cc:1240] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 9. Current term is 10. Ops: []
I20260709 12:28:26.333714  9958 raft_consensus.cc:1240] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:26.295641 15679 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.324185  9957 raft_consensus.cc:1240] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:26.345824 15674 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:26.348817  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:26.352610  9813 raft_consensus.cc:2368] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 17. Current term is 18.
I20260709 12:28:26.352670  9956 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:28:26.349115  9959 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 17.
I20260709 12:28:26.347242 15649 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.324864  9778 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:28:26.349763 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 121289us
I20260709 12:28:26.350570  9963 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 18.
I20260709 12:28:26.347993  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:26.355144  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.356703  9927 leader_election.cc:400] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 17. Current term is 18.
I20260709 12:28:26.357043  9927 leader_election.cc:403] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:28:26.359965  9955 raft_consensus.cc:2393] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 16: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:26.361120 15656 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:28:26.361337 15582 raft_consensus.cc:2749] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 17. Current term is 18.
I20260709 12:28:26.361593  9888 raft_consensus.cc:3055] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:28:26.361989  9888 raft_consensus.cc:740] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:26.362756  9888 consensus_queue.cc:260] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.363678  9888 raft_consensus.cc:3060] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:26.366806 15679 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:26.367985  9928 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:26.371408 10526 raft_consensus.cc:1240] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 12. Current term is 13. Ops: []
I20260709 12:28:26.371549 15606 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:28:26.378635  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 104935us
I20260709 12:28:26.382117  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.384651 10526 raft_consensus.cc:1240] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:26.381685 15678 consensus_queue.cc:1059] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 12:28:26.385841  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.387413 15673 raft_consensus.cc:993] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:26.388021 15673 raft_consensus.cc:1081] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:26.390748 15569 consensus_queue.cc:1048] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:26.393146  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.394928  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.395586  9886 raft_consensus.cc:2393] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 17: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:26.396360  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.397100  9882 raft_consensus.cc:2393] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 15: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:26.397799  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.398414  9882 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 17.
I20260709 12:28:26.398723  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.399446  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.382186  9779 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:26.400128  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.400341 15606 raft_consensus.cc:3055] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:28:26.400753 15606 raft_consensus.cc:740] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:26.409818  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.417203 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:26.418063 10528 raft_consensus.cc:2393] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 13: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:26.418316  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.418927  9886 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
I20260709 12:28:26.419291  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.419792  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.417392 15606 consensus_queue.cc:260] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.420411  9881 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 18.
I20260709 12:28:26.420877  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.421144 15606 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:26.423265 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:26.423965 10526 raft_consensus.cc:2368] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 17. Current term is 18.
I20260709 12:28:26.425330 15632 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:26.425763 15632 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:26.426024  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.429487  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.435477  9928 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:26.410689 15605 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:28:26.427627 15653 consensus_queue.cc:1059] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:28:26.437879  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.438568  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.438999  9885 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:57652
I20260709 12:28:26.440687  9885 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:26.440734  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7dd9ecad304177bbefcb8725c66393" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.441115  9885 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:26.441478  9806 raft_consensus.cc:1240] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:26.442185  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.443353  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a47692d74f884d019a3ec583399bdb4c" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.426116 15632 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:26.443183 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:26.447835 10530 raft_consensus.cc:2393] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 16: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:26.448627  9888 raft_consensus.cc:1275] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 12:28:26.449184  9888 pending_rounds.cc:85] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 13
I20260709 12:28:26.449541  9888 pending_rounds.cc:107] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 12:28:26.449874  9888 raft_consensus.cc:2889] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:26.452023  9779 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:26.453536 15605 raft_consensus.cc:697] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 18 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:26.454198 10527 raft_consensus.cc:1240] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:26.455170 15697 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:26.458578  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.459151  9889 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:26.461015  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27b8e99a0274a2791f902106d779c23" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.462419 15674 raft_consensus.cc:2804] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:26.462706  9779 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:26.463008 15674 raft_consensus.cc:697] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:26.464025 15674 consensus_queue.cc:237] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.465597  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.466351  9890 raft_consensus.cc:2393] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 14: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:26.466501 15697 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.467128  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af001ec909824ed199d355fd69f43ede" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.467025 15697 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.468315  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ebec313878e48e88fcec9daadd369b9" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.469391  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:28:26.469707  9930 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:26.452394 15654 consensus_queue.cc:1059] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:28:26.472489 15654 raft_consensus.cc:3055] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:28:26.472837 15654 raft_consensus.cc:740] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:26.473212  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.473886  9887 raft_consensus.cc:2468] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:28:26.474136 15645 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:26.474807  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.462182  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.477542  9853 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:26.481509  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.479826 10497 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:26.487371  9887 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:26.454653 15605 consensus_queue.cc:237] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.488989  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:26.469339 15697 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:26.488644  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.495671  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e55138bc5c8b46a1a4b5408bb8a06868" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.490775  9854 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:26.491802  9960 raft_consensus.cc:1240] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:26.492597 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:26.501564  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 72403.7us
I20260709 12:28:26.510582  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.473667 15654 consensus_queue.cc:260] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.513563 15700 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:28:26.514190  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ffb5c0a23894c12bb5bd0d73c289106" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.519081  9887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:57658
I20260709 12:28:26.520866  9887 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:26.521411  9887 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:26.500509 15609 consensus_queue.cc:1059] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:28:26.489032 15579 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:26.524482 15654 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:26.519425 15572 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:28:26.531484  9888 raft_consensus.cc:1240] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 11. Current term is 12. Ops: []
W20260709 12:28:26.532407 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 52664.6us
I20260709 12:28:26.533228 10497 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:26.534353 15700 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:26.483650 15596 consensus_queue.cc:1059] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:28:26.540792 10497 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:26.541285 15649 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:26.541931 15649 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:26.542405 10525 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 16.
I20260709 12:28:26.536257  9885 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:26.547205  9885 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:26.547524  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:26.545230  9887 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.542022 10497 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:26.549364  9887 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:26.537895  9853 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:26.558488 15579 raft_consensus.cc:697] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 10 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:26.559139  9928 leader_election.cc:400] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 17. Current term is 18.
I20260709 12:28:26.561781 15584 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:26.564039  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:26.565686 15678 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:26.569293  9806 raft_consensus.cc:1275] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:28:26.579648  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 89211.9us
I20260709 12:28:26.581139 15704 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:28:26.581712 15704 raft_consensus.cc:697] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 17 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:26.581655 15593 raft_consensus.cc:3055] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:26.582715 15704 consensus_queue.cc:237] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.583273 15593 raft_consensus.cc:740] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:26.585862 15703 consensus_queue.cc:1059] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:26.587430  9779 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:26.591773 15678 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:26.593538 15596 raft_consensus.cc:3055] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:28:26.593959 15596 raft_consensus.cc:740] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:26.594897 15596 consensus_queue.cc:260] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:26.597787 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 55845.4us
I20260709 12:28:26.598652 10497 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:26.599548 15648 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:26.599956 15648 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:26.600351 15648 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:26.601336 15697 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:26.601750 15697 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:26.602077 15697 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:26.604848 15596 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:26.617496 10497 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:26.584158 15593 consensus_queue.cc:260] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.623348 15593 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:26.620609 10525 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:28:26.617501 15598 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:26.627951 15632 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:26.628813 15671 consensus_queue.cc:1048] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:28:26.593791 15656 raft_consensus.cc:3055] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:26.631407 15656 raft_consensus.cc:740] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:26.632548 15656 consensus_queue.cc:260] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.635708 15574 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:26.636543 15606 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:26.637084 15606 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.637593 15572 raft_consensus.cc:3055] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:26.638171 15572 raft_consensus.cc:740] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:26.639369 15572 consensus_queue.cc:260] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.654503 15598 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.655814 15632 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:26.656664  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 141837us
I20260709 12:28:26.658186  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:26.659536 15584 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:26.634155 15656 raft_consensus.cc:3060] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:28:26.661159  9856 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:26.656914 15606 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:26.664324  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:26.656914 15598 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:26.665203 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 58065.6us
I20260709 12:28:26.681859 10497 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:26.684598  9960 raft_consensus.cc:2393] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 17: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:26.666600  9854 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:26.669675 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:26.687394 10525 raft_consensus.cc:2393] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 16: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:26.700162  9883 raft_consensus.cc:1275] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:28:26.670347 15618 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:26.700518 10533 raft_consensus.cc:1240] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:26.702215  9854 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:26.711112  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 126752us
I20260709 12:28:26.713635  9883 raft_consensus.cc:3060] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:26.685576 15671 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:26.704788 15654 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:28:26.727196  9712 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59986 (request call id 335) took 12168 ms (client timeout 15000 ms). Trace:
W20260709 12:28:26.727339  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 112256us
W20260709 12:28:26.727672  9712 rpcz_store.cc:269] 0709 12:28:14.559022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:14.559402 (+   380us) service_pool.cc:224] Handling call
0709 12:28:26.726990 (+12167588us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":439951,"reported_tablets":47}
W20260709 12:28:26.732292  9779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:26.736928  9854 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:26.715687 15574 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:26.701722 15606 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:28:26.700958 15618 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.741714 10528 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:28:26.728574 15598 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:26.751667 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 69895.7us
I20260709 12:28:26.754246 10497 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:26.741039 15654 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:28:26.720157 15605 consensus_queue.cc:1059] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:28:26.779904 15567 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:26.780464 15605 raft_consensus.cc:3055] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:28:26.780844 15605 raft_consensus.cc:740] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:26.764130 15598 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.764143 15612 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:28:26.783039 15598 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:26.755561 15677 consensus_queue.cc:1048] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:28:26.740160 15671 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.778959 15618 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:26.779346 10497 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:26.779596 15708 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:28:26.788900 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:26.781688 15605 consensus_queue.cc:260] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.800149  9883 raft_consensus.cc:1275] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:28:26.799371 10528 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 18.
I20260709 12:28:26.805115  9779 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:26.806203 15618 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:28:26.806614 15618 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:26.806962 15618 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:28:26.807997  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 94627us
W20260709 12:28:26.809341  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 72517.6us
I20260709 12:28:26.810591  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:26.811321  9955 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 19.
I20260709 12:28:26.753641 15697 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:26.815541  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 87495.9us
I20260709 12:28:26.818436  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:26.819229  9806 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 20.
I20260709 12:28:26.811611 15584 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:26.751284 15579 consensus_queue.cc:237] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.828193  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:26.830113 10496 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:26.830976 10497 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:26.831388 15671 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:26.834518 15574 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:28:26.834811 15697 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:26.834975 15574 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:26.835427 15574 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:28:26.821524 15584 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:26.837761 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:26.842123 10528 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:26.837707  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:26.842869  9810 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 20.
I20260709 12:28:26.840405  9813 raft_consensus.cc:2368] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 16. Current term is 17.
I20260709 12:28:26.836468  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:26.848016  9883 raft_consensus.cc:1240] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:26.848218  9960 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:26.844631  9927 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:26.823897 15605 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:26.851389 15579 consensus_queue.cc:1059] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:28:26.851897  9808 raft_consensus.cc:1275] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:28:26.855332 15702 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:28:26.854708 15678 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:28:26.859124 15648 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:26.870319  9855 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:28:26.870697 15649 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:26.871995 15648 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:26.872184 15678 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:26.872603 15678 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:28:26.872640  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 58688.5us
I20260709 12:28:26.862035 15702 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:26.875759 15702 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:26.876260  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "511405268634431e9bf729e0fc87c838" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:26.878513 15712 consensus_queue.cc:1059] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:26.879026  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:26.879282 15712 consensus_queue.cc:1243] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [LEADER]: Peer b011791796d1457284b857d7d3422195 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:28:26.879717  9888 raft_consensus.cc:2393] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 14: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:26.880254 15712 raft_consensus.cc:3055] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:26.880646 15712 raft_consensus.cc:740] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:26.881043  9882 raft_consensus.cc:1240] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:26.881521 15712 consensus_queue.cc:260] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:26.882804  9883 raft_consensus.cc:2468] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 18.
I20260709 12:28:26.883142 15579 raft_consensus.cc:3055] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:28:26.883538 15579 raft_consensus.cc:740] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:26.884347 15579 consensus_queue.cc:260] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.885654 15579 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:26.888058  9779 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:26.888782  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:26.889019 15707 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:26.889288  9779 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:26.850646 15584 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:26.862174  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:26.895350  9963 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:28:26.897615 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:26.900622 10533 raft_consensus.cc:2393] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 14: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:26.899396  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:26.904136 15719 consensus_queue.cc:1048] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:28:26.899410 15593 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:28:26.897217 15678 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.902979 15712 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:26.908875 15702 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.917202  9779 leader_election.cc:304] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:26.920499 15572 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:26.924878 15702 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 19 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:26.927488  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:26.936008 10528 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
W20260709 12:28:26.947685  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 44193.4us
I20260709 12:28:26.948464  9779 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
W20260709 12:28:26.949074 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 45475.8us
I20260709 12:28:26.951541  9779 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:26.952734  9779 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:26.953356 15593 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:26.946468 15707 raft_consensus.cc:2749] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:26.954319 15653 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:26.961282  9779 leader_election.cc:304] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:26.979175  9779 leader_election.cc:304] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:26.956806 15593 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:26.982923  9963 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:26.989871  9778 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:26.991186 15678 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:26.993332 10497 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:26.983800  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:26.994829 15605 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:28:26.995752 15707 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:26.996305  9779 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:26.996770 15700 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:28:26.997329 15697 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:26.997529  9779 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:26.998457 15716 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:26.999037 15605 raft_consensus.cc:697] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:26.999969 15605 consensus_queue.cc:237] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:27.001174 15700 consensus_queue.cc:1059] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:28:26.978267 15645 raft_consensus.cc:2749] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:27.001493  9887 raft_consensus.cc:1240] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:27.003043 15598 raft_consensus.cc:3055] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:28:27.003423 15598 raft_consensus.cc:740] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:27.004278 15598 consensus_queue.cc:260] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.988164  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:27.011313  9890 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:26.985010  9960 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 18.
I20260709 12:28:27.028807 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:27.034999  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:27.035179  9778 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:26.987978 15584 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.954967 15618 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:27.056511 15618 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 19 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:27.049933  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:27.058622  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:27.059051  9779 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:27.059170 15645 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:27.059655 15645 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:27.059791  9887 raft_consensus.cc:1275] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:28:27.060079 15645 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:27.060467  9779 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:27.061693  9779 leader_election.cc:304] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:27.062427 15697 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:27.063561 15697 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:27.064208 15697 raft_consensus.cc:2749] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:28:26.976363 15574 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:26.985212 15653 raft_consensus.cc:2749] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:27.067833 15574 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 21 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:27.059171  9963 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:28:27.070492 10497 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:27.070588  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:27.051542 15584 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:27.074262  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:27.068624 15645 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:27.076601 15585 consensus_queue.cc:1048] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:28:27.079226 10533 raft_consensus.cc:2368] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 20. Current term is 21.
I20260709 12:28:27.074875  9927 leader_election.cc:400] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 16. Current term is 17.
I20260709 12:28:27.080278  9927 leader_election.cc:403] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:27.029273 15582 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:27.083101 15719 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:27.088603 15569 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 16. Current term is 17.
I20260709 12:28:27.096494  9890 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 18.
I20260709 12:28:27.069669 15707 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:28:27.101035 15707 raft_consensus.cc:697] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:27.101255 15645 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:27.099223  9808 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 20.
I20260709 12:28:27.099208 15582 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:27.111800  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:27.112059  9963 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 19.
I20260709 12:28:27.112116  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:27.114301  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:27.116428 10497 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:27.125639 10497 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:27.115960  9927 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:27.137333  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:27.140148  9962 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:28:27.111720 15678 consensus_queue.cc:1048] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:28:27.133246 15648 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:28:27.139276 15598 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:27.113104 15677 consensus_queue.cc:1059] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:28:27.161377 10497 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:27.136509 15726 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:28:27.102028 15707 consensus_queue.cc:237] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:27.163031 15584 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:28:27.164775  9778 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:28:27.167614  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 105984us
I20260709 12:28:27.168475  9779 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:27.174434 15593 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:27.170647 15645 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:28:27.177208 15719 raft_consensus.cc:2749] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:28:27.177464  9710 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56416 (request call id 251) took 31070 ms (client timeout 15000 ms). Trace:
W20260709 12:28:27.177886  9710 rpcz_store.cc:269] 0709 12:27:56.107124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:56.107304 (+   180us) service_pool.cc:224] Handling call
0709 12:28:27.177261 (+31069957us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":238054,"reported_tablets":39}
I20260709 12:28:27.179364 15645 raft_consensus.cc:697] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:27.180243 15645 consensus_queue.cc:237] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:27.181095 15697 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:28:27.186141  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 58398.6us
I20260709 12:28:27.170405 15584 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:27.208261  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 49997.3us
I20260709 12:28:27.209438  9960 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:28:27.209363 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:27.210371 10525 raft_consensus.cc:2368] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 20. Current term is 21.
I20260709 12:28:27.213191 10525 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:28:27.214871  9884 raft_consensus.cc:1275] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:28:27.217284  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:27.217846  9806 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:27.219074  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:27.206660 15680 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:27.229127  9810 raft_consensus.cc:1240] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 13. Current term is 14. Ops: []
I20260709 12:28:27.250717 15680 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:27.252790 15680 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:27.219645  9815 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 18.
I20260709 12:28:27.241678 10533 consensus_queue.cc:237] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:27.244390 15725 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:28:27.245187 15582 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:27.211457 15584 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:27.247231 15671 raft_consensus.cc:3055] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:27.214574 15716 consensus_queue.cc:1059] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:28:27.209327 15679 consensus_queue.cc:1048] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:28:27.270174 15632 raft_consensus.cc:3055] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:27.270576 15632 raft_consensus.cc:740] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:27.271335 15632 consensus_queue.cc:260] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:27.272181 10527 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:28:27.272442 15632 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:27.273674 15714 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:28:27.290244 15677 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:27.290858 15677 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:27.292187  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:27.296315  9927 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:27.266680 15671 raft_consensus.cc:740] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:27.297432 15679 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:28:27.297884 15679 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:27.298264 15679 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:27.298218  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:27.298113 15671 consensus_queue.cc:260] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:27.333006  9962 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 21.
I20260709 12:28:27.333755 15573 raft_consensus.cc:2764] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 21 FOLLOWER]: Leader election decision vote started in defunct term 20: won
W20260709 12:28:27.403283  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 115787us
I20260709 12:28:27.404208  9928 leader_election.cc:400] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 20. Current term is 21.
I20260709 12:28:27.404249  9811 raft_consensus.cc:1240] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:27.406739  9806 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:28:27.420990  9928 leader_election.cc:400] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 20. Current term is 21.
I20260709 12:28:27.426992  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:27.432214  9955 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:28:27.425875 10496 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:27.434195  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:27.433127  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:27.440001  9806 raft_consensus.cc:1275] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:28:27.444226  9960 raft_consensus.cc:1275] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:28:27.448015  9806 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:28:27.427942 15671 raft_consensus.cc:3060] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:27.455893 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:27.450114  9810 raft_consensus.cc:1275] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:28:27.458652 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:27.459396 10525 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:27.450577  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:27.460172  9884 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:28:27.463421 10526 raft_consensus.cc:1240] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 17. Current term is 18. Ops: []
I20260709 12:28:27.465507 10533 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 18. Current term is 19. Ops: []
I20260709 12:28:27.466511  9961 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:28:27.462802  9853 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:27.426067 15567 consensus_queue.cc:1059] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:28:27.445439 15719 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:28:27.473402  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:27.475092  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:27.475766  9810 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:28:27.478793 10531 raft_consensus.cc:1240] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:27.434594 15678 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:28:27.476580 15654 raft_consensus.cc:2804] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:27.485488  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb82dc8d0b87403f90e84b650a35abb0" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:27.493582 10533 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:28:27.479267 15584 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:27.476143 15725 consensus_queue.cc:1059] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 12:28:27.505451 15654 raft_consensus.cc:697] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:27.495748 15677 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:27.525887  9815 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
I20260709 12:28:27.485282 15572 consensus_queue.cc:1048] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:28:27.543404  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:27.543509 10531 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:28:27.548343 10525 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 19.
I20260709 12:28:27.513397 15679 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:27.553484 15732 log.cc:927] Time spent T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:28:27.553377 15609 consensus_queue.cc:1048] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:28:27.488801 15645 consensus_queue.cc:1059] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 12:28:27.518016 15716 consensus_queue.cc:1059] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:28:27.525712 15697 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 12:28:27.550866 15618 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:28:27.605104  9957 raft_consensus.cc:1240] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 18. Current term is 19. Ops: []
I20260709 12:28:27.558179 15719 raft_consensus.cc:697] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 21 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:28:27.566256  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 58069.3us
I20260709 12:28:27.610183  9853 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:27.613471  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 47959.7us
I20260709 12:28:27.556913 15739 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:28:27.563584 15725 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 12:28:27.629181 15572 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:27.629967 15719 consensus_queue.cc:237] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:27.625243 15654 consensus_queue.cc:237] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:27.647835  9883 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:28:27.707185  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 71195.2us
I20260709 12:28:27.657184 15741 consensus_queue.cc:1048] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
W20260709 12:28:27.759093  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 43533us
I20260709 12:28:27.716039 15653 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:28:27.782927  9928 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:27.753623 15679 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 19 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:27.749855 15572 raft_consensus.cc:697] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 14 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:27.806667  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:27.806782  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:27.808933 10530 raft_consensus.cc:1240] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 14. Current term is 15. Ops: []
I20260709 12:28:27.809252 15755 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:27.810698 15755 consensus_queue.cc:1048] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:27.790432 15673 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:27.822688 15673 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:27.823041 15673 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:27.823858 10530 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:27.821780 15572 consensus_queue.cc:237] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:27.826553 10526 raft_consensus.cc:1240] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 18. Current term is 19. Ops: []
I20260709 12:28:27.851027 15645 consensus_queue.cc:1059] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 12:28:27.880865 15632 raft_consensus.cc:3055] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:28:27.881099 10530 raft_consensus.cc:1275] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:28:27.881413 15632 raft_consensus.cc:740] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:27.882946 15731 raft_consensus.cc:3055] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:28:27.883425 15731 raft_consensus.cc:740] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:27.883148 15748 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:28:27.885520  9963 raft_consensus.cc:2468] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:28:27.893271 15758 consensus_queue.cc:1059] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:28:27.902709 15632 consensus_queue.cc:260] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:27.919277  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 122567us
I20260709 12:28:27.929097 15741 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:27.929880 15741 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:27.940374 15733 log.cc:927] Time spent T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.428s	user 0.003s	sys 0.002s
I20260709 12:28:27.965220 15673 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:27.701813  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:27.974773 15673 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:27.978359  9704 catalog_manager.cc:5697] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 14 to 15, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 15 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:27.980396  9704 catalog_manager.cc:5697] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 15 to 16, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 16 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
W20260709 12:28:27.981700 15736 log.cc:927] Time spent T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.470s	user 0.000s	sys 0.002s
I20260709 12:28:27.988181  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:27.950826 15697 raft_consensus.cc:3055] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:28:27.989676 15697 raft_consensus.cc:740] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:27.990739 15697 consensus_queue.cc:260] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:27.996054  9713 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59986 (request call id 334) took 32987 ms (client timeout 15000 ms). Trace:
W20260709 12:28:27.999353  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 71106.7us
I20260709 12:28:27.999598 10533 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:28:28.022235  9956 raft_consensus.cc:1275] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:28:28.008762  9713 rpcz_store.cc:269] 0709 12:27:55.008805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:55.011340 (+  2535us) service_pool.cc:224] Handling call
0709 12:28:27.995869 (+32984529us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110343,"reported_tablets":47,"spinlock_wait_cycles":7040}
I20260709 12:28:28.031052 10496 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:28.031744  9927 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:28.022106 15572 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:28.050987  9781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:28:28.068620  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 322650us
I20260709 12:28:28.021620 15609 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 12:28:28.037596 15584 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.070978  9955 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:28:28.041854 15726 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:28.036070 15716 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:28:28.066174 15673 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.071122 15674 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:28:28.124996  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 49124.6us
I20260709 12:28:28.129532  9955 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:28:27.981984  9704 catalog_manager.cc:5697] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 15 to 16, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 16 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:28:28.083503 15741 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:28.064700 15572 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.125864 15753 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.082086 15584 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.128654 15674 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.167713 15740 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:28.168952  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 45268.7us
I20260709 12:28:28.127851 15673 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.159997 15704 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.177775  9810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:28.178601  9810 raft_consensus.cc:606] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 20 FOLLOWER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:28.179047  9810 raft_consensus.cc:614] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:28.169241 15674 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:28.186767 15673 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:28.190434 15776 log.cc:927] Time spent T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 12:28:28.191068 15767 log.cc:927] Time spent T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:28:28.186312 15572 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:28.201488 15697 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:28:28.204526 15737 log.cc:927] Time spent T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.692s	user 0.004s	sys 0.000s
W20260709 12:28:28.206585 15735 log.cc:927] Time spent T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.694s	user 0.003s	sys 0.001s
I20260709 12:28:28.207947  9890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57652 (request call id 3114) took 1005 ms. Trace:
I20260709 12:28:28.181963 15704 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.208417  9890 rpcz_store.cc:276] 0709 12:28:27.202230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:27.202395 (+   165us) service_pool.cc:224] Handling call
0709 12:28:27.202674 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:27.208128 (+  5454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:27.208163 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:27.224791 (+ 16628us) log.cc:844] Serialized 26 byte log entry
0709 12:28:27.449499 (+224708us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:28:27.449538 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:27.449602 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:28.205817 (+756215us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:28:28.207554 (+  1737us) raft_consensus.cc:1685] finished
0709 12:28:28.207586 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:28.207876 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":8190,"spinlock_wait_cycles":31989632,"thread_start_us":157996,"threads_started":1,"wal-append.queue_time_us":215690}
I20260709 12:28:28.210758 10528 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36670 (request call id 1474) took 1003 ms. Trace:
I20260709 12:28:28.211139 10528 rpcz_store.cc:276] 0709 12:28:27.207564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:27.207704 (+   140us) service_pool.cc:224] Handling call
0709 12:28:27.207989 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:28:27.303386 (+ 95397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:28:27.303417 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:28:27.303919 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 12:28:27.451662 (+147743us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:28:27.465367 (+ 13705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:28:27.998577 (+533210us) spinlock_profiling.cc:243] Waited 95 ms on lock 0x7b54005e92d4. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e51ce01 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:27.998620 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:28:28.203727 (+205107us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:28:28.210574 (+  6847us) raft_consensus.cc:1685] finished
0709 12:28:28.210593 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:28:28.210708 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1266,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":250517632,"thread_start_us":135038,"threads_started":1,"wal-append.queue_time_us":198403}
I20260709 12:28:28.168213 15740 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.213783 15584 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:28.214174 15740 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:28.215262 15731 consensus_queue.cc:260] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.215508  9704 catalog_manager.cc:5697] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 16 to 18, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 18 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:28.216939 15731 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:28.164515 15753 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.223277 15753 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:28.224220  9963 raft_consensus.cc:1275] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:28:28.230751  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:28.231755  9811 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
I20260709 12:28:28.234511 10528 raft_consensus.cc:1240] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 17. Current term is 18. Ops: []
I20260709 12:28:28.240656 15704 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:28.243654 15649 raft_consensus.cc:3055] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:28:28.244086 15649 raft_consensus.cc:740] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:28.244884 15649 consensus_queue.cc:260] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.271425 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:28.272313 10525 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 17.
I20260709 12:28:28.248024 15649 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:28.286208  9963 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:28:28.288692 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:28.289619 10526 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:28:28.217494  9704 catalog_manager.cc:5697] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 16 to 17, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 17 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:28.261989 15632 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:28.248167 15731 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.307070  9704 catalog_manager.cc:5697] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 10 to 11, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 11 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:28.310483  9704 catalog_manager.cc:5697] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 13 to 14, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 14 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:28.326944  9928 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:28:28.327982  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 142327us
I20260709 12:28:28.328442 15673 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:28:28.330945 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:28.335111 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:28.336444 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:28.337198 10531 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 15.
I20260709 12:28:28.337268  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:28.337906  9957 raft_consensus.cc:1275] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:28:28.338181  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:28.338426 15609 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.338344  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:28.339032 15609 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:28.339473  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:28.341059 15609 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:28.342772 15573 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:28.343153 15573 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.343225  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
W20260709 12:28:28.343461  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 88476.1us
I20260709 12:28:28.343577 15573 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:28.343825  9885 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:28.344683  9853 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:28.346652  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:28.347416  9882 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:28:28.348258 15654 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:28.348770 15654 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.349143 15654 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:28.353101  9812 raft_consensus.cc:1275] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:28:28.346704 15782 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.337880  9955 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 10.
I20260709 12:28:28.334884 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e528961028ca49b7a317cd20fbb343a8" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:28.353911 15782 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.359552 15772 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:28.364802  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:28.365461  9884 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 13.
I20260709 12:28:28.365725  9810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:28.358180 15782 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:28.370312  9887 raft_consensus.cc:1275] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:28:28.370390 15740 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:28:28.366575  9810 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 12.
I20260709 12:28:28.367338 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:28.372201 10525 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:28:28.373785 15784 consensus_queue.cc:1059] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:28:28.375586 15784 raft_consensus.cc:3055] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:28:28.376377 15784 raft_consensus.cc:740] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:28.377655  9854 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:28.378453 15784 consensus_queue.cc:260] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:28.404196 15784 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:28.380072  9853 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:28.386930  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:28.391357 15654 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.397104  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:28.406981  9890 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 17.
I20260709 12:28:28.399804  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:28.403302 15782 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:28.408684 15782 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.411487 15782 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:28.414619 15654 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:28.417063  9885 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:28:28.301240 15700 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:28.423326  9812 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:28:28.298863 15716 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 12:28:28.299944 15605 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:28:28.430482  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:28.433799  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:28.431902  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:28.434789  9811 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:28:28.303809 15618 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.117s
I20260709 12:28:28.325032 15680 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.440023  9957 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:53218
W20260709 12:28:28.447721  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 70123.9us
I20260709 12:28:28.448657 10497 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:28.451246 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b97d7561bbd8444f9bbafa9c397d3f62" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:28.452011 10525 raft_consensus.cc:3060] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:28.441684  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:28.447211  9957 raft_consensus.cc:606] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:28.317276 15731 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.457237 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:28.456111 15782 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:28.463068  9853 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:28.425829 15573 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.428903 15700 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.470609 15766 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:28.471304 10526 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 9.
I20260709 12:28:28.466068 15584 consensus_queue.cc:1048] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:28:28.475208 15573 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:28.464464 15641 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:28.478603 15783 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:28.464677 15708 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:28:28.478638 15641 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.440543 15572 consensus_queue.cc:1048] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:28:28.489235 15731 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:28.455026 15680 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:28.493641 15680 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:28.470201 15738 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.494827  9811 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 16.
I20260709 12:28:28.499928 15772 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.500394 15772 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:28.486953 15641 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:28.495985 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:28.502243 10527 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:28.502974  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:28.503592  9811 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:28:28.464533 15609 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:28:28.504235 15609 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.504663 15609 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:28.508270 15702 consensus_queue.cc:1048] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:28.497999  9810 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:28:28.510473  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 58224.6us
I20260709 12:28:28.513082  9854 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:28.494455 15738 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.522200  9811 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:28:28.519280  9779 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:28:28.528276  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 62806.9us
I20260709 12:28:28.526017  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:28.530642  9885 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:28.529199  9928 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:28.542081  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
W20260709 12:28:28.547003  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 83992.4us
I20260709 12:28:28.554215  9810 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 21 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:28:28.467500 15782 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.555181 15782 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:28.556255 15674 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:28.564248 10525 raft_consensus.cc:2468] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 16.
I20260709 12:28:28.550698 15618 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:28.564669  9853 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:28.570636 15618 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.560407 15654 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:28:28.578299  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 49191.6us
I20260709 12:28:28.578522  9958 raft_consensus.cc:1240] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:28:28.575645 15618 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:28.580147 15679 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:28.580698 15679 raft_consensus.cc:697] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:28.581601 15679 consensus_queue.cc:237] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:28.591156  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:28.595582 15585 raft_consensus.cc:993] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:28.566159 15584 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 12:28:28.597437  9806 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:28.597962  9806 raft_consensus.cc:606] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 18 LEADER]: Received request to transfer leadership to TS f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:28.573400 15708 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.598821 15708 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.600945 15708 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:28.578348 15654 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.601538 15787 raft_consensus.cc:2804] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:28.601661 15654 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:28.604619 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:28.604720 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:28.605221  9806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:28.605317 10526 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:28.605882  9806 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
I20260709 12:28:28.607790  9955 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 21 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:28:28.605259 10533 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
I20260709 12:28:28.610172  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:28.612325  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:28.612887  9853 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:28.613646 15585 raft_consensus.cc:1081] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:28.614691  9955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:28.615222  9955 raft_consensus.cc:606] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:28.615558  9955 raft_consensus.cc:614] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:28.615482 15728 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:28.616086 15728 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:28.569190 15740 consensus_queue.cc:1048] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:28:28.575685 15715 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.622913  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:28.638676  9815 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:28:28.627396  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:28.642266  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:28.642904  9885 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:28.643591  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:28.641356  9928 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:28.650888  9812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46504
I20260709 12:28:28.658469  9815 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:28.651682  9812 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:28.659024  9815 raft_consensus.cc:606] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:28.659447  9815 raft_consensus.cc:614] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:28.659408  9812 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:28.618166 15728 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:28.638505 15787 raft_consensus.cc:697] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 16 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:28.685527 10533 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:28:28.686123  9885 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 18.
I20260709 12:28:28.687088  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:28:28.688050 10526 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 18.
I20260709 12:28:28.692937  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:28.694284  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:28.657796 15579 consensus_queue.cc:1059] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:28:28.703678 15609 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:28.710664  9890 raft_consensus.cc:2368] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 12. Current term is 13.
I20260709 12:28:28.681586 15741 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:28.714465 15762 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:28.714907 15762 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.704865 15784 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:28:28.718724 15782 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.656949 15726 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
W20260709 12:28:28.721271  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 48429us
I20260709 12:28:28.715291 15762 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:28.723835  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:28.769709  9812 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.775573  9812 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:28.776693 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:28.777483 10533 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:28.662119 15715 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.763911 15702 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:28.831453  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 64169.7us
I20260709 12:28:28.835167  9927 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:28.779548 15766 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:28.847481  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:28.844841  9957 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:28:28.765105 15707 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:28.851433  9815 raft_consensus.cc:1240] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Rejecting Update request from peer b011791796d1457284b857d7d3422195 for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:28.870097 15673 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:28.912952  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:28.913585  9815 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:28.875115 15674 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:28.842662 15702 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:28.915150 15792 log.cc:927] Time spent T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:28:28.898437 15738 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:28.873656 15707 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.938262  9815 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:28:28.896553 15680 consensus_queue.cc:1059] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 12:28:28.903723 15673 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:28.842123 15787 consensus_queue.cc:237] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:28.947594 15673 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:28:28.987138 15798 log.cc:927] Time spent T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:28:28.987556 15808 log.cc:927] Time spent T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.084s	user 0.003s	sys 0.003s
W20260709 12:28:28.989101 15801 log.cc:927] Time spent T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:28:28.989374 15702 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:28:28.993319 15803 log.cc:927] Time spent T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:28:28.993436 15700 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:29.000907  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:29.001034  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:29.001592  9811 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 14.
I20260709 12:28:29.001719  9809 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 19.
I20260709 12:28:28.924924 15772 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.004482  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:29.012918 15618 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.018900 15618 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:29.020496 15641 consensus_meta.cc:287] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: Time spent flushing consensus metadata: real 0.518s	user 0.003s	sys 0.007s
I20260709 12:28:29.020957 15641 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.023981 15707 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:29.025254  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:29.025447 15715 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:29.025815  9958 raft_consensus.cc:3055] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:28:29.026140  9958 raft_consensus.cc:740] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:29.031014  9958 consensus_queue.cc:260] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.032229  9958 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:29.036582  9956 raft_consensus.cc:2368] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11.
I20260709 12:28:29.036775 10533 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 16.
I20260709 12:28:29.039211 15702 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:29.039366 15782 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:29.039783 15702 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.040921 15812 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:29.041312 15654 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.041465 15812 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.042465 15700 raft_consensus.cc:2955] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 4 to 8, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:29.044797 15812 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:29.045101 15702 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:29.047406 15641 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:29.042510  9882 raft_consensus.cc:2368] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11.
I20260709 12:28:29.038023  9779 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:28:29.049407 15811 log.cc:927] Time spent T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:28:29.050804  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:29.051564 15741 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:28:29.052182 15741 raft_consensus.cc:697] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 18 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:29.052749 15731 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:29.053223 15772 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:29.053239 15731 raft_consensus.cc:697] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:29.054250 15731 consensus_queue.cc:237] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.057576 15572 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:29.058130 15572 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.058874 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:29.059818 10527 raft_consensus.cc:2393] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 14: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:29.060237 15572 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:29.053042 15741 consensus_queue.cc:237] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.060578 15754 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:29.064359 15754 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.066869 15754 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:29.067927 15773 raft_consensus.cc:993] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:28:29.077232  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:29.070734  9853 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:29.079773  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:29.077908  9881 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 18.
I20260709 12:28:29.085434  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:29.088024 10532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:29.089118 10532 raft_consensus.cc:2393] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 18: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:29.090619 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:29.090710 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:29.091102  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:29.091439 10528 raft_consensus.cc:2393] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 19: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:29.091514 10533 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:29.092252  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:29.094142  9881 raft_consensus.cc:2393] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 14: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:29.098150 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:29.098726 10528 raft_consensus.cc:3060] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:28:29.100183 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:29.139756 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:29.140743 10530 raft_consensus.cc:2393] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 in current term 14: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:29.141460  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:29.142488  9886 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:29.145821  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:29.146665  9960 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:29.117316 15579 raft_consensus.cc:2804] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:29.141381 10497 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:29.115705 15758 raft_consensus.cc:1081] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 18 LEADER]: Signalling peer f5208640a51f493e930ce4f64ceeed0b to start an election
I20260709 12:28:29.170219 10533 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 16.
I20260709 12:28:29.189842 15579 raft_consensus.cc:697] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 13 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:29.191174 15579 consensus_queue.cc:237] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:29.191962 15609 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:29.193122  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:28:29.193955 15817 log.cc:927] Time spent T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:28:29.194585  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:28:29.195341 15814 log.cc:927] Time spent T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:28:29.196002  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:29.217890  9960 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
I20260709 12:28:29.209465 10528 raft_consensus.cc:2468] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:28:29.228307  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:29.228442  9885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:29.229205  9960 raft_consensus.cc:2393] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 14: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:29.230000  9885 raft_consensus.cc:2393] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 14: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:29.261037  9885 raft_consensus.cc:2955] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 4 to 8, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:29.208455 15819 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:28:29.271371  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 110072us
I20260709 12:28:29.253538 15641 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:29.278198  9959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:29.278963  9809 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:28:29.282117 10496 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:29.271291 15819 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:29.287416 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:29.288164 10526 raft_consensus.cc:2393] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 11: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:29.236951 15762 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.289582  9886 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 16.
I20260709 12:28:29.296060 10496 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:29.297353 15726 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:29.299551  9779 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:29.311110 15673 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:29.313491 15673 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:29.285734 15819 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:28:29.288072 15654 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:29.313875  9883 raft_consensus.cc:2393] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b in current term 15: Already voted for candidate 963185e117384b2085d7cea02a64478b in this term.
I20260709 12:28:29.284313 15567 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:28:29.283205 15641 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.304754 15731 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:29.333277  9886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:29.336100  9885 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:28:29.337013  9853 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:29.339498 15654 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:29.340008 15654 raft_consensus.cc:697] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 14 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:29.304214 15572 raft_consensus.cc:493] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:29.349998 15572 raft_consensus.cc:515] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:29.351276  9958 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 16.
I20260709 12:28:29.355543 15819 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.360179 15572 leader_election.cc:290] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:29.362768 15819 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 20 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:29.371243 10496 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:29.373689 15702 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:28:29.351613 15830 log.cc:927] Time spent T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:28:29.374122 15702 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:29.375171 15702 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:29.376554 15641 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:29.360250 15762 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:29.385128 15708 raft_consensus.cc:3055] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:28:29.385560 15708 raft_consensus.cc:740] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:29.385725  9928 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:29.340875 15654 consensus_queue.cc:237] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.386565 15679 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:28:29.387429  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:29.392062 10496 leader_election.cc:400] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11.
I20260709 12:28:29.393046 10496 leader_election.cc:403] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:29.393956  9928 leader_election.cc:400] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 12. Current term is 13.
I20260709 12:28:29.401105 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:29.347438 15731 raft_consensus.cc:697] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 16 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:29.404536  9778 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:29.392695 15762 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:29.409395 15653 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:29.416491  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:29.405129 15819 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253) with higher term. Message: Invalid argument: T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11.
I20260709 12:28:29.427523  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:29.428120  9811 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:28:29.423444  9808 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 15.
I20260709 12:28:29.424667  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:29.386380 15708 consensus_queue.cc:260] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:29.402473 15825 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:28:29.431762  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:29.433133  9808 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 18.
I20260709 12:28:29.436882 15731 consensus_queue.cc:237] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.411685 15762 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:29.450218 10496 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:29.449903  9811 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 20.
I20260709 12:28:29.431156 15700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:58768 (request call id 5) took 2250 ms. Trace:
I20260709 12:28:29.458479 15584 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:29.470638 15584 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:29.471303 15584 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:29.470407 15700 rpcz_store.cc:276] 0709 12:28:27.176383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:27.178822 (+  2439us) service_pool.cc:224] Handling call
0709 12:28:27.240934 (+ 62112us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b58005e70d0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e4780aa 00007f2f8e4fa447 00007f2f8e51770a 00007f2f8e51876a 00007f2f8e51791b 00007f2f8e52303c 00007f2f8e5226b3 00007f2f8e51a9fa 00007f2f934e24c9 00007f2f8ca5ec54
0709 12:28:27.291140 (+ 50206us) log.cc:844] Serialized 494 byte log entry
0709 12:28:27.632111 (+340971us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b2c0010bbf8. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8ce15a11 00007f2f8ce24a0a 00007f2f8ce24693 00007f2f8ce24631 00007f2f8e558b52 00007f2f8e558cf5 00007f2f8e495691 00007f2f8e475eaa 00007f2f8e47cd53 00007f2f8e47ccd9 00007f2f8e47cc69
0709 12:28:27.942076 (+309965us) spinlock_profiling.cc:243] Waited 9.41 ms on lock 0x7b1800209fe0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b3fd2a6 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e495142 00007f2f8e475eaa 00007f2f8e47cd53
0709 12:28:27.980916 (+ 38840us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:28:28.202715 (+221799us) spinlock_profiling.cc:243] Waited 7.72 ms on lock 0x7b5400831ba0. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e495142 00007f2f8e475eaa 00007f2f8e47cd53 00007f2f8e47ccd9 00007f2f8e47cc69 00007f2f8e47cc31 00007f2f8e47bdfd 0000000000388634 0000000000388479 00007f2f8b42f475
0709 12:28:29.424382 (+1221667us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31876,"raft.queue_time_us":14432,"raft.run_cpu_time_us":11432,"raft.run_wall_time_us":961198,"spinlock_wait_cycles":161008384,"thread_start_us":131321,"threads_started":1,"wal-append.queue_time_us":199376,"wal-append.run_cpu_time_us":4329,"wal-append.run_wall_time_us":1491504}
I20260709 12:28:29.448096 15708 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:29.463893 15762 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:29.464478 15702 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.483633 10496 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:29.484457 10496 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:29.494005 15812 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:28:29.497836 15812 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:29.498324 15812 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:29.502655 10526 raft_consensus.cc:2393] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 15: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:29.503755 15702 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:29.503891 15645 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:29.504482 15645 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:29.506599 15645 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:29.508023  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:29.495394 15641 raft_consensus.cc:2804] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:28:29.509181 15641 raft_consensus.cc:697] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 20 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:29.509589  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:29.510143  9808 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:29.510097 15641 consensus_queue.cc:237] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.508749  9956 raft_consensus.cc:2393] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 19: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:29.519313  9808 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 15.
I20260709 12:28:29.520839 10496 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:29.535281 15834 raft_consensus.cc:493] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
W20260709 12:28:29.536273 15809 log.cc:927] Time spent T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.592s	user 0.004s	sys 0.000s
I20260709 12:28:29.524458 15702 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:28:29.543084 15702 raft_consensus.cc:697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 15 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:29.543886  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:29.543958 15702 consensus_queue.cc:237] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.544734  9815 raft_consensus.cc:2368] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 19. Current term is 20.
I20260709 12:28:29.545697  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:29.545519  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:29.546020  9812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:29.546468  9813 raft_consensus.cc:2393] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 15: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:29.546507  9811 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 18.
I20260709 12:28:29.546979 15773 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:29.547501 15773 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.551211 15773 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:29.535920 15834 raft_consensus.cc:515] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.565919  9886 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:28:29.570436  9956 raft_consensus.cc:1240] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:28:29.503775 15584 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:29.580029 15674 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 12:28:29.565318 15807 raft_consensus.cc:493] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:29.580999  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:29.581640  9956 raft_consensus.cc:3060] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:29.585167  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3541b3559e488d9911972fd2250fc6" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:29.585536  9698 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3e593a3b7d754d449a065a58afdb1b7a with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:28:29.585958  9963 raft_consensus.cc:2393] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 11: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:29.585791 15747 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:29.591240  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e64098fbd794a1daa6778e4c06eb54e" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:29.582893  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:29.589025  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:29.600904  9881 raft_consensus.cc:3060] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:28:29.613503  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:28:29.623314 15839 log.cc:927] Time spent T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:28:29.624096  9956 raft_consensus.cc:2468] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:28:29.639452 15747 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.641819 15747 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:29.642611  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:29.634196 15834 leader_election.cc:290] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:29.647224 15838 log.cc:927] Time spent T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:28:29.590546 15807 raft_consensus.cc:515] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.650503 15807 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:29.658571  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 43491.8us
I20260709 12:28:29.643301  9888 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 17.
W20260709 12:28:29.671407  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 51136.9us
I20260709 12:28:29.673197  9853 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:29.660573  9956 raft_consensus.cc:2955] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 4 to 8, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:29.687141 10526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:29.688165 10526 raft_consensus.cc:2368] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 15. Current term is 16.
I20260709 12:28:29.692987  9854 leader_election.cc:400] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 15. Current term is 16.
I20260709 12:28:29.693359  9854 leader_election.cc:403] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:29.696650 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:29.697526 10531 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 16.
I20260709 12:28:29.709700  9881 raft_consensus.cc:2468] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 20.
I20260709 12:28:29.712972 15740 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:28:29.698964 15782 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:28:29.716858 15584 leader_election.cc:290] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:29.717437  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:29.717715  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:29.718034  9808 raft_consensus.cc:3060] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:29.730307  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:29.731176  9890 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 19.
I20260709 12:28:29.731530  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:29.735541  9811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:29.736274  9811 raft_consensus.cc:2393] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 16: Already voted for candidate 4104e34a61b7448281d6d91ce23ebf71 in this term.
I20260709 12:28:29.737056  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:29.737797  9890 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:29.738190  9779 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:29.738379  9853 leader_election.cc:400] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 19 pre-election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 19. Current term is 20.
I20260709 12:28:29.738739  9853 leader_election.cc:403] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:29.740407  9853 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:29.743844  9853 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:29.744163  9808 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 16.
I20260709 12:28:29.745188 10496 leader_election.cc:304] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:29.732847 15606 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 12:28:29.753393 15812 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.758637  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:29.763015 15585 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:29.764554 15812 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 19 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:29.769914  9854 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:29.762799  9928 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:29.775434  9813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f56c0f50a014def9b283a94186feae6" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:29.776289  9813 raft_consensus.cc:2368] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 12. Current term is 13.
I20260709 12:28:29.776539 15609 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:29.776952 15609 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting leader election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:29.777313 15609 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:29.778081 15569 raft_consensus.cc:2804] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:29.778618 15569 raft_consensus.cc:697] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:29.778779  9963 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:28:29.780591  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:29.784111  9853 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:29.757880 15782 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 19. Current term is 20.
I20260709 12:28:29.786154  9853 leader_election.cc:304] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:29.788537  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:29.758522 15748 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:28:29.761667 15766 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:29.789410  9808 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:29.779598 15593 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:28:29.793534  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:29.768581 15574 raft_consensus.cc:2804] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:29.797642 15593 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:29.769701 15606 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:28:29.791316 15754 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:29.819070  9927 leader_election.cc:400] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 12. Current term is 13.
I20260709 12:28:29.801463 15593 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:29.793090 15766 raft_consensus.cc:493] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:29.821393 15766 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:29.811306 10526 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:28:29.792619 15569 consensus_queue.cc:237] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:29.814688 15823 log.cc:927] Time spent T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259: Append to log took a long time: real 0.489s	user 0.008s	sys 0.000s
I20260709 12:28:29.816256 10527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
 from {username='slave'} at 127.0.0.1:36676
I20260709 12:28:29.825834 10527 raft_consensus.cc:493] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:29.826210 10527 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:29.809333 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3290aa2b0ef349e78e838202fb70b358" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:29.819630  9927 leader_election.cc:403] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:28:29.820339 15574 raft_consensus.cc:697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 16 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:29.796485 15773 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:28:29.837723 15574 consensus_queue.cc:237] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.801753 15748 raft_consensus.cc:2749] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:29.804823  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
W20260709 12:28:29.848250  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 43506us
I20260709 12:28:29.854184  9812 raft_consensus.cc:1275] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:28:29.894593 15842 log.cc:927] Time spent T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:28:29.903842 15806 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for earlier term 12. Current term is 13.
I20260709 12:28:29.924630  9882 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54428 (request call id 1529) took 1189 ms. Trace:
I20260709 12:28:29.861653 15773 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:29.925046  9882 rpcz_store.cc:276] 0709 12:28:28.723369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:28.723538 (+   169us) service_pool.cc:224] Handling call
0709 12:28:29.911484 (+1187946us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54001bc454. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:28:29.912799 (+  1315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":654157696}
W20260709 12:28:29.930359  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 88156.3us
I20260709 12:28:29.932636  9808 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 19.
I20260709 12:28:29.939317 10496 leader_election.cc:304] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:29.940012 10527 raft_consensus.cc:515] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:29.949658  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:29.929185 15773 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:29.946636  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 160529us
I20260709 12:28:29.958088 10497 leader_election.cc:400] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 10 pre-election: Vote denied by peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205) with higher term. Message: Invalid argument: T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5208640a51f493e930ce4f64ceeed0b for earlier term 10. Current term is 11.
I20260709 12:28:29.960474 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:29.961117 10533 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 16.
I20260709 12:28:29.966583 10527 leader_election.cc:290] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 19 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:29.950776 15738 raft_consensus.cc:2804] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:28:29.955824 15773 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:29.979084 10533 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:28:29.995965 10533 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:28:29.978297 15738 raft_consensus.cc:697] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 19 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
W20260709 12:28:30.083236  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 126282us
I20260709 12:28:30.084142  9927 leader_election.cc:304] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:30.086536  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 118344us
I20260709 12:28:30.006392 15740 raft_consensus.cc:2749] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) with higher term. Message: Invalid argument: T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 15. Current term is 16.
I20260709 12:28:30.096032  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a95007be04144b799116ba6a2d753a1e" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:30.096704  9956 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:28:30.096715 15849 log.cc:927] Time spent T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:28:30.098904 15677 raft_consensus.cc:2749] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:30.116053  9881 raft_consensus.cc:2468] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 16.
I20260709 12:28:30.082165 15753 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 12:28:30.100788 15731 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:28:30.106199  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 117741us
I20260709 12:28:30.124475  9956 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 19.
I20260709 12:28:30.142412 10533 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:28:30.105233 15748 consensus_queue.cc:1048] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:28:30.099752 15707 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:28:30.178490 15857 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:30.175987 15609 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:30.179016 15857 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:30.179697  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bd0e88f609e4c15aadc811cb9ecf5a9" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:30.180418  9807 raft_consensus.cc:2368] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 15. Current term is 16.
I20260709 12:28:30.180547 15609 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:30.181591 15848 log.cc:927] Time spent T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:28:30.186458 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:30.190219 10496 leader_election.cc:304] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:30.159324 15856 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:30.193953 15856 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:30.157028 15572 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:28:30.174491 15855 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:30.158114 15731 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:30.214833  9806 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:28:30.215660  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:30.216475 10528 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 16.
W20260709 12:28:30.205538 15745 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.000s	sys 0.014s
W20260709 12:28:30.220130  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 62207.2us
I20260709 12:28:30.204922 15813 raft_consensus.cc:2804] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:28:30.222769  9854 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:30.229202  9807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:30.224977  9853 leader_election.cc:400] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 15 pre-election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 15. Current term is 16.
I20260709 12:28:30.141764 15738 consensus_queue.cc:237] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:30.230470  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:30.231786  9890 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:28:30.237212 15865 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:30.237756 15865 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:30.224083 15745 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.000s	sys 0.014s
I20260709 12:28:30.240343 15865 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:30.242211  9957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:30.242925  9957 raft_consensus.cc:2393] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 17: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:30.235850 15833 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:28:30.232779 15781 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:30.247538 15781 raft_consensus.cc:697] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 16 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:30.248476 15781 consensus_queue.cc:237] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:30.254369  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:30.256732  9890 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:30.206182 15697 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:28:30.260116  9779 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:30.236407 15813 raft_consensus.cc:697] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 19 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:30.266700 15813 consensus_queue.cc:237] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:30.261253 15854 log.cc:927] Time spent T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:28:30.264670 15707 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:30.224400 15855 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:30.272974 15731 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:30.272640 15766 raft_consensus.cc:515] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:30.273403 15858 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:30.274533  9956 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:28:30.280541  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:30.287261 15862 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 12:28:30.288285 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:30.274549 15806 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:30.290683 15858 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:30.290143 15806 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:30.294171  9889 raft_consensus.cc:3060] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:30.295363 15806 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:30.299815  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:30.300055  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:30.277402 15707 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:30.307036 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:30.307438  9889 raft_consensus.cc:2468] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 19.
I20260709 12:28:30.309334 15593 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:30.315079  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:30.316031  9815 raft_consensus.cc:2368] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 18. Current term is 19.
I20260709 12:28:30.295365 15766 leader_election.cc:290] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:30.321264  9853 leader_election.cc:400] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 18. Current term is 19.
I20260709 12:28:30.324141  9853 leader_election.cc:403] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:28:30.325688  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:30.304580 15707 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:30.329331 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb049358bf66417d84d91e61b68ff1bb" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:30.336135 15863 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:30.342803  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:30.301844 15714 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:28:30.356344  9884 raft_consensus.cc:1275] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:28:30.367261  9890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:30.367661  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:30.356343 15773 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:30.369020 15855 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:30.376295 15858 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:30.352016 15766 raft_consensus.cc:2749] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 18. Current term is 19.
I20260709 12:28:30.399609  9807 raft_consensus.cc:2368] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 16. Current term is 17.
I20260709 12:28:30.418685  9955 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 18. Current term is 19. Ops: []
I20260709 12:28:30.420717  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:30.423254 10525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8367fec391344e099ca237f0942e4f6d" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:30.424005 10532 raft_consensus.cc:1240] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 19 LEADER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 18. Current term is 19. Ops: []
I20260709 12:28:30.424710 10526 raft_consensus.cc:1275] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:28:30.425691  9779 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:30.447196  9810 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 20 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:28:30.457140 15881 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:28:30.442946 15858 consensus_queue.cc:1059] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:28:30.462885 15858 consensus_queue.cc:1243] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Peer f5208640a51f493e930ce4f64ceeed0b log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:28:30.464941  9808 raft_consensus.cc:3055] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:28:30.465341  9808 raft_consensus.cc:740] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:30.469521  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:30.470252  9955 raft_consensus.cc:2393] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 19: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:30.435937 15753 consensus_queue.cc:1048] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:28:30.436324 15731 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:30.471158 15707 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:30.505954 15857 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:30.507843 15707 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:30.466068  9808 consensus_queue.cc:260] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:30.513921  9808 raft_consensus.cc:3060] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:30.501286 15593 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 19 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:30.474735 15787 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.216s	user 0.001s	sys 0.014s
W20260709 12:28:30.528676 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 63184.9us
I20260709 12:28:30.531646  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:30.538949  9958 raft_consensus.cc:2393] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4104e34a61b7448281d6d91ce23ebf71 in current term 17: Already voted for candidate b011791796d1457284b857d7d3422195 in this term.
I20260709 12:28:30.530761  9778 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
W20260709 12:28:30.529822 15787 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.298s	user 0.002s	sys 0.015s
I20260709 12:28:30.549263  9808 raft_consensus.cc:2468] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 19.
I20260709 12:28:30.552074  9927 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:30.555305  9778 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:30.564962 15853 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:28:30.555908 15858 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 12:28:30.562464 15725 raft_consensus.cc:2749] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:30.538976 15727 consensus_queue.cc:1048] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:28:30.545156 15593 raft_consensus.cc:2749] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:28:30.555706 15585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.011s	sys 0.011s
W20260709 12:28:30.607281 15585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.011s	sys 0.011s
W20260709 12:28:30.633922  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 44496.8us
W20260709 12:28:30.638999  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 74399.9us
I20260709 12:28:30.645641 15773 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:30.652716  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:30.655990  9812 raft_consensus.cc:1275] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:28:30.657423 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:30.657967 10530 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:30.653012  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:30.670547  9881 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:30.680109  9853 leader_election.cc:400] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 election: Vote denied by peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) with higher term. Message: Invalid argument: T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b for earlier term 16. Current term is 17.
I20260709 12:28:30.722254  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:30.672726  9779 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:30.741405 15812 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:28:30.743844 15882 log.cc:927] Time spent T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 12:28:30.745812  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 73236.3us
W20260709 12:28:30.747117  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 84359.5us
I20260709 12:28:30.769218 15856 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:30.779911 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:30.782063  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:30.783190 15856 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:30.785100  9884 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 19.
I20260709 12:28:30.786368  9779 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195
I20260709 12:28:30.793156  9889 raft_consensus.cc:1275] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:28:30.795171  9885 raft_consensus.cc:1275] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 20 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:28:30.798843 10530 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:30.748301 15697 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:28:30.809983  9884 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:28:30.821817  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 88509us
I20260709 12:28:30.801088 15856 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:28:30.820891 15697 raft_consensus.cc:697] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:30.814260 15819 consensus_queue.cc:1048] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:28:30.820353 15745 consensus_queue.cc:1048] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 12:28:30.852783 15885 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:30.858923 15885 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:30.866442  9811 raft_consensus.cc:1240] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 16. Current term is 17. Ops: []
I20260709 12:28:30.838342 15856 raft_consensus.cc:697] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:30.834246 15719 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:28:30.911897  9811 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:28:30.913237  9810 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:28:30.916129 15697 consensus_queue.cc:237] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:30.919019  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 49283.5us
I20260709 12:28:30.920894 15714 consensus_queue.cc:1059] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:28:30.922941 15714 raft_consensus.cc:3055] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:28:30.923264 15714 raft_consensus.cc:740] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:30.924048 15714 consensus_queue.cc:260] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:30.925117 15714 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:30.926222  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:30.938843  9887 raft_consensus.cc:2410] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 12:28:30.944200  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:30.946070 10531 raft_consensus.cc:1240] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Rejecting Update request from peer 963185e117384b2085d7cea02a64478b for earlier term 16. Current term is 17. Ops: []
I20260709 12:28:30.882184 15885 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:30.945478 15702 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:28:30.949098 15567 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:28:31.025110  9927 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:31.009419  9704 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59972 (request call id 309) took 4623 ms. Trace:
I20260709 12:28:31.015091  9779 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:30.492291  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:31.016139  9958 raft_consensus.cc:1275] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:28:31.028846 15891 log.cc:927] Time spent T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:28:30.966779 15856 consensus_queue.cc:237] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:31.061471 15806 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:28:31.033083 15653 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:31.062500 15653 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:31.064716 15573 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:31.058023 15890 log.cc:927] Time spent T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:28:31.058557 15645 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:28:31.030398  9704 rpcz_store.cc:276] 0709 12:28:26.386354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:26.386840 (+   486us) service_pool.cc:224] Handling call
0709 12:28:31.009360 (+4622520us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:28.588630 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:28.900836 (+312206us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:28.918317 (+ 17481us) write_op.cc:435] Acquired schema lock
0709 12:28:28.923237 (+  4920us) tablet.cc:662] Decoding operations
0709 12:28:29.017243 (+ 94006us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:29.017354 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:29.017385 (+    31us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:28:29.018199 (+   814us) tablet.cc:701] Row locks acquired
0709 12:28:29.018261 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:28:29.033579 (+ 15318us) write_op.cc:270] Start()
0709 12:28:29.033745 (+   166us) write_op.cc:276] Timestamp: P: 1783600109033504 usec, L: 0
0709 12:28:29.033772 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:28:29.045508 (+ 11736us) log.cc:844] Serialized 2815 byte log entry
0709 12:28:29.779322 (+733814us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b4400022b4c. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b355c85 00007f2f8b3566a2 00007f2f8e0c81db 00007f2f8e0c3aaf 00007f2f8e0b786e 00007f2f8e0b6bb6 00007f2f8e0b67d8 00007f2f8e0c0221 00007f2f8e0c01d9 00007f2f8e0c0169
0709 12:28:30.183396 (+404074us) op_driver.cc:464] REPLICATION: finished
0709 12:28:30.243560 (+ 60164us) write_op.cc:301] APPLY: starting
0709 12:28:30.243647 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:30.263859 (+ 20212us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:30.264718 (+   859us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:30.374237 (+109519us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:30.376107 (+  1870us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 12:28:30.376171 (+    64us) write_op.cc:312] APPLY: finished
0709 12:28:30.376537 (+   366us) log.cc:844] Serialized 73 byte log entry
0709 12:28:30.376715 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:30.382146 (+  5431us) write_op.cc:454] Released schema lock
0709 12:28:30.382225 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:30.382793 (+   568us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:30.382835 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":587841,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":53435,"apply.run_cpu_time_us":13060,"apply.run_wall_time_us":139197,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33359,"num_ops":7,"prepare.queue_time_us":108269,"prepare.run_cpu_time_us":70837,"prepare.run_wall_time_us":641450,"raft.queue_time_us":311552,"raft.run_cpu_time_us":8252,"raft.run_wall_time_us":79589,"replication_time_us":1136509,"spinlock_wait_cycles":72324864,"thread_start_us":582552,"threads_started":4,"wal-append.queue_time_us":237641}]]}
I20260709 12:28:31.093703  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:31.097295  9889 raft_consensus.cc:1275] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:28:31.085052 15573 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:31.103932 15653 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:31.106678 15894 log.cc:927] Time spent T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:28:31.096153 15645 raft_consensus.cc:697] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:31.110524 15645 consensus_queue.cc:237] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:31.106211  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:31.118821  9779 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
W20260709 12:28:31.123864 15898 log.cc:927] Time spent T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 12:28:31.140974 15893 log.cc:927] Time spent T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 12:28:31.144824 15870 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:31.149191 15567 consensus_queue.cc:1048] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:28:31.149567 15807 consensus_queue.cc:1048] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:28:31.157667 15573 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:31.163381  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:31.168453  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:31.169734  9889 raft_consensus.cc:2410] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b011791796d1457284b857d7d3422195 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:28:31.249815  9928 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:31.277964  9962 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:31.278708  9962 raft_consensus.cc:606] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:31.278995  9962 raft_consensus.cc:614] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:31.246852  9705 catalog_manager.cc:5697] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 5 to 9, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 9 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:31.292028 15867 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:31.292598 15867 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:31.294659 15867 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:31.295258  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:31.264261 15853 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:28:31.316532 15894 log.cc:927] Time spent T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:28:31.324437 15878 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:31.325049 15878 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:31.329105 15908 log.cc:927] Time spent T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71: Append to log took a long time: real 0.056s	user 0.003s	sys 0.000s
I20260709 12:28:31.336452 15878 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:31.337333 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:31.345742  9958 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bae6a0d1c1c44960b4b110046bee07a8"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:31.375905  9958 raft_consensus.cc:606] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:31.376272  9958 raft_consensus.cc:614] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:31.346532  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:31.349908  9955 raft_consensus.cc:1275] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:28:31.349763  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4104e34a61b7448281d6d91ce23ebf71" is_pre_election: true
I20260709 12:28:31.379416  9778 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:31.381022  9955 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:31.381599  9955 raft_consensus.cc:606] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:31.381911  9955 raft_consensus.cc:614] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:31.354714  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:28:31.372982  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 68923.7us
I20260709 12:28:31.395280  9809 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e31dc7ebba9947e381658ef28347706a"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:31.395821  9809 raft_consensus.cc:606] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:31.396265  9809 raft_consensus.cc:614] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:28:31.399887  9884 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:28:31.382479 15862 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:31.405081 15648 consensus_queue.cc:1048] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:28:31.408388  9814 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:31.409037  9814 raft_consensus.cc:606] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:31.414866  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:28:31.416512  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:31.417215  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:31.420730 15912 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:28:31.457948 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:31.458950 15745 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:31.485875  9960 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:28:31.488933 15856 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:28:31.579603  9962 raft_consensus.cc:1275] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:28:31.583544 15856 consensus_queue.cc:1048] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:31.667042  9888 raft_consensus.cc:1275] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:28:31.673909 15862 consensus_queue.cc:1048] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:28:31.680430 10531 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:28:31.686944 15856 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:28:31.696969 15862 raft_consensus.cc:993] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:31.697479 15862 raft_consensus.cc:1081] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:31.702523  9888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:57658
I20260709 12:28:31.703194  9888 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:31.703684  9888 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:31.741065  9888 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:31.752533  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:31.753147  9814 raft_consensus.cc:3055] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:28:31.753715  9884 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:28:31.754133  9884 pending_rounds.cc:85] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b: Aborting all ops after (but not including) 12
I20260709 12:28:31.754343  9884 pending_rounds.cc:107] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:28:31.754562  9884 raft_consensus.cc:2889] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:28:31.753460  9814 raft_consensus.cc:740] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:31.756982  9888 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 19 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:31.759603  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecaeb132991949858ba7ff5186bd7024" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:31.760135  9960 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:31.755856  9814 consensus_queue.cc:260] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:31.766443  9814 raft_consensus.cc:3060] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:31.770462 15856 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:28:31.778252  9960 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 19.
I20260709 12:28:31.780345  9853 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:31.797242 15755 raft_consensus.cc:2804] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:28:31.817721 15755 raft_consensus.cc:697] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 19 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:31.843199  9814 raft_consensus.cc:2468] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 19.
W20260709 12:28:31.839675 15922 log.cc:927] Time spent T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:28:31.848711 15755 consensus_queue.cc:237] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:31.938501  9704 catalog_manager.cc:5697] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 11 to 12, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 12 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:28:31.940387  9704 catalog_manager.cc:5697] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 14 to 16, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 16 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
W20260709 12:28:31.960675  9698 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 3e593a3b7d754d449a065a58afdb1b7a with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 4 but the committed config has opid_index of 8
I20260709 12:28:31.961067  9704 catalog_manager.cc:5697] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 11 to 13, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 13 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:28:31.962642  9704 catalog_manager.cc:5697] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:31.964145  9704 catalog_manager.cc:5697] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:31.965734  9704 catalog_manager.cc:5697] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:31.967154  9704 catalog_manager.cc:5697] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 13 to 14, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 14 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:28:31.968590  9704 catalog_manager.cc:5697] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:31.972882  9704 catalog_manager.cc:5697] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 13 to 14, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 14 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
W20260709 12:28:31.975307  9705 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56416 (request call id 252) took 14848 ms (client timeout 15000 ms). Trace:
I20260709 12:28:31.978111  9704 catalog_manager.cc:5697] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:31.980316  9704 catalog_manager.cc:5697] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 19 to 21, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 21 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:31.984439  9704 catalog_manager.cc:5697] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:31.990789  9704 catalog_manager.cc:5697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
W20260709 12:28:31.975800  9705 rpcz_store.cc:269] 0709 12:28:17.126526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:17.126731 (+   205us) service_pool.cc:224] Handling call
0709 12:28:31.975240 (+14848509us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:31.569256 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:31.569810 (+   554us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:31.569843 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:28:31.569861 (+    18us) tablet.cc:662] Decoding operations
0709 12:28:31.570175 (+   314us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:31.570246 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:31.570308 (+    62us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:28:31.574586 (+  4278us) tablet.cc:701] Row locks acquired
0709 12:28:31.576036 (+  1450us) write_op.cc:260] PREPARE: finished
0709 12:28:31.602733 (+ 26697us) write_op.cc:270] Start()
0709 12:28:31.605826 (+  3093us) write_op.cc:276] Timestamp: P: 1783600111599449 usec, L: 0
0709 12:28:31.606355 (+   529us) op_driver.cc:348] REPLICATION: starting
0709 12:28:31.616785 (+ 10430us) log.cc:844] Serialized 533 byte log entry
0709 12:28:31.845622 (+228837us) op_driver.cc:464] REPLICATION: finished
0709 12:28:31.908207 (+ 62585us) write_op.cc:301] APPLY: starting
0709 12:28:31.908295 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:31.909442 (+  1147us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:31.909544 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:31.910343 (+   799us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:31.910529 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:28:31.910569 (+    40us) write_op.cc:312] APPLY: finished
0709 12:28:31.912391 (+  1822us) log.cc:844] Serialized 25 byte log entry
0709 12:28:31.913120 (+   729us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:31.913206 (+    86us) write_op.cc:454] Released schema lock
0709 12:28:31.913246 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:31.915263 (+  2017us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:31.915298 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":882048,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":62200,"apply.run_cpu_time_us":3227,"apply.run_wall_time_us":7007,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8303,"num_ops":1,"prepare.queue_time_us":158134,"prepare.run_cpu_time_us":94610,"prepare.run_wall_time_us":186143,"raft.queue_time_us":71540,"raft.run_cpu_time_us":43224,"raft.run_wall_time_us":62301,"replication_time_us":239094,"spinlock_wait_cycles":310144,"thread_start_us":372436,"threads_started":4,"wal-append.queue_time_us":146766}]]}
I20260709 12:28:31.992028  9704 catalog_manager.cc:5697] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 11 to 12, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 12 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:28:31.994923  9704 catalog_manager.cc:5697] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 15 to 16, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 16 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:31.998123  9704 catalog_manager.cc:5697] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 16 to 19, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 19 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:31.999571  9704 catalog_manager.cc:5697] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:32.000877  9704 catalog_manager.cc:5697] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 11 to 12, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 12 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:28:32.002192  9704 catalog_manager.cc:5697] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 14 to 16, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 16 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:28:32.004971  9704 catalog_manager.cc:5697] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 18 to 20, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 20 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:32.182895  9704 catalog_manager.cc:5697] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 17 to 19, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 19 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:32.185384  9704 catalog_manager.cc:5697] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 15 to 17, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 17 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:28:32.242198  9709 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59992 (request call id 300) took 57314 ms (client timeout 15000 ms). Trace:
W20260709 12:28:32.242935  9709 rpcz_store.cc:269] 0709 12:27:34.927783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:34.928052 (+   269us) service_pool.cc:224] Handling call
0709 12:27:35.896826 (+968774us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b5400002490. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f8640 00007f2f942cf846 00007f2f943d990e 00007f2f9289a2a4 00007f2f9289a232 00007f2f9289a161 00007f2f9289a0dc 00007f2f92899392 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:32.242088 (+56345262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6554,"reported_tablets":47,"spinlock_wait_cycles":4550528}
I20260709 12:28:32.305302  9710 catalog_manager.cc:5697] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 9 to 10, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 10 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:32.331890  9707 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59992 (request call id 303) took 6181 ms. Trace:
I20260709 12:28:32.332273  9707 rpcz_store.cc:276] 0709 12:28:26.150428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:26.150632 (+   204us) service_pool.cc:224] Handling call
0709 12:28:32.331826 (+6181194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":156165,"reported_tablets":23}
I20260709 12:28:32.332558  9710 catalog_manager.cc:5697] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:32.338246  9710 catalog_manager.cc:5697] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 16 to 17, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 17 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:32.359200  9960 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:28:32.363159 15755 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:28:32.456012  9814 raft_consensus.cc:1275] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 12:28:32.460067  9711 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59986 (request call id 333) took 66500 ms (client timeout 15000 ms). Trace:
W20260709 12:28:32.460630  9711 rpcz_store.cc:269] 0709 12:27:25.863320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.906554 (+ 43234us) service_pool.cc:224] Handling call
0709 12:27:26.217282 (+310728us) spinlock_profiling.cc:243] Waited 8.8 ms on lock 0x7b5400002490. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f7b71 00007f2f8b3f80b2 00007f2f94371759 00007f2f94309a76 00007f2f942dad58 00007f2f943d904e 00007f2f9289a2a4 00007f2f9289a232 00007f2f9289a161 00007f2f9289a0dc
0709 12:28:32.361406 (+66144124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2169497,"reported_tablets":47,"spinlock_wait_cycles":20250368}
I20260709 12:28:32.470345 15944 consensus_queue.cc:1048] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:28:32.470985 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 56396.2us
I20260709 12:28:32.551662  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:32.614364  9711 catalog_manager.cc:5697] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 18 to 19, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 19 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } }
I20260709 12:28:32.654978  9960 consensus_queue.cc:237] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:32.729691  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 59763us
W20260709 12:28:32.740536  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 68009.4us
I20260709 12:28:32.779202 15653 raft_consensus.cc:493] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:32.779767 15653 raft_consensus.cc:515] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } attrs { replace: true } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:32.800207  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:32.806097  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:32.816016  9779 leader_election.cc:304] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:32.817629 10533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e593a3b7d754d449a065a58afdb1b7a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:32.817801 15954 raft_consensus.cc:2749] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:32.812481 15653 leader_election.cc:290] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:32.871138  9705 catalog_manager.cc:5697] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:32.877240  9705 catalog_manager.cc:5697] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 11 to 12, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 12 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
W20260709 12:28:32.885321  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 153527us
I20260709 12:28:32.892644  9705 catalog_manager.cc:5697] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b reported cstate change: config changed from index 4 to 8, VOTER 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) evicted. New cstate: current_term: 9 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:32.902112  9705 catalog_manager.cc:5697] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 9 to 11, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 11 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:32.911546  9710 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59986 (request call id 336) took 5408 ms. Trace:
I20260709 12:28:32.917716  9809 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:28:32.916054  9710 rpcz_store.cc:276] 0709 12:28:27.502992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:27.503131 (+   139us) service_pool.cc:224] Handling call
0709 12:28:28.208635 (+705504us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b5400002490. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8b2b7db1 00007f2f8b3f8640 00007f2f942cf846 00007f2f943d990e 00007f2f9289a2a4 00007f2f9289a232 00007f2f9289a161 00007f2f9289a0dc 00007f2f92899392 00007f2f8c85748c 00007f2f8c8568c6
0709 12:28:32.911483 (+4702848us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:32.352573 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:32.412930 (+ 60357us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:32.414361 (+  1431us) write_op.cc:435] Acquired schema lock
0709 12:28:32.416071 (+  1710us) tablet.cc:662] Decoding operations
0709 12:28:32.476373 (+ 60302us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:32.477464 (+  1091us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:32.481596 (+  4132us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:28:32.490567 (+  8971us) tablet.cc:701] Row locks acquired
0709 12:28:32.490588 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:28:32.490754 (+   166us) write_op.cc:270] Start()
0709 12:28:32.490878 (+   124us) write_op.cc:276] Timestamp: P: 1783600112490712 usec, L: 0
0709 12:28:32.490898 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:28:32.505013 (+ 14115us) log.cc:844] Serialized 1293 byte log entry
0709 12:28:32.508877 (+  3864us) op_driver.cc:464] REPLICATION: finished
0709 12:28:32.509327 (+   450us) write_op.cc:301] APPLY: starting
0709 12:28:32.509410 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:32.511406 (+  1996us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:32.511512 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:32.551336 (+ 39824us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:32.551499 (+   163us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:28:32.551545 (+    46us) write_op.cc:312] APPLY: finished
0709 12:28:32.551741 (+   196us) log.cc:844] Serialized 41 byte log entry
0709 12:28:32.551896 (+   155us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:32.551985 (+    89us) write_op.cc:454] Released schema lock
0709 12:28:32.552034 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:32.552352 (+   318us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:32.552378 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12766,"reported_tablets":35,"spinlock_wait_cycles":3491200,"child_traces":[["op",{"apply.queue_time_us":247,"apply.run_cpu_time_us":5322,"apply.run_wall_time_us":42998,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12528,"num_ops":3,"prepare.queue_time_us":655,"prepare.run_cpu_time_us":4210,"prepare.run_wall_time_us":154312,"replication_time_us":15898}]]}
I20260709 12:28:32.914398  9705 catalog_manager.cc:5697] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:32.933177 15943 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:32.933019  9705 catalog_manager.cc:5697] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 12 to 13, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 13 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:32.961738 10533 raft_consensus.cc:1275] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:28:32.964258  9705 catalog_manager.cc:5697] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 15 to 16, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 16 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:32.986524 15960 raft_consensus.cc:2955] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 5 to 10, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:32.989944  9963 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:32.990568  9963 raft_consensus.cc:606] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:32.991896  9809 raft_consensus.cc:2955] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 5 to 10, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:33.031085 15943 consensus_queue.cc:1048] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:33.035923 10533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:60770
I20260709 12:28:33.036567 10533 raft_consensus.cc:606] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 21 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:33.044168 10533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900"
dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:60770
I20260709 12:28:33.044714 10533 raft_consensus.cc:606] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 15 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:33.050086  9963 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:33.050671  9963 raft_consensus.cc:606] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:33.051918  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:28:33.079761  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:33.080587  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:33.080502  9710 catalog_manager.cc:5697] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: config changed from index 5 to 10, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New cstate: current_term: 15 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:33.089876  9697 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8367fec391344e099ca237f0942e4f6d with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:28:33.104058 10533 raft_consensus.cc:2955] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 5 to 10, VOTER 963185e117384b2085d7cea02a64478b (127.8.111.66) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } } }
I20260709 12:28:33.227017  9871 tablet_service.cc:1558] Processing DeleteTablet for tablet 8367fec391344e099ca237f0942e4f6d with delete_type TABLET_DATA_TOMBSTONED (TS 963185e117384b2085d7cea02a64478b not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:54772
I20260709 12:28:33.258481  9705 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56416 (request call id 253) took 1196 ms. Trace:
I20260709 12:28:33.299513 15968 tablet_replica.cc:333] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:33.300720 15968 raft_consensus.cc:2243] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:33.301628 15968 raft_consensus.cc:2272] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:33.306079 15935 raft_consensus.cc:993] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:33.306561 15935 raft_consensus.cc:1081] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 15 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:33.262398  9705 rpcz_store.cc:276] 0709 12:28:32.055107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:32.055418 (+   311us) service_pool.cc:224] Handling call
0709 12:28:33.251213 (+1195795us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:32.990052 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:32.990584 (+   532us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:32.990618 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:28:32.990631 (+    13us) tablet.cc:662] Decoding operations
0709 12:28:32.991419 (+   788us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:32.991473 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:32.991497 (+    24us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:28:32.992072 (+   575us) tablet.cc:701] Row locks acquired
0709 12:28:32.992086 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:28:32.992214 (+   128us) write_op.cc:270] Start()
0709 12:28:32.992311 (+    97us) write_op.cc:276] Timestamp: P: 1783600112992172 usec, L: 0
0709 12:28:32.992327 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:28:32.992915 (+   588us) log.cc:844] Serialized 2814 byte log entry
0709 12:28:32.996836 (+  3921us) op_driver.cc:464] REPLICATION: finished
0709 12:28:32.999558 (+  2722us) write_op.cc:301] APPLY: starting
0709 12:28:32.999635 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:33.015938 (+ 16303us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:33.016032 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:33.022729 (+  6697us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b1800475c00. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b42f522 00007f2f8b4317c1 00007f2f8b431779 00007f2f8b431709 00007f2f8b4316d1 00007f2f8b4309cd 0000000000388634 0000000000388479 00007f2f8b41283a
0709 12:28:33.025617 (+  2888us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:33.025830 (+   213us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=0,mrs_lookups=0
0709 12:28:33.025882 (+    52us) write_op.cc:312] APPLY: finished
0709 12:28:33.026140 (+   258us) log.cc:844] Serialized 73 byte log entry
0709 12:28:33.035116 (+  8976us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:33.035245 (+   129us) write_op.cc:454] Released schema lock
0709 12:28:33.035302 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:33.035633 (+   331us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:33.035664 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":79647,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":2510,"apply.run_cpu_time_us":9592,"apply.run_wall_time_us":36049,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29232,"num_ops":7,"prepare.queue_time_us":10486,"prepare.run_cpu_time_us":3150,"prepare.run_wall_time_us":24937,"replication_time_us":4396,"spinlock_wait_cycles":13517056}]]}
I20260709 12:28:33.323787  9809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:34802
I20260709 12:28:33.324384  9809 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:33.324679  9809 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:33.331481  9809 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:33.338081  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:33.338475  9809 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:33.338646  9889 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:33.339694 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:33.340234 10531 raft_consensus.cc:3055] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:28:33.340494 10531 raft_consensus.cc:740] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:33.342693 10531 consensus_queue.cc:260] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:33.349617  9889 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 16.
I20260709 12:28:33.405452 15968 ts_tablet_manager.cc:1916] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:28:33.429837  9802 tablet_service.cc:1558] Processing DeleteTablet for tablet 3e593a3b7d754d449a065a58afdb1b7a with delete_type TABLET_DATA_TOMBSTONED (TS 4104e34a61b7448281d6d91ce23ebf71 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:41720
I20260709 12:28:33.450212  9882 raft_consensus.cc:1240] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Rejecting Update request from peer f5208640a51f493e930ce4f64ceeed0b for earlier term 15. Current term is 16. Ops: []
I20260709 12:28:33.452159 15745 consensus_queue.cc:1059] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:28:33.453118  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 57932.3us
I20260709 12:28:33.454305 15715 raft_consensus.cc:993] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:33.466467 15957 raft_consensus.cc:1081] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:33.473084 10531 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:33.478672  9809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46504
I20260709 12:28:33.479305  9809 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:33.479679  9809 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:33.486868 15960 raft_consensus.cc:993] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:33.487352 15972 raft_consensus.cc:1081] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:33.492524  9812 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46504
I20260709 12:28:33.493095  9812 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:33.493460  9812 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:33.504235 15968 ts_tablet_manager.cc:1929] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.9
I20260709 12:28:33.514627  9779 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:33.515398 15971 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:33.515933 15971 raft_consensus.cc:697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:33.515554 15968 log.cc:1199] T 8367fec391344e099ca237f0942e4f6d P 963185e117384b2085d7cea02a64478b: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-1-root/wals/8367fec391344e099ca237f0942e4f6d
I20260709 12:28:33.516882 15971 consensus_queue.cc:237] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:33.523034  9698 catalog_manager.cc:5028] TS 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): tablet 8367fec391344e099ca237f0942e4f6d (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:28:33.524179 15973 tablet_replica.cc:333] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:33.529896  9812 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:33.532958  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:33.533623  9960 raft_consensus.cc:3055] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:28:33.533932  9960 raft_consensus.cc:740] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:33.536264  9960 consensus_queue.cc:260] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:33.537403  9960 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:33.509733 10531 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 16.
I20260709 12:28:33.513233  9809 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:33.557397 15940 raft_consensus.cc:993] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:33.558197 15940 raft_consensus.cc:1081] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 21 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:33.564371  9815 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:34802
I20260709 12:28:33.564842  9809 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:33.564997  9815 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:33.617202  9705 catalog_manager.cc:5697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 15 to 16, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 16 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:33.618402  9815 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:28:33.567677  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:33.557556  9812 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:33.622787  9963 raft_consensus.cc:3055] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:33.581791 15973 raft_consensus.cc:2243] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:33.623123  9963 raft_consensus.cc:740] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:33.623651 15973 raft_consensus.cc:2272] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:33.623929  9963 consensus_queue.cc:260] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:33.625260  9963 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:33.627219 15973 ts_tablet_manager.cc:1916] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:28:33.594760  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:33.628377  9884 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:33.633680  9815 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:33.640079  9963 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:28:33.642294  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:33.642915  9958 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:28:33.649556  9958 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 22.
I20260709 12:28:33.642326  9884 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 16.
I20260709 12:28:33.650463  9778 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
W20260709 12:28:33.617769  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 46188.1us
I20260709 12:28:33.634035  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:33.608103 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:33.652961  9889 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:33.653066 10531 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:33.653266 15971 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:28:33.653825 15971 raft_consensus.cc:697] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 22 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:33.654629 15971 consensus_queue.cc:237] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:33.659963  9889 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:28:33.660598 10531 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 11.
I20260709 12:28:33.651738  9815 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 22 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:33.669100  9779 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:33.676414 15970 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:33.676796  9960 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 16.
I20260709 12:28:33.677137 15970 raft_consensus.cc:697] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 16 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:33.678025 15970 consensus_queue.cc:237] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:33.678731 15973 ts_tablet_manager.cc:1929] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.7
I20260709 12:28:33.679176 15973 log.cc:1199] T 3e593a3b7d754d449a065a58afdb1b7a P 4104e34a61b7448281d6d91ce23ebf71: Deleting WAL directory at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0/minicluster-data/ts-0-root/wals/3e593a3b7d754d449a065a58afdb1b7a
I20260709 12:28:33.688185  9697 catalog_manager.cc:5028] TS 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): tablet 3e593a3b7d754d449a065a58afdb1b7a (table test-workload [id=2104d965acd740c18427483cb0d3ea73]) successfully deleted
I20260709 12:28:33.691869  9779 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:33.701783 15970 raft_consensus.cc:2804] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:33.701848 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:33.702605 10531 raft_consensus.cc:3055] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:28:33.703106 10531 raft_consensus.cc:740] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:33.703787 10531 consensus_queue.cc:260] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:33.704901 10531 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:28:33.713516 10531 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 22.
I20260709 12:28:33.702569 15970 raft_consensus.cc:697] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:33.717522 15970 consensus_queue.cc:237] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:33.766861  9705 catalog_manager.cc:5697] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 21 to 22, leader changed from f5208640a51f493e930ce4f64ceeed0b (127.8.111.68) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 22 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:33.768656  9705 catalog_manager.cc:5697] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 15 to 16, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 16 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:33.770195  9705 catalog_manager.cc:5697] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 10 to 11, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 11 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:33.858494  9697 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet d1e4bd6e7a424475b1d707bfa268d54e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:28:33.928398 10531 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:28:33.932518 15971 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:28:34.003734  9884 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:28:34.005445 15953 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:28:34.105564  9963 raft_consensus.cc:1275] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:28:34.107532 15953 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:28:34.142724 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 68982.6us
W20260709 12:28:34.219313 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 59620.2us
W20260709 12:28:34.248803  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 84245.6us
I20260709 12:28:34.253309  9889 raft_consensus.cc:1275] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:28:34.256934 10533 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 22 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:28:34.258744  9958 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:28:34.260316  9960 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 22 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:28:34.261211 15953 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:28:34.263170 15953 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:34.261256 15971 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:28:34.264665 15970 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:28:34.274060  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:34.280171 10531 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:28:34.299059 15970 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:28:34.428123  9960 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:34.428730  9960 raft_consensus.cc:606] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:34.443111  9960 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:34.443714  9960 raft_consensus.cc:606] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 18 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:34.465152  9960 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:34.465705  9960 raft_consensus.cc:606] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:34.482018  9884 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:28:34.486842 15971 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:34.493175 15715 raft_consensus.cc:993] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:34.493654 15715 raft_consensus.cc:1081] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:34.495417  9809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46504
I20260709 12:28:34.495880  9809 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:34.496205  9809 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:34.506510  9960 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f93660c342af47199c6cec5c0424043a"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:34.506448  9809 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:34.507148  9960 raft_consensus.cc:606] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:34.508376  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:28:34.508688  9809 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:34.510216  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:34.514122  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:34.514695  9884 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:34.511111  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:34.539726  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:34.540370  9958 raft_consensus.cc:3055] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:28:34.540702  9958 raft_consensus.cc:740] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:34.541445  9958 consensus_queue.cc:260] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:34.559525  9884 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:28:34.564709  9779 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:34.572466  9958 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:34.606426  9958 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 9.
I20260709 12:28:34.642167 16002 raft_consensus.cc:2804] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:28:34.677827  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 103157us
W20260709 12:28:34.678810  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 114216us
I20260709 12:28:34.642856 16002 raft_consensus.cc:697] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 9 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:34.735378 16002 consensus_queue.cc:237] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:34.835855 15990 raft_consensus.cc:993] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:34.836357 15990 raft_consensus.cc:1081] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:34.866866 15991 raft_consensus.cc:993] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:34.867395 15991 raft_consensus.cc:1081] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 18 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:34.871344 15943 raft_consensus.cc:993] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:34.871819 15943 raft_consensus.cc:1081] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:34.873175  9815 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46504
I20260709 12:28:34.873767  9815 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:34.874120  9815 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:34.882473  9809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46504
I20260709 12:28:34.883028  9809 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:34.883389  9809 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:34.883458  9815 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:34.885344  9815 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 19 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:34.887105  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:34.887909  9889 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:34.896211  9809 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:34.898818  9882 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f93660c342af47199c6cec5c0424043a"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:57652
I20260709 12:28:34.899456  9882 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:34.899883  9882 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:34.922539  9887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:34.923161  9887 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:34.931509  9887 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:34.937878  9779 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:34.939689 15953 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:28:34.940161 15953 raft_consensus.cc:697] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:34.940984 15953 consensus_queue.cc:237] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:34.958508  9809 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:34.965828  9882 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:34.967948  9882 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:34.973145  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:34.974805  9960 raft_consensus.cc:3055] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:28:34.975155  9960 raft_consensus.cc:740] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:34.975927  9960 consensus_queue.cc:260] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:34.978430  9960 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:34.986013  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:34.986698  9958 raft_consensus.cc:3055] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:28:34.987048  9958 raft_consensus.cc:740] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:34.987810  9958 consensus_queue.cc:260] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:34.989075  9958 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:34.991225  9889 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 19.
I20260709 12:28:34.995572  9779 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:35.004244  9958 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:35.004979  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:35.011585  9962 raft_consensus.cc:3055] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:35.011884  9962 raft_consensus.cc:740] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:35.012620  9962 consensus_queue.cc:260] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:35.014938  9962 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:35.005259 15953 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:28:35.016891 15953 raft_consensus.cc:697] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 19 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:35.017901 15953 consensus_queue.cc:237] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:35.006727  9710 catalog_manager.cc:5697] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 8 to 9, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 9 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:35.010957  9960 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 19.
I20260709 12:28:35.030696  9962 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:28:35.032007  9853 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:35.033022 16024 raft_consensus.cc:2804] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:35.033563 16024 raft_consensus.cc:697] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 13 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:35.034654  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f93660c342af47199c6cec5c0424043a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:35.035300  9815 raft_consensus.cc:3060] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:35.034399 16024 consensus_queue.cc:237] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:35.056952  9815 raft_consensus.cc:2468] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
I20260709 12:28:35.113636  9707 catalog_manager.cc:5697] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 12 to 13, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 13 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:35.181468  9710 catalog_manager.cc:5697] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 16 to 17, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 17 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:35.183729  9710 catalog_manager.cc:5697] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 18 to 19, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 19 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:35.343071  9887 raft_consensus.cc:1275] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:28:35.361518  9958 raft_consensus.cc:1275] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:28:35.379065 15970 consensus_queue.cc:1048] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:35.394629 16002 consensus_queue.cc:1048] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:28:35.424911  9882 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:28:35.446213  9962 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:28:35.457357 16001 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:28:35.550083  9962 raft_consensus.cc:1275] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:28:35.556212 16011 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:28:35.557905 16005 consensus_queue.cc:1048] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:35.647868  9888 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:28:35.666172  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:35.685868  9809 raft_consensus.cc:1275] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:28:35.715756 15998 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:28:35.729132 15956 consensus_queue.cc:1048] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:28:35.776026  9963 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:28:35.787891 16003 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:28:36.114212  9815 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:36.132354  9815 raft_consensus.cc:606] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Received request to transfer leadership to TS b011791796d1457284b857d7d3422195
I20260709 12:28:36.135915  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:28:36.137861  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:36.139001  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:36.677120 16002 raft_consensus.cc:993] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower b011791796d1457284b857d7d3422195 to start an election
I20260709 12:28:36.677713 16002 raft_consensus.cc:1081] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Signalling peer b011791796d1457284b857d7d3422195 to start an election
I20260709 12:28:36.682250  9963 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f"
dest_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55952
I20260709 12:28:36.683017  9963 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:36.683449  9963 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:36.692790  9963 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:36.704279  9808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:36.704926  9808 raft_consensus.cc:3055] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:28:36.705225  9808 raft_consensus.cc:740] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:36.706002  9808 consensus_queue.cc:260] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:36.709247  9808 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:36.751055 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55e4af3d6737421b9d77650fa7d44f8f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:36.751749 10530 raft_consensus.cc:3060] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:36.760066 10530 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:28:36.768826  9808 raft_consensus.cc:2468] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:28:36.773178  9928 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:36.773159  9963 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:36.773978 16008 raft_consensus.cc:2804] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:28:36.774667 16008 raft_consensus.cc:697] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:36.777132 16008 consensus_queue.cc:237] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:36.817773  9707 catalog_manager.cc:5697] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 14 to 15, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 15 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:37.187417 10531 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:28:37.191584  9808 raft_consensus.cc:1275] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:28:37.198448 16000 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:28:37.228330 16008 consensus_queue.cc:1048] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 12:28:37.337939  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:37.486886  9960 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:37.487520  9960 raft_consensus.cc:606] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:37.497579  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:28:37.499255  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:37.499972  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:37.997423 16008 raft_consensus.cc:993] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:37.997974 16008 raft_consensus.cc:1081] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:38.002038  9809 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46504
I20260709 12:28:38.002667  9809 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:38.003021  9809 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:38.014454  9809 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:38.050823  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:38.051477  9883 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:38.050043  9809 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:38.057408  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:38.060534  9960 raft_consensus.cc:3055] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:28:38.060902  9960 raft_consensus.cc:740] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:38.064855  9960 consensus_queue.cc:260] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:38.088521  9960 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:28:38.102461  9883 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:28:38.112699  9779 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b; no voters: 
I20260709 12:28:38.114243 16001 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:28:38.117650 16001 raft_consensus.cc:697] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:38.118680 16001 consensus_queue.cc:237] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:38.139798  9960 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 13.
I20260709 12:28:38.190694  9707 catalog_manager.cc:5697] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 12 to 13, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 13 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:38.246788  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 94620.5us
W20260709 12:28:38.331892  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 54894.9us
I20260709 12:28:38.502419  9889 raft_consensus.cc:1275] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:28:38.508689 16074 consensus_queue.cc:1048] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:38.579134  9963 raft_consensus.cc:1275] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:28:38.582674 16069 consensus_queue.cc:1048] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:38.644119  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:38.822520  9808 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:38.823200  9808 raft_consensus.cc:606] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Received request to transfer leadership to TS b011791796d1457284b857d7d3422195
I20260709 12:28:38.855624  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:28:38.857465  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:38.858470  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:38.870860 16084 raft_consensus.cc:993] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower b011791796d1457284b857d7d3422195 to start an election
I20260709 12:28:38.903865 16085 raft_consensus.cc:1081] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Signalling peer b011791796d1457284b857d7d3422195 to start an election
W20260709 12:28:38.929600  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 44608us
W20260709 12:28:38.941753  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 58637.2us
I20260709 12:28:38.968007  9963 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e"
dest_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55952
I20260709 12:28:38.968578  9963 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:38.968914  9963 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:39.012770  9963 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:39.021837  9963 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:39.024179  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:39.024899  9889 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:39.029567  9815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:39.030194  9815 raft_consensus.cc:3055] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:28:39.030488  9815 raft_consensus.cc:740] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:39.031526  9815 consensus_queue.cc:260] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:39.049754  9815 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:39.049870  9889 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:28:39.050678  9883 raft_consensus.cc:1240] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Rejecting Update request from peer 4104e34a61b7448281d6d91ce23ebf71 for earlier term 11. Current term is 12. Ops: []
I20260709 12:28:39.079061  9815 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
I20260709 12:28:39.142235 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1e4bd6e7a424475b1d707bfa268d54e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:39.142901 10527 raft_consensus.cc:3060] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:39.150825  9928 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:39.178359 16088 raft_consensus.cc:2804] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:39.179141 16088 raft_consensus.cc:697] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:39.180272 16088 consensus_queue.cc:237] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:39.183336 10527 raft_consensus.cc:2468] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 12.
W20260709 12:28:39.207054  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 53133.3us
W20260709 12:28:39.225541 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 44382.1us
I20260709 12:28:39.311474  9707 catalog_manager.cc:5697] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 11 to 12, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 12 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:39.741079  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 43594.7us
I20260709 12:28:39.788352  9883 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:28:39.789958 10533 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:28:39.803958  9815 raft_consensus.cc:1275] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:28:39.809218 16112 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:28:39.812556  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 119097us
I20260709 12:28:39.828742 16089 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:39.850065 16112 consensus_queue.cc:1048] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:28:39.952293  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 65303.6us
I20260709 12:28:40.047174  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:40.103972  9961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:40.104574  9961 raft_consensus.cc:606] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:40.106035  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:28:40.107692  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:40.108415  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:40.300741 16087 raft_consensus.cc:993] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:40.301254 16087 raft_consensus.cc:1081] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:40.304148  9883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:57652
I20260709 12:28:40.304684  9883 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:40.305083  9883 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:40.324029  9883 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:40.336798  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:40.337401  9961 raft_consensus.cc:3055] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:28:40.337675  9961 raft_consensus.cc:740] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:40.338480  9961 consensus_queue.cc:260] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:40.340034  9961 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:40.347860 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:40.348479 10530 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:40.357224 10530 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:28:40.358837  9854 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:40.359862 16100 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:40.360337 16100 raft_consensus.cc:697] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:40.361238 16100 consensus_queue.cc:237] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:40.357648  9883 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 11 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:40.384615  9961 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 11.
I20260709 12:28:40.426443  9707 catalog_manager.cc:5697] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 10 to 11, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 11 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:40.819973  9960 raft_consensus.cc:1275] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:28:40.827272 16113 consensus_queue.cc:1048] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:28:40.864796 10527 raft_consensus.cc:1275] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:28:40.867651 16100 consensus_queue.cc:1048] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:28:41.051638  9779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 62952.8us
I20260709 12:28:41.174870  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:41.322834  9889 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:32962
I20260709 12:28:41.323422  9889 raft_consensus.cc:606] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 14 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:41.324770  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:28:41.326531  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:41.327302  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:41.529189 16131 raft_consensus.cc:993] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:41.529982 16131 raft_consensus.cc:1081] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 14 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:41.532575  9814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46496
I20260709 12:28:41.533108  9814 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:41.533454  9814 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:41.544557  9814 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:41.546945  9814 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:41.547871 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:41.548523 10530 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:41.551165  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:41.551733  9889 raft_consensus.cc:3055] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:28:41.552049  9889 raft_consensus.cc:740] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:41.552893  9889 consensus_queue.cc:260] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:41.554061  9889 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:41.564800 10530 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:41.566431  9779 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:41.566648  9889 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 15.
I20260709 12:28:41.567415 16143 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:28:41.576135 16143 raft_consensus.cc:697] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:41.577245 16143 consensus_queue.cc:237] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:41.615645  9707 catalog_manager.cc:5697] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 14 to 15, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 15 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:41.911235 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 60833.8us
I20260709 12:28:42.108338 10530 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:28:42.109928 16142 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:28:42.127808  9884 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:28:42.136023 16143 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:28:42.464131  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:42.569041  9815 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:42.569671  9815 raft_consensus.cc:606] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 22 LEADER]: Received request to transfer leadership to TS b011791796d1457284b857d7d3422195
I20260709 12:28:42.573271  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:28:42.575224  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:42.577126  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:42.874184 16162 raft_consensus.cc:993] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower b011791796d1457284b857d7d3422195 to start an election
I20260709 12:28:42.874719 16162 raft_consensus.cc:1081] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 22 LEADER]: Signalling peer b011791796d1457284b857d7d3422195 to start an election
I20260709 12:28:42.877946  9962 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e"
dest_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55952
I20260709 12:28:42.878518  9962 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:42.878854  9962 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:28:42.907044  9962 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:42.920684  9814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:42.921310  9814 raft_consensus.cc:3055] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:28:42.921615  9814 raft_consensus.cc:740] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:42.922403  9814 consensus_queue.cc:260] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:42.923576  9814 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:28:42.931569  9962 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 23 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:42.933223 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f77ade6a50544c9a6c3f56b3719a92e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:42.933811 10530 raft_consensus.cc:3060] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:28:42.953078 10530 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 23.
I20260709 12:28:42.964332  9928 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:42.963044  9814 raft_consensus.cc:2468] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 23.
I20260709 12:28:42.965124 16089 raft_consensus.cc:2804] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:28:42.965595 16089 raft_consensus.cc:697] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 23 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:42.966485 16089 consensus_queue.cc:237] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:43.049425  9707 catalog_manager.cc:5697] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 22 to 23, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 23 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.417753 10527 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 23 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:28:43.419487 16089 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:28:43.460843  9814 raft_consensus.cc:1275] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 23 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:28:43.463126 16089 consensus_queue.cc:1048] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:28:43.707355  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:43.765936  9960 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:43.766614  9960 raft_consensus.cc:606] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:43.768268  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:28:43.769848  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:43.770593  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:44.146950 16163 raft_consensus.cc:993] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:44.147495 16089 raft_consensus.cc:1081] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:44.149140  9814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46504
I20260709 12:28:44.149664  9814 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:44.149986  9814 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:44.175942  9814 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:44.182390  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:44.182986  9961 raft_consensus.cc:3055] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:28:44.183279  9961 raft_consensus.cc:740] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:44.184116  9961 consensus_queue.cc:260] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:44.185273  9961 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:44.186616  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:44.187285  9884 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:44.203361  9961 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:44.212327  9778 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:44.213340 16143 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:28:44.213915 16143 raft_consensus.cc:697] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:44.214784 16143 consensus_queue.cc:237] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:44.205878  9884 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:44.206314  9814 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:44.294746  9710 catalog_manager.cc:5697] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 16 to 17, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 17 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:44.596489  9960 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:28:44.599848 16175 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:28:44.653821  9883 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:28:44.657307 16162 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:28:45.041663  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:45.163578  9815 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:45.164273  9815 raft_consensus.cc:606] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 19 LEADER]: Received request to transfer leadership to TS b011791796d1457284b857d7d3422195
I20260709 12:28:45.165892  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:28:45.167742  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:45.168552  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:45.539368 16190 raft_consensus.cc:993] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower b011791796d1457284b857d7d3422195 to start an election
I20260709 12:28:45.540409 16190 raft_consensus.cc:1081] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 19 LEADER]: Signalling peer b011791796d1457284b857d7d3422195 to start an election
W20260709 12:28:45.647843  9778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 83224.9us
I20260709 12:28:45.700189  9962 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f"
dest_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55952
I20260709 12:28:45.701293  9962 raft_consensus.cc:493] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:45.701851  9962 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:28:45.737797  9962 raft_consensus.cc:515] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:45.745584  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:45.746469  9809 raft_consensus.cc:3055] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:28:45.746889  9809 raft_consensus.cc:740] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:45.747951  9809 consensus_queue.cc:260] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:45.749176  9962 leader_election.cc:290] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:45.749524  9809 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:28:45.750379  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8156e447e6a24044b5712dbb3a354b7f" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:45.758625  9882 raft_consensus.cc:3060] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:28:45.802742  9882 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 20.
I20260709 12:28:45.813442  9928 leader_election.cc:304] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:45.814520 16089 raft_consensus.cc:2804] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:28:45.814985 16089 raft_consensus.cc:697] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 20 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:45.815877 16089 consensus_queue.cc:237] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:45.809646  9809 raft_consensus.cc:2468] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 20.
I20260709 12:28:45.845582  9707 catalog_manager.cc:5697] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 19 to 20, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 20 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:46.284217  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:46.298017  9815 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 20 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:28:46.300997 16193 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:28:46.400337  9883 raft_consensus.cc:1275] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 20 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:28:46.403159 16195 consensus_queue.cc:1048] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:28:46.448657  9956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "27036dabafd8427cac190478948639ae"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:46.456127  9956 raft_consensus.cc:606] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 18 LEADER]: Received request to transfer leadership to TS 963185e117384b2085d7cea02a64478b
I20260709 12:28:46.466318  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:28:46.476238  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:46.483223  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:46.681813 16193 raft_consensus.cc:993] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195: : Instructing follower 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:46.682354 16193 raft_consensus.cc:1081] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 18 LEADER]: Signalling peer 963185e117384b2085d7cea02a64478b to start an election
I20260709 12:28:46.684230  9883 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "27036dabafd8427cac190478948639ae"
dest_uuid: "963185e117384b2085d7cea02a64478b"
 from {username='slave'} at 127.0.0.1:57652
I20260709 12:28:46.684770  9883 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:46.685084  9883 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:46.699954  9883 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:46.714473  9956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:46.715047  9956 raft_consensus.cc:3055] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:28:46.715317  9956 raft_consensus.cc:740] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:46.716197  9956 consensus_queue.cc:260] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:46.717384  9956 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:46.730171  9883 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 19 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:46.731376 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:46.732935 10530 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:28:46.745589 10530 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 19.
I20260709 12:28:46.747061  9854 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:46.748060 16154 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:28:46.748535 16154 raft_consensus.cc:697] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 19 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:46.749374 16154 consensus_queue.cc:237] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:46.731364  9956 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 19.
I20260709 12:28:46.779366  9707 catalog_manager.cc:5697] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 18 to 19, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 19 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:47.155825  9962 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:28:47.157500 16135 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:28:47.229771 10528 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:28:47.231874 16154 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:28:47.617744  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:47.822206  9889 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118"
dest_uuid: "963185e117384b2085d7cea02a64478b"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:32962
I20260709 12:28:47.822870  9889 raft_consensus.cc:606] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 16 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:47.826984  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:28:47.828874  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:47.838935  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:47.963182 16219 raft_consensus.cc:993] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:47.963757 16219 raft_consensus.cc:1081] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 16 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:47.967396  9815 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46496
I20260709 12:28:47.967936  9815 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:47.968334  9815 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:47.979578  9815 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:47.990396  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:47.990990  9889 raft_consensus.cc:3055] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:28:47.991307  9889 raft_consensus.cc:740] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:47.992146  9889 consensus_queue.cc:260] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:47.994700  9889 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:48.002717 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:48.003327 10528 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:48.012506 10528 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:48.013906  9779 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:48.014791 16222 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:28:48.015301 16222 raft_consensus.cc:697] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:48.016338 16222 consensus_queue.cc:237] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:48.035779  9815 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:48.045248  9707 catalog_manager.cc:5697] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 16 to 17, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 17 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:48.053668  9889 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:48.466833 10530 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:28:48.469594 16200 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:28:48.540046  9883 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:28:48.545320 16194 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:28:49.021027  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:49.098129  9815 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
mode: GRACEFUL
new_leader_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55720
I20260709 12:28:49.098752  9815 raft_consensus.cc:606] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Received request to transfer leadership to TS b011791796d1457284b857d7d3422195
I20260709 12:28:49.100696  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:28:49.102610  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:49.103449  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:49.332427 16200 raft_consensus.cc:993] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71: : Instructing follower b011791796d1457284b857d7d3422195 to start an election
I20260709 12:28:49.332938 16200 raft_consensus.cc:1081] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Signalling peer b011791796d1457284b857d7d3422195 to start an election
I20260709 12:28:49.334791  9956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e"
dest_uuid: "b011791796d1457284b857d7d3422195"
 from {username='slave'} at 127.0.0.1:55952
I20260709 12:28:49.335312  9956 raft_consensus.cc:493] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:49.335634  9956 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:49.348663  9956 raft_consensus.cc:515] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:49.354450  9956 leader_election.cc:290] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:49.355046  9809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
I20260709 12:28:49.355386  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bb7b32528a4a0b83305a9131ca5f1e" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:49.355659  9809 raft_consensus.cc:3055] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:28:49.356045  9889 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:49.356097  9809 raft_consensus.cc:740] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:49.357097  9809 consensus_queue.cc:260] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:49.358603  9809 raft_consensus.cc:3060] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:49.365268  9809 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 18.
I20260709 12:28:49.376006  9927 leader_election.cc:304] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:49.376773  9889 raft_consensus.cc:2468] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 18.
I20260709 12:28:49.376912 16195 raft_consensus.cc:2804] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:28:49.380641 16195 raft_consensus.cc:697] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 18 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:49.381561 16195 consensus_queue.cc:237] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:49.418830  9707 catalog_manager.cc:5697] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 17 to 18, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 18 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:49.786311  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 142147us
I20260709 12:28:49.808115  9882 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:28:49.811079 16195 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:28:49.881851  9809 raft_consensus.cc:1275] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:28:49.883875 16239 consensus_queue.cc:1048] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:28:50.268936  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:50.496266  9960 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7"
dest_uuid: "b011791796d1457284b857d7d3422195"
mode: GRACEFUL
new_leader_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:53218
I20260709 12:28:50.496876  9960 raft_consensus.cc:606] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Received request to transfer leadership to TS 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:50.498412  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:28:50.500182  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:50.500976  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:50.864151 16235 raft_consensus.cc:993] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195: : Instructing follower 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:50.865566 16235 raft_consensus.cc:1081] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Signalling peer 4104e34a61b7448281d6d91ce23ebf71 to start an election
I20260709 12:28:50.869585  9814 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7"
dest_uuid: "4104e34a61b7448281d6d91ce23ebf71"
 from {username='slave'} at 127.0.0.1:46504
I20260709 12:28:50.870172  9814 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:50.870555  9814 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:50.878584  9814 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:50.907521  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:50.908138  9961 raft_consensus.cc:3055] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:28:50.908429  9961 raft_consensus.cc:740] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:50.909227  9961 consensus_queue.cc:260] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:50.912930  9961 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:50.920683  9961 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:50.921813  9778 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:50.923492 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "4104e34a61b7448281d6d91ce23ebf71" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:50.924098 10528 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:50.921922  9814 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [CANDIDATE]: Term 17 election: Requested vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:50.928128 16200 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:28:50.929589 16200 raft_consensus.cc:697] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Becoming Leader. State: Replica: 4104e34a61b7448281d6d91ce23ebf71, State: Running, Role: LEADER
I20260709 12:28:50.930526 16200 consensus_queue.cc:237] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:50.935998 10528 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4104e34a61b7448281d6d91ce23ebf71 in term 17.
I20260709 12:28:50.960824  9707 catalog_manager.cc:5697] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 reported cstate change: term changed from 16 to 17, leader changed from b011791796d1457284b857d7d3422195 (127.8.111.67) to 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65). New cstate: current_term: 17 leader_uuid: "4104e34a61b7448281d6d91ce23ebf71" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:51.363873  9960 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:28:51.371073 16222 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:28:51.469837 10528 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Refusing update from remote peer 4104e34a61b7448281d6d91ce23ebf71: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:28:51.471757 16222 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:28:51.613544  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:461: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 1
I20260709 12:28:51.776643  8637 tablet_server.cc:179] TabletServer@127.8.111.65:0 shutting down...
W20260709 12:28:51.783152  9927 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 31 similar messages]
W20260709 12:28:51.849884  9927 consensus_peers.cc:597] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:51.854404  9927 consensus_peers.cc:597] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:51.862248  9853 consensus_peers.cc:597] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:51.866174  9927 consensus_peers.cc:597] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:51.869545  9853 consensus_peers.cc:597] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:51.879789 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 69340us
W20260709 12:28:51.881423 10496 consensus_peers.cc:597] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:51.888738  9853 consensus_peers.cc:597] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:51.910521  9927 consensus_peers.cc:597] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:51.956549  9927 consensus_peers.cc:597] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:51.962054 10496 consensus_peers.cc:597] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:51.962797 10496 consensus_peers.cc:597] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:51.984336  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:51.987977  8637 tablet_replica.cc:333] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
W20260709 12:28:51.988925  9853 consensus_peers.cc:597] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:51.989073  8637 raft_consensus.cc:2243] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:28:51.990489  8637 raft_consensus.cc:2272] T 816661d3711b4989a37fe8f5befcd6a4 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.005277  8637 tablet_replica.cc:333] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.006219  8637 raft_consensus.cc:2243] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.006891  8637 raft_consensus.cc:2272] T 3ffb5c0a23894c12bb5bd0d73c289106 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.010016  8637 tablet_replica.cc:333] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.010896  8637 raft_consensus.cc:2243] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.011476  8637 raft_consensus.cc:2272] T 8156e447e6a24044b5712dbb3a354b7f P 4104e34a61b7448281d6d91ce23ebf71 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.030711  8637 tablet_replica.cc:333] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.031716  8637 raft_consensus.cc:2243] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:28:52.032933  8637 raft_consensus.cc:2272] T 02b534aa26dd41d5afe616e203520c1a P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.035974  8637 tablet_replica.cc:333] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.041414  8637 raft_consensus.cc:2243] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:28:52.055164  8637 raft_consensus.cc:2272] T 95440cd9ec714a699fca70a8a9b17e96 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.059257  8637 tablet_replica.cc:333] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.060750  8637 raft_consensus.cc:2243] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:52.061261 10496 consensus_peers.cc:597] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:52.061431  8637 raft_consensus.cc:2272] T a95007be04144b799116ba6a2d753a1e P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.065768  8637 tablet_replica.cc:333] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.066656  8637 raft_consensus.cc:2243] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.067411  8637 raft_consensus.cc:2272] T f27b8e99a0274a2791f902106d779c23 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.070612  8637 tablet_replica.cc:333] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
W20260709 12:28:52.071262  9927 consensus_peers.cc:597] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:52.075902  8637 raft_consensus.cc:2243] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:28:52.076996  8637 raft_consensus.cc:2272] T c1c0ea749e8a45d4935db42359f9df11 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:52.084555 10496 consensus_peers.cc:597] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:52.105326  8637 tablet_replica.cc:333] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.106376  8637 raft_consensus.cc:2243] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.107074  8637 raft_consensus.cc:2272] T 90aeaa3c967a48a4804d8960b26f02b5 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.110121  8637 tablet_replica.cc:333] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.112221  8637 raft_consensus.cc:2243] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.112841  8637 raft_consensus.cc:2272] T 0f77ade6a50544c9a6c3f56b3719a92e P 4104e34a61b7448281d6d91ce23ebf71 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.115728  8637 tablet_replica.cc:333] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.122466  8637 raft_consensus.cc:2243] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 9 LEADER]: Raft consensus shutting down.
W20260709 12:28:52.122824 10496 consensus_peers.cc:597] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:52.116730  9927 consensus_peers.cc:597] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:52.124291  8637 raft_consensus.cc:2272] T ce8d330ea5fd473c98b6e36199f7c07b P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:52.124423  9927 consensus_peers.cc:597] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:52.125092  9927 consensus_peers.cc:597] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:52.125733  9927 consensus_peers.cc:597] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:52.127475  8637 tablet_replica.cc:333] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.135408  8637 raft_consensus.cc:2243] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:28:52.136696  8637 raft_consensus.cc:2272] T af4289b1f8fb44b9a1d46742954fab18 P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.140239  8637 tablet_replica.cc:333] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.141067  8637 raft_consensus.cc:2243] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:28:52.145586  8637 raft_consensus.cc:2272] T 92a71d859626422a835ad38ab2ba7bd7 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:52.160581  9853 consensus_peers.cc:597] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:52.169827  8637 tablet_replica.cc:333] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
W20260709 12:28:52.173606  9853 consensus_peers.cc:597] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:52.174715  8637 raft_consensus.cc:2243] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:28:52.177255  8637 raft_consensus.cc:2272] T f0f4046979c94f6b9fcfd429cb2f454f P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.185866  8637 tablet_replica.cc:333] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.186728  8637 raft_consensus.cc:2243] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:28:52.187896  8637 raft_consensus.cc:2272] T 563b5b4a0da24676a96f01291cf312c7 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.190636  8637 tablet_replica.cc:333] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.191404  8637 raft_consensus.cc:2243] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.192016  8637 raft_consensus.cc:2272] T af001ec909824ed199d355fd69f43ede P 4104e34a61b7448281d6d91ce23ebf71 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:52.193032 10496 consensus_peers.cc:597] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:52.194728  8637 tablet_replica.cc:333] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.195569  8637 raft_consensus.cc:2243] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:28:52.196681  8637 raft_consensus.cc:2272] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.199332  8637 tablet_replica.cc:333] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.200126  8637 raft_consensus.cc:2243] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.200691  8637 raft_consensus.cc:2272] T 55e4af3d6737421b9d77650fa7d44f8f P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.203207  8637 tablet_replica.cc:333] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.204020  8637 raft_consensus.cc:2243] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.204625  8637 raft_consensus.cc:2272] T bae6a0d1c1c44960b4b110046bee07a8 P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.212530  8637 tablet_replica.cc:333] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.213305  8637 raft_consensus.cc:2243] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:28:52.214795  8637 raft_consensus.cc:2272] T 4af4b34b71b641009c828e29f2c4cc41 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:52.218174 10496 consensus_peers.cc:597] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:52.220278  9927 consensus_peers.cc:597] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:52.220479  8637 tablet_replica.cc:333] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
W20260709 12:28:52.221213  9853 consensus_peers.cc:597] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:52.221318  8637 raft_consensus.cc:2243] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.221974  8637 raft_consensus.cc:2272] T fb049358bf66417d84d91e61b68ff1bb P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:52.226730  9853 consensus_peers.cc:597] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:52.232605  8637 tablet_replica.cc:333] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.233587  8637 raft_consensus.cc:2243] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.234198  8637 raft_consensus.cc:2272] T ecaeb132991949858ba7ff5186bd7024 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:52.244098  9853 consensus_peers.cc:597] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:52.261345  8637 tablet_replica.cc:333] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.262292  8637 raft_consensus.cc:2243] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:28:52.263407  8637 raft_consensus.cc:2272] T 5224954c61b74424bc8af520537e37ec P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.286429  8637 tablet_replica.cc:333] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.289330  8637 raft_consensus.cc:2243] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Raft consensus shutting down.
W20260709 12:28:52.286568 10496 consensus_peers.cc:597] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:52.297966  8637 raft_consensus.cc:2272] T 83a89bfaa6124501b656ed0691a7f711 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.300627  8637 tablet_replica.cc:333] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.301409  8637 raft_consensus.cc:2243] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.302179  8637 raft_consensus.cc:2272] T 8367fec391344e099ca237f0942e4f6d P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:52.306911 10496 consensus_peers.cc:597] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:52.358327  8637 tablet_replica.cc:333] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.359324  8637 raft_consensus.cc:2243] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.360093  8637 raft_consensus.cc:2272] T 9a7dd9ecad304177bbefcb8725c66393 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.375139  8637 tablet_replica.cc:333] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.375944  8637 raft_consensus.cc:2243] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:28:52.402514  8637 raft_consensus.cc:2272] T c0075a6cf83049839402dd3dbaa93adc P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.408851  8637 tablet_replica.cc:333] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.409431  8637 raft_consensus.cc:2243] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:28:52.410396  8637 raft_consensus.cc:2272] T 264ab80fe3634a5390e84f23e4dd8c94 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.424187  8637 tablet_replica.cc:333] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.427958  8637 raft_consensus.cc:2243] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.430662  8637 raft_consensus.cc:2272] T 7f56c0f50a014def9b283a94186feae6 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.450960  8637 tablet_replica.cc:333] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.451778  8637 raft_consensus.cc:2243] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.459328  8637 raft_consensus.cc:2272] T d1e4bd6e7a424475b1d707bfa268d54e P 4104e34a61b7448281d6d91ce23ebf71 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.468873  8637 tablet_replica.cc:333] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.474905  8637 raft_consensus.cc:2243] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.475853  8637 raft_consensus.cc:2272] T b97d7561bbd8444f9bbafa9c397d3f62 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.478430  8637 tablet_replica.cc:333] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.485767  8637 raft_consensus.cc:2243] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.486680  8637 raft_consensus.cc:2272] T a47692d74f884d019a3ec583399bdb4c P 4104e34a61b7448281d6d91ce23ebf71 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.498719  8637 tablet_replica.cc:333] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.499512  8637 raft_consensus.cc:2243] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.500283  8637 raft_consensus.cc:2272] T ab78f05fa6f4406a81716ded4d302aee P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.502812  8637 tablet_replica.cc:333] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.503572  8637 raft_consensus.cc:2243] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.504148  8637 raft_consensus.cc:2272] T 3290aa2b0ef349e78e838202fb70b358 P 4104e34a61b7448281d6d91ce23ebf71 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.506803  8637 tablet_replica.cc:333] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.507550  8637 raft_consensus.cc:2243] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.514596  8637 raft_consensus.cc:2272] T a5bdaeb6ccf347499e2dff26efaf7deb P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.525152  8637 tablet_replica.cc:333] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.530814  8637 raft_consensus.cc:2243] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.531574  8637 raft_consensus.cc:2272] T ecf7be2e7d02465d87ce4296e257c29b P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.540812  8637 tablet_replica.cc:333] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.541672  8637 raft_consensus.cc:2243] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.610504  8637 raft_consensus.cc:2272] T e31dc7ebba9947e381658ef28347706a P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.613487  8637 tablet_replica.cc:333] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.622876  8637 raft_consensus.cc:2243] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.623509  8637 raft_consensus.cc:2272] T 59bb7b32528a4a0b83305a9131ca5f1e P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.630676  8637 tablet_replica.cc:333] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.631348  8637 raft_consensus.cc:2243] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.633658  8637 raft_consensus.cc:2272] T 3ebec313878e48e88fcec9daadd369b9 P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.644241  8637 tablet_replica.cc:333] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.644909  8637 raft_consensus.cc:2243] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.645481  8637 raft_consensus.cc:2272] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 4104e34a61b7448281d6d91ce23ebf71 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.657586  8637 tablet_replica.cc:333] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.663898  8637 raft_consensus.cc:2243] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.664597  8637 raft_consensus.cc:2272] T e55138bc5c8b46a1a4b5408bb8a06868 P 4104e34a61b7448281d6d91ce23ebf71 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.677624  8637 tablet_replica.cc:333] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.681291  8637 raft_consensus.cc:2243] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:28:52.691458  8637 raft_consensus.cc:2272] T ad53c1df0a9749d992b37564e8225118 P 4104e34a61b7448281d6d91ce23ebf71 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.698688  8637 tablet_replica.cc:333] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.702320  8637 raft_consensus.cc:2243] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.706543  8637 raft_consensus.cc:2272] T 052aa541571c4bea87eeb1ed2f45a1bf P 4104e34a61b7448281d6d91ce23ebf71 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.718658  8637 tablet_replica.cc:333] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.720973  8637 raft_consensus.cc:2243] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.730700  8637 raft_consensus.cc:2272] T f93660c342af47199c6cec5c0424043a P 4104e34a61b7448281d6d91ce23ebf71 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.733637  8637 tablet_replica.cc:333] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.734426  8637 raft_consensus.cc:2243] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.748984  8637 raft_consensus.cc:2272] T 0e64098fbd794a1daa6778e4c06eb54e P 4104e34a61b7448281d6d91ce23ebf71 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.751852  8637 tablet_replica.cc:333] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71: stopping tablet replica
I20260709 12:28:52.752599  8637 raft_consensus.cc:2243] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:52.753427  8637 raft_consensus.cc:2272] T cbfc8e9bdb244a4c8679e7585cce700c P 4104e34a61b7448281d6d91ce23ebf71 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:52.998168 16198 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:52.998752 16198 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:53.000803 16198 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:53.004200  9961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:28:53.019781  9853 leader_election.cc:336] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:28:53.021037  9853 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:53.022478 16154 raft_consensus.cc:2749] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:53.129429 16266 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.130201 16266 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.133329 16266 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:53.134516  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:28:53.163961 10496 leader_election.cc:336] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:53.164856 10496 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:53.165709 16266 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:53.216114 16235 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.216881 16235 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:53.220233 16235 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:53.222579  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:28:53.228755  9927 leader_election.cc:336] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:53.229199  9927 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:53.229898 16235 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:28:53.254057 16198 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.254616 16198 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:53.256548 16198 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:53.260088  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:53.260910  9960 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 19.
I20260709 12:28:53.262463 16154 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.263306  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:53.280105 16154 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.281438 16244 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:28:53.281911 16244 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.282266 16244 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:28:53.288033 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:53.292110  9853 leader_election.cc:336] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:53.295576  9853 leader_election.cc:336] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:53.296065  9853 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:53.296861 16198 raft_consensus.cc:2749] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:53.297837 16198 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.298332 16198 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:53.300287 16198 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:53.302130 16154 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:53.303562 16244 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:53.305397  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:53.318022 16198 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.310019 16244 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 20 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:53.318598 16198 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.321875 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:53.323597 16198 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:53.329321  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "816661d3711b4989a37fe8f5befcd6a4" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:53.330024  9960 raft_consensus.cc:3060] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:28:53.347817  9853 leader_election.cc:336] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:53.349485  9853 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:53.360857 16154 raft_consensus.cc:2749] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:53.364455 16235 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.365020 16235 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:53.367074 16235 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:53.368525  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
W20260709 12:28:53.375710  9927 leader_election.cc:336] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:53.379382  9927 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:53.380477 16235 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:53.388844  9960 raft_consensus.cc:2468] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 20.
W20260709 12:28:53.389191  9853 leader_election.cc:336] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:53.391165  9853 leader_election.cc:336] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:53.391693  9853 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:53.392427 16154 raft_consensus.cc:2749] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:28:53.396652  9853 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:53.397449 16154 raft_consensus.cc:2804] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:28:53.397884 16154 raft_consensus.cc:697] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 20 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:53.398696 16154 consensus_queue.cc:237] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:53.415910 16235 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.416472 16235 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.418923 16235 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:53.420225 16269 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.420869 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:53.421604 16269 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.424784 16269 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:53.426990 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:53.428586 16266 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.429111 16266 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.431535 16266 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:53.443815 16239 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.444355 16239 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:53.448416 16267 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.448927 16267 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:53.450862 16267 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:28:53.452800 10496 leader_election.cc:336] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:53.455192 16239 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:53.474625  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:28:53.476613  9927 leader_election.cc:336] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:53.479940  9927 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:53.480738 16239 raft_consensus.cc:2749] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:28:53.483258  9927 leader_election.cc:336] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:53.483774  9927 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:53.506765  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 97124.2us
I20260709 12:28:53.507520 16239 raft_consensus.cc:2749] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:28:53.519465 16235 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.523729 16235 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:53.526508 16235 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:53.531060 16266 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.531641 16266 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.533802 16266 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:53.547752 10496 leader_election.cc:336] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:53.555966 16239 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.556655 16239 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.559279 16266 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.559871 16266 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.562178 16266 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:53.576417 16267 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.577055 16267 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.579201 16267 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:53.581128 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:53.581723 10528 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 17.
I20260709 12:28:53.582939  9928 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:53.584604 16269 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:53.585036 16269 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.585454 16269 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:53.599757 16239 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:53.601701 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:53.602666 10528 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
W20260709 12:28:53.603706 10496 leader_election.cc:336] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:53.606117 16266 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.606669 16266 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.608815 16250 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.612124 16250 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.614244 16250 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:28:53.518738  9927 leader_election.cc:336] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:53.619060  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 100350us
I20260709 12:28:53.619709  9928 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:53.620354 16198 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.622766 16198 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:53.624536 16198 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:53.625361  9927 leader_election.cc:336] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:53.627935 16235 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:53.629830 16235 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.630183 16235 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:53.634706 16276 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.635851 16276 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.637948 16276 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:53.638798 16266 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:53.638701  9711 catalog_manager.cc:5697] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 19 to 20, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 20 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:53.639940 16198 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.640544 16198 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.634773 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:53.644490 16198 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:53.656216  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:53.656840  9960 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 13.
W20260709 12:28:53.654844  9853 leader_election.cc:336] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:53.640437 16267 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.662153  9853 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:53.663780 16269 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.666395 16269 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:53.668656 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:53.669333 10528 raft_consensus.cc:3060] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:53.669545  9881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:53.670670  9882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:53.670140  9881 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 9.
I20260709 12:28:53.673266  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:53.654127 16266 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:53.680189 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:53.684170  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:53.684744  9889 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 17.
I20260709 12:28:53.685937  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:53.686532  9883 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 15.
I20260709 12:28:53.686892 16275 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:28:53.687381 16275 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.687839 16275 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:53.688927 10528 raft_consensus.cc:2468] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 18.
I20260709 12:28:53.690358 16198 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.690815 16198 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.692544 16198 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:53.693210  9928 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:28:53.693730  9853 leader_election.cc:336] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:53.697283 16267 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:53.701612 16267 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:53.702505  9853 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:53.708287 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:53.708886 10530 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 16.
I20260709 12:28:53.710701  9854 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:53.702195 16267 raft_consensus.cc:2804] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:28:53.711436 10497 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:53.711916 16267 raft_consensus.cc:697] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 18 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:53.714342  9928 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:53.715822 16276 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:53.716228 16276 raft_consensus.cc:493] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.716572 16276 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:53.713408 10497 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:53.720018 16250 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:53.720388 16250 raft_consensus.cc:493] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.720770 16250 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:53.712975 16267 consensus_queue.cc:237] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.726348 16239 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:28:53.727752 16198 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.728435 16154 raft_consensus.cc:2749] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:53.729519  9928 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:53.731202  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:53.731797  9889 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:28:53.732419 16198 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:53.739840 16239 raft_consensus.cc:2804] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:53.740417 16239 raft_consensus.cc:493] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.740890 16239 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:53.747207 16154 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:53.747601 16154 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.748003 16154 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:53.749559 16198 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:53.760215 16250 raft_consensus.cc:515] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.761718 16266 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.762238 16266 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.762791 16250 leader_election.cc:290] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:53.764266 16266 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:53.766189 16154 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.764277 16239 raft_consensus.cc:515] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:53.764652 16275 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:53.787036 16154 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:53.798979 16198 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.799625 16198 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:53.801469 16239 leader_election.cc:290] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:53.803215 16198 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:53.746227 16235 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:53.825248  9854 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:37417, user_credentials={real_user=slave}} blocked reactor thread for 114607us
I20260709 12:28:53.827320 10530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6b2dfaf2fc345a8a7e88a8c1e9e8900" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:53.828095 10530 raft_consensus.cc:3060] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:53.839596 16198 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.840157 16198 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.867555 16235 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
W20260709 12:28:53.868569  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 139166us
I20260709 12:28:53.869846  9928 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:53.870754 16239 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:28:53.872300  9928 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:53.881546 16239 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:53.882115 16239 raft_consensus.cc:493] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.882563 16239 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:53.885161  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af4289b1f8fb44b9a1d46742954fab18" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:53.885609  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:53.887032  9888 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 17.
I20260709 12:28:53.885798  9889 raft_consensus.cc:3060] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:53.892582 16239 raft_consensus.cc:515] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:53.896754 16239 leader_election.cc:290] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:53.898242  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:53.898995  9960 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 17.
I20260709 12:28:53.899936  9710 catalog_manager.cc:5697] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 17 to 18, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 18 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:53.903671  9889 raft_consensus.cc:2468] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 16.
I20260709 12:28:53.905542 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1c0ea749e8a45d4935db42359f9df11" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:53.906149 10528 raft_consensus.cc:3060] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:53.913097 10528 raft_consensus.cc:2468] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
I20260709 12:28:53.902192 16276 raft_consensus.cc:515] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.916337 16276 leader_election.cc:290] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:53.917382 16275 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:53.927062  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:53.927697  9960 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 17.
I20260709 12:28:53.928531 10530 raft_consensus.cc:2468] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 17.
I20260709 12:28:53.928956  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b534aa26dd41d5afe616e203520c1a" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:53.929504  9883 raft_consensus.cc:3060] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:53.927482  9928 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:28:53.932963 10496 leader_election.cc:336] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:53.934013 10496 leader_election.cc:336] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:53.926704 10497 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:53.937207  9883 raft_consensus.cc:2468] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 17.
W20260709 12:28:53.940623  9853 leader_election.cc:336] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:53.941488  9853 leader_election.cc:336] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:53.935622 10497 leader_election.cc:304] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:53.944252 16277 raft_consensus.cc:2804] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:53.944796 16276 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:53.945981 16276 raft_consensus.cc:493] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.947535 16267 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.947885  9962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:53.948225  9960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563b5b4a0da24676a96f01291cf312c7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:53.948082 16267 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.948577  9962 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 17.
I20260709 12:28:53.950114  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:53.950714  9958 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 19.
I20260709 12:28:53.950949  9854 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:53.954475 16285 raft_consensus.cc:2804] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:28:53.954989 16285 raft_consensus.cc:697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 17 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:53.955363 16267 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:53.955883 16285 consensus_queue.cc:237] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.958088 16277 raft_consensus.cc:697] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:53.959049 16277 consensus_queue.cc:237] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.959735  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8d330ea5fd473c98b6e36199f7c07b" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:53.960350  9889 raft_consensus.cc:3060] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:53.947572 16198 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:53.962899 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:53.966578 16284 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.967084 16284 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.967482 16250 raft_consensus.cc:2804] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:53.968039 16250 raft_consensus.cc:697] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 16 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:53.969075 16284 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:53.968986 16250 consensus_queue.cc:237] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:53.946450 16276 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:53.971101 10531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:53.972023 10531 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 16.
W20260709 12:28:53.977684 10496 leader_election.cc:336] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:53.978880  9928 leader_election.cc:304] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:53.981961  9883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0f4046979c94f6b9fcfd429cb2f454f" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:53.982596  9883 raft_consensus.cc:3060] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:53.986495  9884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b" is_pre_election: true
I20260709 12:28:53.987097  9884 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 16.
I20260709 12:28:53.989768  9928 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:53.990477 16239 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:53.990800 16239 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.991123 16239 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:53.993503  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95440cd9ec714a699fca70a8a9b17e96" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:53.994051 10497 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:53.994045  9963 raft_consensus.cc:3060] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:28:53.997479 16289 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:53.998054 16289 raft_consensus.cc:493] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:53.998592 16289 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:54.005862  9853 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
W20260709 12:28:54.011328 10496 leader_election.cc:336] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:54.025933 16275 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:54.026700 16275 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:54.027228 16275 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:28:54.037364 10496 leader_election.cc:336] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:54.038323 10496 leader_election.cc:336] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:54.043367  9961 raft_consensus.cc:1275] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 12:28:54.045212 10496 leader_election.cc:336] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:54.052733  8637 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 9836)
I20260709 12:28:54.046025  9889 raft_consensus.cc:2468] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:28:54.056182  9963 raft_consensus.cc:2468] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 14.
I20260709 12:28:54.057780  9853 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:54.059289  9928 leader_election.cc:304] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:54.061748 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:28:54.062340 16290 raft_consensus.cc:2804] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:54.062641 16281 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:28:54.063602 16290 raft_consensus.cc:697] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:28:54.064455  9927 leader_election.cc:336] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:54.065331  9927 leader_election.cc:336] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:54.063956 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:54.065852 16198 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:54.072829 16198 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:54.073343 16198 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:54.070744 16269 raft_consensus.cc:2804] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:28:54.075196 16269 raft_consensus.cc:697] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 17 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:54.076083 16269 consensus_queue.cc:237] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:54.077003 16276 raft_consensus.cc:515] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:54.078155 10528 raft_consensus.cc:2393] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 963185e117384b2085d7cea02a64478b in current term 18: Already voted for candidate f5208640a51f493e930ce4f64ceeed0b in this term.
I20260709 12:28:54.091375 16274 consensus_queue.cc:1048] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:28:54.093506  9853 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:54.094384 16274 raft_consensus.cc:2804] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:28:54.094871 16274 raft_consensus.cc:697] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 14 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
W20260709 12:28:54.096215  9853 leader_election.cc:336] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:54.096936  9853 leader_election.cc:336] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:54.085547 16266 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:54.095752 16274 consensus_queue.cc:237] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:54.104100 16266 raft_consensus.cc:493] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:54.104574 16266 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:54.108170 16276 leader_election.cc:290] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:54.109934  9883 raft_consensus.cc:2468] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 18.
W20260709 12:28:54.111435  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 46114.4us
I20260709 12:28:54.113505 16275 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:54.119310 16275 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:54.121390  9888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad53c1df0a9749d992b37564e8225118" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:54.125154  9888 raft_consensus.cc:3060] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:28:54.124133  9853 leader_election.cc:336] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:54.126158  9853 leader_election.cc:336] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:54.126593  9853 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:54.127224 16239 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:54.131528  9927 leader_election.cc:336] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:54.132553  9927 leader_election.cc:336] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:54.133617  9927 leader_election.cc:336] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:54.138062  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0075a6cf83049839402dd3dbaa93adc" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:54.138847  9963 raft_consensus.cc:3060] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:54.140762 16239 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:54.108577 16289 raft_consensus.cc:515] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:54.151504 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "264ab80fe3634a5390e84f23e4dd8c94" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:54.152307 10528 raft_consensus.cc:3060] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:54.065534 16290 consensus_queue.cc:237] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:54.161149  9853 consensus_peers.cc:597] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:54.161726  9853 leader_election.cc:336] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:54.162861 10497 leader_election.cc:304] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:54.163842 16284 raft_consensus.cc:2804] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:28:54.164364 16284 raft_consensus.cc:697] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 18 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:54.165223 16284 consensus_queue.cc:237] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:54.166527 16289 leader_election.cc:290] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:54.170135  9889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5224954c61b74424bc8af520537e37ec" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "963185e117384b2085d7cea02a64478b"
I20260709 12:28:54.170712  9889 raft_consensus.cc:3060] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:54.172995  9963 raft_consensus.cc:2468] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 18.
I20260709 12:28:54.174669 10528 raft_consensus.cc:2468] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 17.
I20260709 12:28:54.179845  9853 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:54.185241 16287 raft_consensus.cc:2804] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:28:54.186321 16287 raft_consensus.cc:697] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 18 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:54.187116 16287 consensus_queue.cc:237] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:54.188285 16266 raft_consensus.cc:515] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:54.188650  9927 leader_election.cc:336] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:54.190264  9927 leader_election.cc:336] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:54.190900  9927 leader_election.cc:336] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:54.192495  9927 leader_election.cc:336] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:54.210431 16266 leader_election.cc:290] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:54.181188 16198 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:54.181207  9888 raft_consensus.cc:2468] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 18.
I20260709 12:28:54.179231  9889 raft_consensus.cc:2468] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 17.
I20260709 12:28:54.222110  9928 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:54.236065 10497 leader_election.cc:304] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:54.236892 10497 leader_election.cc:304] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:28:54.238116  9927 leader_election.cc:336] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:54.238590 16198 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:54.224386  9711 catalog_manager.cc:5697] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 15 to 16, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 16 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.254268  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83a89bfaa6124501b656ed0691a7f711" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:54.255818  9958 raft_consensus.cc:3060] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:54.250018 16250 raft_consensus.cc:2804] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:28:54.249938 16289 raft_consensus.cc:2804] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:28:54.250608 16235 raft_consensus.cc:2804] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:28:54.268456  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 43850.1us
W20260709 12:28:54.269001 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 185812us
I20260709 12:28:54.269618 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71
I20260709 12:28:54.270355 16276 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:28:54.270788 16276 raft_consensus.cc:493] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 4104e34a61b7448281d6d91ce23ebf71)
I20260709 12:28:54.250111 16283 raft_consensus.cc:2749] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:28:54.272692  9710 catalog_manager.cc:5697] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 16 to 17, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 17 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:54.273394 16235 raft_consensus.cc:697] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 17 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:54.276675  9710 catalog_manager.cc:5697] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 13 to 14, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 14 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:54.277657 16235 consensus_queue.cc:237] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:54.280145  9958 raft_consensus.cc:2468] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 963185e117384b2085d7cea02a64478b in term 18.
I20260709 12:28:54.281251  9853 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195; no voters: 
I20260709 12:28:54.272064 16276 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:28:54.273566 16289 raft_consensus.cc:697] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 17 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:54.286307 16286 raft_consensus.cc:2804] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:28:54.295130 16289 consensus_queue.cc:237] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:54.299347 16286 raft_consensus.cc:697] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 18 LEADER]: Becoming Leader. State: Replica: 963185e117384b2085d7cea02a64478b, State: Running, Role: LEADER
I20260709 12:28:54.301151 16286 consensus_queue.cc:237] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:54.301132  9927 consensus_peers.cc:597] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:54.304044 16276 raft_consensus.cc:515] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:54.375893 16250 raft_consensus.cc:697] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 18 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:54.387671 16250 consensus_queue.cc:237] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:54.392735  9927 consensus_peers.cc:597] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:54.392625  9711 catalog_manager.cc:5697] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 15 to 16, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 16 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:54.397899  9711 catalog_manager.cc:5697] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 16 to 17, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 17 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.401212  9711 catalog_manager.cc:5697] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 9 to 10, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 10 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.414356 16276 leader_election.cc:290] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 20 election: Requested vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:54.416390  9853 leader_election.cc:336] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:54.432539  9888 raft_consensus.cc:1275] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:28:54.433794 16281 consensus_queue.cc:1048] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:28:54.436143 10527 raft_consensus.cc:1275] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:28:54.449271 16239 consensus_queue.cc:1048] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:28:54.452267  9853 consensus_peers.cc:597] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:54.452782  9853 consensus_peers.cc:597] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:54.469393 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 197423us
I20260709 12:28:54.476472  9710 catalog_manager.cc:5697] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 16 to 17, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 17 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:54.502923  9853 consensus_peers.cc:597] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:54.507462 10531 raft_consensus.cc:1275] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:28:54.513491 16198 consensus_queue.cc:1048] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:28:54.525713  9927 consensus_peers.cc:597] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:54.526674  9711 catalog_manager.cc:5697] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 17 to 18, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 18 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:54.530375  9711 catalog_manager.cc:5697] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b reported cstate change: term changed from 17 to 18, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to 963185e117384b2085d7cea02a64478b (127.8.111.66). New cstate: current_term: 18 leader_uuid: "963185e117384b2085d7cea02a64478b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:54.542445  9927 consensus_peers.cc:597] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:54.656634 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 112542us
I20260709 12:28:54.709234  9963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4af4b34b71b641009c828e29f2c4cc41" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:54.709679  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92a71d859626422a835ad38ab2ba7bd7" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:54.710060  9963 raft_consensus.cc:3060] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:28:54.710259  9958 raft_consensus.cc:3060] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:54.718080  9963 raft_consensus.cc:2468] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 20.
W20260709 12:28:54.720573 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 63149.5us
I20260709 12:28:54.725073  9958 raft_consensus.cc:2468] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 18.
I20260709 12:28:54.728009 10527 raft_consensus.cc:1275] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:28:54.739758  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 193702us
I20260709 12:28:54.759820  9889 raft_consensus.cc:1275] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:28:54.771124  9710 catalog_manager.cc:5697] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 17 to 18, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 18 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.782001  9710 catalog_manager.cc:5697] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 16 to 17, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 17 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.783526  9710 catalog_manager.cc:5697] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 17 to 18, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 18 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.774748  9883 raft_consensus.cc:1275] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:28:54.761214  9853 consensus_peers.cc:597] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:54.776757  9881 raft_consensus.cc:1275] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:28:54.787555  9853 consensus_peers.cc:597] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:54.787982  9853 consensus_peers.cc:597] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:54.788378  9853 consensus_peers.cc:597] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:54.754508  9927 consensus_peers.cc:597] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:54.789570  9927 consensus_peers.cc:597] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:54.790447 10496 leader_election.cc:304] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:54.791314 16281 raft_consensus.cc:2804] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:28:54.792085 16281 raft_consensus.cc:697] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 20 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:54.793720 16281 consensus_queue.cc:237] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:54.801821  9958 raft_consensus.cc:1275] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:28:54.805606  9881 raft_consensus.cc:1275] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:28:54.810003  9958 raft_consensus.cc:1275] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:28:54.811239 16282 consensus_queue.cc:1048] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:28:54.813253  9927 consensus_peers.cc:597] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:54.814741 16282 consensus_queue.cc:1048] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:28:54.815335  9927 consensus_peers.cc:597] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:54.815649  9853 consensus_peers.cc:597] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:54.817075 16250 consensus_queue.cc:1048] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:28:54.817584 16282 consensus_queue.cc:1048] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:28:54.818774  9927 consensus_peers.cc:597] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:54.818998  9853 consensus_peers.cc:597] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:54.821714 16289 consensus_queue.cc:1048] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:28:54.829391  9927 consensus_peers.cc:597] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:54.830610 16285 consensus_queue.cc:1048] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:54.833756 16285 consensus_queue.cc:1048] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:28:54.838630 10496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 48279us
I20260709 12:28:54.849007  9958 raft_consensus.cc:1275] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Refusing update from remote peer 963185e117384b2085d7cea02a64478b: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:28:54.853722  9927 consensus_peers.cc:597] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:54.855094 10496 leader_election.cc:304] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:54.860766 16250 raft_consensus.cc:2804] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:28:54.861251 16250 raft_consensus.cc:697] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 18 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:54.862066 16250 consensus_queue.cc:237] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:54.875116 16285 consensus_queue.cc:1048] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:28:54.877091  9710 catalog_manager.cc:5697] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 19 to 20, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 20 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.895453 10531 raft_consensus.cc:1275] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:28:54.916721 16290 consensus_queue.cc:1048] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:28:54.930727  9882 raft_consensus.cc:1275] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:28:54.941085 10496 leader_election.cc:336] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:54.942131 10496 leader_election.cc:336] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:54.943557  9927 consensus_peers.cc:597] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:54.942915  9710 catalog_manager.cc:5697] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 17 to 18, leader changed from 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 18 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:28:54.942935 10496 leader_election.cc:336] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:54.959255 10496 consensus_peers.cc:597] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:54.959623 10496 leader_election.cc:336] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:54.960354 10496 consensus_peers.cc:597] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:54.987845 16281 consensus_queue.cc:1048] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:28:55.028558  9853 consensus_peers.cc:597] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:55.032857  9927 consensus_peers.cc:597] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:55.038575 10496 consensus_peers.cc:597] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:55.039158 10496 consensus_peers.cc:597] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:55.039621 10496 consensus_peers.cc:597] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:55.040109 10496 consensus_peers.cc:597] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:55.053609  8637 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 9836)
W20260709 12:28:55.057464  9853 consensus_peers.cc:597] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:55.068717  9927 consensus_peers.cc:597] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:55.085054  9853 consensus_peers.cc:597] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:55.087925  9927 consensus_peers.cc:597] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:55.104099 10496 consensus_peers.cc:597] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:55.122546 10496 consensus_peers.cc:597] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:55.139115 10496 consensus_peers.cc:597] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:55.173838 10496 consensus_peers.cc:597] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:55.219187 10496 consensus_peers.cc:597] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:55.224642  9853 consensus_peers.cc:597] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:55.241576 10496 consensus_peers.cc:597] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:55.290930 10496 consensus_peers.cc:597] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:55.295770  9927 consensus_peers.cc:597] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:55.325165 10496 consensus_peers.cc:597] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:55.335327  9958 raft_consensus.cc:1275] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:28:55.336642 16281 consensus_queue.cc:1048] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:28:55.392436  9955 raft_consensus.cc:1275] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:28:55.395211 16299 consensus_queue.cc:1048] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:28:55.441493 10496 consensus_peers.cc:597] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:55.480561 10496 consensus_peers.cc:597] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:55.612867  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 82430.1us
W20260709 12:28:56.054315  8637 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 9836)
I20260709 12:28:56.522771  8637 tablet_server.cc:196] TabletServer@127.8.111.65:0 shutdown complete.
W20260709 12:28:56.545372  9927 consensus_peers.cc:597] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:56.580551  9853 consensus_peers.cc:597] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:56.633600  9853 consensus_peers.cc:597] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:56.785228  9927 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111) [suppressed 395 similar messages]
W20260709 12:28:56.842568  9853 consensus_peers.cc:597] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:56.884119  9927 consensus_peers.cc:597] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:57.016032  9853 consensus_peers.cc:597] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:57.026494  9927 consensus_peers.cc:597] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:57.045832 10496 consensus_peers.cc:597] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:57.047489  9853 consensus_peers.cc:597] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:57.074589  9927 consensus_peers.cc:597] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:57.090706  9853 consensus_peers.cc:597] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:57.091300  9927 consensus_peers.cc:597] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:57.145605  8637 tablet_server.cc:179] TabletServer@127.8.111.66:0 shutting down...
W20260709 12:28:57.162269  9853 consensus_peers.cc:597] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:57.187063  9927 consensus_peers.cc:597] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:57.187806  9853 consensus_peers.cc:597] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:57.217583  9853 consensus_peers.cc:597] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:57.227787 10497 consensus_peers.cc:597] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:57.255753  9927 consensus_peers.cc:597] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:57.271776  9928 consensus_peers.cc:597] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:57.287191 10497 consensus_peers.cc:597] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:57.319417 10497 consensus_peers.cc:597] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:57.329668 10497 consensus_peers.cc:597] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:57.334354 10496 consensus_peers.cc:597] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:57.335006 10496 consensus_peers.cc:597] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:57.343014 10496 consensus_peers.cc:597] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:57.367787  9928 consensus_peers.cc:597] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:57.371961  9928 consensus_peers.cc:597] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:57.370661 10496 consensus_peers.cc:597] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:57.376282  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:28:57.376467  9928 consensus_peers.cc:597] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:57.379668  9928 consensus_peers.cc:597] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:57.386149  8637 tablet_replica.cc:333] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.388203  8637 raft_consensus.cc:2243] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:28:57.393512  8637 raft_consensus.cc:2272] T 3ffb5c0a23894c12bb5bd0d73c289106 P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:57.401312  9853 consensus_peers.cc:597] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:57.407792  8637 tablet_replica.cc:333] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.408704  8637 raft_consensus.cc:2243] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:57.409334  8637 raft_consensus.cc:2272] T 8156e447e6a24044b5712dbb3a354b7f P 963185e117384b2085d7cea02a64478b [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:57.415488  9928 consensus_peers.cc:597] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:57.418342  9928 consensus_peers.cc:597] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:57.419883  9928 consensus_peers.cc:597] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:57.427215  8637 tablet_replica.cc:333] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.428161  8637 raft_consensus.cc:2243] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 20 LEADER]: Raft consensus shutting down.
W20260709 12:28:57.437803  9927 consensus_peers.cc:597] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:57.439586  9927 consensus_peers.cc:597] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:57.441291  9927 consensus_peers.cc:597] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:57.444394  8637 raft_consensus.cc:2272] T 816661d3711b4989a37fe8f5befcd6a4 P 963185e117384b2085d7cea02a64478b [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:57.456111 10497 consensus_peers.cc:597] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:57.450467  9928 consensus_peers.cc:597] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:57.459108  9927 consensus_peers.cc:597] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:57.464030  9928 consensus_peers.cc:597] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:57.473033  8637 tablet_replica.cc:333] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.478426  8637 raft_consensus.cc:2243] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:28:57.479503  8637 raft_consensus.cc:2272] T bcb5052194b44bc49f4db5030ce11988 P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:57.470844  9853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:42253, user_credentials={real_user=slave}} blocked reactor thread for 66806.5us
W20260709 12:28:57.481274  9927 consensus_peers.cc:597] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:57.488273 10496 consensus_peers.cc:597] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:57.496553  8637 tablet_replica.cc:333] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
W20260709 12:28:57.497432  9928 consensus_peers.cc:597] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:57.508708  8637 raft_consensus.cc:2243] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:28:57.518018  8637 raft_consensus.cc:2272] T 95440cd9ec714a699fca70a8a9b17e96 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:57.521351  8637 tablet_replica.cc:333] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.522374  8637 raft_consensus.cc:2243] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:57.523123  8637 raft_consensus.cc:2272] T 02b534aa26dd41d5afe616e203520c1a P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:57.525388 10497 consensus_peers.cc:597] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:57.516405  9853 consensus_peers.cc:597] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:57.526124  9853 consensus_peers.cc:597] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:57.526896  8637 tablet_replica.cc:333] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.527842  8637 raft_consensus.cc:2243] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:57.528653  8637 raft_consensus.cc:2272] T e528961028ca49b7a317cd20fbb343a8 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:57.531802  8637 tablet_replica.cc:333] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.532770  8637 raft_consensus.cc:2243] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:57.533808  8637 raft_consensus.cc:2272] T ce8d330ea5fd473c98b6e36199f7c07b P 963185e117384b2085d7cea02a64478b [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:57.537393  8637 tablet_replica.cc:333] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.538383  8637 raft_consensus.cc:2243] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:28:57.539624  8637 raft_consensus.cc:2272] T 83a89bfaa6124501b656ed0691a7f711 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:57.542680  8637 tablet_replica.cc:333] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b: stopping tablet replica
W20260709 12:28:57.549248  9928 consensus_peers.cc:597] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:57.556420  9928 consensus_peers.cc:597] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:57.556582 10497 consensus_peers.cc:597] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:57.558755  9928 consensus_peers.cc:597] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:57.559930  8637 raft_consensus.cc:2243] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:57.560770  8637 raft_consensus.cc:2272] T 5224954c61b74424bc8af520537e37ec P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:57.566998  8637 tablet_replica.cc:333] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
W20260709 12:28:57.567427 10497 consensus_peers.cc:597] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:57.567893  8637 raft_consensus.cc:2243] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 13 LEADER]: Raft consensus shutting down.
W20260709 12:28:57.569031 10497 consensus_peers.cc:597] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:57.569276  8637 raft_consensus.cc:2272] T f27b8e99a0274a2791f902106d779c23 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:57.572549  8637 tablet_replica.cc:333] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.573500  8637 raft_consensus.cc:2243] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:57.574246  8637 raft_consensus.cc:2272] T af001ec909824ed199d355fd69f43ede P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:57.577479  8637 tablet_replica.cc:333] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.578413  8637 raft_consensus.cc:2243] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:28:57.579763  8637 raft_consensus.cc:2272] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:57.582557  8637 tablet_replica.cc:333] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.583370  8637 raft_consensus.cc:2243] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:57.583987  8637 raft_consensus.cc:2272] T f0f4046979c94f6b9fcfd429cb2f454f P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:57.586961  8637 tablet_replica.cc:333] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.587859  8637 raft_consensus.cc:2243] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:57.588248 10497 consensus_peers.cc:597] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:57.588640  8637 raft_consensus.cc:2272] T cb82dc8d0b87403f90e84b650a35abb0 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:57.591750  8637 tablet_replica.cc:333] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.592674  8637 raft_consensus.cc:2243] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:28:57.594132  8637 raft_consensus.cc:2272] T be9677b33dcc4236a5656b7747c90d13 P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:57.602108 10497 consensus_peers.cc:597] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:57.604420  9927 consensus_peers.cc:597] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:57.604892  9927 consensus_peers.cc:597] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:57.607506  8637 tablet_replica.cc:333] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.608675  8637 raft_consensus.cc:2243] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:28:57.609793  8637 raft_consensus.cc:2272] T 02b16516f13c42bfae1f9f2e877ee307 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:57.617625  8637 tablet_replica.cc:333] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.618561  8637 raft_consensus.cc:2243] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:28:57.619975  8637 raft_consensus.cc:2272] T 9a7dd9ecad304177bbefcb8725c66393 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:57.623052  8637 tablet_replica.cc:333] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.623980  8637 raft_consensus.cc:2243] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:28:57.625674  8637 raft_consensus.cc:2272] T c0075a6cf83049839402dd3dbaa93adc P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:57.626693 10497 consensus_peers.cc:597] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:57.631683  8637 tablet_replica.cc:333] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.632684  8637 raft_consensus.cc:2243] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:57.634079  8637 raft_consensus.cc:2272] T 3e593a3b7d754d449a065a58afdb1b7a P 963185e117384b2085d7cea02a64478b [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:57.637415  8637 tablet_replica.cc:333] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
W20260709 12:28:57.647959 10496 consensus_peers.cc:597] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:57.666745  8637 raft_consensus.cc:2243] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 12 LEADER]: Raft consensus shutting down.
W20260709 12:28:57.669140  9927 consensus_peers.cc:597] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:57.671734  8637 raft_consensus.cc:2272] T bae6a0d1c1c44960b4b110046bee07a8 P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:57.674868  8637 tablet_replica.cc:333] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.675796  8637 raft_consensus.cc:2243] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:28:57.676990  8637 raft_consensus.cc:2272] T 441af0e88f714cb3be023c9bdcd006fc P 963185e117384b2085d7cea02a64478b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:57.685925  8637 tablet_replica.cc:333] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.686861  8637 raft_consensus.cc:2243] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:57.689814  8637 raft_consensus.cc:2272] T fa3541b3559e488d9911972fd2250fc6 P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:57.695377 10496 consensus_peers.cc:597] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:57.695797  8637 tablet_replica.cc:333] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.696743  8637 raft_consensus.cc:2243] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:28:57.697906  8637 raft_consensus.cc:2272] T 7f56c0f50a014def9b283a94186feae6 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:57.705063  8637 tablet_replica.cc:333] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.705982  8637 raft_consensus.cc:2243] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:28:57.707295  8637 raft_consensus.cc:2272] T 27036dabafd8427cac190478948639ae P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:57.712779 10496 consensus_peers.cc:597] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:57.715281  8637 tablet_replica.cc:333] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.716244  8637 raft_consensus.cc:2243] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:28:57.718703  8637 raft_consensus.cc:2272] T ecaeb132991949858ba7ff5186bd7024 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:57.720746 10496 consensus_peers.cc:597] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:57.722683  8637 tablet_replica.cc:333] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.723748  8637 raft_consensus.cc:2243] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:57.724710  8637 raft_consensus.cc:2272] T fb049358bf66417d84d91e61b68ff1bb P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:57.801848  8637 tablet_replica.cc:333] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.802939  8637 raft_consensus.cc:2243] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:57.803721  8637 raft_consensus.cc:2272] T d1e4bd6e7a424475b1d707bfa268d54e P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:57.844763  9927 consensus_peers.cc:597] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:57.860400  8637 tablet_replica.cc:333] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.874197  8637 raft_consensus.cc:2243] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:57.879824  8637 raft_consensus.cc:2272] T 3ebec313878e48e88fcec9daadd369b9 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:57.892913  8637 tablet_replica.cc:333] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.920946  8637 raft_consensus.cc:2243] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:57.942706  8637 raft_consensus.cc:2272] T ecf7be2e7d02465d87ce4296e257c29b P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:57.941541 10496 consensus_peers.cc:597] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:57.947495 10496 consensus_peers.cc:597] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:57.961946  8637 tablet_replica.cc:333] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:57.982824  8637 raft_consensus.cc:2243] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:28:57.992689  8637 raft_consensus.cc:2272] T e31dc7ebba9947e381658ef28347706a P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:57.990232 10496 consensus_peers.cc:597] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:58.003645 10496 consensus_peers.cc:597] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:58.009819  8637 tablet_replica.cc:333] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:58.010856  8637 raft_consensus.cc:2243] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.032724  8637 raft_consensus.cc:2272] T 511405268634431e9bf729e0fc87c838 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.035807  8637 tablet_replica.cc:333] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:58.036906  8637 raft_consensus.cc:2243] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.037883  8637 raft_consensus.cc:2272] T 59bb7b32528a4a0b83305a9131ca5f1e P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.041049  8637 tablet_replica.cc:333] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b: stopping tablet replica
W20260709 12:28:58.073040 10496 consensus_peers.cc:597] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:58.128332  8637 raft_consensus.cc:2243] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:28:58.131575  8637 raft_consensus.cc:2272] T 6f86e0db5aaa4690a0351c44520f7baf P 963185e117384b2085d7cea02a64478b [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:58.143620 10496 consensus_peers.cc:597] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:58.147188 16288 raft_consensus.cc:493] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f5208640a51f493e930ce4f64ceeed0b)
I20260709 12:28:58.154767 16288 raft_consensus.cc:515] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:58.157234 16288 leader_election.cc:290] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:58.159691 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "052aa541571c4bea87eeb1ed2f45a1bf" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:58.167809  8637 tablet_replica.cc:333] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
W20260709 12:28:58.174773  9853 leader_election.cc:336] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:58.175443  9853 leader_election.cc:304] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: 4104e34a61b7448281d6d91ce23ebf71, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:58.176765 16288 raft_consensus.cc:2749] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:28:58.191253  8637 raft_consensus.cc:2243] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.194052  8637 raft_consensus.cc:2272] T 4b844d67afb64319be2e7e6a8ec99319 P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.203100  8637 tablet_replica.cc:333] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:58.204909  8637 raft_consensus.cc:2243] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.214761  8637 raft_consensus.cc:2272] T e55138bc5c8b46a1a4b5408bb8a06868 P 963185e117384b2085d7cea02a64478b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.223569  8637 tablet_replica.cc:333] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:58.224586  8637 raft_consensus.cc:2243] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.225754  8637 raft_consensus.cc:2272] T ab78f05fa6f4406a81716ded4d302aee P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.250628  8637 tablet_replica.cc:333] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:58.257593  8637 raft_consensus.cc:2243] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.262367  8637 raft_consensus.cc:2272] T a47692d74f884d019a3ec583399bdb4c P 963185e117384b2085d7cea02a64478b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.265194  8637 tablet_replica.cc:333] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:58.273559  8637 raft_consensus.cc:2243] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.274266  8637 raft_consensus.cc:2272] T 052aa541571c4bea87eeb1ed2f45a1bf P 963185e117384b2085d7cea02a64478b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.277086 16288 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:28:58.277621 16288 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:58.279901 16288 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b011791796d1457284b857d7d3422195 (127.8.111.67:42253), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:58.281960  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:58.282210 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a402ce065f4914a9fab2f516a37bcd" candidate_uuid: "963185e117384b2085d7cea02a64478b" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:58.284353  9853 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 963185e117384b2085d7cea02a64478b; no voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:58.285527 16288 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:58.286347  8637 tablet_replica.cc:333] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:58.287447  8637 raft_consensus.cc:2243] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:28:58.291656  8637 raft_consensus.cc:2272] T f93660c342af47199c6cec5c0424043a P 963185e117384b2085d7cea02a64478b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.296525  8637 tablet_replica.cc:333] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:58.297363  8637 raft_consensus.cc:2243] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.298113  8637 raft_consensus.cc:2272] T ad53c1df0a9749d992b37564e8225118 P 963185e117384b2085d7cea02a64478b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.300940  8637 tablet_replica.cc:333] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:58.306846  8637 raft_consensus.cc:2243] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.307592  8637 raft_consensus.cc:2272] T 0e64098fbd794a1daa6778e4c06eb54e P 963185e117384b2085d7cea02a64478b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.311167  8637 tablet_replica.cc:333] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:58.311925  8637 raft_consensus.cc:2243] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.313171  8637 raft_consensus.cc:2272] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.315980  8637 tablet_replica.cc:333] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:58.316757  8637 raft_consensus.cc:2243] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.317600  8637 raft_consensus.cc:2272] T af4289b1f8fb44b9a1d46742954fab18 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.320546  8637 tablet_replica.cc:333] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:58.322664  8637 raft_consensus.cc:2243] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:28:58.328128  8637 raft_consensus.cc:2272] T b97d7561bbd8444f9bbafa9c397d3f62 P 963185e117384b2085d7cea02a64478b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.330909  8637 tablet_replica.cc:333] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b: stopping tablet replica
I20260709 12:28:58.331631  8637 raft_consensus.cc:2243] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:58.332358  8637 raft_consensus.cc:2272] T b4a402ce065f4914a9fab2f516a37bcd P 963185e117384b2085d7cea02a64478b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:58.510934 16339 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:58.511466 16339 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:58.519556  9928 leader_election.cc:336] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:58.520155 16339 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:28:58.541708  9927 leader_election.cc:336] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:58.542246  9927 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:58.543056 16339 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:28:58.582213 16308 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:58.582870 16308 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:58.585079 16308 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:58.586000  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
W20260709 12:28:58.590726 10497 leader_election.cc:336] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:58.591192 10497 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:58.592254 16342 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:58.672202 16336 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:58.672811 16336 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:58.676967 16336 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:58.679116 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:58.686170  9928 leader_election.cc:336] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:58.686632  9928 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:58.688719 16339 raft_consensus.cc:2749] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:28:58.725342 16336 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:58.725893 16336 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:58.732985  9927 leader_election.cc:336] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:58.739526 16336 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:28:58.740294  9928 leader_election.cc:336] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:58.740960  9928 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:58.742154 16336 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:28:58.778813 16336 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:58.779430 16336 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:58.783882 16336 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:58.785724 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:58.811707 16342 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:58.820258 16342 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:58.822659 16342 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:58.828944 16250 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:58.829531 16250 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:58.813767  9928 leader_election.cc:336] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:58.831513 16250 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:58.832120  9928 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
W20260709 12:28:58.836896 10497 leader_election.cc:336] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:58.838089 16336 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:58.844293 16336 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:58.847566 16336 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:58.849431  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:58.850350 16345 raft_consensus.cc:2749] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:28:58.860754 10496 leader_election.cc:336] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:58.869227 16339 raft_consensus.cc:493] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:58.872738 16339 raft_consensus.cc:515] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:58.874948 16339 leader_election.cc:290] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:58.869915 16345 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:58.875896 16345 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:58.879859 16345 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:58.880462 10496 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:58.881285 16250 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:28:58.861297 10497 leader_election.cc:336] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
W20260709 12:28:58.884970  9927 leader_election.cc:336] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:58.899853  9928 leader_election.cc:336] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:58.903988  9928 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:58.907308 16345 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:28:58.904829 10496 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:28:58.920869 16308 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:58.921459 16308 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:58.923523 16308 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:58.925086 16342 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:58.925621 16342 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:58.927464 16250 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:58.927814 16342 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:58.936259 16345 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:58.936874 16345 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:58.939039 16345 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:58.942252 16339 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:58.942807 16339 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:58.944729 16339 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:58.966460 16342 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:28:58.966969 10497 leader_election.cc:336] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:58.967027 16342 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:58.969528 16342 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:58.974670  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:58.975340  9955 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 16.
W20260709 12:28:58.974773 10497 leader_election.cc:336] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:58.977432 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:58.978123 10528 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 14.
W20260709 12:28:58.980283 10497 leader_election.cc:336] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
W20260709 12:28:58.983289 10496 leader_election.cc:336] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:58.983783 10496 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:58.984510 16342 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:28:58.984470  9927 leader_election.cc:336] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:58.987807  9927 leader_election.cc:336] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:58.990834  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:58.993681 16345 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:28:58.994120 16345 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:58.995007 16336 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:58.995486 16336 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:58.997526 16336 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:58.997972 16336 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:58.999202 10496 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:58.999019 16336 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:58.994550 16345 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:59.001375 16336 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:59.001933 16336 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:59.002523 16336 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:59.004565 16336 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:59.005326 16342 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:28:59.005689 16342 raft_consensus.cc:493] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:59.006048 16342 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:28:59.007938  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:59.008564  9955 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 17.
I20260709 12:28:59.015203 16342 raft_consensus.cc:515] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:59.015874  9928 leader_election.cc:336] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:59.020538  9928 leader_election.cc:304] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
W20260709 12:28:59.023573 10497 leader_election.cc:336] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
W20260709 12:28:59.026480  9928 leader_election.cc:336] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:59.029006  9928 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:59.026978 16336 raft_consensus.cc:2749] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:28:59.030156  9927 leader_election.cc:336] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:59.022050 16345 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:59.030268 10496 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:59.037029 16250 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:28:59.037351 16250 raft_consensus.cc:493] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:59.037684 16250 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:59.031644 16336 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:59.036237 16345 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:59.034792 16342 leader_election.cc:290] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:59.035132 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
I20260709 12:28:59.053128 10528 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 10.
I20260709 12:28:59.055960 16250 raft_consensus.cc:515] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:59.058029 16250 leader_election.cc:290] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:59.064112 10497 leader_election.cc:336] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
W20260709 12:28:59.065385  9928 leader_election.cc:336] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:59.074697  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b16516f13c42bfae1f9f2e877ee307" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:59.078015  9928 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:59.078143  9955 raft_consensus.cc:3060] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:28:59.079067  9928 leader_election.cc:336] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:59.081132 16345 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:59.076153  9958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "441af0e88f714cb3be023c9bdcd006fc" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:59.085167  9958 raft_consensus.cc:3060] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:28:59.095487  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:59.096738 16345 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:59.097981 10528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9677b33dcc4236a5656b7747c90d13" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:59.098584 10528 raft_consensus.cc:3060] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:28:59.100482  9955 raft_consensus.cc:2468] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 17.
I20260709 12:28:59.101404  9958 raft_consensus.cc:2468] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 18.
I20260709 12:28:59.105609 10528 raft_consensus.cc:2468] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 15.
I20260709 12:28:59.098120 16345 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:59.106638 16345 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:28:59.111913  9927 leader_election.cc:336] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:59.112532  9927 leader_election.cc:336] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:59.115272 10496 leader_election.cc:304] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:59.115320 16345 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:59.116307 16342 raft_consensus.cc:2804] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:28:59.116822 16342 raft_consensus.cc:697] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 17 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:59.117506 16345 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:59.117795 16342 consensus_queue.cc:237] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:59.119340 10496 leader_election.cc:304] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
W20260709 12:28:59.122493  9928 leader_election.cc:336] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:59.129653  9928 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:59.130472 16346 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:28:59.130584  9928 leader_election.cc:336] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:59.131011  9928 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:59.131800 16346 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:28:59.131999  9928 leader_election.cc:336] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:59.134400 16250 raft_consensus.cc:2804] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:28:59.135020 16250 raft_consensus.cc:697] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 18 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:59.136154 16250 consensus_queue.cc:237] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:59.121943  9927 consensus_peers.cc:597] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:59.143456 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcb5052194b44bc49f4db5030ce11988" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b"
I20260709 12:28:59.144089 10527 raft_consensus.cc:3060] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:59.143100  9928 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
W20260709 12:28:59.154027  9928 leader_election.cc:336] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:59.156451 16345 raft_consensus.cc:2804] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:28:59.166110 10527 raft_consensus.cc:2468] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b011791796d1457284b857d7d3422195 in term 11.
I20260709 12:28:59.165539  9711 catalog_manager.cc:5697] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 16 to 17, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 17 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:59.175619  9928 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:59.176188 16345 raft_consensus.cc:697] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
W20260709 12:28:59.183132  9928 leader_election.cc:336] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:59.183007 16345 consensus_queue.cc:237] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:59.186866 16339 raft_consensus.cc:2804] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:28:59.177908 16336 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:59.188259 16336 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:59.192601 16336 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:28:59.195403 16336 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:59.195889 16336 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:28:59.198968  9928 leader_election.cc:336] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:59.201967 16250 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:59.202437 16250 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:59.204164 16250 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:59.209545 10497 leader_election.cc:336] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:59.212926  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:59.213620  9955 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 19.
W20260709 12:28:59.215396  9927 leader_election.cc:336] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:59.215827  9927 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:59.213037 16336 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:28:59.218628  9928 leader_election.cc:336] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:59.220245 16336 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:28:59.221923 10496 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:59.222929 16250 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:28:59.223284 16250 raft_consensus.cc:493] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:59.223603 16250 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:28:59.232816  9927 leader_election.cc:336] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:59.233186 16250 raft_consensus.cc:515] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:59.233695 16339 raft_consensus.cc:697] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Becoming Leader. State: Replica: b011791796d1457284b857d7d3422195, State: Running, Role: LEADER
I20260709 12:28:59.238016 16339 consensus_queue.cc:237] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:59.233407  9927 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:59.240347 16350 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:28:59.244393  9927 consensus_peers.cc:597] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:59.257121 16250 leader_election.cc:290] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 20 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:59.259948  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "27036dabafd8427cac190478948639ae" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:59.260589  9955 raft_consensus.cc:3060] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:28:59.264938 10497 leader_election.cc:336] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:59.272944  9955 raft_consensus.cc:2468] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 20.
I20260709 12:28:59.274412 10496 leader_election.cc:304] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:59.275457 16354 raft_consensus.cc:2804] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:28:59.275941 16354 raft_consensus.cc:697] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 20 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:59.276778 16354 consensus_queue.cc:237] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:59.303766  9710 catalog_manager.cc:5697] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 14 to 15, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 15 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:59.305605  9710 catalog_manager.cc:5697] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 reported cstate change: term changed from 10 to 11, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to b011791796d1457284b857d7d3422195 (127.8.111.67). New cstate: current_term: 11 leader_uuid: "b011791796d1457284b857d7d3422195" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:59.330255 16250 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:59.330824 16250 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:59.332829 16250 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:28:59.338481  9927 consensus_peers.cc:597] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:59.343115 10496 leader_election.cc:336] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:28:59.376531 10497 leader_election.cc:336] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:59.381670 10497 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:59.383581 16354 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:28:59.392825  9711 catalog_manager.cc:5697] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 17 to 18, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 18 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:59.395217  9711 catalog_manager.cc:5697] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 19 to 20, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 20 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:28:59.425545 10496 consensus_peers.cc:597] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:59.429035  9927 consensus_peers.cc:597] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:59.445559 16339 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:59.446139 16339 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:28:59.448220 16339 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:28:59.453989 10497 consensus_peers.cc:597] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:59.454463  9927 leader_election.cc:336] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:28:59.455271 16350 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:59.455772 16350 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:59.456347  9928 leader_election.cc:336] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:59.456807  9928 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:28:59.457923 16350 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), f5208640a51f493e930ce4f64ceeed0b (127.8.111.68:37417)
I20260709 12:28:59.458477 16350 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:59.459473 10527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "b011791796d1457284b857d7d3422195" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f5208640a51f493e930ce4f64ceeed0b" is_pre_election: true
W20260709 12:28:59.480669  9928 leader_election.cc:336] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:59.481263  9928 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 963185e117384b2085d7cea02a64478b, f5208640a51f493e930ce4f64ceeed0b
I20260709 12:28:59.482206 16350 raft_consensus.cc:2749] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:59.520248 16354 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:59.520874 16354 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:59.522997 10497 consensus_peers.cc:597] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:59.523319 16354 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:28:59.524987  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195" is_pre_election: true
I20260709 12:28:59.525615  9955 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 11.
I20260709 12:28:59.526834 10496 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 
I20260709 12:28:59.527745 16354 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:59.528177 16354 raft_consensus.cc:493] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:28:59.528614 16354 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:28:59.528748 10497 leader_election.cc:336] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:59.553560 16354 raft_consensus.cc:515] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:28:59.557300  9955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f86e0db5aaa4690a0351c44520f7baf" candidate_uuid: "f5208640a51f493e930ce4f64ceeed0b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b011791796d1457284b857d7d3422195"
I20260709 12:28:59.557827  9955 raft_consensus.cc:3060] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:59.560335 16354 leader_election.cc:290] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Requested vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:28:59.561071 10497 leader_election.cc:336] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:28:59.564872  9955 raft_consensus.cc:2468] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5208640a51f493e930ce4f64ceeed0b in term 12.
I20260709 12:28:59.570899 10496 leader_election.cc:304] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b011791796d1457284b857d7d3422195, f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b
I20260709 12:28:59.572557 16250 raft_consensus.cc:2804] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:59.573076 16250 raft_consensus.cc:697] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Becoming Leader. State: Replica: f5208640a51f493e930ce4f64ceeed0b, State: Running, Role: LEADER
I20260709 12:28:59.573933 16250 consensus_queue.cc:237] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
W20260709 12:28:59.586539 10497 consensus_peers.cc:597] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:59.616268  9711 catalog_manager.cc:5697] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b reported cstate change: term changed from 11 to 12, leader changed from 963185e117384b2085d7cea02a64478b (127.8.111.66) to f5208640a51f493e930ce4f64ceeed0b (127.8.111.68). New cstate: current_term: 12 leader_uuid: "f5208640a51f493e930ce4f64ceeed0b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:28:59.627233  9928 consensus_peers.cc:597] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:59.634377  9927 consensus_peers.cc:597] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:59.646332  9955 raft_consensus.cc:1275] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:28:59.652760 16250 consensus_queue.cc:1048] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:28:59.666908 10497 consensus_peers.cc:597] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:59.671624  9927 consensus_peers.cc:597] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:59.677211  9958 raft_consensus.cc:1275] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 12:28:59.678182  9928 consensus_peers.cc:597] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:59.678717 16354 consensus_queue.cc:1048] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:28:59.684952  9927 consensus_peers.cc:597] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:59.692512  9928 consensus_peers.cc:597] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:59.699889 10497 consensus_peers.cc:597] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:59.738737  9928 consensus_peers.cc:597] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:59.744621 10527 raft_consensus.cc:1275] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:28:59.747133 16350 consensus_queue.cc:1048] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:28:59.764156  9961 raft_consensus.cc:1275] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
W20260709 12:28:59.765467  9928 consensus_peers.cc:597] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:59.765489 16250 consensus_queue.cc:1048] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 12:28:59.777858  9928 consensus_peers.cc:597] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:59.774930  9927 consensus_peers.cc:597] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:59.794698 10527 raft_consensus.cc:1275] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Refusing update from remote peer b011791796d1457284b857d7d3422195: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:28:59.803962 10497 consensus_peers.cc:597] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:59.807073 16371 consensus_queue.cc:1048] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:28:59.826881  9928 consensus_peers.cc:597] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:59.847450  9928 consensus_peers.cc:597] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:59.863842 10496 consensus_peers.cc:597] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:59.871132 10496 consensus_peers.cc:597] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:59.887046 10497 consensus_peers.cc:597] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:59.892100 10497 consensus_peers.cc:597] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:59.901054  9928 consensus_peers.cc:597] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:59.907308  9928 consensus_peers.cc:597] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:59.916325 10496 consensus_peers.cc:597] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:59.923379  9928 consensus_peers.cc:597] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:59.939803  9928 consensus_peers.cc:597] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:59.972606  9927 consensus_peers.cc:597] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:59.997582 10496 consensus_peers.cc:597] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:59.998309 10497 consensus_peers.cc:597] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:00.004972 10497 consensus_peers.cc:597] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:00.021250  9961 raft_consensus.cc:1275] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Refusing update from remote peer f5208640a51f493e930ce4f64ceeed0b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:29:00.023339 16308 consensus_queue.cc:1048] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:29:00.045855  9928 consensus_peers.cc:597] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:00.050419 10497 consensus_peers.cc:597] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:00.070838 10496 consensus_peers.cc:597] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:29:00.076113 10497 consensus_peers.cc:597] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:00.083987  9927 consensus_peers.cc:597] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:29:00.275321  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 191359us
W20260709 12:29:00.106456 10497 consensus_peers.cc:597] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:00.280069 10497 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 173645us
W20260709 12:29:00.290621  9928 consensus_peers.cc:597] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:00.291278  9928 consensus_peers.cc:597] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:00.345075 10497 consensus_peers.cc:597] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:00.345613 10497 consensus_peers.cc:597] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:00.348390  9927 consensus_peers.cc:597] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:29:00.349004  9927 consensus_peers.cc:597] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:29:00.349381  9927 consensus_peers.cc:597] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:29:00.349728  9927 consensus_peers.cc:597] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:29:00.358632 10496 consensus_peers.cc:597] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:00.359136 10496 consensus_peers.cc:597] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:00.374744 10497 consensus_peers.cc:597] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:00.408402 10496 consensus_peers.cc:597] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:29:00.409022 10496 consensus_peers.cc:597] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:29:00.409449 10496 consensus_peers.cc:597] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:00.424047  9928 consensus_peers.cc:597] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:00.458585  9927 consensus_peers.cc:597] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:00.462870 10496 consensus_peers.cc:597] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:29:00.475396 10496 consensus_peers.cc:597] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:29:00.494835 10496 consensus_peers.cc:597] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:29:00.524161 16339 raft_consensus.cc:493] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:29:00.524757 16339 raft_consensus.cc:515] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:29:00.527976 16339 leader_election.cc:290] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:29:00.532459  9928 leader_election.cc:336] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:29:00.539369 16339 raft_consensus.cc:493] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:29:00.539906 16339 raft_consensus.cc:515] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:29:00.545789  9928 leader_election.cc:336] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
W20260709 12:29:00.546741  9927 leader_election.cc:336] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:29:00.547187  9927 leader_election.cc:304] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:29:00.547843 16339 leader_election.cc:290] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:29:00.548386 16350 raft_consensus.cc:2749] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:29:00.556202  9927 leader_election.cc:336] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:29:00.556617  9927 leader_election.cc:304] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:29:00.557268 16339 raft_consensus.cc:2749] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:29:00.640790 16339 raft_consensus.cc:493] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:29:00.641352 16339 raft_consensus.cc:515] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:29:00.648397  9928 leader_election.cc:336] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:29:00.649106 16339 leader_election.cc:290] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:29:00.674679 10496 consensus_peers.cc:597] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:29:00.702330 16354 raft_consensus.cc:493] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:29:00.702900 16354 raft_consensus.cc:515] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:29:00.704975 16354 leader_election.cc:290] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:29:00.712208 10496 leader_election.cc:336] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:29:00.715265 10497 leader_election.cc:336] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:29:00.715665 10497 leader_election.cc:304] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:29:00.717556 16354 raft_consensus.cc:2749] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:00.725873  8637 tablet_server.cc:196] TabletServer@127.8.111.66:0 shutdown complete.
W20260709 12:29:00.727903  9927 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:38995, user_credentials={real_user=slave}} blocked reactor thread for 78209.3us
W20260709 12:29:00.752715  9927 leader_election.cc:336] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:29:00.753212  9927 leader_election.cc:304] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:29:00.753899 16350 raft_consensus.cc:2749] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:29:00.754109  9927 consensus_peers.cc:597] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:29:00.836421  9928 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:34205, user_credentials={real_user=slave}} blocked reactor thread for 52784us
W20260709 12:29:00.852190 10496 consensus_peers.cc:597] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:29:00.874084 16339 raft_consensus.cc:493] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:29:00.874626 16339 raft_consensus.cc:515] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:29:00.876955 16350 raft_consensus.cc:493] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:29:00.877458 16350 raft_consensus.cc:515] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:29:00.879597 16350 leader_election.cc:290] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:29:00.880442 16339 leader_election.cc:290] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:29:00.886210  9928 leader_election.cc:336] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
W20260709 12:29:00.904234  9928 leader_election.cc:336] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
W20260709 12:29:00.905748  9927 leader_election.cc:336] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:29:00.906195  9927 leader_election.cc:304] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:29:00.906919 16381 raft_consensus.cc:2749] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:29:00.907075  9927 leader_election.cc:336] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:29:00.907552  9927 leader_election.cc:304] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:29:00.908226 16381 raft_consensus.cc:2749] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:29:00.956727 16380 raft_consensus.cc:493] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:29:00.957304 16380 raft_consensus.cc:515] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:29:00.959596 16380 leader_election.cc:290] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:29:00.963845  8637 tablet_server.cc:179] TabletServer@127.8.111.67:0 shutting down...
W20260709 12:29:00.965538  9928 leader_election.cc:336] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
W20260709 12:29:00.968876  9927 leader_election.cc:336] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:29:00.969305  9927 leader_election.cc:304] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:29:00.970019 16380 raft_consensus.cc:2749] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:29:00.988029 16379 raft_consensus.cc:493] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:29:00.990485 16379 raft_consensus.cc:515] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:29:00.992621 16379 leader_election.cc:290] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:29:01.002102 10496 leader_election.cc:336] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:29:01.010131 10497 leader_election.cc:336] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:29:01.010560 10497 leader_election.cc:304] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:29:01.011302 16377 raft_consensus.cc:2749] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:29:01.018046 10496 consensus_peers.cc:597] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b -> Peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Couldn't send request to peer b011791796d1457284b857d7d3422195. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:01.031255 16381 raft_consensus.cc:493] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:29:01.031786 16381 raft_consensus.cc:515] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:29:01.033864 16381 leader_election.cc:290] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:29:01.034324 10496 consensus_peers.cc:597] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b -> Peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Couldn't send request to peer b011791796d1457284b857d7d3422195. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:01.042454  9928 leader_election.cc:336] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
W20260709 12:29:01.052673  9927 leader_election.cc:336] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:29:01.053558  9927 leader_election.cc:304] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:29:01.054675 16381 raft_consensus.cc:2749] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:29:01.057042 10496 consensus_peers.cc:597] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b -> Peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Couldn't send request to peer b011791796d1457284b857d7d3422195. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:01.062798  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:01.064589  8637 tablet_replica.cc:333] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.065519  8637 raft_consensus.cc:2243] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.066191  8637 raft_consensus.cc:2272] T 816661d3711b4989a37fe8f5befcd6a4 P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.069027  8637 tablet_replica.cc:333] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.069829  8637 raft_consensus.cc:2243] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.070406  8637 raft_consensus.cc:2272] T 3ffb5c0a23894c12bb5bd0d73c289106 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.072633  8637 tablet_replica.cc:333] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.073423  8637 raft_consensus.cc:2243] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.074796  8637 raft_consensus.cc:2272] T 8156e447e6a24044b5712dbb3a354b7f P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:01.074724 10496 consensus_peers.cc:597] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b -> Peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Couldn't send request to peer b011791796d1457284b857d7d3422195. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:01.077184  8637 tablet_replica.cc:333] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.077865  8637 raft_consensus.cc:2243] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.078439  8637 raft_consensus.cc:2272] T 95440cd9ec714a699fca70a8a9b17e96 P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.080942  8637 tablet_replica.cc:333] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.081758  8637 raft_consensus.cc:2243] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.082881  8637 raft_consensus.cc:2272] T 02b534aa26dd41d5afe616e203520c1a P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.085268  8637 tablet_replica.cc:333] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.086050  8637 raft_consensus.cc:2243] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.086781  8637 raft_consensus.cc:2272] T a95007be04144b799116ba6a2d753a1e P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.089788  8637 tablet_replica.cc:333] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.090641  8637 raft_consensus.cc:2243] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.091614  8637 raft_consensus.cc:2272] T bcb5052194b44bc49f4db5030ce11988 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.093549  8637 tablet_replica.cc:333] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.094167  8637 raft_consensus.cc:2243] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.095214  8637 raft_consensus.cc:2272] T c1c0ea749e8a45d4935db42359f9df11 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.097208  8637 tablet_replica.cc:333] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.097790  8637 raft_consensus.cc:2243] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.098349  8637 raft_consensus.cc:2272] T 83a89bfaa6124501b656ed0691a7f711 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.100754  8637 tablet_replica.cc:333] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.101291 16381 raft_consensus.cc:493] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:29:01.101456  8637 raft_consensus.cc:2243] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.101843 16381 raft_consensus.cc:515] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:29:01.102589  8637 raft_consensus.cc:2272] T 0f77ade6a50544c9a6c3f56b3719a92e P b011791796d1457284b857d7d3422195 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.105460  8637 tablet_replica.cc:333] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.106894  8637 raft_consensus.cc:2243] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.106097 16381 leader_election.cc:290] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:29:01.107677  9927 leader_election.cc:336] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:29:01.108074  8637 raft_consensus.cc:2272] T ce8d330ea5fd473c98b6e36199f7c07b P b011791796d1457284b857d7d3422195 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.110867  8637 tablet_replica.cc:333] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.111642  8637 raft_consensus.cc:2243] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.112187  8637 raft_consensus.cc:2272] T 92a71d859626422a835ad38ab2ba7bd7 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.114686  8637 tablet_replica.cc:333] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.115564  8637 raft_consensus.cc:2243] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.116726  8637 raft_consensus.cc:2272] T be9677b33dcc4236a5656b7747c90d13 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.119434  8637 tablet_replica.cc:333] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.120180  8637 raft_consensus.cc:2243] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.120812  8637 raft_consensus.cc:2272] T f27b8e99a0274a2791f902106d779c23 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.123329  8637 tablet_replica.cc:333] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.124080  8637 raft_consensus.cc:2243] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.124598  8637 raft_consensus.cc:2272] T 02b16516f13c42bfae1f9f2e877ee307 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.126999  8637 tablet_replica.cc:333] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195: stopping tablet replica
W20260709 12:29:01.127549 10496 consensus_peers.cc:597] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b -> Peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Couldn't send request to peer b011791796d1457284b857d7d3422195. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:01.127811  8637 raft_consensus.cc:2243] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.129532  8637 raft_consensus.cc:2272] T af001ec909824ed199d355fd69f43ede P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:01.129957  9928 leader_election.cc:336] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:29:01.130522  9928 leader_election.cc:304] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:29:01.131311 16381 raft_consensus.cc:2749] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:29:01.132207  8637 tablet_replica.cc:333] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.132871  8637 raft_consensus.cc:2243] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.133729  8637 raft_consensus.cc:2272] T cb82dc8d0b87403f90e84b650a35abb0 P b011791796d1457284b857d7d3422195 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.135846  8637 tablet_replica.cc:333] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.136309 16381 raft_consensus.cc:493] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:29:01.136646  8637 raft_consensus.cc:2243] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.136912 16381 raft_consensus.cc:515] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
I20260709 12:29:01.137444  8637 raft_consensus.cc:2272] T 90aeaa3c967a48a4804d8960b26f02b5 P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.140326  8637 tablet_replica.cc:333] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.141166  8637 raft_consensus.cc:2243] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.142879  8637 raft_consensus.cc:2272] T 563b5b4a0da24676a96f01291cf312c7 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:01.143735  9927 leader_election.cc:336] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:29:01.145650 16381 leader_election.cc:290] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:29:01.145833  8637 tablet_replica.cc:333] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.147943 16380 raft_consensus.cc:493] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
W20260709 12:29:01.150978  9928 leader_election.cc:336] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:29:01.152738  9928 leader_election.cc:304] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:29:01.152565 16380 raft_consensus.cc:515] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } }
W20260709 12:29:01.151849 10496 consensus_peers.cc:597] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b -> Peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Couldn't send request to peer b011791796d1457284b857d7d3422195. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:01.154572 16381 raft_consensus.cc:2749] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:29:01.155213 16380 leader_election.cc:290] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
I20260709 12:29:01.156735  8637 raft_consensus.cc:2243] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.157627  8637 raft_consensus.cc:2272] T 3e593a3b7d754d449a065a58afdb1b7a P b011791796d1457284b857d7d3422195 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:01.159787  9927 leader_election.cc:336] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:29:01.160615  8637 tablet_replica.cc:333] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.161303  8637 raft_consensus.cc:2243] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 12:29:01.161435  9928 leader_election.cc:336] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:29:01.162040  9928 leader_election.cc:304] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b011791796d1457284b857d7d3422195; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:29:01.162220  8637 raft_consensus.cc:2272] T 4af4b34b71b641009c828e29f2c4cc41 P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.162966 16380 raft_consensus.cc:2749] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:29:01.165154  8637 tablet_replica.cc:333] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.165773  8637 raft_consensus.cc:2243] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.166339  8637 raft_consensus.cc:2272] T c0075a6cf83049839402dd3dbaa93adc P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.168105  8637 tablet_replica.cc:333] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.168608  8637 raft_consensus.cc:2243] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.169420  8637 raft_consensus.cc:2272] T fa3541b3559e488d9911972fd2250fc6 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.171463  8637 tablet_replica.cc:333] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.172034  8637 raft_consensus.cc:2243] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.172552  8637 raft_consensus.cc:2272] T 7f56c0f50a014def9b283a94186feae6 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.174520  8637 tablet_replica.cc:333] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.175087  8637 raft_consensus.cc:2243] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.175913  8637 raft_consensus.cc:2272] T 55e4af3d6737421b9d77650fa7d44f8f P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.177765  8637 tablet_replica.cc:333] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.178323  8637 raft_consensus.cc:2243] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.178786  8637 raft_consensus.cc:2272] T bae6a0d1c1c44960b4b110046bee07a8 P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.180660  8637 tablet_replica.cc:333] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.181277  8637 raft_consensus.cc:2243] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.181689  8637 raft_consensus.cc:2272] T 441af0e88f714cb3be023c9bdcd006fc P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.183388  8637 tablet_replica.cc:333] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.183915  8637 raft_consensus.cc:2243] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.184365  8637 raft_consensus.cc:2272] T 27036dabafd8427cac190478948639ae P b011791796d1457284b857d7d3422195 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.186216  8637 tablet_replica.cc:333] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.186812  8637 raft_consensus.cc:2243] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.187594  8637 raft_consensus.cc:2272] T ecf7be2e7d02465d87ce4296e257c29b P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.191346  8637 tablet_replica.cc:333] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.192072  8637 raft_consensus.cc:2243] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.192587  8637 raft_consensus.cc:2272] T e31dc7ebba9947e381658ef28347706a P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.195511  8637 tablet_replica.cc:333] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.196269  8637 raft_consensus.cc:2243] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.197268  8637 raft_consensus.cc:2272] T 3ebec313878e48e88fcec9daadd369b9 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.199045  8637 tablet_replica.cc:333] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.199561  8637 raft_consensus.cc:2243] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.200368  8637 raft_consensus.cc:2272] T 59bb7b32528a4a0b83305a9131ca5f1e P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.202132  8637 tablet_replica.cc:333] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.202680  8637 raft_consensus.cc:2243] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.203488  8637 raft_consensus.cc:2272] T 511405268634431e9bf729e0fc87c838 P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.205351  8637 tablet_replica.cc:333] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.205879  8637 raft_consensus.cc:2243] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.206398  8637 raft_consensus.cc:2272] T 3290aa2b0ef349e78e838202fb70b358 P b011791796d1457284b857d7d3422195 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.208267  8637 tablet_replica.cc:333] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.208779  8637 raft_consensus.cc:2243] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.209261  8637 raft_consensus.cc:2272] T a5bdaeb6ccf347499e2dff26efaf7deb P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.211229  8637 tablet_replica.cc:333] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.212019  8637 raft_consensus.cc:2243] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.212908  8637 raft_consensus.cc:2272] T a47692d74f884d019a3ec583399bdb4c P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.214994  8637 tablet_replica.cc:333] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.215550  8637 raft_consensus.cc:2243] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.216567  8637 raft_consensus.cc:2272] T b4a402ce065f4914a9fab2f516a37bcd P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.218655  8637 tablet_replica.cc:333] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.219197  8637 raft_consensus.cc:2243] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.219730  8637 raft_consensus.cc:2272] T ecaeb132991949858ba7ff5186bd7024 P b011791796d1457284b857d7d3422195 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.221757  8637 tablet_replica.cc:333] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.222445  8637 raft_consensus.cc:2243] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.223424  8637 raft_consensus.cc:2272] T d1e4bd6e7a424475b1d707bfa268d54e P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.225427  8637 tablet_replica.cc:333] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.225941  8637 raft_consensus.cc:2243] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.226532  8637 raft_consensus.cc:2272] T f93660c342af47199c6cec5c0424043a P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:01.226745  9744 debug-util.cc:398] Leaking SignalData structure 0x7b08000f9e60 after lost signal to thread 8640
W20260709 12:29:01.227906  9744 debug-util.cc:398] Leaking SignalData structure 0x7b080041e4c0 after lost signal to thread 9747
I20260709 12:29:01.228741  8637 tablet_replica.cc:333] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195: stopping tablet replica
W20260709 12:29:01.229138  9744 debug-util.cc:398] Leaking SignalData structure 0x7b080003a600 after lost signal to thread 9988
I20260709 12:29:01.229449  8637 raft_consensus.cc:2243] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.230594  8637 raft_consensus.cc:2272] T 264ab80fe3634a5390e84f23e4dd8c94 P b011791796d1457284b857d7d3422195 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:01.230814  9744 debug-util.cc:398] Leaking SignalData structure 0x7b0800397820 after lost signal to thread 10557
I20260709 12:29:01.232903  8637 tablet_replica.cc:333] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.233660  8637 raft_consensus.cc:2243] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.234179  8637 raft_consensus.cc:2272] T 6f86e0db5aaa4690a0351c44520f7baf P b011791796d1457284b857d7d3422195 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.237408  8637 tablet_replica.cc:333] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.238184  8637 raft_consensus.cc:2243] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.238895  8637 raft_consensus.cc:2272] T 4b844d67afb64319be2e7e6a8ec99319 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.242754  8637 tablet_replica.cc:333] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.243427  8637 raft_consensus.cc:2243] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.244401  8637 raft_consensus.cc:2272] T e528961028ca49b7a317cd20fbb343a8 P b011791796d1457284b857d7d3422195 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.247587  8637 tablet_replica.cc:333] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.248224  8637 raft_consensus.cc:2243] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.249185  8637 raft_consensus.cc:2272] T 0e64098fbd794a1daa6778e4c06eb54e P b011791796d1457284b857d7d3422195 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.252406  8637 tablet_replica.cc:333] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.252981  8637 raft_consensus.cc:2243] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:29:01.254174  8637 raft_consensus.cc:2272] T 8367fec391344e099ca237f0942e4f6d P b011791796d1457284b857d7d3422195 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:01.256601  8637 tablet_replica.cc:333] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195: stopping tablet replica
I20260709 12:29:01.257462  8637 raft_consensus.cc:2243] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:01.258033  8637 raft_consensus.cc:2272] T cbfc8e9bdb244a4c8679e7585cce700c P b011791796d1457284b857d7d3422195 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:01.276610 10496 consensus_peers.cc:597] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b -> Peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Couldn't send request to peer b011791796d1457284b857d7d3422195. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:01.293057 10496 consensus_peers.cc:597] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b -> Peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Couldn't send request to peer b011791796d1457284b857d7d3422195. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:01.339322 10496 consensus_peers.cc:597] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b -> Peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Couldn't send request to peer b011791796d1457284b857d7d3422195. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:01.341049 10496 consensus_peers.cc:597] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b -> Peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Couldn't send request to peer b011791796d1457284b857d7d3422195. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:01.387349 10496 consensus_peers.cc:597] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b -> Peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Couldn't send request to peer b011791796d1457284b857d7d3422195. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.67:42253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:01.478758 10496 consensus_peers.cc:597] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b -> Peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Couldn't send request to peer b011791796d1457284b857d7d3422195. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.67:42253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:01.490259 10496 consensus_peers.cc:597] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b -> Peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Couldn't send request to peer b011791796d1457284b857d7d3422195. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.67:42253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:01.533701 10496 consensus_peers.cc:597] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b -> Peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Couldn't send request to peer b011791796d1457284b857d7d3422195. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.67:42253: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:01.549197 16379 raft_consensus.cc:493] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 963185e117384b2085d7cea02a64478b)
I20260709 12:29:01.549837 16379 raft_consensus.cc:515] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:29:01.552053 16379 leader_election.cc:290] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205)
W20260709 12:29:01.558450 10497 leader_election.cc:336] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
W20260709 12:29:01.566905 10496 leader_election.cc:336] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:29:01.567384 10496 leader_election.cc:304] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:29:01.568147 16379 raft_consensus.cc:2749] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:29:01.744971 10497 consensus_peers.cc:597] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:01.792065 10497 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111) [suppressed 647 similar messages]
W20260709 12:29:01.918571 10496 consensus_peers.cc:597] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:29:01.941402 10497 consensus_peers.cc:597] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:01.982645 10497 consensus_peers.cc:597] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:02.042484 10497 consensus_peers.cc:597] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:02.048616 10497 consensus_peers.cc:597] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:02.164287 16377 raft_consensus.cc:493] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:29:02.167423 16377 raft_consensus.cc:515] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } attrs { replace: true } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:29:02.174597 16377 leader_election.cc:290] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:29:02.181784 10497 leader_election.cc:336] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
W20260709 12:29:02.190706 10496 leader_election.cc:336] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:29:02.191234 10496 leader_election.cc:304] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, 963185e117384b2085d7cea02a64478b
I20260709 12:29:02.191962 16377 raft_consensus.cc:2749] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:29:02.202688 10496 leader_election.cc:336] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Network error: Client connection negotiation failed: client connection to 127.8.111.67:42253: connect: Connection refused (error 111)
W20260709 12:29:02.203723 10496 consensus_peers.cc:597] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:29:02.225862 10497 consensus_peers.cc:597] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:02.248869 16377 raft_consensus.cc:493] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:29:02.249475 16377 raft_consensus.cc:515] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:29:02.251657 16377 leader_election.cc:290] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:29:02.253285 16377 raft_consensus.cc:493] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:29:02.253779 16377 raft_consensus.cc:515] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:29:02.255885 16377 leader_election.cc:290] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:29:02.265082 10496 leader_election.cc:336] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Network error: Client connection negotiation failed: client connection to 127.8.111.67:42253: connect: Connection refused (error 111)
W20260709 12:29:02.265588 10496 leader_election.cc:336] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Network error: Client connection negotiation failed: client connection to 127.8.111.67:42253: connect: Connection refused (error 111)
W20260709 12:29:02.267360 10496 leader_election.cc:336] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:29:02.267767 10496 leader_election.cc:304] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:29:02.268469 16377 raft_consensus.cc:2749] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:29:02.270666 10496 leader_election.cc:336] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:29:02.271093 10496 leader_election.cc:304] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:29:02.271781 16377 raft_consensus.cc:2749] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:29:02.377303 16379 raft_consensus.cc:493] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:29:02.377907 16379 raft_consensus.cc:515] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:29:02.380079 16382 raft_consensus.cc:493] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:29:02.380717 16382 raft_consensus.cc:515] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:29:02.382887 16382 leader_election.cc:290] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
I20260709 12:29:02.386143 16379 leader_election.cc:290] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:29:02.390693 10497 leader_election.cc:336] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
W20260709 12:29:02.409524 10497 consensus_peers.cc:597] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:02.415975 10496 leader_election.cc:336] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Network error: Client connection negotiation failed: client connection to 127.8.111.67:42253: connect: Connection refused (error 111)
I20260709 12:29:02.416496 10496 leader_election.cc:304] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:29:02.417389 16379 raft_consensus.cc:2749] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:29:02.418511 10496 leader_election.cc:336] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Network error: Client connection negotiation failed: client connection to 127.8.111.67:42253: connect: Connection refused (error 111)
W20260709 12:29:02.419376 10496 leader_election.cc:336] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
I20260709 12:29:02.419767 10496 leader_election.cc:304] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:29:02.420516 16379 raft_consensus.cc:2749] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:29:02.422439 10496 consensus_peers.cc:597] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:29:02.435535  8637 tablet_server.cc:196] TabletServer@127.8.111.67:0 shutdown complete.
I20260709 12:29:02.445263 16379 raft_consensus.cc:493] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:29:02.445889 16379 raft_consensus.cc:515] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:29:02.447963 16379 leader_election.cc:290] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:29:02.452555 10497 leader_election.cc:336] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:29:02.458961 16379 raft_consensus.cc:493] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:29:02.459534 16379 raft_consensus.cc:515] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:29:02.463653 16379 leader_election.cc:290] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:29:02.466343 10497 leader_election.cc:336] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
W20260709 12:29:02.471761 10496 leader_election.cc:336] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Network error: Client connection negotiation failed: client connection to 127.8.111.67:42253: connect: Connection refused (error 111)
I20260709 12:29:02.472183 10496 leader_election.cc:304] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:29:02.473100 16379 raft_consensus.cc:2749] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:29:02.481511 10497 consensus_peers.cc:597] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:02.483345 10496 leader_election.cc:336] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Network error: Client connection negotiation failed: client connection to 127.8.111.67:42253: connect: Connection refused (error 111)
I20260709 12:29:02.483801 10496 leader_election.cc:304] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:29:02.484530 16379 raft_consensus.cc:2749] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:29:02.499090 16379 raft_consensus.cc:493] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:29:02.499594 16379 raft_consensus.cc:515] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:29:02.501900 16379 leader_election.cc:290] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:29:02.512069 10497 consensus_peers.cc:597] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:02.519707 10497 consensus_peers.cc:597] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:29:02.523665 16379 raft_consensus.cc:493] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:29:02.524204 16379 raft_consensus.cc:515] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:29:02.526777 16379 leader_election.cc:290] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:29:02.531987 10497 leader_election.cc:336] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
W20260709 12:29:02.532992 10496 consensus_peers.cc:597] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:29:02.533538 10496 leader_election.cc:336] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:29:02.534197 10496 leader_election.cc:336] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Network error: Client connection negotiation failed: client connection to 127.8.111.67:42253: connect: Connection refused (error 111)
I20260709 12:29:02.534652 10496 leader_election.cc:304] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:29:02.536933 16379 raft_consensus.cc:2749] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:29:02.552386 10497 consensus_peers.cc:597] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:29:02.556619 16379 raft_consensus.cc:493] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:29:02.557354 16379 raft_consensus.cc:515] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:29:02.563831 16379 leader_election.cc:290] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:29:02.566376 10497 consensus_peers.cc:597] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:29:02.568779 16379 raft_consensus.cc:493] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:29:02.569496 16379 raft_consensus.cc:515] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:29:02.577050 16379 leader_election.cc:290] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:29:02.580348 10496 leader_election.cc:336] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Network error: Client connection negotiation failed: client connection to 127.8.111.67:42253: connect: Connection refused (error 111)
I20260709 12:29:02.580921 10496 leader_election.cc:304] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
W20260709 12:29:02.583314 10497 leader_election.cc:336] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:29:02.584074 16379 raft_consensus.cc:2749] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:29:02.587695 10496 consensus_peers.cc:597] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:29:02.589308 16379 raft_consensus.cc:493] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:29:02.589802 16379 raft_consensus.cc:515] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "963185e117384b2085d7cea02a64478b" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 34205 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:29:02.591934  8637 tablet_server.cc:179] TabletServer@127.8.111.68:0 shutting down...
I20260709 12:29:02.592096 16379 leader_election.cc:290] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 963185e117384b2085d7cea02a64478b (127.8.111.66:34205), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:29:02.597239 10496 leader_election.cc:336] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:29:02.598953 10496 leader_election.cc:336] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Network error: Client connection negotiation failed: client connection to 127.8.111.67:42253: connect: Connection refused (error 111)
I20260709 12:29:02.599357 10496 leader_election.cc:304] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
W20260709 12:29:02.599695 10497 leader_election.cc:336] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111)
I20260709 12:29:02.600066 16379 raft_consensus.cc:2749] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:29:02.600183 10496 leader_election.cc:336] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Network error: Client connection negotiation failed: client connection to 127.8.111.67:42253: connect: Connection refused (error 111)
I20260709 12:29:02.600698 10496 leader_election.cc:304] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:29:02.601565 16379 raft_consensus.cc:2749] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:29:02.604475 10496 leader_election.cc:336] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Network error: Client connection negotiation failed: client connection to 127.8.111.67:42253: connect: Connection refused (error 111)
I20260709 12:29:02.604928 10496 leader_election.cc:304] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 963185e117384b2085d7cea02a64478b, b011791796d1457284b857d7d3422195
I20260709 12:29:02.606160 16379 raft_consensus.cc:2749] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:29:02.627213 10497 consensus_peers.cc:597] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b -> Peer 963185e117384b2085d7cea02a64478b (127.8.111.66:34205): Couldn't send request to peer 963185e117384b2085d7cea02a64478b. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:34205: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:29:02.649281 16379 raft_consensus.cc:493] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b011791796d1457284b857d7d3422195)
I20260709 12:29:02.650094 16379 raft_consensus.cc:515] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4104e34a61b7448281d6d91ce23ebf71" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 38995 } } peers { permanent_uuid: "b011791796d1457284b857d7d3422195" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 42253 } } peers { permanent_uuid: "f5208640a51f493e930ce4f64ceeed0b" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 37417 } attrs { promote: false } }
I20260709 12:29:02.653401 16379 leader_election.cc:290] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995), b011791796d1457284b857d7d3422195 (127.8.111.67:42253)
W20260709 12:29:02.658135 10496 leader_election.cc:336] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111)
W20260709 12:29:02.658882 10496 leader_election.cc:336] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer b011791796d1457284b857d7d3422195 (127.8.111.67:42253): Network error: Client connection negotiation failed: client connection to 127.8.111.67:42253: connect: Connection refused (error 111)
I20260709 12:29:02.659289 10496 leader_election.cc:304] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5208640a51f493e930ce4f64ceeed0b; no voters: 4104e34a61b7448281d6d91ce23ebf71, b011791796d1457284b857d7d3422195
I20260709 12:29:02.659981 16377 raft_consensus.cc:2749] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:29:02.679948 10496 consensus_peers.cc:597] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:29:02.687587  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:02.688530  8637 tablet_replica.cc:333] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.689461  8637 raft_consensus.cc:2243] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.690703  8637 raft_consensus.cc:2272] T cbfc8e9bdb244a4c8679e7585cce700c P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.693816  8637 tablet_replica.cc:333] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.694780  8637 raft_consensus.cc:2243] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.695374  8637 raft_consensus.cc:2272] T 0f77ade6a50544c9a6c3f56b3719a92e P f5208640a51f493e930ce4f64ceeed0b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.698067  8637 tablet_replica.cc:333] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.698952  8637 raft_consensus.cc:2243] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.700050  8637 raft_consensus.cc:2272] T 511405268634431e9bf729e0fc87c838 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.702822  8637 tablet_replica.cc:333] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.703636  8637 raft_consensus.cc:2243] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.704202  8637 raft_consensus.cc:2272] T 9a7dd9ecad304177bbefcb8725c66393 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.706815  8637 tablet_replica.cc:333] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.707597  8637 raft_consensus.cc:2243] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.708679  8637 raft_consensus.cc:2272] T 92a71d859626422a835ad38ab2ba7bd7 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.711519  8637 tablet_replica.cc:333] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.712303  8637 raft_consensus.cc:2243] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.713284  8637 raft_consensus.cc:2272] T e55138bc5c8b46a1a4b5408bb8a06868 P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.716040  8637 tablet_replica.cc:333] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.716939  8637 raft_consensus.cc:2243] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.717578  8637 raft_consensus.cc:2272] T e528961028ca49b7a317cd20fbb343a8 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.720538  8637 tablet_replica.cc:333] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.721443  8637 raft_consensus.cc:2243] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:29:02.722564 10496 consensus_peers.cc:597] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:29:02.722633  8637 raft_consensus.cc:2272] T af4289b1f8fb44b9a1d46742954fab18 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.725554  8637 tablet_replica.cc:333] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.726378  8637 raft_consensus.cc:2243] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.727423  8637 raft_consensus.cc:2272] T f0f4046979c94f6b9fcfd429cb2f454f P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.730067  8637 tablet_replica.cc:333] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.730912  8637 raft_consensus.cc:2243] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.731633  8637 raft_consensus.cc:2272] T 8367fec391344e099ca237f0942e4f6d P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.734632  8637 tablet_replica.cc:333] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.735448  8637 raft_consensus.cc:2243] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.736128  8637 raft_consensus.cc:2272] T 55e4af3d6737421b9d77650fa7d44f8f P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.739722  8637 tablet_replica.cc:333] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
W20260709 12:29:02.739650 10496 consensus_peers.cc:597] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b -> Peer 4104e34a61b7448281d6d91ce23ebf71 (127.8.111.65:38995): Couldn't send request to peer 4104e34a61b7448281d6d91ce23ebf71. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:38995: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:29:02.741317  8637 raft_consensus.cc:2243] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.742213  8637 raft_consensus.cc:2272] T fa3541b3559e488d9911972fd2250fc6 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.744663  8637 tablet_replica.cc:333] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.745307  8637 raft_consensus.cc:2243] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.746097  8637 raft_consensus.cc:2272] T 90aeaa3c967a48a4804d8960b26f02b5 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.748267  8637 tablet_replica.cc:333] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.748844  8637 raft_consensus.cc:2243] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.749382  8637 raft_consensus.cc:2272] T d1e4bd6e7a424475b1d707bfa268d54e P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.751502  8637 tablet_replica.cc:333] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.752065  8637 raft_consensus.cc:2243] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.752811  8637 raft_consensus.cc:2272] T fb049358bf66417d84d91e61b68ff1bb P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.754881  8637 tablet_replica.cc:333] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.755541  8637 raft_consensus.cc:2243] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.755998  8637 raft_consensus.cc:2272] T b4a402ce065f4914a9fab2f516a37bcd P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.758440  8637 tablet_replica.cc:333] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.759264  8637 raft_consensus.cc:2243] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.760321  8637 raft_consensus.cc:2272] T ad53c1df0a9749d992b37564e8225118 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.762907  8637 tablet_replica.cc:333] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.763414  8637 raft_consensus.cc:2243] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.764194  8637 raft_consensus.cc:2272] T 02b16516f13c42bfae1f9f2e877ee307 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.766099  8637 tablet_replica.cc:333] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.766614  8637 raft_consensus.cc:2243] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.767154  8637 raft_consensus.cc:2272] T b6b2dfaf2fc345a8a7e88a8c1e9e8900 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.769074  8637 tablet_replica.cc:333] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.769586  8637 raft_consensus.cc:2243] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.770213  8637 raft_consensus.cc:2272] T 264ab80fe3634a5390e84f23e4dd8c94 P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.772301  8637 tablet_replica.cc:333] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.773034  8637 raft_consensus.cc:2243] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.773867  8637 raft_consensus.cc:2272] T 6f86e0db5aaa4690a0351c44520f7baf P f5208640a51f493e930ce4f64ceeed0b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.776271  8637 tablet_replica.cc:333] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.777016  8637 raft_consensus.cc:2243] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.778010  8637 raft_consensus.cc:2272] T 4b844d67afb64319be2e7e6a8ec99319 P f5208640a51f493e930ce4f64ceeed0b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.780459  8637 tablet_replica.cc:333] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.781239  8637 raft_consensus.cc:2243] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.782311  8637 raft_consensus.cc:2272] T 5224954c61b74424bc8af520537e37ec P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.784837  8637 tablet_replica.cc:333] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.785367  8637 raft_consensus.cc:2243] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.785909  8637 raft_consensus.cc:2272] T 563b5b4a0da24676a96f01291cf312c7 P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.787886  8637 tablet_replica.cc:333] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.788431  8637 raft_consensus.cc:2243] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.789201  8637 raft_consensus.cc:2272] T 6bd0e88f609e4c15aadc811cb9ecf5a9 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.791054  8637 tablet_replica.cc:333] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.791558  8637 raft_consensus.cc:2243] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.792299  8637 raft_consensus.cc:2272] T 3290aa2b0ef349e78e838202fb70b358 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.794014  8637 tablet_replica.cc:333] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.794564  8637 raft_consensus.cc:2243] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.795358  8637 raft_consensus.cc:2272] T a5bdaeb6ccf347499e2dff26efaf7deb P f5208640a51f493e930ce4f64ceeed0b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.797333  8637 tablet_replica.cc:333] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.797873  8637 raft_consensus.cc:2243] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.798396  8637 raft_consensus.cc:2272] T cb82dc8d0b87403f90e84b650a35abb0 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.800509  8637 tablet_replica.cc:333] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.800999  8637 raft_consensus.cc:2243] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.801770  8637 raft_consensus.cc:2272] T ab78f05fa6f4406a81716ded4d302aee P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.803707  8637 tablet_replica.cc:333] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.804272  8637 raft_consensus.cc:2243] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.805058  8637 raft_consensus.cc:2272] T 441af0e88f714cb3be023c9bdcd006fc P f5208640a51f493e930ce4f64ceeed0b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.807267  8637 tablet_replica.cc:333] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.807771  8637 raft_consensus.cc:2243] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.808561  8637 raft_consensus.cc:2272] T 27036dabafd8427cac190478948639ae P f5208640a51f493e930ce4f64ceeed0b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.810420  8637 tablet_replica.cc:333] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.810886  8637 raft_consensus.cc:2243] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.811650  8637 raft_consensus.cc:2272] T 052aa541571c4bea87eeb1ed2f45a1bf P f5208640a51f493e930ce4f64ceeed0b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.813920  8637 tablet_replica.cc:333] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.814586  8637 raft_consensus.cc:2243] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.815035  8637 raft_consensus.cc:2272] T b97d7561bbd8444f9bbafa9c397d3f62 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.817286  8637 tablet_replica.cc:333] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.817816  8637 raft_consensus.cc:2243] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.818638  8637 raft_consensus.cc:2272] T a95007be04144b799116ba6a2d753a1e P f5208640a51f493e930ce4f64ceeed0b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.820647  8637 tablet_replica.cc:333] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.821151  8637 raft_consensus.cc:2243] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.821921  8637 raft_consensus.cc:2272] T 3e593a3b7d754d449a065a58afdb1b7a P f5208640a51f493e930ce4f64ceeed0b [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.823927  8637 tablet_replica.cc:333] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.824419  8637 raft_consensus.cc:2243] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.824888  8637 raft_consensus.cc:2272] T c1c0ea749e8a45d4935db42359f9df11 P f5208640a51f493e930ce4f64ceeed0b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.826736  8637 tablet_replica.cc:333] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.827219  8637 raft_consensus.cc:2243] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.827759  8637 raft_consensus.cc:2272] T bcb5052194b44bc49f4db5030ce11988 P f5208640a51f493e930ce4f64ceeed0b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.829650  8637 tablet_replica.cc:333] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.830168  8637 raft_consensus.cc:2243] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:02.830627  8637 raft_consensus.cc:2272] T be9677b33dcc4236a5656b7747c90d13 P f5208640a51f493e930ce4f64ceeed0b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:02.832341  8637 tablet_replica.cc:333] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b: stopping tablet replica
I20260709 12:29:02.832767  8637 raft_consensus.cc:2243] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:29:02.833670  8637 raft_consensus.cc:2272] T 4af4b34b71b641009c828e29f2c4cc41 P f5208640a51f493e930ce4f64ceeed0b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:03.207617  8637 tablet_server.cc:196] TabletServer@127.8.111.68:0 shutdown complete.
I20260709 12:29:03.273942  8637 master.cc:562] Master@127.8.111.126:43135 shutting down...
W20260709 12:29:03.306202  9761 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:29:03.306528  9761 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:29:03.306720  9761 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:29:33.904875  9697 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.111.67:42253: connect: Connection refused (error 111) [suppressed 117 similar messages]
W20260709 12:29:33.908638  9697 catalog_manager.cc:4755] TS b011791796d1457284b857d7d3422195 (127.8.111.67:42253): ChangeConfig:REMOVE_PEER RPC failed for tablet d1e4bd6e7a424475b1d707bfa268d54e: Network error: Client connection negotiation failed: client connection to 127.8.111.67:42253: connect: Connection refused (error 111)
I20260709 12:29:36.484687  8637 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:36.485905  8637 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:36.486261  8637 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9af5d83221164294aea87056091c2259: stopping tablet replica
I20260709 12:29:36.697383  8637 master.cc:584] Master@127.8.111.126:43135 shutdown complete.
I20260709 12:29:36.756633  8637 test_util.cc:182] -----------------------------------------------
I20260709 12:29:36.756846  8637 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599876290468-8637-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (239127 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:29:36.760308  8637 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.111.126:41553
I20260709 12:29:36.761507  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:36.768839 16391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:36.768934 16392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:36.770248  8637 server_base.cc:1061] running on GCE node
W20260709 12:29:36.770913 16394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:36.773876  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:36.774106  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:36.774309  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600176774272 us; error 0 us; skew 500 ppm
I20260709 12:29:36.774868  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:36.777361  8637 webserver.cc:533] Webserver started at http://127.8.111.126:33683/ using document root <none> and password file <none>
I20260709 12:29:36.777892  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:36.778112  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:36.778460  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:36.779803  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/master-0-root/instance:
uuid: "9192e06dae494224a07f6aae9558426a"
format_stamp: "Formatted at 2026-07-09 12:29:36 on dist-test-slave-044g"
I20260709 12:29:36.784297  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:29:36.787905 16399 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:36.788776  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:29:36.789124  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/master-0-root
uuid: "9192e06dae494224a07f6aae9558426a"
format_stamp: "Formatted at 2026-07-09 12:29:36 on dist-test-slave-044g"
I20260709 12:29:36.789494  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:36.800999  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:36.802117  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:36.841645  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.126:41553
I20260709 12:29:36.841763 16450 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.126:41553 every 8 connection(s)
I20260709 12:29:36.845911 16451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:36.856585 16451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a: Bootstrap starting.
I20260709 12:29:36.861310 16451 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:36.865337 16451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a: No bootstrap required, opened a new log
I20260709 12:29:36.867419 16451 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9192e06dae494224a07f6aae9558426a" member_type: VOTER }
I20260709 12:29:36.867843 16451 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:36.868021 16451 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9192e06dae494224a07f6aae9558426a, State: Initialized, Role: FOLLOWER
I20260709 12:29:36.868588 16451 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9192e06dae494224a07f6aae9558426a" member_type: VOTER }
I20260709 12:29:36.869059 16451 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:29:36.869254 16451 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:29:36.869468 16451 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:36.874009 16451 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9192e06dae494224a07f6aae9558426a" member_type: VOTER }
I20260709 12:29:36.874581 16451 leader_election.cc:304] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9192e06dae494224a07f6aae9558426a; no voters: 
I20260709 12:29:36.875787 16451 leader_election.cc:290] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:29:36.876228 16454 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:36.877611 16454 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a [term 1 LEADER]: Becoming Leader. State: Replica: 9192e06dae494224a07f6aae9558426a, State: Running, Role: LEADER
I20260709 12:29:36.878391 16454 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9192e06dae494224a07f6aae9558426a" member_type: VOTER }
I20260709 12:29:36.878829 16451 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:29:36.886904 16455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9192e06dae494224a07f6aae9558426a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9192e06dae494224a07f6aae9558426a" member_type: VOTER } }
I20260709 12:29:36.887416 16455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:36.888504 16456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9192e06dae494224a07f6aae9558426a. Latest consensus state: current_term: 1 leader_uuid: "9192e06dae494224a07f6aae9558426a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9192e06dae494224a07f6aae9558426a" member_type: VOTER } }
I20260709 12:29:36.888945 16456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:36.889381 16464 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:29:36.896353 16464 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:29:36.897439  8637 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:29:36.905387 16464 catalog_manager.cc:1383] Generated new cluster ID: 277d7f02a2d34274b02bd357fdc7e4e7
I20260709 12:29:36.905663 16464 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:29:36.936789 16464 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:29:36.938060 16464 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:29:36.952530 16464 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a: Generated new TSK 0
I20260709 12:29:36.953169 16464 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:29:36.963711  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:36.970057 16472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:36.971405 16473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:36.973480  8637 server_base.cc:1061] running on GCE node
W20260709 12:29:36.973737 16475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:36.975764  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:36.975999  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:36.976181  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600176976163 us; error 0 us; skew 500 ppm
I20260709 12:29:36.976760  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:36.979271  8637 webserver.cc:533] Webserver started at http://127.8.111.65:37971/ using document root <none> and password file <none>
I20260709 12:29:36.979784  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:36.980006  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:36.980293  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:36.981549  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-0-root/instance:
uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
format_stamp: "Formatted at 2026-07-09 12:29:36 on dist-test-slave-044g"
I20260709 12:29:36.985970  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:29:36.989524 16480 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:36.990479  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:29:36.990849  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-0-root
uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
format_stamp: "Formatted at 2026-07-09 12:29:36 on dist-test-slave-044g"
I20260709 12:29:36.991190  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:37.009951  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:37.011178  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:37.012674  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:37.015038  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:37.015290  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:37.015542  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:37.015751  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:37.057526  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.65:36499
I20260709 12:29:37.057672 16542 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.65:36499 every 8 connection(s)
I20260709 12:29:37.062862  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:37.069885 16547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:37.070592 16548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:37.075390 16551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:37.077245  8637 server_base.cc:1061] running on GCE node
I20260709 12:29:37.080231  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:37.080515  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:37.080461 16543 heartbeater.cc:344] Connected to a master server at 127.8.111.126:41553
I20260709 12:29:37.080992  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600177080972 us; error 0 us; skew 500 ppm
I20260709 12:29:37.081243 16543 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:37.081813  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:37.082274 16543 heartbeater.cc:507] Master 127.8.111.126:41553 requested a full tablet report, sending...
I20260709 12:29:37.084764  8637 webserver.cc:533] Webserver started at http://127.8.111.66:46509/ using document root <none> and password file <none>
I20260709 12:29:37.084928 16416 ts_manager.cc:194] Registered new tserver with Master: 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:37.085741  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:37.086021  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:37.086376  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:37.087448 16416 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53802
I20260709 12:29:37.087754  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-1-root/instance:
uuid: "9f5ebf768d584b17897ebb5b4575ece5"
format_stamp: "Formatted at 2026-07-09 12:29:37 on dist-test-slave-044g"
I20260709 12:29:37.093267  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 12:29:37.097211 16555 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:37.098038  8637 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:29:37.098407  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-1-root
uuid: "9f5ebf768d584b17897ebb5b4575ece5"
format_stamp: "Formatted at 2026-07-09 12:29:37 on dist-test-slave-044g"
I20260709 12:29:37.098711  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:37.116266  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:37.117539  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:37.119246  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:37.121636  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:37.121871  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:37.122128  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:37.122344  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:29:37.163188  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.66:35329
I20260709 12:29:37.163327 16617 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.66:35329 every 8 connection(s)
I20260709 12:29:37.168377  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:37.176138 16621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:37.178553 16622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:37.181509 16624 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:37.182127 16618 heartbeater.cc:344] Connected to a master server at 127.8.111.126:41553
I20260709 12:29:37.182524  8637 server_base.cc:1061] running on GCE node
I20260709 12:29:37.182644 16618 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:37.183522  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:29:37.183559 16618 heartbeater.cc:507] Master 127.8.111.126:41553 requested a full tablet report, sending...
W20260709 12:29:37.183914  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:37.184175  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600177184155 us; error 0 us; skew 500 ppm
I20260709 12:29:37.185072  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:37.185837 16416 ts_manager.cc:194] Registered new tserver with Master: 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:37.187408 16416 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53816
I20260709 12:29:37.187891  8637 webserver.cc:533] Webserver started at http://127.8.111.67:41525/ using document root <none> and password file <none>
I20260709 12:29:37.188624  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:37.188903  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:37.189276  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:37.190805  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-2-root/instance:
uuid: "99ca36f8a50c459388f31022b1455ed6"
format_stamp: "Formatted at 2026-07-09 12:29:37 on dist-test-slave-044g"
I20260709 12:29:37.195978  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.005s
I20260709 12:29:37.199679 16629 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:37.200559  8637 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 12:29:37.200870  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-2-root
uuid: "99ca36f8a50c459388f31022b1455ed6"
format_stamp: "Formatted at 2026-07-09 12:29:37 on dist-test-slave-044g"
I20260709 12:29:37.201112  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:37.215808  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:37.216967  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:37.218439  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:37.221155  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:37.221417  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:37.221694  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:37.221890  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:37.269083  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.67:33625
I20260709 12:29:37.269189 16691 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.67:33625 every 8 connection(s)
I20260709 12:29:37.274775  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:37.282745 16695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:37.283464 16696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:37.286612  8637 server_base.cc:1061] running on GCE node
W20260709 12:29:37.286550 16698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:37.288290  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:29:37.288431 16692 heartbeater.cc:344] Connected to a master server at 127.8.111.126:41553
W20260709 12:29:37.288615  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:37.288831 16692 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:37.288911  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600177288890 us; error 0 us; skew 500 ppm
I20260709 12:29:37.289666 16692 heartbeater.cc:507] Master 127.8.111.126:41553 requested a full tablet report, sending...
I20260709 12:29:37.289765  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:37.292011 16416 ts_manager.cc:194] Registered new tserver with Master: 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:37.292807  8637 webserver.cc:533] Webserver started at http://127.8.111.68:34655/ using document root <none> and password file <none>
I20260709 12:29:37.293452  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:37.293498 16416 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53824
I20260709 12:29:37.293694  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:37.294085  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:37.295342  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-3-root/instance:
uuid: "cd924581228b49d889b0e1553519722a"
format_stamp: "Formatted at 2026-07-09 12:29:37 on dist-test-slave-044g"
I20260709 12:29:37.299993  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:29:37.303934 16703 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:37.304741  8637 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:29:37.305052  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-3-root
uuid: "cd924581228b49d889b0e1553519722a"
format_stamp: "Formatted at 2026-07-09 12:29:37 on dist-test-slave-044g"
I20260709 12:29:37.305363  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:37.335287  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:37.336603  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:37.338133  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:37.340384  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:37.340626  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:37.340890  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:37.341087  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:37.385340  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.68:35573
I20260709 12:29:37.385426 16765 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.68:35573 every 8 connection(s)
I20260709 12:29:37.399494 16766 heartbeater.cc:344] Connected to a master server at 127.8.111.126:41553
I20260709 12:29:37.399842 16766 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:37.400609 16766 heartbeater.cc:507] Master 127.8.111.126:41553 requested a full tablet report, sending...
I20260709 12:29:37.402793 16416 ts_manager.cc:194] Registered new tserver with Master: cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:37.403262  8637 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014923829s
I20260709 12:29:37.404599 16416 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53826
I20260709 12:29:37.430749 16416 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53832:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:29:37.679800 16731 tablet_service.cc:1511] Processing CreateTablet for tablet 3d77d239e0634d6894726f6bba42be5e (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:29:37.681419 16731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d77d239e0634d6894726f6bba42be5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.683174 16729 tablet_service.cc:1511] Processing CreateTablet for tablet d4a9660f852f43f19f20f687b10acdd2 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:29:37.684546 16729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a9660f852f43f19f20f687b10acdd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.688369 16728 tablet_service.cc:1511] Processing CreateTablet for tablet d6724b5f4d23403097a81f5e83cf5e0e (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:29:37.689772 16728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6724b5f4d23403097a81f5e83cf5e0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.692619 16727 tablet_service.cc:1511] Processing CreateTablet for tablet 8bbf661e435740adbb0269128765d10e (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:29:37.693971 16727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bbf661e435740adbb0269128765d10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.694826 16657 tablet_service.cc:1511] Processing CreateTablet for tablet 3d77d239e0634d6894726f6bba42be5e (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:29:37.696223 16657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d77d239e0634d6894726f6bba42be5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.699204 16655 tablet_service.cc:1511] Processing CreateTablet for tablet d4a9660f852f43f19f20f687b10acdd2 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:29:37.699462 16654 tablet_service.cc:1511] Processing CreateTablet for tablet e968c7db76fe442fa81826c4035acb91 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:29:37.701445 16655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a9660f852f43f19f20f687b10acdd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.702401 16653 tablet_service.cc:1511] Processing CreateTablet for tablet 8bbf661e435740adbb0269128765d10e (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:29:37.703320 16730 tablet_service.cc:1511] Processing CreateTablet for tablet 5daaf5ff8d2242d2bdfdff37cbbd6146 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:29:37.704732 16730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5daaf5ff8d2242d2bdfdff37cbbd6146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.708235 16656 tablet_service.cc:1511] Processing CreateTablet for tablet 3d9befeb38274b3fbca494f3044f9822 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:29:37.711594 16726 tablet_service.cc:1511] Processing CreateTablet for tablet f0c6961f324049b8a5d9c13b648dc1bc (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:29:37.700544 16652 tablet_service.cc:1511] Processing CreateTablet for tablet f0c6961f324049b8a5d9c13b648dc1bc (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:29:37.713040 16726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c6961f324049b8a5d9c13b648dc1bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.713805 16654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e968c7db76fe442fa81826c4035acb91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.715514 16725 tablet_service.cc:1511] Processing CreateTablet for tablet 6d8898ec613947bfa3b95ae941e1245d (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:29:37.716971 16725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d8898ec613947bfa3b95ae941e1245d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.723469 16651 tablet_service.cc:1511] Processing CreateTablet for tablet 2738a61896734d42b9febbcbf8848761 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:29:37.734308 16652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c6961f324049b8a5d9c13b648dc1bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.740757 16651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2738a61896734d42b9febbcbf8848761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.742624 16656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d9befeb38274b3fbca494f3044f9822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.746582 16653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bbf661e435740adbb0269128765d10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.747716 16583 tablet_service.cc:1511] Processing CreateTablet for tablet 3d77d239e0634d6894726f6bba42be5e (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:29:37.749081 16583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d77d239e0634d6894726f6bba42be5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.751889 16582 tablet_service.cc:1511] Processing CreateTablet for tablet 3d9befeb38274b3fbca494f3044f9822 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:29:37.753214 16582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d9befeb38274b3fbca494f3044f9822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.754328 16724 tablet_service.cc:1511] Processing CreateTablet for tablet 7805d2575cfc4de984937de995038b47 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:29:37.755666 16724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7805d2575cfc4de984937de995038b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.755908 16581 tablet_service.cc:1511] Processing CreateTablet for tablet 5daaf5ff8d2242d2bdfdff37cbbd6146 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:29:37.757495 16581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5daaf5ff8d2242d2bdfdff37cbbd6146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.759441 16580 tablet_service.cc:1511] Processing CreateTablet for tablet e968c7db76fe442fa81826c4035acb91 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:29:37.760772 16580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e968c7db76fe442fa81826c4035acb91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.762770 16723 tablet_service.cc:1511] Processing CreateTablet for tablet f063389a54a742ab8d764101a9168d1b (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:29:37.764138 16723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f063389a54a742ab8d764101a9168d1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.763989 16577 tablet_service.cc:1511] Processing CreateTablet for tablet 2738a61896734d42b9febbcbf8848761 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:29:37.765280 16577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2738a61896734d42b9febbcbf8848761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.767481 16578 tablet_service.cc:1511] Processing CreateTablet for tablet f0c6961f324049b8a5d9c13b648dc1bc (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:29:37.768846 16578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c6961f324049b8a5d9c13b648dc1bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.771062 16650 tablet_service.cc:1511] Processing CreateTablet for tablet 7805d2575cfc4de984937de995038b47 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:29:37.771397 16579 tablet_service.cc:1511] Processing CreateTablet for tablet d6724b5f4d23403097a81f5e83cf5e0e (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:29:37.772388 16650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7805d2575cfc4de984937de995038b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.772681 16579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6724b5f4d23403097a81f5e83cf5e0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.774012 16722 tablet_service.cc:1511] Processing CreateTablet for tablet f3262489dd274a878ecf95eb28323a5b (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:29:37.775463 16722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3262489dd274a878ecf95eb28323a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.780524 16508 tablet_service.cc:1511] Processing CreateTablet for tablet 3d9befeb38274b3fbca494f3044f9822 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:29:37.781968 16508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d9befeb38274b3fbca494f3044f9822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.783532 16507 tablet_service.cc:1511] Processing CreateTablet for tablet 5daaf5ff8d2242d2bdfdff37cbbd6146 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:29:37.784869 16507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5daaf5ff8d2242d2bdfdff37cbbd6146. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.791337 16501 tablet_service.cc:1511] Processing CreateTablet for tablet 6d8898ec613947bfa3b95ae941e1245d (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:29:37.793113 16501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d8898ec613947bfa3b95ae941e1245d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.795737 16504 tablet_service.cc:1511] Processing CreateTablet for tablet d6724b5f4d23403097a81f5e83cf5e0e (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:29:37.799723 16576 tablet_service.cc:1511] Processing CreateTablet for tablet 6d8898ec613947bfa3b95ae941e1245d (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:29:37.801609 16576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d8898ec613947bfa3b95ae941e1245d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.810154 16503 tablet_service.cc:1511] Processing CreateTablet for tablet 8bbf661e435740adbb0269128765d10e (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:29:37.811197 16506 tablet_service.cc:1511] Processing CreateTablet for tablet d4a9660f852f43f19f20f687b10acdd2 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:29:37.812695 16505 tablet_service.cc:1511] Processing CreateTablet for tablet e968c7db76fe442fa81826c4035acb91 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:29:37.819070 16504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6724b5f4d23403097a81f5e83cf5e0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.819937 16575 tablet_service.cc:1511] Processing CreateTablet for tablet f063389a54a742ab8d764101a9168d1b (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:29:37.822609 16503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bbf661e435740adbb0269128765d10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.822474 16574 tablet_service.cc:1511] Processing CreateTablet for tablet 1954b02f86b546d382996faa0aa9fd89 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:29:37.824009 16506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4a9660f852f43f19f20f687b10acdd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.823812 16649 tablet_service.cc:1511] Processing CreateTablet for tablet f063389a54a742ab8d764101a9168d1b (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:29:37.825194 16649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f063389a54a742ab8d764101a9168d1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.826722 16505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e968c7db76fe442fa81826c4035acb91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.827657 16500 tablet_service.cc:1511] Processing CreateTablet for tablet 7805d2575cfc4de984937de995038b47 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:29:37.829046 16500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7805d2575cfc4de984937de995038b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.830701 16502 tablet_service.cc:1511] Processing CreateTablet for tablet 2738a61896734d42b9febbcbf8848761 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:29:37.831998 16502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2738a61896734d42b9febbcbf8848761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.834657 16499 tablet_service.cc:1511] Processing CreateTablet for tablet 1954b02f86b546d382996faa0aa9fd89 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:29:37.835951 16499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1954b02f86b546d382996faa0aa9fd89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.838542 16648 tablet_service.cc:1511] Processing CreateTablet for tablet 1954b02f86b546d382996faa0aa9fd89 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:29:37.840550 16648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1954b02f86b546d382996faa0aa9fd89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.842680 16574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1954b02f86b546d382996faa0aa9fd89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.845283 16575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f063389a54a742ab8d764101a9168d1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.849673 16786 tablet_bootstrap.cc:492] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:37.851043 16787 tablet_bootstrap.cc:492] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:37.877555 16787 tablet_bootstrap.cc:654] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:37.890794 16463 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:37.915810 16581 tablet_service.cc:1511] Processing CreateTablet for tablet f3262489dd274a878ecf95eb28323a5b (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:29:37.916785 16653 tablet_service.cc:1511] Processing CreateTablet for tablet d45c0ead4eb3497c91c28c55ee353d83 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:29:37.918303 16653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45c0ead4eb3497c91c28c55ee353d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.917989 16729 tablet_service.cc:1511] Processing CreateTablet for tablet d45c0ead4eb3497c91c28c55ee353d83 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:29:37.917174 16581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3262489dd274a878ecf95eb28323a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.933281 16729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45c0ead4eb3497c91c28c55ee353d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.939513 16786 tablet_bootstrap.cc:654] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:37.973708 16788 tablet_bootstrap.cc:492] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:37.977223 16790 tablet_bootstrap.cc:492] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:37.994349 16582 tablet_service.cc:1511] Processing CreateTablet for tablet d3719aa0cfe94cd3ad30412f3ad684a8 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:29:37.995797 16582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3719aa0cfe94cd3ad30412f3ad684a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.995935 16499 tablet_service.cc:1511] Processing CreateTablet for tablet f3262489dd274a878ecf95eb28323a5b (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:29:38.003731 16499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3262489dd274a878ecf95eb28323a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.009919 16790 tablet_bootstrap.cc:654] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.000167 16504 tablet_service.cc:1511] Processing CreateTablet for tablet d45c0ead4eb3497c91c28c55ee353d83 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:29:38.021023 16504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45c0ead4eb3497c91c28c55ee353d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.024379 16726 tablet_service.cc:1511] Processing CreateTablet for tablet 38c2fffde641468f9399b51e98f495eb (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:29:38.028133 16726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38c2fffde641468f9399b51e98f495eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.033455 16722 tablet_service.cc:1511] Processing CreateTablet for tablet d285abc27263437a85f24a1d8f993be1 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:29:38.023422 16650 tablet_service.cc:1511] Processing CreateTablet for tablet e405df92b54c47daa8ae52a9fc87b7ac (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:29:38.011993 16502 tablet_service.cc:1511] Processing CreateTablet for tablet e405df92b54c47daa8ae52a9fc87b7ac (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:29:38.034938 16722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d285abc27263437a85f24a1d8f993be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.035717 16502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e405df92b54c47daa8ae52a9fc87b7ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.035351 16649 tablet_service.cc:1511] Processing CreateTablet for tablet d285abc27263437a85f24a1d8f993be1 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:29:38.014737 16657 tablet_service.cc:1511] Processing CreateTablet for tablet d3719aa0cfe94cd3ad30412f3ad684a8 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:29:38.015564 16724 tablet_service.cc:1511] Processing CreateTablet for tablet d3719aa0cfe94cd3ad30412f3ad684a8 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:29:38.016016 16787 tablet_bootstrap.cc:492] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:38.039271 16724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3719aa0cfe94cd3ad30412f3ad684a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.039335 16787 ts_tablet_manager.cc:1403] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.189s	user 0.007s	sys 0.024s
I20260709 12:29:38.027781 16581 tablet_service.cc:1511] Processing CreateTablet for tablet 38c2fffde641468f9399b51e98f495eb (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:29:38.013190 16577 tablet_service.cc:1511] Processing CreateTablet for tablet e405df92b54c47daa8ae52a9fc87b7ac (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:29:38.040733 16581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38c2fffde641468f9399b51e98f495eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.041355 16577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e405df92b54c47daa8ae52a9fc87b7ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.017647 16788 tablet_bootstrap.cc:654] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.026690 16501 tablet_service.cc:1511] Processing CreateTablet for tablet 38c2fffde641468f9399b51e98f495eb (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:29:38.041841 16505 tablet_service.cc:1511] Processing CreateTablet for tablet d285abc27263437a85f24a1d8f993be1 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:29:38.043198 16501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38c2fffde641468f9399b51e98f495eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.043826 16505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d285abc27263437a85f24a1d8f993be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.019729 16786 tablet_bootstrap.cc:492] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:38.046674 16786 ts_tablet_manager.cc:1403] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.197s	user 0.013s	sys 0.003s
I20260709 12:29:38.055320 16787 raft_consensus.cc:359] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:38.056221 16787 raft_consensus.cc:385] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.056566 16787 raft_consensus.cc:740] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.057400 16787 consensus_queue.cc:260] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:38.057886 16576 tablet_service.cc:1511] Processing CreateTablet for tablet 23de375943ed49b2b9da4652fa088021 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:29:38.059322 16576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23de375943ed49b2b9da4652fa088021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.060222 16650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e405df92b54c47daa8ae52a9fc87b7ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.060140 16786 raft_consensus.cc:359] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.061117 16786 raft_consensus.cc:385] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.061465 16786 raft_consensus.cc:740] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.062773 16649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d285abc27263437a85f24a1d8f993be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.062624 16786 consensus_queue.cc:260] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.065399 16657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3719aa0cfe94cd3ad30412f3ad684a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.074607 16648 tablet_service.cc:1511] Processing CreateTablet for tablet 23de375943ed49b2b9da4652fa088021 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:29:38.076032 16648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23de375943ed49b2b9da4652fa088021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.077335 16692 heartbeater.cc:499] Master 127.8.111.126:41553 was elected leader, sending a full tablet report...
I20260709 12:29:38.090574 16543 heartbeater.cc:499] Master 127.8.111.126:41553 was elected leader, sending a full tablet report...
I20260709 12:29:38.091320 16504 tablet_service.cc:1511] Processing CreateTablet for tablet c8e6882ec7b344f7b4783d7610f69d82 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:29:38.092736 16504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8e6882ec7b344f7b4783d7610f69d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.096218 16788 tablet_bootstrap.cc:492] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:38.096860 16788 ts_tablet_manager.cc:1403] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.124s	user 0.013s	sys 0.000s
I20260709 12:29:38.100885 16582 tablet_service.cc:1511] Processing CreateTablet for tablet c8e6882ec7b344f7b4783d7610f69d82 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:29:38.102489 16582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8e6882ec7b344f7b4783d7610f69d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.102259 16723 tablet_service.cc:1511] Processing CreateTablet for tablet 23de375943ed49b2b9da4652fa088021 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:29:38.103739 16723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23de375943ed49b2b9da4652fa088021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.111035 16652 tablet_service.cc:1511] Processing CreateTablet for tablet c8e6882ec7b344f7b4783d7610f69d82 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:29:38.112421 16652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8e6882ec7b344f7b4783d7610f69d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.112110 16722 tablet_service.cc:1511] Processing CreateTablet for tablet fd90b9fc6af748cd9bdb02bd14568f64 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:29:38.113384 16722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd90b9fc6af748cd9bdb02bd14568f64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.116815 16790 tablet_bootstrap.cc:492] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:38.117468 16790 ts_tablet_manager.cc:1403] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.141s	user 0.014s	sys 0.000s
I20260709 12:29:38.121119 16790 raft_consensus.cc:359] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:38.134440 16790 raft_consensus.cc:385] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.134802 16787 ts_tablet_manager.cc:1434] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.000s
I20260709 12:29:38.134822 16790 raft_consensus.cc:740] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.136067 16787 tablet_bootstrap.cc:492] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:38.136122 16790 consensus_queue.cc:260] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:38.139883 16766 heartbeater.cc:499] Master 127.8.111.126:41553 was elected leader, sending a full tablet report...
I20260709 12:29:38.141384 16786 ts_tablet_manager.cc:1434] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.000s
I20260709 12:29:38.142728 16786 tablet_bootstrap.cc:492] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:38.100485 16788 raft_consensus.cc:359] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.150853 16788 raft_consensus.cc:385] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.151186 16788 raft_consensus.cc:740] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.152005 16788 consensus_queue.cc:260] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.156441 16501 tablet_service.cc:1511] Processing CreateTablet for tablet fd90b9fc6af748cd9bdb02bd14568f64 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:29:38.158653 16654 tablet_service.cc:1511] Processing CreateTablet for tablet 5d82d757f6a34783b2b2055824f65e88 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:29:38.159978 16654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d82d757f6a34783b2b2055824f65e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.163138 16729 tablet_service.cc:1511] Processing CreateTablet for tablet 5d82d757f6a34783b2b2055824f65e88 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:29:38.163640 16504 tablet_service.cc:1511] Processing CreateTablet for tablet 5d82d757f6a34783b2b2055824f65e88 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:29:38.164449 16729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d82d757f6a34783b2b2055824f65e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.165916 16576 tablet_service.cc:1511] Processing CreateTablet for tablet a17be6871edc41768bb5b3a6e2d1cf2a (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:29:38.167307 16576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a17be6871edc41768bb5b3a6e2d1cf2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.174306 16501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd90b9fc6af748cd9bdb02bd14568f64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.175084 16504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d82d757f6a34783b2b2055824f65e88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.177861 16581 tablet_service.cc:1511] Processing CreateTablet for tablet fd90b9fc6af748cd9bdb02bd14568f64 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:29:38.180205 16653 tablet_service.cc:1511] Processing CreateTablet for tablet a17be6871edc41768bb5b3a6e2d1cf2a (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:29:38.181596 16653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a17be6871edc41768bb5b3a6e2d1cf2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.190186 16618 heartbeater.cc:499] Master 127.8.111.126:41553 was elected leader, sending a full tablet report...
I20260709 12:29:38.179189 16581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd90b9fc6af748cd9bdb02bd14568f64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.204620 16788 ts_tablet_manager.cc:1434] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.107s	user 0.000s	sys 0.007s
I20260709 12:29:38.205933 16788 tablet_bootstrap.cc:492] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:38.208662 16787 tablet_bootstrap.cc:654] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.219446 16726 tablet_service.cc:1511] Processing CreateTablet for tablet a17be6871edc41768bb5b3a6e2d1cf2a (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:29:38.223119 16726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a17be6871edc41768bb5b3a6e2d1cf2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.230597 16790 ts_tablet_manager.cc:1434] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.113s	user 0.012s	sys 0.063s
I20260709 12:29:38.231760 16790 tablet_bootstrap.cc:492] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:38.231424 16502 tablet_service.cc:1511] Processing CreateTablet for tablet 71752aae771f4c39b2d78e36222c8a4a (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:29:38.233647 16502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71752aae771f4c39b2d78e36222c8a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.235895 16582 tablet_service.cc:1511] Processing CreateTablet for tablet 71752aae771f4c39b2d78e36222c8a4a (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:29:38.237287 16582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71752aae771f4c39b2d78e36222c8a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.239164 16790 tablet_bootstrap.cc:654] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.240586 16504 tablet_service.cc:1511] Processing CreateTablet for tablet 450ac00038aa4947961ef3398fd75ca4 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:29:38.241882 16504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450ac00038aa4947961ef3398fd75ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.241848 16577 tablet_service.cc:1511] Processing CreateTablet for tablet 450ac00038aa4947961ef3398fd75ca4 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:29:38.247036 16577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450ac00038aa4947961ef3398fd75ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.242092 16657 tablet_service.cc:1511] Processing CreateTablet for tablet 71752aae771f4c39b2d78e36222c8a4a (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:29:38.253374 16654 tablet_service.cc:1511] Processing CreateTablet for tablet 14c4bbfcbd3a427d9ddbbeb3b17c3b4f (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:29:38.254699 16654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c4bbfcbd3a427d9ddbbeb3b17c3b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.255839 16788 tablet_bootstrap.cc:654] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.258878 16657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71752aae771f4c39b2d78e36222c8a4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.265823 16794 raft_consensus.cc:493] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.266510 16794 raft_consensus.cc:515] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
W20260709 12:29:38.274566 16693 tablet.cc:2406] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:29:38.281422 16794 leader_election.cc:290] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:38.262457 16724 tablet_service.cc:1511] Processing CreateTablet for tablet 450ac00038aa4947961ef3398fd75ca4 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:29:38.306806 16786 tablet_bootstrap.cc:700] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a: Time spent opening tablet: real 0.105s	user 0.004s	sys 0.000s
I20260709 12:29:38.327668 16723 tablet_service.cc:1511] Processing CreateTablet for tablet 14c4bbfcbd3a427d9ddbbeb3b17c3b4f (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:29:38.331923 16652 tablet_service.cc:1511] Processing CreateTablet for tablet 7ce519a396e148d79231bf7cfbabc173 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:29:38.332156 16576 tablet_service.cc:1511] Processing CreateTablet for tablet 7ce519a396e148d79231bf7cfbabc173 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:29:38.333392 16652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ce519a396e148d79231bf7cfbabc173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.333504 16576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ce519a396e148d79231bf7cfbabc173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.339591 16722 tablet_service.cc:1511] Processing CreateTablet for tablet 7ce519a396e148d79231bf7cfbabc173 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:29:38.340835 16505 tablet_service.cc:1511] Processing CreateTablet for tablet 97b4874f353b48ef8bdfa4c28549a207 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:29:38.342135 16505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b4874f353b48ef8bdfa4c28549a207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.343236 16504 tablet_service.cc:1511] Processing CreateTablet for tablet 14c4bbfcbd3a427d9ddbbeb3b17c3b4f (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:29:38.346168 16724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450ac00038aa4947961ef3398fd75ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.354619 16722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ce519a396e148d79231bf7cfbabc173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.358588 16723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c4bbfcbd3a427d9ddbbeb3b17c3b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.349133 16786 tablet_bootstrap.cc:654] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.360766 16504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14c4bbfcbd3a427d9ddbbeb3b17c3b4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.365237 16787 tablet_bootstrap.cc:492] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:38.365775 16787 ts_tablet_manager.cc:1403] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.230s	user 0.030s	sys 0.029s
I20260709 12:29:38.369016 16787 raft_consensus.cc:359] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.369794 16787 raft_consensus.cc:385] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.370193 16787 raft_consensus.cc:740] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.371153 16787 consensus_queue.cc:260] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.374457 16577 tablet_service.cc:1511] Processing CreateTablet for tablet 97b4874f353b48ef8bdfa4c28549a207 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:29:38.378014 16649 tablet_service.cc:1511] Processing CreateTablet for tablet 97b4874f353b48ef8bdfa4c28549a207 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:29:38.378899 16729 tablet_service.cc:1511] Processing CreateTablet for tablet a7ad2867ed594d4794807e95f2994f46 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:29:38.379388 16649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b4874f353b48ef8bdfa4c28549a207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.380183 16729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ad2867ed594d4794807e95f2994f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.384752 16787 ts_tablet_manager.cc:1434] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 12:29:38.378935 16577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97b4874f353b48ef8bdfa4c28549a207. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.386885 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a9660f852f43f19f20f687b10acdd2" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:38.385818 16787 tablet_bootstrap.cc:492] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
W20260709 12:29:38.388464 16633 leader_election.cc:343] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.396770 16581 tablet_service.cc:1511] Processing CreateTablet for tablet a7ad2867ed594d4794807e95f2994f46 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:29:38.397707 16790 tablet_bootstrap.cc:492] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:38.398171 16581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ad2867ed594d4794807e95f2994f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.398298 16790 ts_tablet_manager.cc:1403] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.167s	user 0.018s	sys 0.006s
I20260709 12:29:38.403764 16790 raft_consensus.cc:359] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:38.405630 16501 tablet_service.cc:1511] Processing CreateTablet for tablet a7ad2867ed594d4794807e95f2994f46 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:29:38.445968 16582 tablet_service.cc:1511] Processing CreateTablet for tablet d31544c1e5974ed9bf1a91c63adb99b8 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:29:38.446539 16790 raft_consensus.cc:385] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.447037 16790 raft_consensus.cc:740] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.414954 16797 raft_consensus.cc:493] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.414880 16728 tablet_service.cc:1511] Processing CreateTablet for tablet 689ed466680f40a59a88298ad3596652 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:29:38.447757 16797 raft_consensus.cc:515] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.448302 16728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689ed466680f40a59a88298ad3596652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.447774 16657 tablet_service.cc:1511] Processing CreateTablet for tablet d31544c1e5974ed9bf1a91c63adb99b8 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:29:38.415280 16654 tablet_service.cc:1511] Processing CreateTablet for tablet 689ed466680f40a59a88298ad3596652 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:29:38.417023 16502 tablet_service.cc:1511] Processing CreateTablet for tablet 689ed466680f40a59a88298ad3596652 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:29:38.449322 16657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d31544c1e5974ed9bf1a91c63adb99b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.417420 16788 tablet_bootstrap.cc:492] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:38.417497 16786 tablet_bootstrap.cc:492] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:38.450917 16786 ts_tablet_manager.cc:1403] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.308s	user 0.015s	sys 0.000s
I20260709 12:29:38.452827 16788 ts_tablet_manager.cc:1403] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.247s	user 0.025s	sys 0.024s
I20260709 12:29:38.420778 16793 raft_consensus.cc:493] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.435286 16787 tablet_bootstrap.cc:654] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.454542 16793 raft_consensus.cc:515] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.455909 16788 raft_consensus.cc:359] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:38.456626 16788 raft_consensus.cc:385] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.456911 16788 raft_consensus.cc:740] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.457152 16793 leader_election.cc:290] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:38.458039 16797 leader_election.cc:290] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:38.459486 16582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d31544c1e5974ed9bf1a91c63adb99b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.410720 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a9660f852f43f19f20f687b10acdd2" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:38.460340 16788 consensus_queue.cc:260] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:38.447154 16501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ad2867ed594d4794807e95f2994f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.462896 16502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689ed466680f40a59a88298ad3596652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.465022 16788 ts_tablet_manager.cc:1434] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:29:38.467293 16788 tablet_bootstrap.cc:492] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:38.459405 16654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689ed466680f40a59a88298ad3596652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.468818 16790 consensus_queue.cc:260] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:38.454025 16786 raft_consensus.cc:359] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:38.481726 16786 raft_consensus.cc:385] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.482056 16786 raft_consensus.cc:740] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.484552 16790 ts_tablet_manager.cc:1434] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.002s
I20260709 12:29:38.485590 16790 tablet_bootstrap.cc:492] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:38.482815 16786 consensus_queue.cc:260] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:38.493134 16724 tablet_service.cc:1511] Processing CreateTablet for tablet d31544c1e5974ed9bf1a91c63adb99b8 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:29:38.497406 16724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d31544c1e5974ed9bf1a91c63adb99b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.499876 16505 tablet_service.cc:1511] Processing CreateTablet for tablet 2ca7f1ce17c243358d69760e6457d24a (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:29:38.501603 16505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca7f1ce17c243358d69760e6457d24a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.510584 16790 tablet_bootstrap.cc:654] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.510794 16786 ts_tablet_manager.cc:1434] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 12:29:38.511927 16786 tablet_bootstrap.cc:492] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:38.526993 16788 tablet_bootstrap.cc:654] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.529678 16787 tablet_bootstrap.cc:492] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:38.531036 16787 ts_tablet_manager.cc:1403] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.145s	user 0.012s	sys 0.005s
I20260709 12:29:38.535811 16787 raft_consensus.cc:359] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.536615 16787 raft_consensus.cc:385] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.537006 16787 raft_consensus.cc:740] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.537945 16787 consensus_queue.cc:260] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.549559 16790 tablet_bootstrap.cc:492] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:38.550123 16790 ts_tablet_manager.cc:1403] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.065s	user 0.007s	sys 0.013s
I20260709 12:29:38.550513 16786 tablet_bootstrap.cc:654] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.553238 16790 raft_consensus.cc:359] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.553968 16790 raft_consensus.cc:385] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.554319 16790 raft_consensus.cc:740] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.555094 16790 consensus_queue.cc:260] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.555613 16652 tablet_service.cc:1511] Processing CreateTablet for tablet 2ca7f1ce17c243358d69760e6457d24a (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:29:38.557013 16652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca7f1ce17c243358d69760e6457d24a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.556844 16581 tablet_service.cc:1511] Processing CreateTablet for tablet 2ca7f1ce17c243358d69760e6457d24a (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:29:38.557535 16790 ts_tablet_manager.cc:1434] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:29:38.558586 16790 tablet_bootstrap.cc:492] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:38.558137 16581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca7f1ce17c243358d69760e6457d24a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.567633 16787 ts_tablet_manager.cc:1434] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:29:38.568193 16576 tablet_service.cc:1511] Processing CreateTablet for tablet 21548ea41a6a427fb041bbd4531e9d29 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:29:38.568728 16787 tablet_bootstrap.cc:492] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:38.571590 16504 tablet_service.cc:1511] Processing CreateTablet for tablet 21548ea41a6a427fb041bbd4531e9d29 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:29:38.572247 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d77d239e0634d6894726f6bba42be5e" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:38.573624 16796 raft_consensus.cc:493] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.574350 16796 raft_consensus.cc:515] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
W20260709 12:29:38.575079 16704 leader_election.cc:343] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.578649 16576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21548ea41a6a427fb041bbd4531e9d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.580488 16501 tablet_service.cc:1511] Processing CreateTablet for tablet fda99eaeca1149d48e54e0d83c3ec4cb (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
W20260709 12:29:38.581782 16631 leader_election.cc:343] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.582500 16631 leader_election.cc:304] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:29:38.585335 16794 raft_consensus.cc:2749] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:38.585888 16577 tablet_service.cc:1511] Processing CreateTablet for tablet 2976cad482cd47bbadc454f8570dbb0d (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:29:38.591738 16577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2976cad482cd47bbadc454f8570dbb0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.592021 16724 tablet_service.cc:1511] Processing CreateTablet for tablet 21548ea41a6a427fb041bbd4531e9d29 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:29:38.592469 16723 tablet_service.cc:1511] Processing CreateTablet for tablet fda99eaeca1149d48e54e0d83c3ec4cb (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:29:38.593291 16724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21548ea41a6a427fb041bbd4531e9d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.595655 16654 tablet_service.cc:1511] Processing CreateTablet for tablet fda99eaeca1149d48e54e0d83c3ec4cb (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:29:38.597533 16504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21548ea41a6a427fb041bbd4531e9d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.599342 16723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fda99eaeca1149d48e54e0d83c3ec4cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.608498 16501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fda99eaeca1149d48e54e0d83c3ec4cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.613457 16654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fda99eaeca1149d48e54e0d83c3ec4cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.616245 16796 leader_election.cc:290] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:38.634703 16649 tablet_service.cc:1511] Processing CreateTablet for tablet 2976cad482cd47bbadc454f8570dbb0d (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:29:38.636269 16649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2976cad482cd47bbadc454f8570dbb0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.638751 16787 tablet_bootstrap.cc:654] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.640262 16788 tablet_bootstrap.cc:492] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:38.640425 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9befeb38274b3fbca494f3044f9822" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:38.640849 16788 ts_tablet_manager.cc:1403] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.174s	user 0.015s	sys 0.025s
I20260709 12:29:38.643937 16788 raft_consensus.cc:359] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.644625 16788 raft_consensus.cc:385] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.644920 16788 raft_consensus.cc:740] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
W20260709 12:29:38.645118 16559 leader_election.cc:343] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.645740 16788 consensus_queue.cc:260] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.670377 16794 raft_consensus.cc:493] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.670902 16794 raft_consensus.cc:515] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.673234 16794 leader_election.cc:290] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:38.681705 16788 ts_tablet_manager.cc:1434] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 12:29:38.663694 16728 tablet_service.cc:1511] Processing CreateTablet for tablet 2976cad482cd47bbadc454f8570dbb0d (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:29:38.682909 16788 tablet_bootstrap.cc:492] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:38.683501 16728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2976cad482cd47bbadc454f8570dbb0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.691586 16505 tablet_service.cc:1511] Processing CreateTablet for tablet 5d56d3967e8f4a15b1883473e50c4c85 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:29:38.705874 16796 raft_consensus.cc:493] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.708771 16505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d56d3967e8f4a15b1883473e50c4c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.706403 16796 raft_consensus.cc:515] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:38.710644 16796 leader_election.cc:290] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:38.717109 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2738a61896734d42b9febbcbf8848761" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
W20260709 12:29:38.718605 16633 leader_election.cc:343] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.724905 16577 tablet_service.cc:1511] Processing CreateTablet for tablet 5d56d3967e8f4a15b1883473e50c4c85 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:29:38.726568 16577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d56d3967e8f4a15b1883473e50c4c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.731267 16788 tablet_bootstrap.cc:654] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.741796 16787 tablet_bootstrap.cc:492] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:38.742401 16787 ts_tablet_manager.cc:1403] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.174s	user 0.033s	sys 0.026s
I20260709 12:29:38.745352 16787 raft_consensus.cc:359] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.746076 16787 raft_consensus.cc:385] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.746479 16787 raft_consensus.cc:740] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.747262 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d77d239e0634d6894726f6bba42be5e" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:38.747259 16787 consensus_queue.cc:260] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.748939 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf661e435740adbb0269128765d10e" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:38.749065 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7805d2575cfc4de984937de995038b47" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:38.749598 16787 ts_tablet_manager.cc:1434] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
W20260709 12:29:38.749253 16707 leader_election.cc:343] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.750202 16707 leader_election.cc:304] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:38.751127 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf661e435740adbb0269128765d10e" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:38.751816 16741 raft_consensus.cc:2468] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 0.
I20260709 12:29:38.751859 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7805d2575cfc4de984937de995038b47" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:38.752560 16786 tablet_bootstrap.cc:492] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:38.752849 16793 raft_consensus.cc:2749] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:38.753062 16786 ts_tablet_manager.cc:1403] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.241s	user 0.004s	sys 0.026s
W20260709 12:29:38.754089 16484 leader_election.cc:343] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:38.754983 16484 leader_election.cc:343] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.755908 16482 leader_election.cc:304] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:38.756322 16786 raft_consensus.cc:359] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:38.757076 16786 raft_consensus.cc:385] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:29:38.757177 16482 leader_election.cc:343] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.757388 16786 raft_consensus.cc:740] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.757719 16482 leader_election.cc:304] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a
I20260709 12:29:38.758191 16786 consensus_queue.cc:260] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:38.760017 16797 raft_consensus.cc:493] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.760604 16797 raft_consensus.cc:515] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:38.763128 16797 leader_election.cc:290] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:38.763612 16796 raft_consensus.cc:2804] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:38.764020 16796 raft_consensus.cc:493] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:38.764359 16796 raft_consensus.cc:3060] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.764600 16786 ts_tablet_manager.cc:1434] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:29:38.765698 16786 tablet_bootstrap.cc:492] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:38.768925 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5daaf5ff8d2242d2bdfdff37cbbd6146" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
W20260709 12:29:38.770990 16559 leader_election.cc:343] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.774003 16790 tablet_bootstrap.cc:654] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.779583 16787 tablet_bootstrap.cc:492] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:38.779253 16722 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb661ebdebf474db7f6380eb0e49d7f (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:29:38.783591 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5daaf5ff8d2242d2bdfdff37cbbd6146" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:38.780722 16796 raft_consensus.cc:515] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
W20260709 12:29:38.789688 16557 leader_election.cc:343] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.790155 16557 leader_election.cc:304] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:29:38.791249 16797 raft_consensus.cc:2749] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:38.792311 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9befeb38274b3fbca494f3044f9822" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:38.784329 16654 tablet_service.cc:1511] Processing CreateTablet for tablet 5d56d3967e8f4a15b1883473e50c4c85 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:29:38.792995 16667 raft_consensus.cc:2468] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:38.793933 16654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d56d3967e8f4a15b1883473e50c4c85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.794157 16559 leader_election.cc:304] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:38.795691 16797 raft_consensus.cc:2804] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:38.796036 16797 raft_consensus.cc:493] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:38.796358 16797 raft_consensus.cc:3060] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.796876 16581 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb661ebdebf474db7f6380eb0e49d7f (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:29:38.798105 16581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb661ebdebf474db7f6380eb0e49d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.794569 16722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb661ebdebf474db7f6380eb0e49d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.799522 16726 tablet_service.cc:1511] Processing CreateTablet for tablet a2ec89af83a842909ba5e19282a9e12d (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:29:38.801961 16576 tablet_service.cc:1511] Processing CreateTablet for tablet 932859a73dad4a39b5874461e99676cc (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:29:38.803256 16576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932859a73dad4a39b5874461e99676cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.809046 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf661e435740adbb0269128765d10e" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
W20260709 12:29:38.810530 16484 leader_election.cc:343] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.815719 16787 tablet_bootstrap.cc:654] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.815349 16797 raft_consensus.cc:515] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.816542 16796 leader_election.cc:290] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:38.823261 16796 raft_consensus.cc:2749] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:38.823190 16729 tablet_service.cc:1511] Processing CreateTablet for tablet 932859a73dad4a39b5874461e99676cc (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:29:38.824693 16726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ec89af83a842909ba5e19282a9e12d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.825419 16796 raft_consensus.cc:493] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.826093 16796 raft_consensus.cc:515] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.827677 16786 tablet_bootstrap.cc:654] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.830888 16729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932859a73dad4a39b5874461e99676cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.821192 16652 tablet_service.cc:1511] Processing CreateTablet for tablet a2ec89af83a842909ba5e19282a9e12d (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:29:38.834988 16652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ec89af83a842909ba5e19282a9e12d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.835623 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2738a61896734d42b9febbcbf8848761" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
W20260709 12:29:38.838800 16630 leader_election.cc:343] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.839432 16630 leader_election.cc:304] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:38.841295 16581 tablet_service.cc:1511] Processing CreateTablet for tablet 95064ed3f05a4169a3ff0f2123274cb7 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:29:38.819272 16649 tablet_service.cc:1511] Processing CreateTablet for tablet 932859a73dad4a39b5874461e99676cc (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:29:38.842664 16581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95064ed3f05a4169a3ff0f2123274cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.842072 16657 tablet_service.cc:1511] Processing CreateTablet for tablet 95064ed3f05a4169a3ff0f2123274cb7 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:29:38.843039 16794 raft_consensus.cc:2749] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:38.843338 16649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932859a73dad4a39b5874461e99676cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.844064 16657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95064ed3f05a4169a3ff0f2123274cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.855643 16504 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb661ebdebf474db7f6380eb0e49d7f (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:29:38.855957 16505 tablet_service.cc:1511] Processing CreateTablet for tablet a2ec89af83a842909ba5e19282a9e12d (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:29:38.857053 16504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb661ebdebf474db7f6380eb0e49d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.858309 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf661e435740adbb0269128765d10e" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:38.858934 16740 raft_consensus.cc:3060] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.858796 16501 tablet_service.cc:1511] Processing CreateTablet for tablet 95064ed3f05a4169a3ff0f2123274cb7 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:29:38.859305 16577 tablet_service.cc:1511] Processing CreateTablet for tablet d0de7225f1bc44a1a67f4f298d60a257 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:29:38.860613 16577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0de7225f1bc44a1a67f4f298d60a257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.862995 16501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95064ed3f05a4169a3ff0f2123274cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.866300 16728 tablet_service.cc:1511] Processing CreateTablet for tablet 2acb6cd36ac547548487db51c2510029 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:29:38.866901 16740 raft_consensus.cc:2468] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:29:38.868373 16728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2acb6cd36ac547548487db51c2510029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.868427 16482 leader_election.cc:304] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:38.869721 16821 raft_consensus.cc:2804] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:38.870230 16821 raft_consensus.cc:697] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:29:38.871109 16821 consensus_queue.cc:237] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:38.866855 16505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2ec89af83a842909ba5e19282a9e12d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.878805 16582 tablet_service.cc:1511] Processing CreateTablet for tablet fcd2958b516b4504aec8657e0fe2ec24 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:29:38.880108 16582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcd2958b516b4504aec8657e0fe2ec24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.889278 16723 tablet_service.cc:1511] Processing CreateTablet for tablet fcd2958b516b4504aec8657e0fe2ec24 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:29:38.890936 16723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcd2958b516b4504aec8657e0fe2ec24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.896008 16579 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce5ce8db6ce4ee6bfef51b5c677c3ba (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:29:38.897816 16579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce5ce8db6ce4ee6bfef51b5c677c3ba. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:29:38.902714 16463 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:38.903622 16786 tablet_bootstrap.cc:492] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:38.904186 16786 ts_tablet_manager.cc:1403] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.139s	user 0.016s	sys 0.030s
I20260709 12:29:38.905471 16724 tablet_service.cc:1511] Processing CreateTablet for tablet d0de7225f1bc44a1a67f4f298d60a257 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:29:38.906916 16724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0de7225f1bc44a1a67f4f298d60a257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.908569 16788 tablet_bootstrap.cc:492] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:38.909132 16788 ts_tablet_manager.cc:1403] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.226s	user 0.016s	sys 0.000s
I20260709 12:29:38.911746 16796 leader_election.cc:290] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:38.912276 16499 tablet_service.cc:1511] Processing CreateTablet for tablet 2acb6cd36ac547548487db51c2510029 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:29:38.913698 16499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2acb6cd36ac547548487db51c2510029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.913427 16653 tablet_service.cc:1511] Processing CreateTablet for tablet 2acb6cd36ac547548487db51c2510029 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:29:38.915620 16650 tablet_service.cc:1511] Processing CreateTablet for tablet fcd2958b516b4504aec8657e0fe2ec24 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:29:38.916878 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1954b02f86b546d382996faa0aa9fd89" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
W20260709 12:29:38.921036 16484 leader_election.cc:343] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.921885 16650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcd2958b516b4504aec8657e0fe2ec24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.921931 16506 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce5ce8db6ce4ee6bfef51b5c677c3ba (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:29:38.923571 16506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce5ce8db6ce4ee6bfef51b5c677c3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.927162 16797 leader_election.cc:290] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:38.929279 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9befeb38274b3fbca494f3044f9822" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:38.931073 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9befeb38274b3fbca494f3044f9822" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:38.931734 16667 raft_consensus.cc:3060] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.913462 16502 tablet_service.cc:1511] Processing CreateTablet for tablet d0de7225f1bc44a1a67f4f298d60a257 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:29:38.933297 16502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0de7225f1bc44a1a67f4f298d60a257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.934558 16653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2acb6cd36ac547548487db51c2510029. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:29:38.935034 16559 leader_election.cc:343] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.937085 16788 raft_consensus.cc:359] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.945143 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1954b02f86b546d382996faa0aa9fd89" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:38.947427 16788 raft_consensus.cc:385] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:29:38.947624 16481 leader_election.cc:343] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.947901 16788 raft_consensus.cc:740] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.948242 16481 leader_election.cc:304] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:38.949234 16822 raft_consensus.cc:2749] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:38.948860 16788 consensus_queue.cc:260] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:38.953359 16413 catalog_manager.cc:5697] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 0 to 1, leader changed from <none> to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 1 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:38.974293 16793 raft_consensus.cc:493] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.974910 16793 raft_consensus.cc:515] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:38.976215 16648 tablet_service.cc:1511] Processing CreateTablet for tablet 4ce5ce8db6ce4ee6bfef51b5c677c3ba (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:29:38.977640 16648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ce5ce8db6ce4ee6bfef51b5c677c3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.983863 16667 raft_consensus.cc:2468] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:38.986068 16788 ts_tablet_manager.cc:1434] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.000s
I20260709 12:29:38.987314 16788 tablet_bootstrap.cc:492] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:38.995062 16559 leader_election.cc:304] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:38.995827 16500 tablet_service.cc:1511] Processing CreateTablet for tablet 1966b49831ff47a3ba7263b77ac4e86b (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:29:38.996381 16797 raft_consensus.cc:2804] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:38.997238 16500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1966b49831ff47a3ba7263b77ac4e86b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.999558 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8898ec613947bfa3b95ae941e1245d" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:39.000947 16726 tablet_service.cc:1511] Processing CreateTablet for tablet 1966b49831ff47a3ba7263b77ac4e86b (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 12:29:39.005478 16704 leader_election.cc:343] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:39.002303 16726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1966b49831ff47a3ba7263b77ac4e86b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.958657 16786 raft_consensus.cc:359] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:39.026118 16786 raft_consensus.cc:385] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:39.028751 16657 tablet_service.cc:1511] Processing CreateTablet for tablet 2eef363dbdce4d7bbd0b446385d8eb9e (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:29:39.024482 16793 leader_election.cc:290] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:39.032840 16581 tablet_service.cc:1511] Processing CreateTablet for tablet 1966b49831ff47a3ba7263b77ac4e86b (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:29:39.037497 16797 raft_consensus.cc:697] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:39.038757 16657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eef363dbdce4d7bbd0b446385d8eb9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.040519 16581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1966b49831ff47a3ba7263b77ac4e86b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.041931 16787 tablet_bootstrap.cc:492] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:39.046979 16787 ts_tablet_manager.cc:1403] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.279s	user 0.012s	sys 0.010s
I20260709 12:29:39.051694 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8898ec613947bfa3b95ae941e1245d" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:39.051988 16790 tablet_bootstrap.cc:492] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:39.052539 16790 ts_tablet_manager.cc:1403] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.494s	user 0.007s	sys 0.006s
W20260709 12:29:39.053284 16707 leader_election.cc:343] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:39.053733 16707 leader_election.cc:304] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:39.055064 16793 raft_consensus.cc:2749] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:39.057094 16787 raft_consensus.cc:359] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:39.058686 16797 consensus_queue.cc:237] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.074084 16794 raft_consensus.cc:493] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:39.074514 16728 tablet_service.cc:1511] Processing CreateTablet for tablet c2c73b3d790842ed9389c18ddb50e3c1 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:29:39.074630 16794 raft_consensus.cc:515] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.075805 16728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c73b3d790842ed9389c18ddb50e3c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.068697 16788 tablet_bootstrap.cc:654] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:39.076890 16794 leader_election.cc:290] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:39.078974 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968c7db76fe442fa81826c4035acb91" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:39.079648 16593 raft_consensus.cc:2468] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
I20260709 12:29:39.081347 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968c7db76fe442fa81826c4035acb91" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:39.082862 16630 leader_election.cc:304] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
W20260709 12:29:39.084146 16633 leader_election.cc:343] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:39.086228 16794 raft_consensus.cc:2804] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:39.086712 16794 raft_consensus.cc:493] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:39.087157 16794 raft_consensus.cc:3060] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:39.086989 16500 tablet_service.cc:1511] Processing CreateTablet for tablet 425340b667774e9083a7c360e90ff2e5 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:29:39.088245 16500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 425340b667774e9083a7c360e90ff2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.066646 16723 tablet_service.cc:1511] Processing CreateTablet for tablet 2eef363dbdce4d7bbd0b446385d8eb9e (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:29:39.092406 16723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eef363dbdce4d7bbd0b446385d8eb9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.068182 16577 tablet_service.cc:1511] Processing CreateTablet for tablet c2c73b3d790842ed9389c18ddb50e3c1 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:29:39.093464 16577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c73b3d790842ed9389c18ddb50e3c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.059937 16790 raft_consensus.cc:359] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:39.094152 16790 raft_consensus.cc:385] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:39.094547 16790 raft_consensus.cc:740] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:39.068528 16501 tablet_service.cc:1511] Processing CreateTablet for tablet 2eef363dbdce4d7bbd0b446385d8eb9e (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:29:39.086068 16581 tablet_service.cc:1511] Processing CreateTablet for tablet 425340b667774e9083a7c360e90ff2e5 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:29:39.067672 16654 tablet_service.cc:1511] Processing CreateTablet for tablet c2c73b3d790842ed9389c18ddb50e3c1 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:29:39.093360 16724 tablet_service.cc:1511] Processing CreateTablet for tablet d60b7bf1ed30467e9437c2b078e41808 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:29:39.095715 16581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 425340b667774e9083a7c360e90ff2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.095947 16654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c73b3d790842ed9389c18ddb50e3c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.096161 16724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d60b7bf1ed30467e9437c2b078e41808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.096931 16501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eef363dbdce4d7bbd0b446385d8eb9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.071388 16787 raft_consensus.cc:385] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:39.098469 16787 raft_consensus.cc:740] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:39.098017 16790 consensus_queue.cc:260] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:39.034746 16786 raft_consensus.cc:740] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:39.134258 16650 tablet_service.cc:1511] Processing CreateTablet for tablet 425340b667774e9083a7c360e90ff2e5 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:29:39.135615 16650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 425340b667774e9083a7c360e90ff2e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.136170 16786 consensus_queue.cc:260] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:39.150723 16790 ts_tablet_manager.cc:1434] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.098s	user 0.006s	sys 0.004s
I20260709 12:29:39.153079 16786 ts_tablet_manager.cc:1434] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.249s	user 0.011s	sys 0.000s
I20260709 12:29:39.166380 16790 tablet_bootstrap.cc:492] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:39.167309 16786 tablet_bootstrap.cc:492] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:39.170644 16649 tablet_service.cc:1511] Processing CreateTablet for tablet 75800960202940669b8d3541a84fdb28 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:29:39.172034 16649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75800960202940669b8d3541a84fdb28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.160784 16500 tablet_service.cc:1511] Processing CreateTablet for tablet d60b7bf1ed30467e9437c2b078e41808 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:29:39.172645 16729 tablet_service.cc:1511] Processing CreateTablet for tablet 75800960202940669b8d3541a84fdb28 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:29:39.173252 16500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d60b7bf1ed30467e9437c2b078e41808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.174000 16729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75800960202940669b8d3541a84fdb28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.146504 16787 consensus_queue.cc:260] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:39.164263 16415 catalog_manager.cc:5697] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:39.175937 16506 tablet_service.cc:1511] Processing CreateTablet for tablet 75800960202940669b8d3541a84fdb28 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:29:39.177220 16506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75800960202940669b8d3541a84fdb28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.184201 16579 tablet_service.cc:1511] Processing CreateTablet for tablet c53516641dc3421cac583bbe728f6e14 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:29:39.175113 16581 tablet_service.cc:1511] Processing CreateTablet for tablet d60b7bf1ed30467e9437c2b078e41808 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:29:39.185617 16579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53516641dc3421cac583bbe728f6e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.191692 16648 tablet_service.cc:1511] Processing CreateTablet for tablet c53516641dc3421cac583bbe728f6e14 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:29:39.192965 16648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53516641dc3421cac583bbe728f6e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.192929 16581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d60b7bf1ed30467e9437c2b078e41808. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.199805 16788 tablet_bootstrap.cc:492] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:39.200309 16788 ts_tablet_manager.cc:1403] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.213s	user 0.033s	sys 0.013s
I20260709 12:29:39.211390 16790 tablet_bootstrap.cc:654] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:39.214545 16788 raft_consensus.cc:359] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:39.215355 16788 raft_consensus.cc:385] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:39.215472 16786 tablet_bootstrap.cc:654] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:39.215699 16788 raft_consensus.cc:740] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:39.219177 16726 tablet_service.cc:1511] Processing CreateTablet for tablet c53516641dc3421cac583bbe728f6e14 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:29:39.220683 16726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c53516641dc3421cac583bbe728f6e14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.220461 16505 tablet_service.cc:1511] Processing CreateTablet for tablet 41cf6ac39c0248398e411dcce49bf021 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:29:39.225232 16505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41cf6ac39c0248398e411dcce49bf021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.230721 16576 tablet_service.cc:1511] Processing CreateTablet for tablet 41cf6ac39c0248398e411dcce49bf021 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:29:39.232177 16576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41cf6ac39c0248398e411dcce49bf021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.237010 16794 raft_consensus.cc:515] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.251298 16787 ts_tablet_manager.cc:1434] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.204s	user 0.013s	sys 0.004s
I20260709 12:29:39.242559 16788 consensus_queue.cc:260] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:39.260300 16788 ts_tablet_manager.cc:1434] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.056s	user 0.004s	sys 0.003s
I20260709 12:29:39.261765 16797 raft_consensus.cc:493] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:39.262259 16797 raft_consensus.cc:515] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.264055 16797 leader_election.cc:290] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:39.264151 16794 leader_election.cc:290] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:39.264732 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d77d239e0634d6894726f6bba42be5e" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:39.265374 16740 raft_consensus.cc:2468] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:39.265892 16787 tablet_bootstrap.cc:492] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:39.264067 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968c7db76fe442fa81826c4035acb91" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:39.266789 16593 raft_consensus.cc:3060] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:39.270361 16667 raft_consensus.cc:3060] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:39.271759 16557 leader_election.cc:304] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:39.272662 16797 raft_consensus.cc:2804] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:39.273056 16797 raft_consensus.cc:493] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:39.273411 16797 raft_consensus.cc:3060] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:39.273631 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968c7db76fe442fa81826c4035acb91" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
W20260709 12:29:39.278978 16633 leader_election.cc:343] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:39.280172 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d77d239e0634d6894726f6bba42be5e" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:39.280064 16729 tablet_service.cc:1511] Processing CreateTablet for tablet 010f5ea2dc68490290208a03251c29b0 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:29:39.281440 16729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 010f5ea2dc68490290208a03251c29b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.282378 16593 raft_consensus.cc:2468] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:39.283769 16630 leader_election.cc:304] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
W20260709 12:29:39.285128 16559 leader_election.cc:343] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:39.286432 16648 tablet_service.cc:1511] Processing CreateTablet for tablet 41cf6ac39c0248398e411dcce49bf021 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:29:39.287297 16797 raft_consensus.cc:515] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.287714 16648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41cf6ac39c0248398e411dcce49bf021. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.292771 16822 consensus_queue.cc:1048] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:39.293443 16786 tablet_bootstrap.cc:492] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:39.293974 16786 ts_tablet_manager.cc:1403] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.127s	user 0.015s	sys 0.007s
I20260709 12:29:39.261370 16788 tablet_bootstrap.cc:492] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:39.290568 16500 tablet_service.cc:1511] Processing CreateTablet for tablet 010f5ea2dc68490290208a03251c29b0 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:29:39.298863 16500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 010f5ea2dc68490290208a03251c29b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.291559 16833 raft_consensus.cc:2804] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:39.302193 16790 tablet_bootstrap.cc:492] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:39.304461 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d77d239e0634d6894726f6bba42be5e" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:39.297317 16786 raft_consensus.cc:359] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:39.307699 16740 raft_consensus.cc:3060] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:39.334502 16788 tablet_bootstrap.cc:654] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:39.318475 16654 tablet_service.cc:1511] Processing CreateTablet for tablet e19834ede0784553865ac5c4cd1024f0 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:29:39.372531 16786 raft_consensus.cc:385] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:39.380090 16654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e19834ede0784553865ac5c4cd1024f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.380383 16786 raft_consensus.cc:740] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:39.312772 16833 raft_consensus.cc:697] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:29:39.381430 16505 tablet_service.cc:1511] Processing CreateTablet for tablet e1765c0523b546c198e7a014b0866bbc (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:29:39.382887 16505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1765c0523b546c198e7a014b0866bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.382423 16833 consensus_queue.cc:237] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.307861 16790 ts_tablet_manager.cc:1403] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.155s	user 0.008s	sys 0.006s
I20260709 12:29:39.319383 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d77d239e0634d6894726f6bba42be5e" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:39.384311 16581 tablet_service.cc:1511] Processing CreateTablet for tablet e1765c0523b546c198e7a014b0866bbc (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:29:39.381430 16786 consensus_queue.cc:260] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:39.385707 16581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1765c0523b546c198e7a014b0866bbc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:29:39.385953 16559 leader_election.cc:343] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:39.347591 16500 tablet_service.cc:1511] Processing CreateTablet for tablet e19834ede0784553865ac5c4cd1024f0 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:29:39.319976 16723 tablet_service.cc:1511] Processing CreateTablet for tablet e19834ede0784553865ac5c4cd1024f0 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:29:39.389947 16723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e19834ede0784553865ac5c4cd1024f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.390400 16793 raft_consensus.cc:493] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:39.310711 16576 tablet_service.cc:1511] Processing CreateTablet for tablet 010f5ea2dc68490290208a03251c29b0 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:29:39.353929 16577 tablet_service.cc:1511] Processing CreateTablet for tablet a39b696cc72749608ab54eae0a99b093 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:29:39.318298 16797 leader_election.cc:290] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:39.391081 16793 raft_consensus.cc:515] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:39.392310 16576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 010f5ea2dc68490290208a03251c29b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.388856 16500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e19834ede0784553865ac5c4cd1024f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.395102 16577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a39b696cc72749608ab54eae0a99b093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.397711 16786 ts_tablet_manager.cc:1434] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.103s	user 0.013s	sys 0.012s
I20260709 12:29:39.359071 16657 tablet_service.cc:1511] Processing CreateTablet for tablet a39b696cc72749608ab54eae0a99b093 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:29:39.378551 16726 tablet_service.cc:1511] Processing CreateTablet for tablet a39b696cc72749608ab54eae0a99b093 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:29:39.365927 16796 consensus_queue.cc:1048] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:29:39.415781 16726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a39b696cc72749608ab54eae0a99b093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.419917 16786 tablet_bootstrap.cc:492] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:39.422263 16657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a39b696cc72749608ab54eae0a99b093. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.423501 16649 tablet_service.cc:1511] Processing CreateTablet for tablet e1765c0523b546c198e7a014b0866bbc (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:29:39.425221 16649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1765c0523b546c198e7a014b0866bbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.430088 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6724b5f4d23403097a81f5e83cf5e0e" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:39.430819 16518 raft_consensus.cc:2468] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 0.
I20260709 12:29:39.432164 16707 leader_election.cc:304] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:39.451669 16579 tablet_service.cc:1511] Processing CreateTablet for tablet 5a084469fa354084b2130b4656a965d1 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:29:39.453310 16579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a084469fa354084b2130b4656a965d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.453646 16650 tablet_service.cc:1511] Processing CreateTablet for tablet ea7880201e5f49299c203ac770ceb930 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:29:39.455057 16650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea7880201e5f49299c203ac770ceb930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.456600 16501 tablet_service.cc:1511] Processing CreateTablet for tablet 5a084469fa354084b2130b4656a965d1 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:29:39.457974 16501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a084469fa354084b2130b4656a965d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.453445 16728 tablet_service.cc:1511] Processing CreateTablet for tablet 5a084469fa354084b2130b4656a965d1 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:29:39.459331 16728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a084469fa354084b2130b4656a965d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.464219 16793 leader_election.cc:290] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:39.465238 16793 raft_consensus.cc:2804] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:39.465682 16793 raft_consensus.cc:493] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:39.465822 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6724b5f4d23403097a81f5e83cf5e0e" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:39.433516 16788 tablet_bootstrap.cc:492] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:39.466176 16793 raft_consensus.cc:3060] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:39.474185 16704 leader_election.cc:343] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:39.491431 16797 consensus_queue.cc:1048] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:29:39.502270 16504 tablet_service.cc:1511] Processing CreateTablet for tablet ea7880201e5f49299c203ac770ceb930 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:29:39.482192 16788 ts_tablet_manager.cc:1403] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.221s	user 0.025s	sys 0.000s
I20260709 12:29:39.503443 16504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea7880201e5f49299c203ac770ceb930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.486068 16786 tablet_bootstrap.cc:654] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:39.481986 16707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:36499, user_credentials={real_user=slave}} blocked reactor thread for 49915us
I20260709 12:29:39.506589 16787 tablet_bootstrap.cc:654] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:39.490562 16729 tablet_service.cc:1511] Processing CreateTablet for tablet ea7880201e5f49299c203ac770ceb930 (DEFAULT_TABLE table=test-workload [id=4e3235ded65445dca6b7377f3bbb7325]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:29:39.510226 16729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea7880201e5f49299c203ac770ceb930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:39.509105 16413 catalog_manager.cc:5697] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:39.475958 16846 raft_consensus.cc:493] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:39.527989 16790 raft_consensus.cc:359] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.528795 16790 raft_consensus.cc:385] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:39.529086 16790 raft_consensus.cc:740] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
W20260709 12:29:39.530047 16559 consensus_peers.cc:597] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:39.524591 16740 raft_consensus.cc:2468] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:39.529758 16790 consensus_queue.cc:260] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.559603 16557 leader_election.cc:304] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:39.561148 16829 raft_consensus.cc:2804] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:39.561638 16829 raft_consensus.cc:697] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:39.534891 16846 raft_consensus.cc:515] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:39.568281 16829 consensus_queue.cc:237] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.595917 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5daaf5ff8d2242d2bdfdff37cbbd6146" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:39.598366 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5daaf5ff8d2242d2bdfdff37cbbd6146" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:39.590536 16846 leader_election.cc:290] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
W20260709 12:29:39.598805 16707 leader_election.cc:343] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:39.599018 16593 raft_consensus.cc:2468] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 0.
I20260709 12:29:39.600934 16704 leader_election.cc:304] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:39.602244 16846 raft_consensus.cc:2804] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:39.602710 16846 raft_consensus.cc:493] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:39.603147 16846 raft_consensus.cc:3060] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:39.605546 16788 raft_consensus.cc:359] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.602831 16790 ts_tablet_manager.cc:1434] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.219s	user 0.010s	sys 0.000s
I20260709 12:29:39.608108 16790 tablet_bootstrap.cc:492] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:39.613071 16788 raft_consensus.cc:385] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:39.644109 16793 raft_consensus.cc:515] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:39.649581 16793 leader_election.cc:290] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:39.651582 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6724b5f4d23403097a81f5e83cf5e0e" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:39.653348 16790 tablet_bootstrap.cc:654] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:39.654920 16704 leader_election.cc:343] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:39.644045 16788 raft_consensus.cc:740] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:39.656266 16788 consensus_queue.cc:260] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.659011 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6724b5f4d23403097a81f5e83cf5e0e" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:39.659597 16518 raft_consensus.cc:3060] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:39.673087 16786 tablet_bootstrap.cc:492] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:39.675701 16518 raft_consensus.cc:2468] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 1.
I20260709 12:29:39.682088 16707 leader_election.cc:304] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:39.682539 16786 ts_tablet_manager.cc:1403] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.263s	user 0.021s	sys 0.017s
I20260709 12:29:39.683316 16793 raft_consensus.cc:2804] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:39.683779 16793 raft_consensus.cc:697] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:29:39.687983 16786 raft_consensus.cc:359] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:39.688720 16786 raft_consensus.cc:385] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:39.689121 16786 raft_consensus.cc:740] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:39.669261 16829 raft_consensus.cc:493] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:39.689052 16793 consensus_queue.cc:237] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:39.669454 16846 raft_consensus.cc:515] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:39.692232 16829 raft_consensus.cc:515] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:39.694496 16829 leader_election.cc:290] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:39.694526 16846 leader_election.cc:290] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:39.695226 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:39.696357 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:39.696398 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5daaf5ff8d2242d2bdfdff37cbbd6146" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
W20260709 12:29:39.697445 16559 leader_election.cc:343] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:39.697613 16593 raft_consensus.cc:3060] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:39.698304 16557 leader_election.cc:343] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:39.698736 16557 leader_election.cc:304] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a
I20260709 12:29:39.699295 16413 catalog_manager.cc:5697] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:39.703774 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5daaf5ff8d2242d2bdfdff37cbbd6146" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:39.701228 16797 raft_consensus.cc:2749] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:39.710541 16829 raft_consensus.cc:493] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:39.693763 16786 consensus_queue.cc:260] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
W20260709 12:29:39.714720 16707 leader_election.cc:343] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:39.717079 16593 raft_consensus.cc:2468] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 1.
I20260709 12:29:39.718516 16787 tablet_bootstrap.cc:492] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:39.721787 16787 ts_tablet_manager.cc:1403] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.456s	user 0.029s	sys 0.019s
I20260709 12:29:39.724151 16790 tablet_bootstrap.cc:492] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:39.724310 16787 raft_consensus.cc:359] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:39.724903 16790 ts_tablet_manager.cc:1403] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.117s	user 0.012s	sys 0.006s
I20260709 12:29:39.725078 16787 raft_consensus.cc:385] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:39.725499 16787 raft_consensus.cc:740] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:39.729002 16790 raft_consensus.cc:359] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:39.729043 16786 ts_tablet_manager.cc:1434] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.046s	user 0.001s	sys 0.008s
I20260709 12:29:39.730957 16790 raft_consensus.cc:385] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:39.731348 16790 raft_consensus.cc:740] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:39.732066 16786 tablet_bootstrap.cc:492] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:39.732259 16704 leader_election.cc:304] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:39.719878 16829 raft_consensus.cc:515] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.733278 16790 consensus_queue.cc:260] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:39.732821 16788 ts_tablet_manager.cc:1434] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.225s	user 0.017s	sys 0.004s
I20260709 12:29:39.735037 16788 tablet_bootstrap.cc:492] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:39.735330 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1954b02f86b546d382996faa0aa9fd89" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:39.735534 16829 leader_election.cc:290] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:39.735975 16518 raft_consensus.cc:2468] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:39.740224 16559 leader_election.cc:304] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:39.741309 16829 raft_consensus.cc:2804] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:39.746174 16786 tablet_bootstrap.cc:654] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:39.746510 16829 raft_consensus.cc:493] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:39.746920 16829 raft_consensus.cc:3060] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:39.747745 16790 ts_tablet_manager.cc:1434] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.003s
I20260709 12:29:39.748838 16790 tablet_bootstrap.cc:492] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:39.736097 16787 consensus_queue.cc:260] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:39.736115 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1954b02f86b546d382996faa0aa9fd89" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:39.745174 16414 catalog_manager.cc:5697] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 0 to 1, leader changed from <none> to cd924581228b49d889b0e1553519722a (127.8.111.68). New cstate: current_term: 1 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:39.741753 16846 raft_consensus.cc:2804] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:39.752980 16846 raft_consensus.cc:697] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
W20260709 12:29:39.753048 16559 leader_election.cc:343] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:39.754384 16790 tablet_bootstrap.cc:654] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:39.754314 16846 consensus_queue.cc:237] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:39.760980 16790 tablet_bootstrap.cc:492] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:39.761574 16790 ts_tablet_manager.cc:1403] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 12:29:39.763499 16788 tablet_bootstrap.cc:654] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:39.764772 16790 raft_consensus.cc:359] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:39.765584 16790 raft_consensus.cc:385] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:39.765959 16790 raft_consensus.cc:740] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:39.766942 16790 consensus_queue.cc:260] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:39.770347 16790 ts_tablet_manager.cc:1434] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 12:29:39.771710 16790 tablet_bootstrap.cc:492] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:39.772599 16787 ts_tablet_manager.cc:1434] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.050s	user 0.000s	sys 0.005s
I20260709 12:29:39.779505 16787 tablet_bootstrap.cc:492] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:39.787894 16788 tablet_bootstrap.cc:492] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:39.788472 16788 ts_tablet_manager.cc:1403] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.054s	user 0.026s	sys 0.003s
I20260709 12:29:39.791056 16414 catalog_manager.cc:5697] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 0 to 1, leader changed from <none> to cd924581228b49d889b0e1553519722a (127.8.111.68). New cstate: current_term: 1 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:39.791515 16788 raft_consensus.cc:359] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:39.793048 16788 raft_consensus.cc:385] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:39.793373 16788 raft_consensus.cc:740] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:39.793833 16787 tablet_bootstrap.cc:654] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:39.794121 16788 consensus_queue.cc:260] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:39.796854 16788 ts_tablet_manager.cc:1434] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:29:39.796936 16822 raft_consensus.cc:493] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:39.797428 16822 raft_consensus.cc:515] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:39.799782 16788 tablet_bootstrap.cc:492] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:39.802675 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5daaf5ff8d2242d2bdfdff37cbbd6146" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:39.802863 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5daaf5ff8d2242d2bdfdff37cbbd6146" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:39.803444 16593 raft_consensus.cc:2393] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in current term 1: Already voted for candidate cd924581228b49d889b0e1553519722a in this term.
I20260709 12:29:39.804984 16790 tablet_bootstrap.cc:654] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:39.806087 16482 leader_election.cc:304] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:29:39.806944 16821 raft_consensus.cc:3060] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:39.799943 16822 leader_election.cc:290] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:39.810348 16822 raft_consensus.cc:493] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:39.810947 16822 raft_consensus.cc:515] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:39.815580 16821 raft_consensus.cc:2749] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:39.817866 16822 leader_election.cc:290] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:39.819247 16829 raft_consensus.cc:515] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.819725 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a9660f852f43f19f20f687b10acdd2" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:39.820410 16741 raft_consensus.cc:2468] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 0.
I20260709 12:29:39.820477 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a9660f852f43f19f20f687b10acdd2" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:39.821364 16665 raft_consensus.cc:2468] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 0.
I20260709 12:29:39.821624 16482 leader_election.cc:304] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:39.822177 16829 leader_election.cc:290] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:39.822558 16822 raft_consensus.cc:2804] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:39.822935 16822 raft_consensus.cc:493] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:39.823271 16822 raft_consensus.cc:3060] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:39.823293 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1954b02f86b546d382996faa0aa9fd89" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:39.824191 16518 raft_consensus.cc:3060] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:39.828365 16788 tablet_bootstrap.cc:654] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:39.832003 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1954b02f86b546d382996faa0aa9fd89" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
W20260709 12:29:39.835402 16559 leader_election.cc:343] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:39.841879 16790 tablet_bootstrap.cc:492] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:39.842633 16790 ts_tablet_manager.cc:1403] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.071s	user 0.021s	sys 0.004s
I20260709 12:29:39.843287 16786 tablet_bootstrap.cc:492] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:39.843739 16786 ts_tablet_manager.cc:1403] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.112s	user 0.014s	sys 0.018s
I20260709 12:29:39.845178 16822 raft_consensus.cc:515] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:39.846238 16518 raft_consensus.cc:2468] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:39.847677 16559 leader_election.cc:304] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:39.847565 16786 raft_consensus.cc:359] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:39.848359 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a9660f852f43f19f20f687b10acdd2" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:39.848479 16790 raft_consensus.cc:359] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.848893 16829 raft_consensus.cc:2804] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:39.849023 16665 raft_consensus.cc:3060] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:39.849201 16790 raft_consensus.cc:385] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:39.849463 16829 raft_consensus.cc:697] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:39.849623 16790 raft_consensus.cc:740] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:39.850757 16822 leader_election.cc:290] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:39.850630 16829 consensus_queue.cc:237] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.851079 16787 tablet_bootstrap.cc:492] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:39.851845 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a9660f852f43f19f20f687b10acdd2" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:39.853590 16787 ts_tablet_manager.cc:1403] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.074s	user 0.015s	sys 0.016s
I20260709 12:29:39.853638 16741 raft_consensus.cc:3060] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:39.856531 16822 raft_consensus.cc:493] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:39.857050 16822 raft_consensus.cc:515] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.857421 16787 raft_consensus.cc:359] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.858304 16787 raft_consensus.cc:385] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:39.858652 16787 raft_consensus.cc:740] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:39.848366 16786 raft_consensus.cc:385] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:39.852821 16788 tablet_bootstrap.cc:492] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:39.860654 16788 ts_tablet_manager.cc:1403] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.017s
I20260709 12:29:39.850337 16790 consensus_queue.cc:260] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.860746 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9befeb38274b3fbca494f3044f9822" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:39.864156 16790 ts_tablet_manager.cc:1434] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:29:39.862035 16786 raft_consensus.cc:740] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:39.865923 16788 raft_consensus.cc:359] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.865996 16786 consensus_queue.cc:260] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:39.866808 16788 raft_consensus.cc:385] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:39.867106 16788 raft_consensus.cc:740] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:39.867738 16788 consensus_queue.cc:260] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.869760 16788 ts_tablet_manager.cc:1434] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:29:39.870538 16833 consensus_queue.cc:1048] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:39.865831 16790 tablet_bootstrap.cc:492] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:39.875087 16786 ts_tablet_manager.cc:1434] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.002s
I20260709 12:29:39.876209 16786 tablet_bootstrap.cc:492] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:39.876905 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9befeb38274b3fbca494f3044f9822" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:39.879056 16484 leader_election.cc:304] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:39.879968 16821 raft_consensus.cc:2749] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:39.880510 16822 leader_election.cc:290] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:39.880887 16788 tablet_bootstrap.cc:492] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:39.883176 16786 tablet_bootstrap.cc:654] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:39.884997 16741 raft_consensus.cc:2468] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:29:39.889408 16482 leader_election.cc:304] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:39.890678 16822 raft_consensus.cc:2804] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:39.891289 16822 raft_consensus.cc:697] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:29:39.891986 16790 tablet_bootstrap.cc:654] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:39.892180 16822 consensus_queue.cc:237] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:39.859572 16787 consensus_queue.cc:260] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.900079 16414 catalog_manager.cc:5697] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:39.910928 16518 raft_consensus.cc:3060] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:39.915385 16463 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:39.921001 16790 tablet_bootstrap.cc:492] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:39.928375 16786 tablet_bootstrap.cc:492] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:39.905001 16665 raft_consensus.cc:2468] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:29:39.929066 16786 ts_tablet_manager.cc:1403] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.010s
I20260709 12:29:39.929921 16790 ts_tablet_manager.cc:1403] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.002s
I20260709 12:29:39.931895 16786 raft_consensus.cc:359] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:39.928359 16787 ts_tablet_manager.cc:1434] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.074s	user 0.004s	sys 0.003s
I20260709 12:29:39.932577 16786 raft_consensus.cc:385] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:39.932905 16786 raft_consensus.cc:740] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:39.933542 16786 consensus_queue.cc:260] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:39.934516 16788 tablet_bootstrap.cc:654] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:39.936520 16787 tablet_bootstrap.cc:492] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:39.938905 16829 raft_consensus.cc:493] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:39.939455 16829 raft_consensus.cc:515] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:39.943186 16415 catalog_manager.cc:5697] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 0 to 1, leader changed from <none> to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 1 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:39.938006 16790 raft_consensus.cc:359] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:39.944774 16790 raft_consensus.cc:385] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:39.945142 16790 raft_consensus.cc:740] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:39.944998 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f063389a54a742ab8d764101a9168d1b" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:39.946237 16790 consensus_queue.cc:260] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
W20260709 12:29:39.947155 16559 leader_election.cc:343] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:39.951364 16790 ts_tablet_manager.cc:1434] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:29:39.952576 16790 tablet_bootstrap.cc:492] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:39.942080 16829 leader_election.cc:290] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:39.956549 16786 ts_tablet_manager.cc:1434] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 12:29:39.958138 16786 tablet_bootstrap.cc:492] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:39.965932 16786 tablet_bootstrap.cc:654] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:39.958832 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f063389a54a742ab8d764101a9168d1b" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
W20260709 12:29:39.973666 16557 leader_election.cc:343] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:39.974321 16557 leader_election.cc:304] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a
I20260709 12:29:39.975318 16829 raft_consensus.cc:2749] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:39.982637 16787 tablet_bootstrap.cc:654] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:39.987985 16790 tablet_bootstrap.cc:654] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:39.988319 16786 tablet_bootstrap.cc:492] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:39.988824 16786 ts_tablet_manager.cc:1403] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.003s
I20260709 12:29:39.990089 16517 raft_consensus.cc:3060] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:39.994445 16786 raft_consensus.cc:359] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:39.995570 16786 raft_consensus.cc:385] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:39.999439 16786 raft_consensus.cc:740] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:39.997601 16788 tablet_bootstrap.cc:492] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:40.000492 16788 ts_tablet_manager.cc:1403] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.120s	user 0.019s	sys 0.006s
I20260709 12:29:40.001704 16786 consensus_queue.cc:260] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.008987 16786 ts_tablet_manager.cc:1434] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.002s
I20260709 12:29:40.010381 16786 tablet_bootstrap.cc:492] T f063389a54a742ab8d764101a9168d1b P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:40.010995 16833 raft_consensus.cc:493] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.012099 16788 raft_consensus.cc:359] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.013196 16833 raft_consensus.cc:515] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:40.013764 16788 raft_consensus.cc:385] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.014437 16788 raft_consensus.cc:740] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.015314 16788 consensus_queue.cc:260] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.015600 16833 leader_election.cc:290] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:40.016278 16875 raft_consensus.cc:493] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.016877 16875 raft_consensus.cc:515] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.017799 16788 ts_tablet_manager.cc:1434] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:29:40.018808 16788 tablet_bootstrap.cc:492] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:40.024215 16516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7805d2575cfc4de984937de995038b47" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:40.025010 16516 raft_consensus.cc:2468] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
I20260709 12:29:40.026298 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d77d239e0634d6894726f6bba42be5e" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:40.027164 16741 raft_consensus.cc:2393] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99ca36f8a50c459388f31022b1455ed6 in current term 1: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
I20260709 12:29:40.027704 16786 tablet_bootstrap.cc:654] T f063389a54a742ab8d764101a9168d1b P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.028137 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7805d2575cfc4de984937de995038b47" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:40.028839 16740 raft_consensus.cc:2468] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
I20260709 12:29:40.031225 16829 raft_consensus.cc:493] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.032887 16829 raft_consensus.cc:515] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:40.030968 16875 leader_election.cc:290] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:40.040856 16829 leader_election.cc:290] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:40.037063 16633 leader_election.cc:304] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:29:40.043817 16878 raft_consensus.cc:2804] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.044240 16878 raft_consensus.cc:493] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.044595 16878 raft_consensus.cc:3060] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.044919 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d77d239e0634d6894726f6bba42be5e" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:40.045704 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2738a61896734d42b9febbcbf8848761" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:40.047768 16665 raft_consensus.cc:2468] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:40.047003 16875 consensus_queue.cc:1048] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:29:40.048610 16630 leader_election.cc:304] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:29:40.049870 16875 raft_consensus.cc:3060] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.051575 16559 leader_election.cc:304] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:40.052548 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2738a61896734d42b9febbcbf8848761" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:40.054755 16855 raft_consensus.cc:2804] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.055531 16855 raft_consensus.cc:493] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.055933 16855 raft_consensus.cc:3060] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.059880 16517 raft_consensus.cc:2468] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:40.061208 16790 tablet_bootstrap.cc:492] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:40.061825 16790 ts_tablet_manager.cc:1403] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.109s	user 0.012s	sys 0.021s
I20260709 12:29:40.064190 16855 raft_consensus.cc:515] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:40.067313 16788 tablet_bootstrap.cc:654] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.069247 16875 raft_consensus.cc:2749] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:40.079082 16787 tablet_bootstrap.cc:492] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:40.080619 16787 ts_tablet_manager.cc:1403] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.144s	user 0.020s	sys 0.005s
I20260709 12:29:40.084086 16855 leader_election.cc:290] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:40.085729 16786 tablet_bootstrap.cc:492] T f063389a54a742ab8d764101a9168d1b P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:40.089825 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2738a61896734d42b9febbcbf8848761" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:40.090685 16665 raft_consensus.cc:3060] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.091189 16788 tablet_bootstrap.cc:492] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:40.091866 16788 ts_tablet_manager.cc:1403] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.073s	user 0.006s	sys 0.005s
I20260709 12:29:40.092634 16855 raft_consensus.cc:493] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.093159 16855 raft_consensus.cc:515] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.095295 16829 consensus_queue.cc:1048] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:40.098963 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2738a61896734d42b9febbcbf8848761" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:40.099725 16517 raft_consensus.cc:3060] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.106653 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8898ec613947bfa3b95ae941e1245d" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:40.107676 16741 raft_consensus.cc:2468] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:40.109584 16557 leader_election.cc:304] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:40.110862 16829 raft_consensus.cc:2804] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.111402 16829 raft_consensus.cc:493] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.111887 16829 raft_consensus.cc:3060] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.090159 16786 ts_tablet_manager.cc:1403] T f063389a54a742ab8d764101a9168d1b P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.003s
I20260709 12:29:40.120504 16855 leader_election.cc:290] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:40.121863 16516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8898ec613947bfa3b95ae941e1245d" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
W20260709 12:29:40.123805 16559 leader_election.cc:343] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.128741 16829 raft_consensus.cc:515] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.133536 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8898ec613947bfa3b95ae941e1245d" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:40.134454 16741 raft_consensus.cc:3060] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.135536 16787 raft_consensus.cc:359] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.136291 16787 raft_consensus.cc:385] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.136633 16787 raft_consensus.cc:740] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.137466 16787 consensus_queue.cc:260] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.139478 16788 raft_consensus.cc:359] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.139925 16786 raft_consensus.cc:359] T f063389a54a742ab8d764101a9168d1b P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.140254 16788 raft_consensus.cc:385] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.140676 16788 raft_consensus.cc:740] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.141359 16788 consensus_queue.cc:260] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.142335 16787 ts_tablet_manager.cc:1434] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.061s	user 0.004s	sys 0.003s
I20260709 12:29:40.143388 16788 ts_tablet_manager.cc:1434] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.001s
I20260709 12:29:40.144280 16788 tablet_bootstrap.cc:492] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:40.144402 16790 raft_consensus.cc:359] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.147244 16793 raft_consensus.cc:493] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.147493 16790 raft_consensus.cc:385] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.148022 16790 raft_consensus.cc:740] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.146509 16786 raft_consensus.cc:385] T f063389a54a742ab8d764101a9168d1b P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.149507 16786 raft_consensus.cc:740] T f063389a54a742ab8d764101a9168d1b P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.149295 16790 consensus_queue.cc:260] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.150166 16786 consensus_queue.cc:260] T f063389a54a742ab8d764101a9168d1b P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.146021 16517 raft_consensus.cc:2468] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:40.147843 16793 raft_consensus.cc:515] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.151991 16559 leader_election.cc:304] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:40.152510 16786 ts_tablet_manager.cc:1434] T f063389a54a742ab8d764101a9168d1b P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 12:29:40.133944 16665 raft_consensus.cc:2468] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:40.153342 16797 raft_consensus.cc:2804] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:40.153915 16797 raft_consensus.cc:697] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:40.156747 16846 consensus_queue.cc:1048] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:40.157368 16797 consensus_queue.cc:237] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:40.160028 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:40.160761 16592 raft_consensus.cc:2468] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 0.
I20260709 12:29:40.160818 16741 raft_consensus.cc:2468] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:40.162247 16788 tablet_bootstrap.cc:654] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.162096 16704 leader_election.cc:304] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:40.163342 16846 raft_consensus.cc:2804] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.163715 16846 raft_consensus.cc:493] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.164052 16846 raft_consensus.cc:3060] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.154152 16790 ts_tablet_manager.cc:1434] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.089s	user 0.036s	sys 0.029s
I20260709 12:29:40.166327 16790 tablet_bootstrap.cc:492] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:40.155545 16793 leader_election.cc:290] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:40.155150 16878 raft_consensus.cc:515] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.171087 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:40.172755 16846 raft_consensus.cc:515] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.173589 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7805d2575cfc4de984937de995038b47" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:40.174189 16739 raft_consensus.cc:3060] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.174700 16787 tablet_bootstrap.cc:492] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:40.176632 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:40.153417 16786 tablet_bootstrap.cc:492] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:40.178786 16846 leader_election.cc:290] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:40.162147 16557 leader_election.cc:304] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:40.180778 16878 leader_election.cc:290] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:40.181974 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:40.182195 16855 raft_consensus.cc:2804] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:40.182588 16592 raft_consensus.cc:3060] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.182684 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7805d2575cfc4de984937de995038b47" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:40.183650 16517 raft_consensus.cc:3060] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.186739 16854 consensus_queue.cc:1048] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:40.181766 16739 raft_consensus.cc:2468] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:40.192672 16631 leader_election.cc:304] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:40.193668 16878 raft_consensus.cc:2804] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:40.194403 16878 raft_consensus.cc:697] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:29:40.195322 16878 consensus_queue.cc:237] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.182893 16855 raft_consensus.cc:697] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
W20260709 12:29:40.198154 16707 leader_election.cc:343] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.198938 16786 tablet_bootstrap.cc:654] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.193508 16592 raft_consensus.cc:2468] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 1.
W20260709 12:29:40.217381 16704 consensus_peers.cc:597] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a -> Peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Couldn't send request to peer 9f5ebf768d584b17897ebb5b4575ece5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:40.219592 16517 raft_consensus.cc:2468] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:40.200730 16787 tablet_bootstrap.cc:654] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.203099 16790 tablet_bootstrap.cc:654] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.202790 16855 consensus_queue.cc:237] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.226725 16704 leader_election.cc:304] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:40.228081 16793 raft_consensus.cc:2804] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:40.244450 16788 tablet_bootstrap.cc:492] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:40.244977 16788 ts_tablet_manager.cc:1403] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.101s	user 0.015s	sys 0.007s
I20260709 12:29:40.247774 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8898ec613947bfa3b95ae941e1245d" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:40.248481 16518 raft_consensus.cc:3060] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.250154 16415 catalog_manager.cc:5697] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:40.255208 16829 leader_election.cc:290] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:40.254863 16793 raft_consensus.cc:697] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:29:40.265823 16788 raft_consensus.cc:359] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.266377 16788 raft_consensus.cc:385] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.266623 16788 raft_consensus.cc:740] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.267294 16788 consensus_queue.cc:260] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.269095 16788 ts_tablet_manager.cc:1434] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:29:40.269827 16788 tablet_bootstrap.cc:492] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:40.271373 16790 tablet_bootstrap.cc:492] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:40.272033 16790 ts_tablet_manager.cc:1403] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.106s	user 0.008s	sys 0.006s
I20260709 12:29:40.280445 16793 consensus_queue.cc:237] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.287994 16790 raft_consensus.cc:359] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.288689 16790 raft_consensus.cc:385] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.288945 16790 raft_consensus.cc:740] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.289712 16790 consensus_queue.cc:260] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.284422 16892 consensus_queue.cc:1048] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:29:40.292790 16786 tablet_bootstrap.cc:492] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:40.293046 16787 tablet_bootstrap.cc:492] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:40.293290 16786 ts_tablet_manager.cc:1403] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.140s	user 0.016s	sys 0.000s
I20260709 12:29:40.293471 16787 ts_tablet_manager.cc:1403] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.130s	user 0.018s	sys 0.018s
I20260709 12:29:40.296403 16518 raft_consensus.cc:2468] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:40.299134 16788 tablet_bootstrap.cc:654] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.300822 16786 raft_consensus.cc:359] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.301812 16786 raft_consensus.cc:385] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.302182 16786 raft_consensus.cc:740] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.303885 16786 consensus_queue.cc:260] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.303360 16855 raft_consensus.cc:493] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.303370 16415 catalog_manager.cc:5697] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:40.303114 16892 raft_consensus.cc:493] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.306118 16786 ts_tablet_manager.cc:1434] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:29:40.305636 16415 catalog_manager.cc:5697] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:40.307348 16855 raft_consensus.cc:515] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.310298 16787 raft_consensus.cc:359] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.310954 16787 raft_consensus.cc:385] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.311226 16787 raft_consensus.cc:740] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.311997 16787 consensus_queue.cc:260] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.314199 16787 ts_tablet_manager.cc:1434] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:29:40.316596 16855 leader_election.cc:290] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:40.308723 16786 tablet_bootstrap.cc:492] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:40.317497 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3262489dd274a878ecf95eb28323a5b" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:40.317690 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3262489dd274a878ecf95eb28323a5b" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:40.318416 16518 raft_consensus.cc:2468] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:40.319360 16787 tablet_bootstrap.cc:492] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:40.319655 16559 leader_election.cc:304] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:40.320559 16855 raft_consensus.cc:2804] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.320921 16855 raft_consensus.cc:493] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.321287 16855 raft_consensus.cc:3060] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.325327 16787 tablet_bootstrap.cc:654] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.327317 16413 catalog_manager.cc:5697] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 0 to 1, leader changed from <none> to cd924581228b49d889b0e1553519722a (127.8.111.68). New cstate: current_term: 1 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:40.306562 16892 raft_consensus.cc:515] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.332360 16790 ts_tablet_manager.cc:1434] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.004s
I20260709 12:29:40.333474 16790 tablet_bootstrap.cc:492] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:40.339236 16740 raft_consensus.cc:2468] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:40.339480 16790 tablet_bootstrap.cc:654] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.344074 16793 consensus_queue.cc:1048] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:40.347141 16871 consensus_queue.cc:1048] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:40.350070 16786 tablet_bootstrap.cc:654] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.349915 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3262489dd274a878ecf95eb28323a5b" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:40.364080 16518 raft_consensus.cc:2468] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 0.
I20260709 12:29:40.367638 16707 leader_election.cc:304] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:40.368196 16892 leader_election.cc:290] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:40.368536 16846 raft_consensus.cc:2804] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.370478 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3262489dd274a878ecf95eb28323a5b" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:40.369067 16846 raft_consensus.cc:493] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.372430 16846 raft_consensus.cc:3060] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.376295 16788 tablet_bootstrap.cc:492] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:40.376924 16788 ts_tablet_manager.cc:1403] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.025s
I20260709 12:29:40.382021 16788 raft_consensus.cc:359] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.383340 16788 raft_consensus.cc:385] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.383667 16788 raft_consensus.cc:740] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.391388 16829 consensus_queue.cc:1048] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:29:40.396185 16846 raft_consensus.cc:515] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.404014 16787 tablet_bootstrap.cc:492] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:40.404480 16787 ts_tablet_manager.cc:1403] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.085s	user 0.026s	sys 0.023s
I20260709 12:29:40.398408 16855 raft_consensus.cc:515] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.408022 16592 raft_consensus.cc:2393] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a in current term 1: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
I20260709 12:29:40.409631 16787 raft_consensus.cc:359] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:40.410473 16787 raft_consensus.cc:385] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.410820 16787 raft_consensus.cc:740] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.412050 16786 tablet_bootstrap.cc:492] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:40.412541 16786 ts_tablet_manager.cc:1403] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.104s	user 0.013s	sys 0.000s
I20260709 12:29:40.413028 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3262489dd274a878ecf95eb28323a5b" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:40.413719 16517 raft_consensus.cc:3060] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.413705 16787 consensus_queue.cc:260] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:40.415961 16787 ts_tablet_manager.cc:1434] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:29:40.416160 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3262489dd274a878ecf95eb28323a5b" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:40.416831 16787 tablet_bootstrap.cc:492] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:40.416970 16740 raft_consensus.cc:2393] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f5ebf768d584b17897ebb5b4575ece5 in current term 1: Already voted for candidate cd924581228b49d889b0e1553519722a in this term.
I20260709 12:29:40.420207 16855 leader_election.cc:290] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:40.422307 16516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3262489dd274a878ecf95eb28323a5b" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:40.423377 16871 consensus_queue.cc:1048] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:40.424379 16846 leader_election.cc:290] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:40.424594 16787 tablet_bootstrap.cc:654] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.426249 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3262489dd274a878ecf95eb28323a5b" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:40.441222 16667 raft_consensus.cc:3060] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.450053 16790 tablet_bootstrap.cc:492] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:40.433382 16786 raft_consensus.cc:359] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.451467 16790 ts_tablet_manager.cc:1403] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.118s	user 0.009s	sys 0.005s
I20260709 12:29:40.451740 16786 raft_consensus.cc:385] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.452062 16786 raft_consensus.cc:740] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.452798 16786 consensus_queue.cc:260] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.440987 16592 raft_consensus.cc:2393] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a in current term 1: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
I20260709 12:29:40.454385 16790 raft_consensus.cc:359] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.455214 16790 raft_consensus.cc:385] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.455523 16790 raft_consensus.cc:740] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.455981 16704 leader_election.cc:304] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:40.456218 16790 consensus_queue.cc:260] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.456549 16878 raft_consensus.cc:493] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.457408 16793 raft_consensus.cc:2749] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:40.457167 16878 raft_consensus.cc:515] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.458489 16790 ts_tablet_manager.cc:1434] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:29:40.429787 16788 consensus_queue.cc:260] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.459506 16790 tablet_bootstrap.cc:492] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:40.459805 16878 leader_election.cc:290] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:40.461139 16788 ts_tablet_manager.cc:1434] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.084s	user 0.010s	sys 0.000s
I20260709 12:29:40.460973 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:40.461551 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:40.462483 16592 raft_consensus.cc:2393] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99ca36f8a50c459388f31022b1455ed6 in current term 1: Already voted for candidate cd924581228b49d889b0e1553519722a in this term.
I20260709 12:29:40.464064 16630 leader_election.cc:304] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:29:40.465507 16788 tablet_bootstrap.cc:492] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:40.467273 16829 consensus_queue.cc:1048] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:40.467851 16786 ts_tablet_manager.cc:1434] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.001s
I20260709 12:29:40.471041 16829 raft_consensus.cc:493] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.471796 16829 raft_consensus.cc:515] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.472255 16786 tablet_bootstrap.cc:492] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:40.471076 16878 raft_consensus.cc:493] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.474772 16878 raft_consensus.cc:515] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.475241 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3719aa0cfe94cd3ad30412f3ad684a8" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:40.469036 16875 raft_consensus.cc:3060] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:40.476662 16557 leader_election.cc:343] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.477193 16878 leader_election.cc:290] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:40.478297 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f063389a54a742ab8d764101a9168d1b" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:40.478960 16739 raft_consensus.cc:2468] T f063389a54a742ab8d764101a9168d1b P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
I20260709 12:29:40.479552 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f063389a54a742ab8d764101a9168d1b" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:40.480326 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3719aa0cfe94cd3ad30412f3ad684a8" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:40.480518 16592 raft_consensus.cc:2468] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
I20260709 12:29:40.475210 16790 tablet_bootstrap.cc:654] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.481639 16631 leader_election.cc:304] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
W20260709 12:29:40.482853 16559 leader_election.cc:343] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.483340 16559 leader_election.cc:304] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a
I20260709 12:29:40.484203 16797 raft_consensus.cc:2749] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:40.474057 16829 leader_election.cc:290] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:40.490953 16790 tablet_bootstrap.cc:492] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:40.491632 16790 ts_tablet_manager.cc:1403] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.005s
I20260709 12:29:40.494799 16790 raft_consensus.cc:359] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.495469 16790 raft_consensus.cc:385] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.495713 16790 raft_consensus.cc:740] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.496354 16790 consensus_queue.cc:260] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.498636 16790 ts_tablet_manager.cc:1434] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:29:40.502978 16786 tablet_bootstrap.cc:654] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.506237 16875 raft_consensus.cc:2749] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:40.485195 16878 raft_consensus.cc:2804] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.507169 16878 raft_consensus.cc:493] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.507634 16878 raft_consensus.cc:3060] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.509238 16787 tablet_bootstrap.cc:492] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:40.509902 16787 ts_tablet_manager.cc:1403] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.028s
I20260709 12:29:40.513475 16787 raft_consensus.cc:359] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.514366 16787 raft_consensus.cc:385] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.514724 16787 raft_consensus.cc:740] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.515565 16787 consensus_queue.cc:260] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.518657 16790 tablet_bootstrap.cc:492] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:40.519547 16787 ts_tablet_manager.cc:1434] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:29:40.520540 16787 tablet_bootstrap.cc:492] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:40.521900 16786 tablet_bootstrap.cc:492] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:40.522387 16786 ts_tablet_manager.cc:1403] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.005s
I20260709 12:29:40.524979 16786 raft_consensus.cc:359] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.525643 16786 raft_consensus.cc:385] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.525898 16786 raft_consensus.cc:740] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.526055 16787 tablet_bootstrap.cc:654] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.526718 16786 consensus_queue.cc:260] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.426733 16517 raft_consensus.cc:2468] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:40.529240 16786 ts_tablet_manager.cc:1434] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:29:40.529497 16559 leader_election.cc:304] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: cd924581228b49d889b0e1553519722a
I20260709 12:29:40.530160 16786 tablet_bootstrap.cc:492] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:40.530377 16855 raft_consensus.cc:2804] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:40.534363 16855 raft_consensus.cc:697] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:40.534868 16787 tablet_bootstrap.cc:492] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:40.535363 16787 ts_tablet_manager.cc:1403] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.002s
I20260709 12:29:40.535550 16855 consensus_queue.cc:237] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.536716 16786 tablet_bootstrap.cc:654] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.538120 16787 raft_consensus.cc:359] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.538237 16788 tablet_bootstrap.cc:654] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.538836 16787 raft_consensus.cc:385] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.541365 16786 tablet_bootstrap.cc:492] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:40.541580 16787 raft_consensus.cc:740] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.541839 16786 ts_tablet_manager.cc:1403] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:29:40.542268 16787 consensus_queue.cc:260] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.544418 16787 ts_tablet_manager.cc:1434] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:29:40.544859 16786 raft_consensus.cc:359] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.545284 16787 tablet_bootstrap.cc:492] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:40.545512 16786 raft_consensus.cc:385] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.545806 16786 raft_consensus.cc:740] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.549511 16790 tablet_bootstrap.cc:654] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.526211 16878 raft_consensus.cc:515] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.551170 16786 consensus_queue.cc:260] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.551824 16787 tablet_bootstrap.cc:654] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.552893 16878 leader_election.cc:290] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:40.557472 16786 ts_tablet_manager.cc:1434] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:29:40.559070 16786 tablet_bootstrap.cc:492] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:40.560943 16829 raft_consensus.cc:493] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.561506 16829 raft_consensus.cc:515] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.567693 16415 catalog_manager.cc:5697] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:40.555050 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f063389a54a742ab8d764101a9168d1b" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:40.563882 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f063389a54a742ab8d764101a9168d1b" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:40.571992 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6724b5f4d23403097a81f5e83cf5e0e" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:40.570576 16592 raft_consensus.cc:3060] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.577962 16788 tablet_bootstrap.cc:492] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:40.578522 16788 ts_tablet_manager.cc:1403] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.113s	user 0.017s	sys 0.003s
I20260709 12:29:40.581676 16871 raft_consensus.cc:493] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.582293 16871 raft_consensus.cc:515] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.590425 16786 tablet_bootstrap.cc:654] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.573473 16740 raft_consensus.cc:3060] T f063389a54a742ab8d764101a9168d1b P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.592839 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d285abc27263437a85f24a1d8f993be1" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
W20260709 12:29:40.595217 16484 leader_election.cc:343] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.597786 16593 raft_consensus.cc:3060] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.589735 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6724b5f4d23403097a81f5e83cf5e0e" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:40.601827 16559 leader_election.cc:304] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:29:40.607296 16871 leader_election.cc:290] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:40.608428 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d285abc27263437a85f24a1d8f993be1" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:40.609047 16739 raft_consensus.cc:2468] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 0.
I20260709 12:29:40.610245 16482 leader_election.cc:304] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:40.579574 16829 leader_election.cc:290] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:40.610102 16788 raft_consensus.cc:359] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:40.611608 16788 raft_consensus.cc:385] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.611931 16788 raft_consensus.cc:740] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.612530 16788 consensus_queue.cc:260] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:40.614707 16797 consensus_queue.cc:1048] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:40.617400 16788 ts_tablet_manager.cc:1434] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:29:40.617931 16740 raft_consensus.cc:2468] T f063389a54a742ab8d764101a9168d1b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:40.618419 16788 tablet_bootstrap.cc:492] T 23de375943ed49b2b9da4652fa088021 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:40.611577 16871 raft_consensus.cc:2804] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.624035 16829 consensus_queue.cc:1048] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:40.632771 16871 raft_consensus.cc:493] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.635171 16790 tablet_bootstrap.cc:492] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:40.643874 16790 ts_tablet_manager.cc:1403] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.125s	user 0.006s	sys 0.064s
I20260709 12:29:40.638712 16592 raft_consensus.cc:2468] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:40.638813 16631 leader_election.cc:304] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:40.639452 16788 tablet_bootstrap.cc:654] T 23de375943ed49b2b9da4652fa088021 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.647498 16875 raft_consensus.cc:2804] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:40.648068 16875 raft_consensus.cc:697] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:29:40.648954 16875 consensus_queue.cc:237] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.646368 16871 raft_consensus.cc:3060] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.651193 16797 raft_consensus.cc:493] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.651748 16797 raft_consensus.cc:515] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:40.641582 16787 tablet_bootstrap.cc:492] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:40.653340 16787 ts_tablet_manager.cc:1403] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.108s	user 0.039s	sys 0.017s
I20260709 12:29:40.654050 16797 leader_election.cc:290] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:40.655485 16790 raft_consensus.cc:359] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:40.656236 16790 raft_consensus.cc:385] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.656594 16790 raft_consensus.cc:740] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.657253 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e405df92b54c47daa8ae52a9fc87b7ac" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:40.657317 16790 consensus_queue.cc:260] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:40.656124 16787 raft_consensus.cc:359] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.658625 16787 raft_consensus.cc:385] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.658912 16787 raft_consensus.cc:740] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.657317 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e405df92b54c47daa8ae52a9fc87b7ac" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:40.660264 16787 consensus_queue.cc:260] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
W20260709 12:29:40.664057 16559 leader_election.cc:343] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.664825 16787 ts_tablet_manager.cc:1434] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
W20260709 12:29:40.664796 16559 leader_election.cc:343] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.665298 16559 leader_election.cc:304] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:40.665869 16787 tablet_bootstrap.cc:492] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:40.666016 16797 raft_consensus.cc:2749] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:40.664073 16790 ts_tablet_manager.cc:1434] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 12:29:40.669239 16790 tablet_bootstrap.cc:492] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:40.680351 16790 tablet_bootstrap.cc:654] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.680625 16855 raft_consensus.cc:2749] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:40.672457 16788 tablet_bootstrap.cc:492] T 23de375943ed49b2b9da4652fa088021 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:40.684866 16788 ts_tablet_manager.cc:1403] T 23de375943ed49b2b9da4652fa088021 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.007s
I20260709 12:29:40.687724 16788 raft_consensus.cc:359] T 23de375943ed49b2b9da4652fa088021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.688468 16788 raft_consensus.cc:385] T 23de375943ed49b2b9da4652fa088021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.688011 16871 raft_consensus.cc:515] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.688778 16788 raft_consensus.cc:740] T 23de375943ed49b2b9da4652fa088021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.689555 16788 consensus_queue.cc:260] T 23de375943ed49b2b9da4652fa088021 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.696782 16786 tablet_bootstrap.cc:492] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:40.697516 16786 ts_tablet_manager.cc:1403] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.139s	user 0.010s	sys 0.008s
I20260709 12:29:40.699463 16846 raft_consensus.cc:493] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.700011 16846 raft_consensus.cc:515] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.700315 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d285abc27263437a85f24a1d8f993be1" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
W20260709 12:29:40.703441 16484 leader_election.cc:343] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.705538 16793 raft_consensus.cc:493] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.707347 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c2fffde641468f9399b51e98f495eb" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:40.708050 16793 raft_consensus.cc:515] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.710561 16822 raft_consensus.cc:493] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.703367 16871 leader_election.cc:290] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:40.712771 16822 raft_consensus.cc:515] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
W20260709 12:29:40.712687 16707 leader_election.cc:343] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.713944 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c2fffde641468f9399b51e98f495eb" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:40.715221 16822 leader_election.cc:290] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:40.703399 16846 leader_election.cc:290] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:40.712131 16793 leader_election.cc:290] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:40.713193 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:40.716084 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d285abc27263437a85f24a1d8f993be1" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:40.719142 16740 raft_consensus.cc:3060] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.719352 16786 raft_consensus.cc:359] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.720099 16786 raft_consensus.cc:385] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.720443 16786 raft_consensus.cc:740] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.721776 16786 consensus_queue.cc:260] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.724493 16786 ts_tablet_manager.cc:1434] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:29:40.724282 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8e6882ec7b344f7b4783d7610f69d82" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:40.725415 16788 ts_tablet_manager.cc:1434] T 23de375943ed49b2b9da4652fa088021 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
W20260709 12:29:40.736114 16707 leader_election.cc:343] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.736665 16786 tablet_bootstrap.cc:492] T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:40.736559 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8e6882ec7b344f7b4783d7610f69d82" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:40.738526 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
W20260709 12:29:40.741168 16481 leader_election.cc:343] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:40.741480 16704 leader_election.cc:343] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.742010 16704 leader_election.cc:304] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
W20260709 12:29:40.742640 16484 leader_election.cc:343] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.742776 16793 raft_consensus.cc:2749] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:40.743144 16484 leader_election.cc:304] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:40.743821 16786 tablet_bootstrap.cc:654] T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:40.744055 16704 leader_election.cc:343] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.744455 16704 leader_election.cc:304] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:40.744550 16875 raft_consensus.cc:493] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.745023 16793 raft_consensus.cc:2749] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:40.745150 16875 raft_consensus.cc:515] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.745947 16788 tablet_bootstrap.cc:492] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:40.749346 16516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45c0ead4eb3497c91c28c55ee353d83" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:40.750159 16516 raft_consensus.cc:2468] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
I20260709 12:29:40.750478 16833 consensus_queue.cc:1048] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:40.751871 16633 leader_election.cc:304] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:29:40.752629 16833 raft_consensus.cc:2804] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.752888 16788 tablet_bootstrap.cc:654] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.753031 16833 raft_consensus.cc:493] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.753492 16833 raft_consensus.cc:3060] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.754856 16829 consensus_queue.cc:1048] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:40.749106 16822 raft_consensus.cc:2749] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:40.758903 16875 leader_election.cc:290] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:40.764725 16787 tablet_bootstrap.cc:654] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.774140 16829 consensus_queue.cc:1048] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:29:40.778584 16793 raft_consensus.cc:493] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.779373 16793 raft_consensus.cc:515] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.780894 16415 catalog_manager.cc:5697] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:40.781843 16740 raft_consensus.cc:2468] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:29:40.782260 16793 leader_election.cc:290] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:40.773448 16833 raft_consensus.cc:515] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.801242 16788 tablet_bootstrap.cc:492] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:40.801985 16788 ts_tablet_manager.cc:1403] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.056s	user 0.022s	sys 0.006s
I20260709 12:29:40.802611 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45c0ead4eb3497c91c28c55ee353d83" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:40.802798 16482 leader_election.cc:304] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:40.803479 16740 raft_consensus.cc:2468] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
I20260709 12:29:40.805974 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45c0ead4eb3497c91c28c55ee353d83" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:40.806833 16667 raft_consensus.cc:2393] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a in current term 1: Already voted for candidate 99ca36f8a50c459388f31022b1455ed6 in this term.
I20260709 12:29:40.807823 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45c0ead4eb3497c91c28c55ee353d83" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:40.808513 16517 raft_consensus.cc:2468] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 0.
I20260709 12:29:40.807590 16822 raft_consensus.cc:2804] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:40.810101 16822 raft_consensus.cc:697] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:29:40.811062 16875 consensus_queue.cc:1048] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:40.811268 16822 consensus_queue.cc:237] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.812739 16833 leader_election.cc:290] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:40.813946 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45c0ead4eb3497c91c28c55ee353d83" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:40.815414 16517 raft_consensus.cc:3060] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.815618 16788 raft_consensus.cc:359] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.811266 16707 leader_election.cc:304] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:40.816318 16788 raft_consensus.cc:385] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.818235 16788 raft_consensus.cc:740] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.819394 16788 consensus_queue.cc:260] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.822433 16788 ts_tablet_manager.cc:1434] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.003s
I20260709 12:29:40.834208 16788 tablet_bootstrap.cc:492] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:40.838999 16843 raft_consensus.cc:493] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.839497 16843 raft_consensus.cc:515] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.841580 16843 leader_election.cc:290] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:40.842554 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3719aa0cfe94cd3ad30412f3ad684a8" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:40.843267 16593 raft_consensus.cc:2468] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 0.
I20260709 12:29:40.845372 16788 tablet_bootstrap.cc:654] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:40.845779 16704 leader_election.cc:304] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:40.846822 16843 raft_consensus.cc:2804] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.847379 16843 raft_consensus.cc:493] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.847896 16843 raft_consensus.cc:3060] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.850493 16829 raft_consensus.cc:493] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.851162 16829 raft_consensus.cc:515] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.853889 16829 leader_election.cc:290] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:40.854525 16738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c2fffde641468f9399b51e98f495eb" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:40.855300 16738 raft_consensus.cc:2468] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:40.856602 16557 leader_election.cc:304] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:40.857781 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c2fffde641468f9399b51e98f495eb" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:40.857805 16797 raft_consensus.cc:2804] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.859174 16797 raft_consensus.cc:493] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:40.859365 16559 leader_election.cc:343] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.824589 16790 tablet_bootstrap.cc:492] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:40.860206 16790 ts_tablet_manager.cc:1403] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.191s	user 0.013s	sys 0.017s
I20260709 12:29:40.863054 16790 raft_consensus.cc:359] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.863689 16790 raft_consensus.cc:385] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.864022 16790 raft_consensus.cc:740] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.864840 16790 consensus_queue.cc:260] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.866164 16872 raft_consensus.cc:493] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.866796 16872 raft_consensus.cc:515] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.868340 16790 ts_tablet_manager.cc:1434] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:29:40.869889 16790 tablet_bootstrap.cc:492] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:40.828361 16846 raft_consensus.cc:2804] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.871662 16846 raft_consensus.cc:493] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.872025 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45c0ead4eb3497c91c28c55ee353d83" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:40.832788 16786 tablet_bootstrap.cc:492] T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:40.873191 16786 ts_tablet_manager.cc:1403] T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.137s	user 0.022s	sys 0.028s
I20260709 12:29:40.859571 16797 raft_consensus.cc:3060] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:40.824275 16923 log.cc:927] Time spent T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:29:40.870851 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c2fffde641468f9399b51e98f495eb" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:40.872239 16846 raft_consensus.cc:3060] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.828823 16793 consensus_queue.cc:1048] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:40.870064 16872 leader_election.cc:290] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:40.876593 16786 raft_consensus.cc:359] T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.888971 16786 raft_consensus.cc:385] T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.889326 16786 raft_consensus.cc:740] T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.890025 16786 consensus_queue.cc:260] T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.892197 16786 ts_tablet_manager.cc:1434] T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:29:40.893117 16786 tablet_bootstrap.cc:492] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:40.886595 16892 consensus_queue.cc:1048] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:29:40.897591 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3719aa0cfe94cd3ad30412f3ad684a8" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:40.885072 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c2fffde641468f9399b51e98f495eb" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:40.910563 16739 raft_consensus.cc:2468] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 0.
I20260709 12:29:40.825824 16517 raft_consensus.cc:2468] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:40.885075 16797 raft_consensus.cc:515] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:40.920004 16593 raft_consensus.cc:2393] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in current term 1: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
I20260709 12:29:40.920347 16633 leader_election.cc:304] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:29:40.921263 16878 raft_consensus.cc:2804] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:40.921766 16878 raft_consensus.cc:697] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:29:40.922612 16878 consensus_queue.cc:237] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.923765 16797 leader_election.cc:290] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:40.925985 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c2fffde641468f9399b51e98f495eb" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:40.926616 16518 raft_consensus.cc:3060] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.914877 16415 catalog_manager.cc:5697] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 0 to 1, leader changed from <none> to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 1 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:40.928589 16843 raft_consensus.cc:515] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.934782 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c2fffde641468f9399b51e98f495eb" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:40.935909 16739 raft_consensus.cc:3060] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.893762 16846 raft_consensus.cc:515] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.930572 16875 raft_consensus.cc:493] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:40.954680 16875 raft_consensus.cc:515] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.958983 16875 leader_election.cc:290] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:40.960978 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23de375943ed49b2b9da4652fa088021" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:40.961939 16593 raft_consensus.cc:2468] T 23de375943ed49b2b9da4652fa088021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
I20260709 12:29:40.963852 16630 leader_election.cc:304] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:40.947952 16787 tablet_bootstrap.cc:492] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:40.964973 16787 ts_tablet_manager.cc:1403] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.299s	user 0.032s	sys 0.023s
I20260709 12:29:40.965273 16875 raft_consensus.cc:2804] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:40.965924 16875 raft_consensus.cc:493] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:40.966583 16875 raft_consensus.cc:3060] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:40.965624 16518 raft_consensus.cc:2468] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:40.968043 16787 raft_consensus.cc:359] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:40.968693 16787 raft_consensus.cc:385] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:40.968959 16787 raft_consensus.cc:740] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:40.969631 16787 consensus_queue.cc:260] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
W20260709 12:29:40.944747 16707 leader_election.cc:343] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:40.970085 16740 raft_consensus.cc:2393] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 99ca36f8a50c459388f31022b1455ed6 in current term 1: Already voted for candidate cd924581228b49d889b0e1553519722a in this term.
I20260709 12:29:40.972111 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23de375943ed49b2b9da4652fa088021" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:40.972752 16741 raft_consensus.cc:2468] T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
I20260709 12:29:40.981197 16846 leader_election.cc:290] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:40.981700 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45c0ead4eb3497c91c28c55ee353d83" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:40.983227 16516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45c0ead4eb3497c91c28c55ee353d83" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:40.994884 16516 raft_consensus.cc:2393] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a in current term 1: Already voted for candidate 99ca36f8a50c459388f31022b1455ed6 in this term.
W20260709 12:29:40.963977 16704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 68553.8us
I20260709 12:29:40.988155 16559 leader_election.cc:304] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:40.998339 16707 leader_election.cc:304] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:40.998624 16797 raft_consensus.cc:2804] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:40.999424 16934 raft_consensus.cc:2749] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:40.999879 16797 raft_consensus.cc:697] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:41.001197 16829 consensus_queue.cc:1048] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:41.001713 16413 catalog_manager.cc:5697] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:41.002806 16843 leader_election.cc:290] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:40.990043 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3719aa0cfe94cd3ad30412f3ad684a8" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:40.992424 16790 tablet_bootstrap.cc:654] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:41.009933 16707 leader_election.cc:343] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:41.001015 16797 consensus_queue.cc:237] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.013569 16875 raft_consensus.cc:515] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:40.932458 16786 tablet_bootstrap.cc:654] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.014930 16482 leader_election.cc:304] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:41.015774 16872 raft_consensus.cc:2764] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:29:41.007787 16739 raft_consensus.cc:2468] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:41.004554 16788 tablet_bootstrap.cc:492] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:41.019629 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3719aa0cfe94cd3ad30412f3ad684a8" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:41.021166 16788 ts_tablet_manager.cc:1403] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.187s	user 0.024s	sys 0.042s
W20260709 12:29:41.021778 16463 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:41.021410 16592 raft_consensus.cc:3060] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.024995 16788 raft_consensus.cc:359] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:41.025666 16788 raft_consensus.cc:385] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:41.026013 16788 raft_consensus.cc:740] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:41.027019 16788 consensus_queue.cc:260] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:41.027381 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23de375943ed49b2b9da4652fa088021" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:41.028195 16591 raft_consensus.cc:3060] T 23de375943ed49b2b9da4652fa088021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.031790 16849 consensus_queue.cc:1048] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:41.032243 16788 ts_tablet_manager.cc:1434] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:29:41.033171 16788 tablet_bootstrap.cc:492] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:41.033409 16592 raft_consensus.cc:2468] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 1.
I20260709 12:29:41.035693 16875 leader_election.cc:290] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:41.037259 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23de375943ed49b2b9da4652fa088021" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:41.037946 16740 raft_consensus.cc:3060] T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.038705 16786 tablet_bootstrap.cc:492] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:41.039326 16786 ts_tablet_manager.cc:1403] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.146s	user 0.013s	sys 0.003s
I20260709 12:29:41.046327 16790 tablet_bootstrap.cc:492] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:41.046520 16788 tablet_bootstrap.cc:654] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.046834 16790 ts_tablet_manager.cc:1403] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.177s	user 0.012s	sys 0.005s
I20260709 12:29:41.046023 16704 leader_election.cc:304] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:41.048673 16843 raft_consensus.cc:2804] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:41.049227 16843 raft_consensus.cc:697] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:29:41.050405 16843 consensus_queue.cc:237] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:41.055538 16786 raft_consensus.cc:359] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:40.989989 16787 ts_tablet_manager.cc:1434] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.002s
I20260709 12:29:41.059129 16787 tablet_bootstrap.cc:492] T d3719aa0cfe94cd3ad30412f3ad684a8 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:41.061852 16591 raft_consensus.cc:2468] T 23de375943ed49b2b9da4652fa088021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:41.063995 16740 raft_consensus.cc:2468] T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:41.071872 16788 tablet_bootstrap.cc:492] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:41.072471 16788 ts_tablet_manager.cc:1403] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.008s
I20260709 12:29:41.074690 16630 leader_election.cc:304] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:41.075537 16875 raft_consensus.cc:2804] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:41.076025 16875 raft_consensus.cc:697] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:29:41.077021 16875 consensus_queue.cc:237] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:41.080341 16786 raft_consensus.cc:385] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:41.080775 16786 raft_consensus.cc:740] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:41.066494 16787 tablet_bootstrap.cc:654] T d3719aa0cfe94cd3ad30412f3ad684a8 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.081558 16786 consensus_queue.cc:260] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:41.081368 16414 catalog_manager.cc:5697] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:41.058490 16790 raft_consensus.cc:359] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:41.083120 16790 raft_consensus.cc:385] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:41.083385 16790 raft_consensus.cc:740] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:41.084728 16788 raft_consensus.cc:359] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:41.085453 16788 raft_consensus.cc:385] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:41.085119 16790 consensus_queue.cc:260] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:41.085728 16788 raft_consensus.cc:740] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:41.086489 16788 consensus_queue.cc:260] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:41.087636 16786 ts_tablet_manager.cc:1434] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 12:29:41.088598 16786 tablet_bootstrap.cc:492] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:41.088948 16788 ts_tablet_manager.cc:1434] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:29:41.089910 16788 tablet_bootstrap.cc:492] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:41.091971 16790 ts_tablet_manager.cc:1434] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:29:41.092959 16790 tablet_bootstrap.cc:492] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:41.095985 16788 tablet_bootstrap.cc:654] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.104218 16787 tablet_bootstrap.cc:492] T d3719aa0cfe94cd3ad30412f3ad684a8 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:41.104691 16787 ts_tablet_manager.cc:1403] T d3719aa0cfe94cd3ad30412f3ad684a8 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.009s
I20260709 12:29:41.108088 16788 tablet_bootstrap.cc:492] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:41.108573 16788 ts_tablet_manager.cc:1403] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 12:29:41.110227 16787 raft_consensus.cc:359] T d3719aa0cfe94cd3ad30412f3ad684a8 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:41.110924 16787 raft_consensus.cc:385] T d3719aa0cfe94cd3ad30412f3ad684a8 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:41.111199 16787 raft_consensus.cc:740] T d3719aa0cfe94cd3ad30412f3ad684a8 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:41.111148 16788 raft_consensus.cc:359] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.112043 16788 raft_consensus.cc:385] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:41.112371 16788 raft_consensus.cc:740] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:41.112103 16787 consensus_queue.cc:260] T d3719aa0cfe94cd3ad30412f3ad684a8 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:41.113286 16788 consensus_queue.cc:260] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.114584 16787 ts_tablet_manager.cc:1434] T d3719aa0cfe94cd3ad30412f3ad684a8 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:29:41.115535 16787 tablet_bootstrap.cc:492] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:41.115362 16875 consensus_queue.cc:1048] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:41.115782 16788 ts_tablet_manager.cc:1434] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:29:41.116235 16790 tablet_bootstrap.cc:654] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.116654 16878 raft_consensus.cc:493] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.116791 16788 tablet_bootstrap.cc:492] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:41.117169 16878 raft_consensus.cc:515] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:41.119516 16878 leader_election.cc:290] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:41.121871 16786 tablet_bootstrap.cc:654] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.123436 16788 tablet_bootstrap.cc:654] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.123895 16516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d82d757f6a34783b2b2055824f65e88" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:41.124593 16516 raft_consensus.cc:2468] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
I20260709 12:29:41.129555 16790 tablet_bootstrap.cc:492] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:41.130246 16790 ts_tablet_manager.cc:1403] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.000s
I20260709 12:29:41.131531 16633 leader_election.cc:304] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:29:41.133074 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d82d757f6a34783b2b2055824f65e88" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:41.134243 16740 raft_consensus.cc:2468] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
I20260709 12:29:41.133956 16790 raft_consensus.cc:359] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:41.137159 16790 raft_consensus.cc:385] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:41.137437 16790 raft_consensus.cc:740] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:41.134913 16415 catalog_manager.cc:5697] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 0 to 1, leader changed from <none> to cd924581228b49d889b0e1553519722a (127.8.111.68). New cstate: current_term: 1 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:41.137835 16878 raft_consensus.cc:2804] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:41.138091 16790 consensus_queue.cc:260] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:41.138680 16878 raft_consensus.cc:493] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:41.139226 16878 raft_consensus.cc:3060] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.139519 16788 tablet_bootstrap.cc:492] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:41.140204 16788 ts_tablet_manager.cc:1403] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.004s
I20260709 12:29:41.140594 16790 ts_tablet_manager.cc:1434] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:29:41.141583 16790 tablet_bootstrap.cc:492] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:41.143280 16788 raft_consensus.cc:359] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.143957 16788 raft_consensus.cc:385] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:41.144249 16788 raft_consensus.cc:740] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:41.144981 16788 consensus_queue.cc:260] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.147750 16788 ts_tablet_manager.cc:1434] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:29:41.148650 16790 tablet_bootstrap.cc:654] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.150187 16786 tablet_bootstrap.cc:492] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:41.150758 16786 ts_tablet_manager.cc:1403] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.008s
I20260709 12:29:41.148679 16788 tablet_bootstrap.cc:492] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:41.153321 16786 raft_consensus.cc:359] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:41.153995 16786 raft_consensus.cc:385] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:41.154345 16786 raft_consensus.cc:740] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:41.157953 16788 tablet_bootstrap.cc:654] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.160435 16786 consensus_queue.cc:260] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:41.177121 16786 ts_tablet_manager.cc:1434] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.003s
I20260709 12:29:41.178408 16786 tablet_bootstrap.cc:492] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:41.184648 16938 raft_consensus.cc:493] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.185621 16938 raft_consensus.cc:515] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:41.198424 16786 tablet_bootstrap.cc:654] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.198182 16797 raft_consensus.cc:493] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.201901 16797 raft_consensus.cc:515] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:41.206110 16833 consensus_queue.cc:1048] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:41.213014 16797 leader_election.cc:290] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:41.218746 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17be6871edc41768bb5b3a6e2d1cf2a" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:41.219452 16740 raft_consensus.cc:2468] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:41.220737 16788 tablet_bootstrap.cc:492] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:41.220847 16557 leader_election.cc:304] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:41.221305 16788 ts_tablet_manager.cc:1403] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.073s	user 0.023s	sys 0.006s
I20260709 12:29:41.222029 16829 raft_consensus.cc:2804] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:41.222488 16829 raft_consensus.cc:493] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:41.222827 16829 raft_consensus.cc:3060] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.222867 16878 raft_consensus.cc:515] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:41.224434 16788 raft_consensus.cc:359] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:41.225171 16788 raft_consensus.cc:385] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:41.225457 16788 raft_consensus.cc:740] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:41.226115 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d82d757f6a34783b2b2055824f65e88" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:41.228844 16788 consensus_queue.cc:260] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:41.229463 16740 raft_consensus.cc:3060] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.231642 16788 ts_tablet_manager.cc:1434] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:29:41.232719 16788 tablet_bootstrap.cc:492] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:41.235237 16787 tablet_bootstrap.cc:654] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.236092 16938 leader_election.cc:290] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:41.238354 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17be6871edc41768bb5b3a6e2d1cf2a" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:41.239887 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e405df92b54c47daa8ae52a9fc87b7ac" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:41.240509 16591 raft_consensus.cc:2468] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
W20260709 12:29:41.241768 16559 leader_election.cc:343] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:41.242888 16630 leader_election.cc:304] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:41.244102 16833 raft_consensus.cc:2804] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:41.244540 16833 raft_consensus.cc:493] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:41.244889 16833 raft_consensus.cc:3060] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.245517 16829 raft_consensus.cc:515] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:41.246358 16788 tablet_bootstrap.cc:654] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.239751 16740 raft_consensus.cc:2468] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:41.249998 16878 leader_election.cc:290] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:41.258291 16631 leader_election.cc:304] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:41.259443 16878 raft_consensus.cc:2804] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:41.260051 16878 raft_consensus.cc:697] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:29:41.267382 16878 consensus_queue.cc:237] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:41.279548 16829 leader_election.cc:290] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:41.301054 16790 tablet_bootstrap.cc:492] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:41.301546 16790 ts_tablet_manager.cc:1403] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.160s	user 0.023s	sys 0.032s
W20260709 12:29:41.310288 16956 log.cc:927] Time spent T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:29:41.318665 16833 raft_consensus.cc:515] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:41.321099 16833 leader_election.cc:290] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:41.323325 16790 raft_consensus.cc:359] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.324270 16790 raft_consensus.cc:385] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:41.324605 16790 raft_consensus.cc:740] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:41.325445 16790 consensus_queue.cc:260] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.334038 16790 ts_tablet_manager.cc:1434] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 12:29:41.335120 16790 tablet_bootstrap.cc:492] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:41.336228 16786 tablet_bootstrap.cc:492] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:41.337143 16786 ts_tablet_manager.cc:1403] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.159s	user 0.024s	sys 0.013s
I20260709 12:29:41.341451 16790 tablet_bootstrap.cc:654] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.341799 16786 raft_consensus.cc:359] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.342877 16786 raft_consensus.cc:385] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:41.343267 16786 raft_consensus.cc:740] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:41.344245 16786 consensus_queue.cc:260] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.344669 16516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e405df92b54c47daa8ae52a9fc87b7ac" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:41.345599 16516 raft_consensus.cc:2468] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
I20260709 12:29:41.346873 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d82d757f6a34783b2b2055824f65e88" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:41.347364 16786 ts_tablet_manager.cc:1434] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:29:41.347671 16517 raft_consensus.cc:3060] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.348348 16786 tablet_bootstrap.cc:492] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:41.363632 16517 raft_consensus.cc:2468] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:41.417929 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e405df92b54c47daa8ae52a9fc87b7ac" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:41.418768 16517 raft_consensus.cc:3060] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.425611 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17be6871edc41768bb5b3a6e2d1cf2a" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:41.426090 16517 raft_consensus.cc:2468] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
W20260709 12:29:41.426977 16559 leader_election.cc:343] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:41.427788 16633 leader_election.cc:304] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:29:41.428367 16787 tablet_bootstrap.cc:492] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:41.428829 16787 ts_tablet_manager.cc:1403] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.313s	user 0.020s	sys 0.024s
I20260709 12:29:41.430226 16938 raft_consensus.cc:2804] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:41.430747 16938 raft_consensus.cc:697] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:29:41.431339 16787 raft_consensus.cc:359] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:41.431516 16938 consensus_queue.cc:237] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:41.432049 16787 raft_consensus.cc:385] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:41.432381 16787 raft_consensus.cc:740] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:41.432461 16875 consensus_queue.cc:1048] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:41.433014 16787 consensus_queue.cc:260] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:41.437065 16787 ts_tablet_manager.cc:1434] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:29:41.438230 16787 tablet_bootstrap.cc:492] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:41.446854 16787 tablet_bootstrap.cc:654] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.455806 16787 tablet_bootstrap.cc:492] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:41.456223 16787 ts_tablet_manager.cc:1403] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.018s	user 0.003s	sys 0.007s
I20260709 12:29:41.457919 16667 raft_consensus.cc:3060] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.458997 16787 raft_consensus.cc:359] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:41.459673 16787 raft_consensus.cc:385] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:41.459944 16787 raft_consensus.cc:740] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:41.460657 16787 consensus_queue.cc:260] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:41.461510 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e405df92b54c47daa8ae52a9fc87b7ac" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:41.462111 16593 raft_consensus.cc:3060] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.462806 16787 ts_tablet_manager.cc:1434] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:29:41.463950 16787 tablet_bootstrap.cc:492] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:41.470016 16797 raft_consensus.cc:493] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.470543 16797 raft_consensus.cc:515] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.471083 16787 tablet_bootstrap.cc:654] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.472847 16797 leader_election.cc:290] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:41.474445 16854 raft_consensus.cc:493] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.474905 16854 raft_consensus.cc:515] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:41.476754 16854 leader_election.cc:290] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:41.482908 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
W20260709 12:29:41.484581 16559 leader_election.cc:343] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:41.485463 16516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:41.487679 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:41.491531 16786 tablet_bootstrap.cc:654] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.500566 16790 tablet_bootstrap.cc:492] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:41.501181 16790 ts_tablet_manager.cc:1403] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.166s	user 0.019s	sys 0.005s
I20260709 12:29:41.505437 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:41.506320 16739 raft_consensus.cc:2468] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:41.514739 16788 tablet_bootstrap.cc:492] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:41.515209 16788 ts_tablet_manager.cc:1403] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.283s	user 0.027s	sys 0.009s
I20260709 12:29:41.537350 16878 consensus_queue.cc:1048] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:41.539990 16855 raft_consensus.cc:493] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.540666 16855 raft_consensus.cc:515] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.543325 16855 leader_election.cc:290] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:41.524165 16557 leader_election.cc:304] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
W20260709 12:29:41.545573 16559 leader_election.cc:343] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:41.547576 16855 raft_consensus.cc:2804] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:41.548204 16855 raft_consensus.cc:493] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:41.548993 16855 raft_consensus.cc:3060] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.528610 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17be6871edc41768bb5b3a6e2d1cf2a" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:41.559896 16855 raft_consensus.cc:515] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.571940 16833 raft_consensus.cc:493] T d3719aa0cfe94cd3ad30412f3ad684a8 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.581280 16790 raft_consensus.cc:359] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:41.582258 16790 raft_consensus.cc:385] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:41.582649 16790 raft_consensus.cc:740] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:41.582358 16833 raft_consensus.cc:515] T d3719aa0cfe94cd3ad30412f3ad684a8 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:41.583541 16790 consensus_queue.cc:260] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:41.586558 16740 raft_consensus.cc:3060] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.586727 16833 leader_election.cc:290] T d3719aa0cfe94cd3ad30412f3ad684a8 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:41.591188 16855 leader_election.cc:290] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:41.567970 16849 consensus_queue.cc:1048] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:29:41.603070 16667 raft_consensus.cc:3060] T d3719aa0cfe94cd3ad30412f3ad684a8 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.550148 16738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ac00038aa4947961ef3398fd75ca4" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:41.608286 16414 catalog_manager.cc:5697] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:41.593390 16788 raft_consensus.cc:359] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.611135 16788 raft_consensus.cc:385] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:41.611498 16788 raft_consensus.cc:740] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:41.615787 16788 consensus_queue.cc:260] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.603039 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3719aa0cfe94cd3ad30412f3ad684a8" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:41.612792 16822 raft_consensus.cc:493] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.625483 16822 raft_consensus.cc:515] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.628759 16822 leader_election.cc:290] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:41.515921 16872 consensus_queue.cc:1048] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:29:41.633477 16871 consensus_queue.cc:1048] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:41.643476 16788 ts_tablet_manager.cc:1434] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.128s	user 0.005s	sys 0.002s
I20260709 12:29:41.644703 16788 tablet_bootstrap.cc:492] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:41.639444 16593 raft_consensus.cc:2468] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:41.651940 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ac00038aa4947961ef3398fd75ca4" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:41.673213 16514 raft_consensus.cc:2468] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:41.672557 16892 consensus_queue.cc:1048] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
W20260709 12:29:41.696396 16559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:33625, user_credentials={real_user=slave}} blocked reactor thread for 146993us
I20260709 12:29:41.705204 16790 ts_tablet_manager.cc:1434] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.204s	user 0.031s	sys 0.022s
I20260709 12:29:41.706389 16790 tablet_bootstrap.cc:492] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:41.706003 16872 raft_consensus.cc:493] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.714138 16972 raft_consensus.cc:493] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.722648 16787 tablet_bootstrap.cc:492] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:41.723886 16787 ts_tablet_manager.cc:1403] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.260s	user 0.043s	sys 0.061s
I20260709 12:29:41.726231 16972 raft_consensus.cc:515] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:41.718446 16872 raft_consensus.cc:515] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:41.728442 16972 leader_election.cc:290] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:41.726364 16892 raft_consensus.cc:493] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.729588 16892 raft_consensus.cc:515] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.730403 16786 tablet_bootstrap.cc:492] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:41.731031 16786 ts_tablet_manager.cc:1403] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.383s	user 0.057s	sys 0.061s
I20260709 12:29:41.731629 16892 leader_election.cc:290] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:41.733712 16833 consensus_queue.cc:1048] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:41.734772 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
W20260709 12:29:41.738106 16484 leader_election.cc:343] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:41.739195 16878 raft_consensus.cc:493] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.739683 16878 raft_consensus.cc:515] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:41.742326 16878 leader_election.cc:290] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:41.743029 16788 tablet_bootstrap.cc:654] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.733955 16740 raft_consensus.cc:2468] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:41.730016 16872 leader_election.cc:290] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:41.739311 16787 raft_consensus.cc:359] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:41.762981 16787 raft_consensus.cc:385] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:41.757926 16786 raft_consensus.cc:359] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.763337 16787 raft_consensus.cc:740] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:41.767930 16787 consensus_queue.cc:260] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:41.769201 16786 raft_consensus.cc:385] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:41.769604 16786 raft_consensus.cc:740] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:41.787495 16786 consensus_queue.cc:260] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.792369 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ad2867ed594d4794807e95f2994f46" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:41.793768 16790 tablet_bootstrap.cc:654] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.794241 16516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8e6882ec7b344f7b4783d7610f69d82" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:41.795154 16516 raft_consensus.cc:2468] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
I20260709 12:29:41.801822 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ac00038aa4947961ef3398fd75ca4" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:41.802560 16740 raft_consensus.cc:2468] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 0.
I20260709 12:29:41.794516 16833 raft_consensus.cc:493] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:41.803517 16833 raft_consensus.cc:515] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:41.808586 16833 leader_election.cc:290] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:41.812579 16482 leader_election.cc:304] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
W20260709 12:29:41.814868 16707 leader_election.cc:343] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:41.815678 16738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17be6871edc41768bb5b3a6e2d1cf2a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:41.816610 16738 raft_consensus.cc:2393] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99ca36f8a50c459388f31022b1455ed6 in current term 1: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
W20260709 12:29:41.763322 16559 leader_election.cc:343] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:41.823575 16787 ts_tablet_manager.cc:1434] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.099s	user 0.008s	sys 0.002s
I20260709 12:29:41.825816 16787 tablet_bootstrap.cc:492] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:41.828148 16786 ts_tablet_manager.cc:1434] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.097s	user 0.009s	sys 0.000s
I20260709 12:29:41.822685 16871 raft_consensus.cc:2804] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:41.844624 16786 tablet_bootstrap.cc:492] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:41.823007 16833 consensus_queue.cc:1048] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:29:41.847254 16871 raft_consensus.cc:493] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:41.826406 16559 leader_election.cc:304] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:41.826251 16633 leader_election.cc:304] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
W20260709 12:29:41.856688 16559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:36499, user_credentials={real_user=slave}} blocked reactor thread for 98155us
I20260709 12:29:41.857579 16559 leader_election.cc:304] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:41.856119 16855 raft_consensus.cc:2749] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:29:41.854312 16557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 305912us
I20260709 12:29:41.854455 16871 raft_consensus.cc:3060] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.861927 16787 tablet_bootstrap.cc:654] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.860849 16878 raft_consensus.cc:2804] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:41.865360 16878 raft_consensus.cc:493] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:41.865803 16878 raft_consensus.cc:3060] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.869311 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:41.869915 16741 raft_consensus.cc:3060] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.871770 16790 tablet_bootstrap.cc:492] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:41.872249 16790 ts_tablet_manager.cc:1403] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.166s	user 0.037s	sys 0.003s
I20260709 12:29:41.865371 16855 raft_consensus.cc:2804] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:41.877995 16855 raft_consensus.cc:493] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:41.878669 16855 raft_consensus.cc:3060] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.878993 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ad2867ed594d4794807e95f2994f46" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:41.879635 16593 raft_consensus.cc:2468] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 0.
I20260709 12:29:41.881330 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ac00038aa4947961ef3398fd75ca4" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:41.883756 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:41.884404 16593 raft_consensus.cc:2468] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 0.
W20260709 12:29:41.881281 16557 leader_election.cc:343] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:41.885794 16557 leader_election.cc:304] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:41.888005 16970 raft_consensus.cc:2804] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:41.888489 16970 raft_consensus.cc:697] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:41.889293 16970 consensus_queue.cc:237] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:41.893378 16878 raft_consensus.cc:515] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:41.893936 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8e6882ec7b344f7b4783d7610f69d82" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:41.894618 16512 raft_consensus.cc:2468] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:41.898566 16892 consensus_queue.cc:1048] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:41.899627 16704 leader_election.cc:304] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:41.900563 16892 raft_consensus.cc:2804] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:41.900923 16892 raft_consensus.cc:493] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:41.901258 16892 raft_consensus.cc:3060] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.877434 16938 consensus_queue.cc:1048] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:29:41.903810 16786 tablet_bootstrap.cc:654] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.903955 16481 leader_election.cc:304] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:41.904943 16974 raft_consensus.cc:2804] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:41.905437 16974 raft_consensus.cc:493] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:41.905805 16974 raft_consensus.cc:3060] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.906452 16741 raft_consensus.cc:2468] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:41.909762 16557 leader_election.cc:304] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:41.910645 16516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:41.911654 16797 raft_consensus.cc:2804] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:41.912196 16797 raft_consensus.cc:697] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
W20260709 12:29:41.912650 16979 log.cc:927] Time spent T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a: Append to log took a long time: real 0.082s	user 0.002s	sys 0.000s
I20260709 12:29:41.913062 16797 consensus_queue.cc:237] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.917128 16788 tablet_bootstrap.cc:492] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:41.917757 16788 ts_tablet_manager.cc:1403] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.273s	user 0.026s	sys 0.014s
I20260709 12:29:41.955619 16790 raft_consensus.cc:359] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.956300 16878 leader_election.cc:290] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:41.956467 16790 raft_consensus.cc:385] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:41.956858 16790 raft_consensus.cc:740] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:41.894106 16855 raft_consensus.cc:515] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.964526 16413 catalog_manager.cc:5697] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:41.966902 16790 consensus_queue.cc:260] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:41.966822 16413 catalog_manager.cc:5697] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:41.980865 16790 ts_tablet_manager.cc:1434] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.108s	user 0.006s	sys 0.002s
I20260709 12:29:41.982666 16790 tablet_bootstrap.cc:492] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:41.987664 16788 raft_consensus.cc:359] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:41.988575 16788 raft_consensus.cc:385] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:41.988931 16788 raft_consensus.cc:740] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:41.991330 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3719aa0cfe94cd3ad30412f3ad684a8" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:41.992821 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17be6871edc41768bb5b3a6e2d1cf2a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:41.993376 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8e6882ec7b344f7b4783d7610f69d82" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:41.993970 16590 raft_consensus.cc:3060] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:41.994118 16630 leader_election.cc:304] T d3719aa0cfe94cd3ad30412f3ad684a8 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:29:41.994848 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8e6882ec7b344f7b4783d7610f69d82" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:41.995616 16991 raft_consensus.cc:2749] T d3719aa0cfe94cd3ad30412f3ad684a8 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:42.000140 16790 tablet_bootstrap.cc:654] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:41.989835 16788 consensus_queue.cc:260] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:41.977840 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8e6882ec7b344f7b4783d7610f69d82" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:42.013808 16590 raft_consensus.cc:2468] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:42.015529 16591 raft_consensus.cc:2393] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in current term 1: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
I20260709 12:29:42.013448 16788 ts_tablet_manager.cc:1434] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.001s
I20260709 12:29:42.041110 16855 leader_election.cc:290] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:42.043509 16855 consensus_queue.cc:1048] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:42.043797 16871 raft_consensus.cc:515] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:42.045424 16559 leader_election.cc:304] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:42.046720 16969 raft_consensus.cc:2764] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:29:42.037536 16665 raft_consensus.cc:2393] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f5ebf768d584b17897ebb5b4575ece5 in current term 1: Already voted for candidate 99ca36f8a50c459388f31022b1455ed6 in this term.
W20260709 12:29:42.049208 16559 leader_election.cc:343] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.054294 16630 leader_election.cc:304] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:29:42.068282 16788 tablet_bootstrap.cc:492] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:42.057302 16892 raft_consensus.cc:515] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
W20260709 12:29:42.072072 16633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:36499, user_credentials={real_user=slave}} blocked reactor thread for 129460us
W20260709 12:29:42.067844 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 50913.1us
I20260709 12:29:42.090363 16516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ac00038aa4947961ef3398fd75ca4" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:42.092585 16516 raft_consensus.cc:2393] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f5ebf768d584b17897ebb5b4575ece5 in current term 1: Already voted for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in this term.
I20260709 12:29:42.097568 16787 tablet_bootstrap.cc:492] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:42.098395 16787 ts_tablet_manager.cc:1403] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.273s	user 0.014s	sys 0.004s
I20260709 12:29:42.118510 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8e6882ec7b344f7b4783d7610f69d82" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:42.119215 16511 raft_consensus.cc:3060] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.120430 16516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ad2867ed594d4794807e95f2994f46" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:42.111727 16974 raft_consensus.cc:515] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:42.123263 16786 tablet_bootstrap.cc:492] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:42.123781 16786 ts_tablet_manager.cc:1403] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.295s	user 0.010s	sys 0.008s
I20260709 12:29:42.125566 16974 leader_election.cc:290] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:42.132918 16892 leader_election.cc:290] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:42.134214 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ac00038aa4947961ef3398fd75ca4" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:42.134619 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:42.134905 16737 raft_consensus.cc:3060] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.135241 16591 raft_consensus.cc:3060] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.135664 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ad2867ed594d4794807e95f2994f46" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:42.136307 16592 raft_consensus.cc:3060] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.138959 16871 leader_election.cc:290] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:42.138832 16787 raft_consensus.cc:359] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:42.139551 16787 raft_consensus.cc:385] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.139844 16787 raft_consensus.cc:740] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.140528 16787 consensus_queue.cc:260] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:42.142023 16787 ts_tablet_manager.cc:1434] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.043s	user 0.003s	sys 0.000s
I20260709 12:29:42.142400 16997 raft_consensus.cc:3060] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.153558 16511 raft_consensus.cc:2468] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
W20260709 12:29:42.157127 16707 leader_election.cc:343] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.159387 16736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ac00038aa4947961ef3398fd75ca4" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:42.164206 16854 raft_consensus.cc:493] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.165220 16787 tablet_bootstrap.cc:492] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:42.166069 16786 raft_consensus.cc:359] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:42.166772 16786 raft_consensus.cc:385] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.167008 16786 raft_consensus.cc:740] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.168635 16854 raft_consensus.cc:515] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:42.174046 16854 leader_election.cc:290] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
W20260709 12:29:42.166400 16630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 108853us
I20260709 12:29:42.175590 16630 leader_election.cc:304] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:42.176153 16878 consensus_queue.cc:1048] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:42.176554 16991 raft_consensus.cc:2804] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:42.177296 16991 raft_consensus.cc:697] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:29:42.178260 16991 consensus_queue.cc:237] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:42.180123 16787 tablet_bootstrap.cc:654] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.180805 16737 raft_consensus.cc:2468] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:42.183784 16788 tablet_bootstrap.cc:654] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.187011 16786 consensus_queue.cc:260] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:42.189754 16592 raft_consensus.cc:2468] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 1.
I20260709 12:29:42.191929 16990 consensus_queue.cc:1048] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:42.196003 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b4874f353b48ef8bdfa4c28549a207" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:42.196283 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ac00038aa4947961ef3398fd75ca4" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:42.196521 16557 leader_election.cc:304] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:42.197165 16590 raft_consensus.cc:2393] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in current term 1: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
W20260709 12:29:42.197896 16559 leader_election.cc:343] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.198055 16854 raft_consensus.cc:2804] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:42.198419 16481 leader_election.cc:304] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:29:42.209087 16413 catalog_manager.cc:5697] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:42.211604 16413 catalog_manager.cc:5697] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:42.200074 16854 raft_consensus.cc:697] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:42.215823 16786 ts_tablet_manager.cc:1434] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.000s
I20260709 12:29:42.200503 16591 raft_consensus.cc:2468] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:29:42.215163 16974 raft_consensus.cc:2749] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:42.215885 16854 consensus_queue.cc:237] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:42.229281 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b4874f353b48ef8bdfa4c28549a207" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:42.219004 16704 leader_election.cc:304] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:42.230700 16989 consensus_queue.cc:1048] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:29:42.231762 16892 raft_consensus.cc:2804] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:42.232416 16892 raft_consensus.cc:697] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:29:42.233454 16892 consensus_queue.cc:237] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
W20260709 12:29:42.234647 16559 leader_election.cc:343] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.235186 16559 leader_election.cc:304] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:42.236164 16971 raft_consensus.cc:2749] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:42.221549 16997 raft_consensus.cc:2749] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:42.223594 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
W20260709 12:29:42.222082 16463 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:42.242188 16787 tablet_bootstrap.cc:492] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:42.242621 16974 raft_consensus.cc:493] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.243661 16974 raft_consensus.cc:515] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:42.245712 16974 leader_election.cc:290] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:42.239125 16786 tablet_bootstrap.cc:492] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:42.243683 16787 ts_tablet_manager.cc:1403] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.002s
I20260709 12:29:42.246666 16790 tablet_bootstrap.cc:492] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:42.249892 16790 ts_tablet_manager.cc:1403] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.267s	user 0.027s	sys 0.009s
I20260709 12:29:42.253822 16481 leader_election.cc:304] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:42.255545 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:42.255565 16974 raft_consensus.cc:2804] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:42.261329 16974 raft_consensus.cc:697] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:29:42.265722 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:42.265635 16787 raft_consensus.cc:359] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:42.266559 16787 raft_consensus.cc:385] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.266788 16737 raft_consensus.cc:2393] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in current term 1: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
I20260709 12:29:42.266911 16787 raft_consensus.cc:740] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.266896 16790 raft_consensus.cc:359] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:42.267755 16790 raft_consensus.cc:385] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.268034 16790 raft_consensus.cc:740] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
W20260709 12:29:42.268277 16484 leader_election.cc:343] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.268672 16790 consensus_queue.cc:260] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:42.269127 16787 consensus_queue.cc:260] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:42.271483 16790 ts_tablet_manager.cc:1434] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:29:42.271404 16974 consensus_queue.cc:237] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:42.272763 16790 tablet_bootstrap.cc:492] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:42.284083 16787 ts_tablet_manager.cc:1434] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:29:42.285183 16787 tablet_bootstrap.cc:492] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:42.289057 16786 tablet_bootstrap.cc:654] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.293762 16415 catalog_manager.cc:5697] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 0 to 1, leader changed from <none> to cd924581228b49d889b0e1553519722a (127.8.111.68). New cstate: current_term: 1 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:42.295181 16482 leader_election.cc:304] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:29:42.300812 16871 raft_consensus.cc:3060] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.305367 16787 tablet_bootstrap.cc:654] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.305259 16991 raft_consensus.cc:493] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.308935 16991 raft_consensus.cc:515] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:42.312161 16790 tablet_bootstrap.cc:654] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.312433 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c4bbfcbd3a427d9ddbbeb3b17c3b4f" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:42.313225 16737 raft_consensus.cc:2468] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
I20260709 12:29:42.316924 16788 tablet_bootstrap.cc:492] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:42.317431 16788 ts_tablet_manager.cc:1403] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.278s	user 0.013s	sys 0.001s
I20260709 12:29:42.319051 16631 leader_election.cc:304] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:42.319921 16997 raft_consensus.cc:2804] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:42.320334 16997 raft_consensus.cc:493] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:42.320741 16997 raft_consensus.cc:3060] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.325191 16786 tablet_bootstrap.cc:492] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:42.328315 16997 raft_consensus.cc:515] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:42.328953 16871 raft_consensus.cc:2749] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:42.330014 16786 ts_tablet_manager.cc:1403] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.004s
I20260709 12:29:42.330914 16788 raft_consensus.cc:359] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.331589 16788 raft_consensus.cc:385] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.331120 16413 catalog_manager.cc:5697] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } }
W20260709 12:29:42.334533 17005 log.cc:927] Time spent T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:29:42.331875 16788 raft_consensus.cc:740] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.345831 16854 consensus_queue.cc:1048] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:42.347754 16991 leader_election.cc:290] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:42.340145 16788 consensus_queue.cc:260] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.354048 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c4bbfcbd3a427d9ddbbeb3b17c3b4f" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:42.354668 16737 raft_consensus.cc:3060] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.366098 16737 raft_consensus.cc:2468] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:42.367519 16854 consensus_queue.cc:1048] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:42.367962 16631 leader_election.cc:304] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
W20260709 12:29:42.369215 16539 debug-util.cc:398] Leaking SignalData structure 0x7b08000601a0 after lost signal to thread 8640
I20260709 12:29:42.370225 16833 raft_consensus.cc:2804] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:29:42.370698 16539 debug-util.cc:398] Leaking SignalData structure 0x7b0800266c60 after lost signal to thread 16450
I20260709 12:29:42.370760 16833 raft_consensus.cc:697] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:29:42.371997 16833 consensus_queue.cc:237] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
W20260709 12:29:42.372767 16539 debug-util.cc:398] Leaking SignalData structure 0x7b08001580c0 after lost signal to thread 16542
I20260709 12:29:42.374908 16871 raft_consensus.cc:493] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.375041 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c4bbfcbd3a427d9ddbbeb3b17c3b4f" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:42.375429 16871 raft_consensus.cc:515] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:42.377516 16871 leader_election.cc:290] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:42.377625 16997 leader_election.cc:290] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:42.379009 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b4874f353b48ef8bdfa4c28549a207" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:42.379865 16591 raft_consensus.cc:2468] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 0.
I20260709 12:29:42.380354 16786 raft_consensus.cc:359] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.381084 16786 raft_consensus.cc:385] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.381191 16788 ts_tablet_manager.cc:1434] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.000s
I20260709 12:29:42.381392 16786 raft_consensus.cc:740] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.382253 16788 tablet_bootstrap.cc:492] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
W20260709 12:29:42.380492 16633 leader_election.cc:343] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.383033 16415 catalog_manager.cc:5697] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:42.383860 16481 leader_election.cc:304] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:42.383750 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14c4bbfcbd3a427d9ddbbeb3b17c3b4f" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:42.384670 16871 raft_consensus.cc:2804] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:42.385051 16871 raft_consensus.cc:493] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:42.385542 16790 tablet_bootstrap.cc:492] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
W20260709 12:29:42.385751 16633 leader_election.cc:343] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.385619 16786 consensus_queue.cc:260] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.382369 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b4874f353b48ef8bdfa4c28549a207" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:42.387053 16871 raft_consensus.cc:3060] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.391655 16790 ts_tablet_manager.cc:1403] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.119s	user 0.036s	sys 0.039s
I20260709 12:29:42.394922 16786 ts_tablet_manager.cc:1434] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.000s
I20260709 12:29:42.395875 16786 tablet_bootstrap.cc:492] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
W20260709 12:29:42.399513 16484 leader_election.cc:343] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.401839 16790 raft_consensus.cc:359] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:42.402534 16790 raft_consensus.cc:385] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.402792 16790 raft_consensus.cc:740] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.406500 16871 raft_consensus.cc:515] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:42.415838 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b4874f353b48ef8bdfa4c28549a207" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:42.416599 16591 raft_consensus.cc:3060] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:42.416911 16539 debug-util.cc:398] Leaking SignalData structure 0x7b080002f8c0 after lost signal to thread 16617
W20260709 12:29:42.419199 16539 debug-util.cc:398] Leaking SignalData structure 0x7b080033e460 after lost signal to thread 16691
W20260709 12:29:42.420610 16539 debug-util.cc:398] Leaking SignalData structure 0x7b080022cd00 after lost signal to thread 16765
I20260709 12:29:42.431418 16786 tablet_bootstrap.cc:654] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.432631 16854 consensus_queue.cc:1048] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:42.426812 16591 raft_consensus.cc:2468] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:29:42.435714 16481 leader_election.cc:304] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:42.436765 16872 raft_consensus.cc:2804] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:42.437234 16872 raft_consensus.cc:697] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:29:42.438061 16872 consensus_queue.cc:237] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:42.442619 16971 raft_consensus.cc:493] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.443181 16971 raft_consensus.cc:515] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.445290 16971 leader_election.cc:290] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:42.445387 16790 consensus_queue.cc:260] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:42.450428 16790 ts_tablet_manager.cc:1434] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260709 12:29:42.451608 16790 tablet_bootstrap.cc:492] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:42.451368 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
W20260709 12:29:42.453174 16559 leader_election.cc:343] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.437256 16793 raft_consensus.cc:493] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.455749 16793 raft_consensus.cc:515] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.459348 16793 leader_election.cc:290] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:42.461282 16787 tablet_bootstrap.cc:492] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:42.461130 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:42.461932 16787 ts_tablet_manager.cc:1403] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.177s	user 0.020s	sys 0.004s
W20260709 12:29:42.462805 16707 leader_election.cc:343] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.465162 16787 raft_consensus.cc:359] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:42.466001 16787 raft_consensus.cc:385] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.469944 16786 tablet_bootstrap.cc:492] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:42.471942 16786 ts_tablet_manager.cc:1403] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.000s
I20260709 12:29:42.473207 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:42.473939 16969 consensus_queue.cc:1048] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:29:42.478529 16590 raft_consensus.cc:2468] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 0.
I20260709 12:29:42.471824 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:42.477111 16413 catalog_manager.cc:5697] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 0 to 1, leader changed from <none> to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 1 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:42.482300 16740 raft_consensus.cc:2468] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:42.484201 16786 raft_consensus.cc:359] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.484479 16704 leader_election.cc:304] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:42.484920 16786 raft_consensus.cc:385] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.485664 16786 raft_consensus.cc:740] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.485378 16793 raft_consensus.cc:2804] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:42.486325 16793 raft_consensus.cc:493] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:42.486793 16793 raft_consensus.cc:3060] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.470615 16787 raft_consensus.cc:740] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.496222 16787 consensus_queue.cc:260] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:42.499540 16787 ts_tablet_manager.cc:1434] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.001s
I20260709 12:29:42.500919 16786 consensus_queue.cc:260] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.502439 16787 tablet_bootstrap.cc:492] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:42.509493 16786 ts_tablet_manager.cc:1434] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.035s	user 0.002s	sys 0.004s
I20260709 12:29:42.506136 16793 raft_consensus.cc:515] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.513715 16788 tablet_bootstrap.cc:654] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.515377 16793 leader_election.cc:290] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:42.516530 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
W20260709 12:29:42.518211 16707 leader_election.cc:343] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.518211 16787 tablet_bootstrap.cc:654] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.520843 16557 leader_election.cc:304] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:42.522572 16971 raft_consensus.cc:2804] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:42.523025 16971 raft_consensus.cc:493] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:42.523423 16971 raft_consensus.cc:3060] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.526435 16790 tablet_bootstrap.cc:654] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.526944 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:42.529349 16786 tablet_bootstrap.cc:492] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:42.536633 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b4874f353b48ef8bdfa4c28549a207" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:42.537443 16664 raft_consensus.cc:3060] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.535802 16871 leader_election.cc:290] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:42.568399 16971 raft_consensus.cc:515] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.569643 16590 raft_consensus.cc:2393] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a in current term 1: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
I20260709 12:29:42.572069 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
W20260709 12:29:42.573575 16559 leader_election.cc:343] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.574730 16793 raft_consensus.cc:493] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.575621 16704 leader_election.cc:304] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:42.575419 16793 raft_consensus.cc:515] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.576823 16788 tablet_bootstrap.cc:492] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:42.576762 16892 raft_consensus.cc:2749] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:42.577768 16788 ts_tablet_manager.cc:1403] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.196s	user 0.012s	sys 0.009s
I20260709 12:29:42.579324 16793 leader_election.cc:290] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:42.579337 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d31544c1e5974ed9bf1a91c63adb99b8" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
W20260709 12:29:42.581993 16707 leader_election.cc:343] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.584025 16787 tablet_bootstrap.cc:492] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:42.584537 16787 ts_tablet_manager.cc:1403] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.082s	user 0.006s	sys 0.013s
I20260709 12:29:42.583709 16412 catalog_manager.cc:5697] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:42.586803 16971 leader_election.cc:290] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:42.587581 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d31544c1e5974ed9bf1a91c63adb99b8" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:42.591380 16788 raft_consensus.cc:359] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.592068 16788 raft_consensus.cc:385] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.592335 16788 raft_consensus.cc:740] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.592955 16788 consensus_queue.cc:260] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.590767 16787 raft_consensus.cc:359] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.597173 16787 raft_consensus.cc:385] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.596406 16736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:42.598434 16736 raft_consensus.cc:2393] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f5ebf768d584b17897ebb5b4575ece5 in current term 1: Already voted for candidate cd924581228b49d889b0e1553519722a in this term.
W20260709 12:29:42.599764 16704 leader_election.cc:343] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.600236 16704 leader_election.cc:304] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:42.601712 16793 raft_consensus.cc:2749] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:42.603008 16788 ts_tablet_manager.cc:1434] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:29:42.604080 16786 tablet_bootstrap.cc:654] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.597510 16787 raft_consensus.cc:740] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.607898 16787 consensus_queue.cc:260] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.608201 16664 raft_consensus.cc:2468] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:29:42.609962 16787 ts_tablet_manager.cc:1434] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 12:29:42.610944 16787 tablet_bootstrap.cc:492] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:42.613804 16557 leader_election.cc:304] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a
I20260709 12:29:42.615221 16969 raft_consensus.cc:2749] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:42.615402 16790 tablet_bootstrap.cc:492] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:42.615947 16790 ts_tablet_manager.cc:1403] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.165s	user 0.040s	sys 0.039s
I20260709 12:29:42.618644 16790 raft_consensus.cc:359] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:42.619309 16790 raft_consensus.cc:385] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.619568 16790 raft_consensus.cc:740] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.620226 16790 consensus_queue.cc:260] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:42.622500 16788 tablet_bootstrap.cc:492] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:42.629012 16788 tablet_bootstrap.cc:654] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.629258 16971 consensus_queue.cc:1048] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:42.630110 16786 tablet_bootstrap.cc:492] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:42.630615 16786 ts_tablet_manager.cc:1403] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.120s	user 0.011s	sys 0.001s
I20260709 12:29:42.633524 16786 raft_consensus.cc:359] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:42.633672 16833 consensus_queue.cc:1048] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:42.634245 16786 raft_consensus.cc:385] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.634593 16786 raft_consensus.cc:740] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.635380 16786 consensus_queue.cc:260] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:42.637708 16786 ts_tablet_manager.cc:1434] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:29:42.638304 16787 tablet_bootstrap.cc:654] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.638793 16786 tablet_bootstrap.cc:492] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:42.640867 16971 raft_consensus.cc:493] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.640781 16790 ts_tablet_manager.cc:1434] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:29:42.646142 16971 raft_consensus.cc:515] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.647130 16790 tablet_bootstrap.cc:492] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:42.649099 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d31544c1e5974ed9bf1a91c63adb99b8" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:42.649792 16667 raft_consensus.cc:2468] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:42.651376 16559 leader_election.cc:304] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:42.652266 16972 raft_consensus.cc:2804] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:42.652622 16972 raft_consensus.cc:493] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:42.652956 16972 raft_consensus.cc:3060] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.653522 16790 tablet_bootstrap.cc:654] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.652983 16415 catalog_manager.cc:5697] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 0 to 1, leader changed from <none> to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 1 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:42.659034 16787 tablet_bootstrap.cc:492] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:42.659579 16787 ts_tablet_manager.cc:1403] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.000s
I20260709 12:29:42.659629 16786 tablet_bootstrap.cc:654] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.661918 16972 raft_consensus.cc:515] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.707096 16972 leader_election.cc:290] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:42.707584 16892 raft_consensus.cc:493] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.708206 16892 raft_consensus.cc:515] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:42.711704 16974 consensus_queue.cc:1048] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:42.715040 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689ed466680f40a59a88298ad3596652" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:42.715471 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d31544c1e5974ed9bf1a91c63adb99b8" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:42.715646 16793 consensus_queue.cc:1048] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:42.716151 16740 raft_consensus.cc:3060] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:42.717052 16707 leader_election.cc:343] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.662684 16971 leader_election.cc:290] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:42.670984 16997 consensus_queue.cc:1048] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:42.672871 16787 raft_consensus.cc:359] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.677829 16788 tablet_bootstrap.cc:492] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:42.721513 16787 raft_consensus.cc:385] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.681977 16786 tablet_bootstrap.cc:492] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:42.721804 16787 raft_consensus.cc:740] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.722093 16786 ts_tablet_manager.cc:1403] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.084s	user 0.006s	sys 0.008s
I20260709 12:29:42.721796 16788 ts_tablet_manager.cc:1403] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.108s	user 0.011s	sys 0.001s
I20260709 12:29:42.688669 16790 tablet_bootstrap.cc:492] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:42.724236 16790 ts_tablet_manager.cc:1403] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.010s
I20260709 12:29:42.724846 16788 raft_consensus.cc:359] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.725538 16788 raft_consensus.cc:385] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.725819 16788 raft_consensus.cc:740] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.718644 16989 raft_consensus.cc:493] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.726496 16989 raft_consensus.cc:515] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:42.726902 16787 consensus_queue.cc:260] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.728489 16787 ts_tablet_manager.cc:1434] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.000s
I20260709 12:29:42.728677 16989 leader_election.cc:290] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:42.726476 16788 consensus_queue.cc:260] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.730424 16786 raft_consensus.cc:359] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:42.730875 16788 ts_tablet_manager.cc:1434] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:42.731096 16786 raft_consensus.cc:385] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.731382 16786 raft_consensus.cc:740] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.731817 16788 tablet_bootstrap.cc:492] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:42.734947 16787 tablet_bootstrap.cc:492] T 689ed466680f40a59a88298ad3596652 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:42.736202 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:42.736918 16854 consensus_queue.cc:1048] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:42.725142 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d31544c1e5974ed9bf1a91c63adb99b8" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:42.741863 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:42.742084 16786 consensus_queue.cc:260] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:42.742766 16787 tablet_bootstrap.cc:654] T 689ed466680f40a59a88298ad3596652 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.744462 16786 ts_tablet_manager.cc:1434] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 12:29:42.747571 16790 raft_consensus.cc:359] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:42.747982 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d31544c1e5974ed9bf1a91c63adb99b8" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:42.748518 16790 raft_consensus.cc:385] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.748729 16667 raft_consensus.cc:3060] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.748958 16790 raft_consensus.cc:740] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.751287 16892 leader_election.cc:290] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:42.752005 16786 tablet_bootstrap.cc:492] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:42.751901 16892 raft_consensus.cc:493] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.753042 16790 consensus_queue.cc:260] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:42.761667 16786 tablet_bootstrap.cc:654] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.761240 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689ed466680f40a59a88298ad3596652" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:42.768381 16790 ts_tablet_manager.cc:1434] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.001s
I20260709 12:29:42.772223 16790 tablet_bootstrap.cc:492] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:42.779860 16787 tablet_bootstrap.cc:492] T 689ed466680f40a59a88298ad3596652 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:42.780471 16787 ts_tablet_manager.cc:1403] T 689ed466680f40a59a88298ad3596652 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.046s	user 0.019s	sys 0.003s
I20260709 12:29:42.781622 16788 tablet_bootstrap.cc:654] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.763456 16892 raft_consensus.cc:515] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:42.789235 16892 leader_election.cc:290] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:42.785270 16664 raft_consensus.cc:3060] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.786206 16630 leader_election.cc:304] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:42.793534 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
W20260709 12:29:42.799840 16707 leader_election.cc:343] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.800721 16790 tablet_bootstrap.cc:654] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.801008 16511 raft_consensus.cc:3060] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.813050 16740 raft_consensus.cc:2468] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:42.771739 16512 raft_consensus.cc:2468] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 0.
I20260709 12:29:42.848714 16989 raft_consensus.cc:2749] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:42.849258 16707 leader_election.cc:304] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:42.849593 16667 raft_consensus.cc:2468] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:42.851337 16557 leader_election.cc:304] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:42.852638 16972 raft_consensus.cc:2804] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:42.853225 16843 raft_consensus.cc:2804] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:42.853818 16843 raft_consensus.cc:493] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:42.854774 16843 raft_consensus.cc:3060] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.828136 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:42.832939 16513 raft_consensus.cc:3060] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.819191 16997 consensus_queue.cc:1048] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:42.853276 16972 raft_consensus.cc:697] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:42.833420 16787 raft_consensus.cc:359] T 689ed466680f40a59a88298ad3596652 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:42.876099 16787 raft_consensus.cc:385] T 689ed466680f40a59a88298ad3596652 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.876560 16787 raft_consensus.cc:740] T 689ed466680f40a59a88298ad3596652 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.883234 16787 consensus_queue.cc:260] T 689ed466680f40a59a88298ad3596652 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:42.896018 16787 ts_tablet_manager.cc:1434] T 689ed466680f40a59a88298ad3596652 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.115s	user 0.004s	sys 0.003s
I20260709 12:29:42.896907 16787 tablet_bootstrap.cc:492] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:42.899617 16972 consensus_queue.cc:237] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
W20260709 12:29:42.907171 16704 leader_election.cc:343] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.907799 16704 leader_election.cc:304] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:42.911126 16843 raft_consensus.cc:515] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:42.926430 16833 raft_consensus.cc:493] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.927033 16833 raft_consensus.cc:515] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:42.929503 16833 leader_election.cc:290] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:42.926430 16793 consensus_queue.cc:1048] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:29:42.932013 16892 raft_consensus.cc:2749] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:42.932917 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689ed466680f40a59a88298ad3596652" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:42.933643 16667 raft_consensus.cc:3060] T 689ed466680f40a59a88298ad3596652 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.936911 16872 consensus_queue.cc:1048] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:42.949818 16843 leader_election.cc:290] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:42.951759 16974 consensus_queue.cc:1048] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:42.954604 16997 consensus_queue.cc:1048] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:42.955135 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:42.956086 16737 raft_consensus.cc:2393] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99ca36f8a50c459388f31022b1455ed6 in current term 1: Already voted for candidate cd924581228b49d889b0e1553519722a in this term.
I20260709 12:29:42.957033 16872 consensus_queue.cc:1048] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:42.960091 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689ed466680f40a59a88298ad3596652" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:42.960423 16667 raft_consensus.cc:2468] T 689ed466680f40a59a88298ad3596652 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 1.
I20260709 12:29:42.960842 16511 raft_consensus.cc:3060] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.961794 16707 leader_election.cc:304] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:42.963027 16843 raft_consensus.cc:2804] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:42.964301 16843 raft_consensus.cc:697] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:29:42.965319 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:42.966511 16591 raft_consensus.cc:2393] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99ca36f8a50c459388f31022b1455ed6 in current term 1: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
I20260709 12:29:42.965473 16843 consensus_queue.cc:237] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:42.992614 16786 tablet_bootstrap.cc:492] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:42.993335 16786 ts_tablet_manager.cc:1403] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.248s	user 0.012s	sys 0.000s
I20260709 12:29:43.029573 16786 raft_consensus.cc:359] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:43.030635 16786 raft_consensus.cc:385] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.031008 16786 raft_consensus.cc:740] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.035346 16786 consensus_queue.cc:260] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:43.059759 16787 tablet_bootstrap.cc:654] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.036044 16631 leader_election.cc:304] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:29:43.067147 16997 raft_consensus.cc:3060] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.078563 16790 tablet_bootstrap.cc:492] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:43.079105 16790 ts_tablet_manager.cc:1403] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.310s	user 0.034s	sys 0.024s
I20260709 12:29:43.079525 16997 raft_consensus.cc:2749] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:43.082731 16790 raft_consensus.cc:359] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.083873 16790 raft_consensus.cc:385] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.084252 16790 raft_consensus.cc:740] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.084749 16788 tablet_bootstrap.cc:492] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:43.085281 16788 ts_tablet_manager.cc:1403] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.354s	user 0.083s	sys 0.133s
I20260709 12:29:43.085306 16790 consensus_queue.cc:260] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.088959 16790 ts_tablet_manager.cc:1434] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:29:43.089867 16790 tablet_bootstrap.cc:492] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:43.093976 16786 ts_tablet_manager.cc:1434] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.100s	user 0.016s	sys 0.014s
I20260709 12:29:43.094986 16786 tablet_bootstrap.cc:492] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:43.073865 16511 raft_consensus.cc:2468] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 1.
I20260709 12:29:43.100126 16412 catalog_manager.cc:5697] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 0 to 1, leader changed from <none> to cd924581228b49d889b0e1553519722a (127.8.111.68). New cstate: current_term: 1 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:43.106103 16788 raft_consensus.cc:359] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:43.107064 16788 raft_consensus.cc:385] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.107359 16788 raft_consensus.cc:740] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.156355 16788 consensus_queue.cc:260] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:43.171037 16788 ts_tablet_manager.cc:1434] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.085s	user 0.013s	sys 0.004s
I20260709 12:29:43.172432 16788 tablet_bootstrap.cc:492] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:43.223682 16854 raft_consensus.cc:493] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.224579 16854 raft_consensus.cc:515] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:43.229743 16854 leader_election.cc:290] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:43.249429 16787 tablet_bootstrap.cc:492] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:43.250082 16787 ts_tablet_manager.cc:1403] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.353s	user 0.021s	sys 0.027s
I20260709 12:29:43.255712 17049 raft_consensus.cc:493] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.257220 17049 raft_consensus.cc:515] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.269074 16790 tablet_bootstrap.cc:654] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.270736 16788 tablet_bootstrap.cc:654] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.276834 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2976cad482cd47bbadc454f8570dbb0d" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:43.281899 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2976cad482cd47bbadc454f8570dbb0d" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
W20260709 12:29:43.283294 16559 leader_election.cc:343] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.286038 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7f1ce17c243358d69760e6457d24a" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:43.287324 16787 raft_consensus.cc:359] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:43.289719 16787 raft_consensus.cc:385] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.291407 16787 raft_consensus.cc:740] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.294252 16412 catalog_manager.cc:5697] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:43.288578 16786 tablet_bootstrap.cc:654] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:43.304688 16557 leader_election.cc:343] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.305086 16557 leader_election.cc:304] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a
W20260709 12:29:43.305851 16481 leader_election.cc:343] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.307312 17049 leader_election.cc:290] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:43.312340 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7f1ce17c243358d69760e6457d24a" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
W20260709 12:29:43.315448 16484 leader_election.cc:343] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.315975 16484 leader_election.cc:304] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:43.316332 16854 raft_consensus.cc:2749] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:43.316847 17049 raft_consensus.cc:2749] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:43.323179 16787 consensus_queue.cc:260] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:43.328890 16972 consensus_queue.cc:1048] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:43.331259 16786 tablet_bootstrap.cc:492] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:43.331877 16786 ts_tablet_manager.cc:1403] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.237s	user 0.010s	sys 0.004s
I20260709 12:29:43.334939 16790 tablet_bootstrap.cc:492] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:43.335500 16790 ts_tablet_manager.cc:1403] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.246s	user 0.013s	sys 0.003s
I20260709 12:29:43.338469 16790 raft_consensus.cc:359] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:43.339219 16790 raft_consensus.cc:385] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.339362 16787 ts_tablet_manager.cc:1434] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.085s	user 0.010s	sys 0.000s
I20260709 12:29:43.341099 16787 tablet_bootstrap.cc:492] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:43.339517 16790 raft_consensus.cc:740] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.346083 16790 consensus_queue.cc:260] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:43.353551 16788 tablet_bootstrap.cc:492] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:43.354336 16788 ts_tablet_manager.cc:1403] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.182s	user 0.010s	sys 0.003s
I20260709 12:29:43.348698 16972 raft_consensus.cc:493] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.356827 16972 raft_consensus.cc:515] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:43.359378 16786 raft_consensus.cc:359] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:43.360423 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
W20260709 12:29:43.362468 16559 leader_election.cc:343] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.360106 16972 leader_election.cc:290] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:43.366868 16790 ts_tablet_manager.cc:1434] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:29:43.367935 16790 tablet_bootstrap.cc:492] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:43.367733 16788 raft_consensus.cc:359] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.368597 16788 raft_consensus.cc:385] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.368933 16788 raft_consensus.cc:740] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.370087 16787 tablet_bootstrap.cc:654] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.360230 16786 raft_consensus.cc:385] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.370980 16786 raft_consensus.cc:740] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.372193 16786 consensus_queue.cc:260] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:43.374965 16786 ts_tablet_manager.cc:1434] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:29:43.369700 16788 consensus_queue.cc:260] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.382503 16788 ts_tablet_manager.cc:1434] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.002s
I20260709 12:29:43.383564 16788 tablet_bootstrap.cc:492] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:43.384944 16787 tablet_bootstrap.cc:492] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:43.385471 16787 ts_tablet_manager.cc:1403] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.008s
I20260709 12:29:43.388803 16787 raft_consensus.cc:359] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.389508 16787 raft_consensus.cc:385] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.389804 16787 raft_consensus.cc:740] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.390903 16788 tablet_bootstrap.cc:654] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.391182 16787 consensus_queue.cc:260] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.398088 16787 ts_tablet_manager.cc:1434] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 12:29:43.401712 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:43.402524 16737 raft_consensus.cc:2468] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:43.403141 16787 tablet_bootstrap.cc:492] T 2976cad482cd47bbadc454f8570dbb0d P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:43.404140 16786 tablet_bootstrap.cc:492] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:43.407047 16790 tablet_bootstrap.cc:654] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.411190 16793 consensus_queue.cc:1048] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:43.423385 16843 consensus_queue.cc:1048] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:43.428364 16787 tablet_bootstrap.cc:654] T 2976cad482cd47bbadc454f8570dbb0d P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:43.433032 16463 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:43.433490 16557 leader_election.cc:304] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:43.441140 16972 raft_consensus.cc:2804] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:43.441633 16972 raft_consensus.cc:493] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:43.442065 16972 raft_consensus.cc:3060] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.443580 16787 tablet_bootstrap.cc:492] T 2976cad482cd47bbadc454f8570dbb0d P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:43.444180 16787 ts_tablet_manager.cc:1403] T 2976cad482cd47bbadc454f8570dbb0d P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.000s
I20260709 12:29:43.449137 16786 tablet_bootstrap.cc:654] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.451563 16787 raft_consensus.cc:359] T 2976cad482cd47bbadc454f8570dbb0d P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:43.452359 16787 raft_consensus.cc:385] T 2976cad482cd47bbadc454f8570dbb0d P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.452685 16787 raft_consensus.cc:740] T 2976cad482cd47bbadc454f8570dbb0d P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.453384 16787 consensus_queue.cc:260] T 2976cad482cd47bbadc454f8570dbb0d P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:43.457056 16787 ts_tablet_manager.cc:1434] T 2976cad482cd47bbadc454f8570dbb0d P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:29:43.458066 16787 tablet_bootstrap.cc:492] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:43.458607 16971 consensus_queue.cc:1048] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:29:43.487035 16971 raft_consensus.cc:493] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.488193 16971 raft_consensus.cc:515] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.494787 16971 leader_election.cc:290] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:43.497112 16972 raft_consensus.cc:515] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:43.498510 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7f1ce17c243358d69760e6457d24a" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:43.499477 16664 raft_consensus.cc:2468] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:43.499737 16972 leader_election.cc:290] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:43.502583 16786 tablet_bootstrap.cc:492] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:43.503106 16786 ts_tablet_manager.cc:1403] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.099s	user 0.014s	sys 0.000s
I20260709 12:29:43.504385 16788 tablet_bootstrap.cc:492] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:43.505198 16788 ts_tablet_manager.cc:1403] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.122s	user 0.016s	sys 0.002s
I20260709 12:29:43.505934 16786 raft_consensus.cc:359] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:43.506716 16786 raft_consensus.cc:385] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.506999 16786 raft_consensus.cc:740] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.507263 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7f1ce17c243358d69760e6457d24a" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:43.507532 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:43.507897 16511 raft_consensus.cc:2468] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:43.507833 16786 consensus_queue.cc:260] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:43.508083 16788 raft_consensus.cc:359] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.508903 16788 raft_consensus.cc:385] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.509174 16788 raft_consensus.cc:740] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.509626 16559 leader_election.cc:304] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:43.509969 16788 consensus_queue.cc:260] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.510381 16786 ts_tablet_manager.cc:1434] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:29:43.511041 16971 raft_consensus.cc:2804] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:43.511399 16971 raft_consensus.cc:493] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:43.511498 16786 tablet_bootstrap.cc:492] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:43.511787 16971 raft_consensus.cc:3060] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.508242 16740 raft_consensus.cc:3060] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.518623 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:43.519286 16786 tablet_bootstrap.cc:654] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.518383 16843 raft_consensus.cc:493] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.522615 16843 raft_consensus.cc:515] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:43.524888 16843 leader_election.cc:290] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:43.530154 16790 tablet_bootstrap.cc:492] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:43.530709 16790 ts_tablet_manager.cc:1403] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.163s	user 0.022s	sys 0.016s
I20260709 12:29:43.530831 16787 tablet_bootstrap.cc:654] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.526928 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda99eaeca1149d48e54e0d83c3ec4cb" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:43.533341 16667 raft_consensus.cc:2468] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 0.
I20260709 12:29:43.534559 16790 raft_consensus.cc:359] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.535032 16707 leader_election.cc:304] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
W20260709 12:29:43.535708 16559 leader_election.cc:343] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.535305 16790 raft_consensus.cc:385] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.542548 16790 raft_consensus.cc:740] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.543038 16843 raft_consensus.cc:2804] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:43.543498 16843 raft_consensus.cc:493] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:43.543941 16843 raft_consensus.cc:3060] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.543525 16790 consensus_queue.cc:260] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.551575 16790 ts_tablet_manager.cc:1434] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:29:43.552933 16790 tablet_bootstrap.cc:492] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:43.567518 16790 tablet_bootstrap.cc:654] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.573343 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda99eaeca1149d48e54e0d83c3ec4cb" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:43.582316 16786 tablet_bootstrap.cc:492] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:43.582808 16786 ts_tablet_manager.cc:1403] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.072s	user 0.018s	sys 0.009s
I20260709 12:29:43.585429 16786 raft_consensus.cc:359] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:43.586069 16786 raft_consensus.cc:385] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.586786 16971 raft_consensus.cc:515] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.589203 16786 raft_consensus.cc:740] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.588701 16788 ts_tablet_manager.cc:1434] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.001s
I20260709 12:29:43.588207 16787 tablet_bootstrap.cc:492] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:43.589970 16787 ts_tablet_manager.cc:1403] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.132s	user 0.018s	sys 0.011s
I20260709 12:29:43.590420 16788 tablet_bootstrap.cc:492] T 2fb661ebdebf474db7f6380eb0e49d7f P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:43.590023 16786 consensus_queue.cc:260] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:43.576625 16513 raft_consensus.cc:2468] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 0.
I20260709 12:29:43.595551 17047 raft_consensus.cc:493] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.597010 16790 tablet_bootstrap.cc:492] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:43.600287 16790 ts_tablet_manager.cc:1403] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.008s
I20260709 12:29:43.600059 17047 raft_consensus.cc:515] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:43.601936 16971 leader_election.cc:290] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:43.599418 16740 raft_consensus.cc:2468] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:43.602919 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7f1ce17c243358d69760e6457d24a" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:43.615168 16513 raft_consensus.cc:3060] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.603516 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7f1ce17c243358d69760e6457d24a" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:43.617967 16667 raft_consensus.cc:3060] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.619788 16788 tablet_bootstrap.cc:654] T 2fb661ebdebf474db7f6380eb0e49d7f P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.604962 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2976cad482cd47bbadc454f8570dbb0d" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:43.622609 16591 raft_consensus.cc:2468] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 0.
I20260709 12:29:43.607071 16787 raft_consensus.cc:359] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.608539 16786 ts_tablet_manager.cc:1434] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:29:43.608330 16790 raft_consensus.cc:359] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:43.612031 17047 leader_election.cc:290] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:43.623529 16787 raft_consensus.cc:385] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.613682 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2976cad482cd47bbadc454f8570dbb0d" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:43.623873 16787 raft_consensus.cc:740] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.624334 16786 tablet_bootstrap.cc:492] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:43.624961 16790 raft_consensus.cc:385] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.624632 16787 consensus_queue.cc:260] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.625356 16790 raft_consensus.cc:740] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.626348 16790 consensus_queue.cc:260] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:43.630115 16513 raft_consensus.cc:2468] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:43.624197 16664 raft_consensus.cc:2468] T 2976cad482cd47bbadc454f8570dbb0d P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 0.
I20260709 12:29:43.603525 16843 raft_consensus.cc:515] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:43.631371 16786 tablet_bootstrap.cc:654] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.644239 16707 leader_election.cc:304] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:43.645069 16793 raft_consensus.cc:2804] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:43.645426 16793 raft_consensus.cc:493] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:43.645653 16843 leader_election.cc:290] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:43.645789 16793 raft_consensus.cc:3060] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.615406 16557 leader_election.cc:304] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:43.646953 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda99eaeca1149d48e54e0d83c3ec4cb" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:43.647323 16559 leader_election.cc:304] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:43.647567 16513 raft_consensus.cc:3060] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.632833 17047 raft_consensus.cc:493] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.648208 16854 raft_consensus.cc:2804] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:43.648331 17047 raft_consensus.cc:515] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:43.648729 16854 raft_consensus.cc:697] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:43.649577 16854 consensus_queue.cc:237] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:43.634457 16787 ts_tablet_manager.cc:1434] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 12:29:43.654227 16787 tablet_bootstrap.cc:492] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:43.653934 16793 raft_consensus.cc:515] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:43.656105 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ec89af83a842909ba5e19282a9e12d" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:43.656489 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2976cad482cd47bbadc454f8570dbb0d" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:43.657049 16591 raft_consensus.cc:3060] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:43.657536 16707 leader_election.cc:343] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.658730 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ec89af83a842909ba5e19282a9e12d" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:43.641872 16667 raft_consensus.cc:2468] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:43.650444 16972 raft_consensus.cc:2804] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:29:43.660321 16707 leader_election.cc:343] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.660759 16972 raft_consensus.cc:697] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:43.650537 17047 leader_election.cc:290] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:43.661626 16972 consensus_queue.cc:237] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.660775 16707 leader_election.cc:304] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:43.664392 17047 raft_consensus.cc:2749] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:43.651432 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda99eaeca1149d48e54e0d83c3ec4cb" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:43.665377 16664 raft_consensus.cc:3060] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.670964 16591 raft_consensus.cc:2468] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 1.
I20260709 12:29:43.672688 16704 leader_election.cc:304] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:43.673574 17047 raft_consensus.cc:2804] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:43.675673 16787 tablet_bootstrap.cc:654] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.678851 17047 raft_consensus.cc:697] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:29:43.680097 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2976cad482cd47bbadc454f8570dbb0d" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:43.679909 17047 consensus_queue.cc:237] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:43.680775 16667 raft_consensus.cc:3060] T 2976cad482cd47bbadc454f8570dbb0d P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.682732 16843 raft_consensus.cc:493] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.645443 16788 tablet_bootstrap.cc:492] T 2fb661ebdebf474db7f6380eb0e49d7f P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:43.683171 16971 raft_consensus.cc:493] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.683439 16788 ts_tablet_manager.cc:1403] T 2fb661ebdebf474db7f6380eb0e49d7f P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.093s	user 0.007s	sys 0.003s
I20260709 12:29:43.683266 16843 raft_consensus.cc:515] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:43.685436 16843 leader_election.cc:290] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:43.678886 16793 leader_election.cc:290] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:43.686456 16971 raft_consensus.cc:515] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.686813 16788 raft_consensus.cc:359] T 2fb661ebdebf474db7f6380eb0e49d7f P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:43.687534 16788 raft_consensus.cc:385] T 2fb661ebdebf474db7f6380eb0e49d7f P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.687825 16788 raft_consensus.cc:740] T 2fb661ebdebf474db7f6380eb0e49d7f P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.688714 16971 leader_election.cc:290] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:43.678226 16513 raft_consensus.cc:2468] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 1.
I20260709 12:29:43.690707 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56d3967e8f4a15b1883473e50c4c85" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:43.688476 16788 consensus_queue.cc:260] T 2fb661ebdebf474db7f6380eb0e49d7f P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:43.691425 16707 leader_election.cc:304] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:43.692211 16793 raft_consensus.cc:2804] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:43.693017 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56d3967e8f4a15b1883473e50c4c85" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:43.693362 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb661ebdebf474db7f6380eb0e49d7f" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:43.693801 16511 raft_consensus.cc:2468] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
W20260709 12:29:43.694118 16559 leader_election.cc:343] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.693005 16793 raft_consensus.cc:697] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:29:43.695063 16559 leader_election.cc:304] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:43.695434 16793 consensus_queue.cc:237] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:43.696211 16972 raft_consensus.cc:2804] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:43.696587 16972 raft_consensus.cc:493] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:43.696943 16972 raft_consensus.cc:3060] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.694048 16591 raft_consensus.cc:2468] T 2fb661ebdebf474db7f6380eb0e49d7f P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 0.
I20260709 12:29:43.699906 16788 ts_tablet_manager.cc:1434] T 2fb661ebdebf474db7f6380eb0e49d7f P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:29:43.700817 16788 tablet_bootstrap.cc:492] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:43.702335 16973 raft_consensus.cc:493] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.702809 16973 raft_consensus.cc:515] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:43.704866 16973 leader_election.cc:290] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:43.704993 16412 catalog_manager.cc:5697] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 0 to 1, leader changed from <none> to cd924581228b49d889b0e1553519722a (127.8.111.68). New cstate: current_term: 1 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:43.707029 16704 leader_election.cc:304] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:43.708974 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:43.711620 16664 raft_consensus.cc:2468] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 1.
I20260709 12:29:43.632579 16790 ts_tablet_manager.cc:1434] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:29:43.712870 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:43.723492 16741 raft_consensus.cc:2393] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in current term 1: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
I20260709 12:29:43.723707 16787 tablet_bootstrap.cc:492] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:43.724184 16787 ts_tablet_manager.cc:1403] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.070s	user 0.009s	sys 0.002s
I20260709 12:29:43.724746 16482 leader_election.cc:304] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:29:43.725544 16973 raft_consensus.cc:3060] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.729385 16790 tablet_bootstrap.cc:492] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:43.730683 16787 raft_consensus.cc:359] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:43.731379 16787 raft_consensus.cc:385] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.731648 16787 raft_consensus.cc:740] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.735146 16787 consensus_queue.cc:260] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:43.715164 17047 raft_consensus.cc:2804] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:43.715327 16972 raft_consensus.cc:515] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.716312 16667 raft_consensus.cc:2468] T 2976cad482cd47bbadc454f8570dbb0d P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 1.
I20260709 12:29:43.717618 16788 tablet_bootstrap.cc:654] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.720028 16786 tablet_bootstrap.cc:492] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:43.737439 16786 ts_tablet_manager.cc:1403] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.113s	user 0.021s	sys 0.001s
I20260709 12:29:43.740248 17047 raft_consensus.cc:493] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:43.742702 17047 raft_consensus.cc:3060] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.744670 16786 raft_consensus.cc:359] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:43.745383 16786 raft_consensus.cc:385] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.745649 16786 raft_consensus.cc:740] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.748418 16786 consensus_queue.cc:260] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:43.753053 16787 ts_tablet_manager.cc:1434] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:29:43.754262 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb661ebdebf474db7f6380eb0e49d7f" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:43.754734 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56d3967e8f4a15b1883473e50c4c85" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:43.755285 16511 raft_consensus.cc:3060] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.756009 16972 leader_election.cc:290] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:43.757022 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56d3967e8f4a15b1883473e50c4c85" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
W20260709 12:29:43.758402 16559 leader_election.cc:343] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:43.759414 16707 leader_election.cc:343] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.762457 16787 tablet_bootstrap.cc:492] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:43.764575 16511 raft_consensus.cc:2468] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:43.765096 16973 raft_consensus.cc:2749] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:43.765884 16559 leader_election.cc:304] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:43.766335 16786 ts_tablet_manager.cc:1434] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:29:43.767334 16972 raft_consensus.cc:2804] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:43.767637 16786 tablet_bootstrap.cc:492] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:43.767956 16972 raft_consensus.cc:697] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:43.768714 16787 tablet_bootstrap.cc:654] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.768875 16972 consensus_queue.cc:237] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.776563 17047 raft_consensus.cc:515] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:43.812103 16788 tablet_bootstrap.cc:492] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:43.812711 16788 ts_tablet_manager.cc:1403] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.112s	user 0.011s	sys 0.001s
I20260709 12:29:43.812355 16413 catalog_manager.cc:5697] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:43.815542 16788 raft_consensus.cc:359] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:43.816181 16788 raft_consensus.cc:385] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.816468 16788 raft_consensus.cc:740] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.817873 16787 tablet_bootstrap.cc:492] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:43.818385 16787 ts_tablet_manager.cc:1403] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.004s
I20260709 12:29:43.819721 16412 catalog_manager.cc:5697] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 0 to 1, leader changed from <none> to cd924581228b49d889b0e1553519722a (127.8.111.68). New cstate: current_term: 1 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:43.821007 16787 raft_consensus.cc:359] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.821660 16787 raft_consensus.cc:385] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.821915 16787 raft_consensus.cc:740] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.822516 16788 consensus_queue.cc:260] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:43.824713 16788 ts_tablet_manager.cc:1434] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:29:43.824599 16787 consensus_queue.cc:260] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.825701 16788 tablet_bootstrap.cc:492] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:43.832528 16786 tablet_bootstrap.cc:654] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.844094 16787 ts_tablet_manager.cc:1434] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 12:29:43.845355 16787 tablet_bootstrap.cc:492] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:43.836575 16793 raft_consensus.cc:493] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.846876 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb661ebdebf474db7f6380eb0e49d7f" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:43.847126 16793 raft_consensus.cc:515] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
W20260709 12:29:43.848443 16707 leader_election.cc:343] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.849169 16793 leader_election.cc:290] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:43.850823 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:43.852030 16787 tablet_bootstrap.cc:654] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.852279 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
W20260709 12:29:43.853639 16707 leader_election.cc:343] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:43.854362 16707 leader_election.cc:343] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.854854 16707 leader_election.cc:304] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:43.856091 16793 raft_consensus.cc:2749] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:43.861065 17047 leader_election.cc:290] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:43.865871 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb661ebdebf474db7f6380eb0e49d7f" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:43.866716 16591 raft_consensus.cc:3060] T 2fb661ebdebf474db7f6380eb0e49d7f P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.867172 16790 tablet_bootstrap.cc:654] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.844928 16412 catalog_manager.cc:5697] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:43.871284 16412 catalog_manager.cc:5697] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:43.878901 16788 tablet_bootstrap.cc:654] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.906445 17078 raft_consensus.cc:493] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.907127 17078 raft_consensus.cc:515] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.911864 16787 tablet_bootstrap.cc:492] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:43.913501 16787 ts_tablet_manager.cc:1403] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.068s	user 0.030s	sys 0.027s
I20260709 12:29:43.913793 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56d3967e8f4a15b1883473e50c4c85" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:43.917202 16511 raft_consensus.cc:2393] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99ca36f8a50c459388f31022b1455ed6 in current term 1: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
I20260709 12:29:43.918671 16787 raft_consensus.cc:359] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:43.919739 16787 raft_consensus.cc:385] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.920169 16787 raft_consensus.cc:740] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.921499 16787 consensus_queue.cc:260] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:43.924037 17078 leader_election.cc:290] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:43.924264 16787 ts_tablet_manager.cc:1434] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:29:43.925350 16787 tablet_bootstrap.cc:492] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:43.932003 16787 tablet_bootstrap.cc:654] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:43.920143 16591 raft_consensus.cc:2468] T 2fb661ebdebf474db7f6380eb0e49d7f P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 1.
I20260709 12:29:43.935554 16704 leader_election.cc:304] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:43.937089 17047 raft_consensus.cc:2804] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:43.937728 17047 raft_consensus.cc:697] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:29:43.938783 17047 consensus_queue.cc:237] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:43.945546 16787 tablet_bootstrap.cc:492] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:43.946156 16787 ts_tablet_manager.cc:1403] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 12:29:43.950965 16854 raft_consensus.cc:493] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.953291 16786 tablet_bootstrap.cc:492] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:43.951027 16787 raft_consensus.cc:359] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:43.953694 16786 ts_tablet_manager.cc:1403] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.186s	user 0.014s	sys 0.000s
I20260709 12:29:43.953858 16787 raft_consensus.cc:385] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.954221 16787 raft_consensus.cc:740] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.951107 17078 raft_consensus.cc:493] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.955878 17078 raft_consensus.cc:515] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:43.970405 16997 raft_consensus.cc:493] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.971102 16997 raft_consensus.cc:515] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:43.972064 16788 tablet_bootstrap.cc:492] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:43.972633 16788 ts_tablet_manager.cc:1403] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.147s	user 0.036s	sys 0.016s
I20260709 12:29:43.974961 16787 consensus_queue.cc:260] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:43.979914 16790 tablet_bootstrap.cc:492] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:43.980346 16790 ts_tablet_manager.cc:1403] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.251s	user 0.003s	sys 0.015s
I20260709 12:29:43.981760 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56d3967e8f4a15b1883473e50c4c85" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:43.951768 16854 raft_consensus.cc:515] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:43.983563 16997 leader_election.cc:290] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:43.984630 16854 leader_election.cc:290] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:43.985314 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd2958b516b4504aec8657e0fe2ec24" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:43.985648 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd2958b516b4504aec8657e0fe2ec24" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:43.985934 16664 raft_consensus.cc:2468] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:43.986114 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd2958b516b4504aec8657e0fe2ec24" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:43.987134 16559 leader_election.cc:304] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:43.987910 16972 raft_consensus.cc:2804] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:43.988282 16972 raft_consensus.cc:493] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:43.988631 16972 raft_consensus.cc:3060] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.991536 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95064ed3f05a4169a3ff0f2123274cb7" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:43.992553 16788 raft_consensus.cc:359] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:43.992974 16997 raft_consensus.cc:493] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:43.993124 16633 leader_election.cc:343] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:43.993310 16788 raft_consensus.cc:385] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.993566 17078 leader_election.cc:290] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:43.993748 16788 raft_consensus.cc:740] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.982195 16787 ts_tablet_manager.cc:1434] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:29:43.998598 16788 consensus_queue.cc:260] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:43.999442 16787 tablet_bootstrap.cc:492] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:44.001593 16788 ts_tablet_manager.cc:1434] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 12:29:44.002673 16997 raft_consensus.cc:515] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:44.003132 16788 tablet_bootstrap.cc:492] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:44.005801 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ec89af83a842909ba5e19282a9e12d" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:44.005903 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ec89af83a842909ba5e19282a9e12d" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:44.006619 16787 tablet_bootstrap.cc:654] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.006588 16740 raft_consensus.cc:2468] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
W20260709 12:29:44.007423 16633 leader_election.cc:343] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:44.008136 16997 leader_election.cc:290] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:44.008291 16631 leader_election.cc:304] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:44.009579 16997 raft_consensus.cc:2804] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:44.009729 16788 tablet_bootstrap.cc:654] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.010016 16997 raft_consensus.cc:493] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:44.010448 16997 raft_consensus.cc:3060] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.012387 16972 raft_consensus.cc:515] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:44.015285 16972 leader_election.cc:290] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:44.017696 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd2958b516b4504aec8657e0fe2ec24" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:44.019857 16997 raft_consensus.cc:515] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:44.020663 16790 raft_consensus.cc:359] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:44.021353 16790 raft_consensus.cc:385] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.021621 16790 raft_consensus.cc:740] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.021649 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd2958b516b4504aec8657e0fe2ec24" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:44.022300 16667 raft_consensus.cc:3060] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.023262 16997 leader_election.cc:290] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:44.023355 16630 leader_election.cc:304] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:44.024384 17078 raft_consensus.cc:3060] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.025422 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd2958b516b4504aec8657e0fe2ec24" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:44.026158 16590 raft_consensus.cc:2393] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99ca36f8a50c459388f31022b1455ed6 in current term 1: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
I20260709 12:29:44.026993 16786 raft_consensus.cc:359] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:44.029834 16786 raft_consensus.cc:385] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.030114 16786 raft_consensus.cc:740] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.030488 16667 raft_consensus.cc:2468] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:44.027246 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ec89af83a842909ba5e19282a9e12d" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:44.033742 16559 leader_election.cc:304] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:44.034726 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95064ed3f05a4169a3ff0f2123274cb7" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:44.036404 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ec89af83a842909ba5e19282a9e12d" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
W20260709 12:29:44.050580 16633 leader_election.cc:343] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:44.037057 16415 catalog_manager.cc:5697] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 0 to 1, leader changed from <none> to cd924581228b49d889b0e1553519722a (127.8.111.68). New cstate: current_term: 1 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:44.045994 17078 raft_consensus.cc:2749] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:44.034191 16741 raft_consensus.cc:3060] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.031988 16790 consensus_queue.cc:260] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:44.054787 16854 raft_consensus.cc:2804] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:44.055236 16854 raft_consensus.cc:697] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:44.055290 16786 consensus_queue.cc:260] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:44.056195 16740 raft_consensus.cc:3060] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.056102 16854 consensus_queue.cc:237] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:44.062649 16630 leader_election.cc:304] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
W20260709 12:29:44.063889 16630 leader_election.cc:343] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:44.064272 16740 raft_consensus.cc:2468] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:44.064327 16630 leader_election.cc:304] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:44.065207 16997 raft_consensus.cc:2749] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:44.065752 17080 raft_consensus.cc:2749] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:44.048661 16787 tablet_bootstrap.cc:492] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:44.078397 16787 ts_tablet_manager.cc:1403] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.079s	user 0.006s	sys 0.023s
I20260709 12:29:44.086841 16788 tablet_bootstrap.cc:492] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:44.087327 16788 ts_tablet_manager.cc:1403] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.084s	user 0.007s	sys 0.011s
I20260709 12:29:44.090814 16786 ts_tablet_manager.cc:1434] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.137s	user 0.007s	sys 0.000s
I20260709 12:29:44.091719 16786 tablet_bootstrap.cc:492] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:44.094801 16790 ts_tablet_manager.cc:1434] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.114s	user 0.005s	sys 0.002s
I20260709 12:29:44.095594 16790 tablet_bootstrap.cc:492] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:44.107385 17047 consensus_queue.cc:1048] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:44.112821 17047 consensus_queue.cc:1048] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:44.098417 16741 raft_consensus.cc:2468] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:44.126464 16413 catalog_manager.cc:5697] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:44.140316 16631 leader_election.cc:304] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:44.141952 17078 raft_consensus.cc:2804] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:44.142661 17078 raft_consensus.cc:697] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:29:44.138545 16787 raft_consensus.cc:359] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:44.145769 16787 raft_consensus.cc:385] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.146157 16787 raft_consensus.cc:740] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.143730 17078 consensus_queue.cc:237] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:44.148387 16787 consensus_queue.cc:260] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:44.156243 16790 tablet_bootstrap.cc:654] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.157400 16972 consensus_queue.cc:1048] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:44.162063 16786 tablet_bootstrap.cc:654] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.163473 16788 raft_consensus.cc:359] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:44.164062 16788 raft_consensus.cc:385] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.164294 16788 raft_consensus.cc:740] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.167632 16788 consensus_queue.cc:260] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:44.174746 16788 ts_tablet_manager.cc:1434] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.001s
I20260709 12:29:44.175648 16788 tablet_bootstrap.cc:492] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:44.180087 16787 ts_tablet_manager.cc:1434] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.101s	user 0.007s	sys 0.001s
I20260709 12:29:44.181185 16787 tablet_bootstrap.cc:492] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
W20260709 12:29:44.266077 17089 log.cc:927] Time spent T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6: Append to log took a long time: real 0.072s	user 0.003s	sys 0.003s
I20260709 12:29:44.279671 16787 tablet_bootstrap.cc:654] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.279762 16788 tablet_bootstrap.cc:654] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.291077 16790 tablet_bootstrap.cc:492] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:44.291592 16790 ts_tablet_manager.cc:1403] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.196s	user 0.011s	sys 0.009s
I20260709 12:29:44.292269 17097 raft_consensus.cc:493] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:44.292924 17097 raft_consensus.cc:515] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:44.295679 17097 leader_election.cc:290] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:44.304376 17047 consensus_queue.cc:1048] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:44.320402 16786 tablet_bootstrap.cc:492] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:44.321096 16786 ts_tablet_manager.cc:1403] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.230s	user 0.014s	sys 0.003s
I20260709 12:29:44.323127 17080 raft_consensus.cc:493] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:44.323850 17080 raft_consensus.cc:515] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:44.325209 16786 raft_consensus.cc:359] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:44.334671 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:44.335505 16667 raft_consensus.cc:2468] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
W20260709 12:29:44.334461 17093 log.cc:927] Time spent T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6: Append to log took a long time: real 0.070s	user 0.004s	sys 0.000s
I20260709 12:29:44.326120 16786 raft_consensus.cc:385] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.352504 16786 raft_consensus.cc:740] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.352246 16415 catalog_manager.cc:5697] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:44.354012 16786 consensus_queue.cc:260] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:44.377099 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932859a73dad4a39b5874461e99676cc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:44.377918 16589 raft_consensus.cc:2468] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
I20260709 12:29:44.382097 16843 raft_consensus.cc:493] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:44.382766 16843 raft_consensus.cc:515] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:44.386636 16843 leader_election.cc:290] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:44.386528 16971 consensus_queue.cc:1048] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:44.390210 16736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:44.394973 16736 raft_consensus.cc:2468] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:44.395350 17099 consensus_queue.cc:1048] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:29:44.395675 16991 raft_consensus.cc:493] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:44.396443 17080 leader_election.cc:290] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:44.396653 16991 raft_consensus.cc:515] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:44.390621 16854 consensus_queue.cc:1048] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:29:44.399559 16991 leader_election.cc:290] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:44.407145 16786 ts_tablet_manager.cc:1434] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.003s
I20260709 12:29:44.412758 16786 tablet_bootstrap.cc:492] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:44.415796 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932859a73dad4a39b5874461e99676cc" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:44.415956 16971 consensus_queue.cc:1048] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:44.416610 16666 raft_consensus.cc:2468] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 0.
I20260709 12:29:44.418180 17097 consensus_queue.cc:1048] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:44.423432 16559 leader_election.cc:304] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:44.411352 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:44.426996 16973 raft_consensus.cc:493] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:44.437708 16854 raft_consensus.cc:2804] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:44.431075 17096 consensus_queue.cc:1048] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:29:44.454180 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932859a73dad4a39b5874461e99676cc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:44.447463 16973 raft_consensus.cc:515] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:44.449436 16854 raft_consensus.cc:493] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:44.447096 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932859a73dad4a39b5874461e99676cc" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:44.581948 16854 raft_consensus.cc:3060] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:44.582124 16591 raft_consensus.cc:2468] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 0.
I20260709 12:29:44.583165 16788 tablet_bootstrap.cc:492] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:44.439169 16630 leader_election.cc:304] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
W20260709 12:29:44.551860 17089 log.cc:927] Time spent T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:29:44.583732 16788 ts_tablet_manager.cc:1403] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.408s	user 0.022s	sys 0.040s
I20260709 12:29:44.603281 16787 tablet_bootstrap.cc:492] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:44.603715 16787 ts_tablet_manager.cc:1403] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.423s	user 0.042s	sys 0.035s
I20260709 12:29:44.605643 16787 raft_consensus.cc:359] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:44.606129 16787 raft_consensus.cc:385] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.607506 16787 raft_consensus.cc:740] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.608044 16786 tablet_bootstrap.cc:654] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.608192 16787 consensus_queue.cc:260] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:44.613260 16788 raft_consensus.cc:359] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:44.613989 16788 raft_consensus.cc:385] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.583830 16741 raft_consensus.cc:2468] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
I20260709 12:29:44.614257 16788 raft_consensus.cc:740] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.617769 16788 consensus_queue.cc:260] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:44.620296 16790 raft_consensus.cc:359] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:44.621074 16790 raft_consensus.cc:385] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.621337 16790 raft_consensus.cc:740] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.621990 16790 consensus_queue.cc:260] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:44.599048 17080 raft_consensus.cc:2804] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:44.596536 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
W20260709 12:29:44.596864 16630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 164373us
I20260709 12:29:44.631822 16788 ts_tablet_manager.cc:1434] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.043s	user 0.003s	sys 0.003s
I20260709 12:29:44.627408 16787 ts_tablet_manager.cc:1434] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 12:29:44.633576 16787 tablet_bootstrap.cc:492] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:44.625134 17080 raft_consensus.cc:493] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:44.648077 17080 raft_consensus.cc:3060] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.637458 16737 raft_consensus.cc:2468] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
W20260709 12:29:44.663872 16481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 210224us
I20260709 12:29:44.648640 17100 raft_consensus.cc:493] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:44.683620 16788 tablet_bootstrap.cc:492] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:44.692577 16973 leader_election.cc:290] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:44.693576 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:44.694260 16590 raft_consensus.cc:2468] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 0.
I20260709 12:29:44.695386 16481 leader_election.cc:304] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:44.682363 16704 leader_election.cc:304] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:44.706327 16793 raft_consensus.cc:2804] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:44.706707 16793 raft_consensus.cc:493] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:44.707034 16793 raft_consensus.cc:3060] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.707808 16787 tablet_bootstrap.cc:654] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.760033 16790 ts_tablet_manager.cc:1434] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.468s	user 0.019s	sys 0.029s
W20260709 12:29:44.711463 16630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 72098.8us
I20260709 12:29:44.761808 16790 tablet_bootstrap.cc:492] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:44.711094 16971 consensus_queue.cc:1048] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
W20260709 12:29:44.730306 16484 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:33625, user_credentials={real_user=slave}} blocked reactor thread for 122997us
I20260709 12:29:44.798007 16787 tablet_bootstrap.cc:492] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:44.798700 16787 ts_tablet_manager.cc:1403] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.165s	user 0.019s	sys 0.021s
I20260709 12:29:44.800101 17114 consensus_queue.cc:1048] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:29:44.715790 17100 raft_consensus.cc:515] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:44.760332 17113 raft_consensus.cc:2804] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:44.834308 17113 raft_consensus.cc:493] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:44.873555 16787 raft_consensus.cc:359] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
W20260709 12:29:44.835564 16704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 70420us
I20260709 12:29:44.875806 17113 raft_consensus.cc:3060] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.851557 16854 raft_consensus.cc:515] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:44.880275 16788 tablet_bootstrap.cc:654] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.843240 17116 raft_consensus.cc:493] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:44.881376 16787 raft_consensus.cc:385] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.894379 16787 raft_consensus.cc:740] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.896054 16787 consensus_queue.cc:260] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:44.845206 17080 raft_consensus.cc:515] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:44.849020 16793 raft_consensus.cc:515] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:44.906917 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:44.915068 16786 tablet_bootstrap.cc:492] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:44.915547 16786 ts_tablet_manager.cc:1403] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.504s	user 0.009s	sys 0.011s
I20260709 12:29:44.916646 17080 leader_election.cc:290] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:44.917600 16790 tablet_bootstrap.cc:654] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:44.918061 16786 raft_consensus.cc:359] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:44.928481 16786 raft_consensus.cc:385] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:44.928748 16786 raft_consensus.cc:740] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:44.929416 16786 consensus_queue.cc:260] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:44.897183 17116 raft_consensus.cc:515] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:44.911633 16854 leader_election.cc:290] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:44.931469 16663 raft_consensus.cc:3060] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:44.952997 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:44.937830 17116 leader_election.cc:290] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:44.939764 17080 raft_consensus.cc:493] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:44.962617 17080 raft_consensus.cc:515] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:44.963928 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932859a73dad4a39b5874461e99676cc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:44.964532 16589 raft_consensus.cc:3060] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.966007 17100 leader_election.cc:290] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:44.968418 16793 leader_election.cc:290] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:44.970778 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95064ed3f05a4169a3ff0f2123274cb7" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:44.971403 16660 raft_consensus.cc:2468] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 0.
I20260709 12:29:44.971606 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:44.972194 16737 raft_consensus.cc:3060] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:44.975986 16484 leader_election.cc:304] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:29:44.976908 17049 raft_consensus.cc:2804] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:44.977283 17049 raft_consensus.cc:493] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:44.977632 17049 raft_consensus.cc:3060] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:44.978591 16786 ts_tablet_manager.cc:1434] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.003s
I20260709 12:29:44.983546 16786 tablet_bootstrap.cc:492] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:44.993834 17113 raft_consensus.cc:515] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
W20260709 12:29:44.939893 16707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:33625, user_credentials={real_user=slave}} blocked reactor thread for 88718.4us
W20260709 12:29:45.008409 16633 consensus_peers.cc:597] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:45.008759 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95064ed3f05a4169a3ff0f2123274cb7" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:45.009429 16659 raft_consensus.cc:2468] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:45.011410 16559 leader_election.cc:304] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:45.036921 16787 ts_tablet_manager.cc:1434] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.238s	user 0.041s	sys 0.068s
I20260709 12:29:45.028076 16854 raft_consensus.cc:2804] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:44.933980 17128 consensus_queue.cc:1048] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.048s
I20260709 12:29:45.037352 16737 raft_consensus.cc:2468] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 2.
I20260709 12:29:45.048897 16854 raft_consensus.cc:493] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:45.048177 16704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 113077us
I20260709 12:29:45.090812 16854 raft_consensus.cc:3060] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.122756 16991 raft_consensus.cc:493] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:45.123346 16991 raft_consensus.cc:515] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:45.161742 16991 leader_election.cc:290] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:45.165319 16786 tablet_bootstrap.cc:654] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:45.090535 16630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 53773.2us
I20260709 12:29:45.190534 16738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:45.191298 16738 raft_consensus.cc:2468] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 0.
I20260709 12:29:45.182890 16854 raft_consensus.cc:515] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:45.194882 16734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:45.195294 16854 leader_election.cc:290] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:45.163754 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932859a73dad4a39b5874461e99676cc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:45.195866 16734 raft_consensus.cc:2468] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 0.
I20260709 12:29:45.196493 16739 raft_consensus.cc:2393] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 99ca36f8a50c459388f31022b1455ed6 in current term 1: Already voted for candidate cd924581228b49d889b0e1553519722a in this term.
I20260709 12:29:45.197438 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:45.198256 16733 raft_consensus.cc:3060] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.210873 16788 tablet_bootstrap.cc:492] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:45.211413 16788 ts_tablet_manager.cc:1403] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.541s	user 0.021s	sys 0.012s
I20260709 12:29:45.208375 16557 leader_election.cc:304] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:45.223053 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95064ed3f05a4169a3ff0f2123274cb7" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:45.223716 16661 raft_consensus.cc:3060] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.225226 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ce8db6ce4ee6bfef51b5c677c3ba" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:45.227694 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932859a73dad4a39b5874461e99676cc" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:45.232836 16663 raft_consensus.cc:2468] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 2.
I20260709 12:29:45.235668 16589 raft_consensus.cc:2468] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:45.240994 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932859a73dad4a39b5874461e99676cc" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:45.241892 16666 raft_consensus.cc:2393] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a in current term 1: Already voted for candidate 99ca36f8a50c459388f31022b1455ed6 in this term.
I20260709 12:29:45.236434 16787 tablet_bootstrap.cc:492] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:45.253512 17080 leader_election.cc:290] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
W20260709 12:29:45.236344 16707 consensus_peers.cc:597] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:45.236856 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95064ed3f05a4169a3ff0f2123274cb7" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:45.237190 17049 raft_consensus.cc:515] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:45.230342 16971 raft_consensus.cc:2804] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:29:45.263361 16559 leader_election.cc:343] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:45.222199 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ce8db6ce4ee6bfef51b5c677c3ba" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
W20260709 12:29:45.283275 16633 leader_election.cc:343] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:45.289327 16733 raft_consensus.cc:2468] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:29:45.290601 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eef363dbdce4d7bbd0b446385d8eb9e" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:45.282863 16971 raft_consensus.cc:697] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:45.291687 16509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eef363dbdce4d7bbd0b446385d8eb9e" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:45.292480 16971 consensus_queue.cc:237] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
W20260709 12:29:45.294965 16630 leader_election.cc:343] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:45.296962 16633 leader_election.cc:343] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:45.301105 16790 tablet_bootstrap.cc:492] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:45.299504 16511 raft_consensus.cc:2393] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99ca36f8a50c459388f31022b1455ed6 in current term 1: Already voted for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in this term.
I20260709 12:29:45.295450 16630 leader_election.cc:304] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:45.307302 16630 leader_election.cc:304] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:45.301913 16790 ts_tablet_manager.cc:1403] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.540s	user 0.019s	sys 0.012s
I20260709 12:29:45.310456 17049 leader_election.cc:290] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:45.314879 16631 leader_election.cc:304] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:45.319293 16997 raft_consensus.cc:2804] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:45.319733 16997 raft_consensus.cc:493] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:45.320152 16997 raft_consensus.cc:3060] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.313243 16787 tablet_bootstrap.cc:654] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:45.285400 17113 leader_election.cc:290] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:45.329520 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:45.330217 16589 raft_consensus.cc:3060] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.314220 17080 raft_consensus.cc:2749] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:45.314844 17134 raft_consensus.cc:2804] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:45.316465 16661 raft_consensus.cc:2468] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:45.317682 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:45.313035 16790 raft_consensus.cc:359] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:45.309995 16788 raft_consensus.cc:359] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:45.339004 16788 raft_consensus.cc:385] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.339354 16788 raft_consensus.cc:740] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
W20260709 12:29:45.331013 16559 leader_election.cc:343] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:45.340824 16790 raft_consensus.cc:385] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.341235 16790 raft_consensus.cc:740] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:45.379588 16790 consensus_queue.cc:260] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:45.385645 16790 ts_tablet_manager.cc:1434] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.075s	user 0.004s	sys 0.002s
I20260709 12:29:45.387318 16788 consensus_queue.cc:260] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
W20260709 12:29:45.381764 16707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:33625, user_credentials={real_user=slave}} blocked reactor thread for 53430.9us
W20260709 12:29:45.383984 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 45314.3us
I20260709 12:29:45.410866 16788 ts_tablet_manager.cc:1434] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.199s	user 0.005s	sys 0.001s
I20260709 12:29:45.412915 16788 tablet_bootstrap.cc:492] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:45.416308 16787 tablet_bootstrap.cc:492] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:45.416816 16787 ts_tablet_manager.cc:1403] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.181s	user 0.023s	sys 0.021s
I20260709 12:29:45.416659 17091 consensus_queue.cc:1048] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:45.420071 16997 raft_consensus.cc:515] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:45.420610 16787 raft_consensus.cc:359] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:45.421638 16787 raft_consensus.cc:385] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.421989 16787 raft_consensus.cc:740] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
W20260709 12:29:45.416745 16631 leader_election.cc:343] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:45.422688 16666 raft_consensus.cc:2393] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in current term 1: Already voted for candidate 99ca36f8a50c459388f31022b1455ed6 in this term.
W20260709 12:29:45.387174 16704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 62752.1us
I20260709 12:29:45.394299 17134 raft_consensus.cc:697] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:29:45.441727 16704 leader_election.cc:304] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:45.422899 16787 consensus_queue.cc:260] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:45.442675 16843 raft_consensus.cc:2749] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:45.426838 16631 leader_election.cc:304] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:29:45.447947 17113 raft_consensus.cc:493] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:29:45.422246 16997 leader_election.cc:290] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:45.448571 17113 raft_consensus.cc:515] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:45.455724 16559 leader_election.cc:304] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:45.460340 16787 ts_tablet_manager.cc:1434] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.001s
I20260709 12:29:45.459867 17114 raft_consensus.cc:2804] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:45.473963 17114 raft_consensus.cc:697] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:45.475222 17114 consensus_queue.cc:237] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:45.456089 16991 raft_consensus.cc:2749] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:45.482169 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:45.486992 17113 leader_election.cc:290] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
W20260709 12:29:45.464607 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 47891.2us
I20260709 12:29:45.490948 16589 raft_consensus.cc:2468] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:29:45.493642 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:45.497738 16733 raft_consensus.cc:3060] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:45.517431 16463 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:45.527827 16481 leader_election.cc:304] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:45.533720 16790 tablet_bootstrap.cc:492] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:45.535110 16511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59670 (request call id 69) took 1131 ms. Trace:
I20260709 12:29:45.535576 16511 rpcz_store.cc:276] 0709 12:29:44.403531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:29:44.404753 (+  1222us) service_pool.cc:224] Handling call
0709 12:29:44.991354 (+586601us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540046ef28. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f942f95f4 00007f2f934e2227 00007f2f934e1ab8 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6
0709 12:29:45.534927 (+543573us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54003a8754. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:29:45.535052 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1015337472}
I20260709 12:29:45.537580 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ad2867ed594d4794807e95f2994f46" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:45.539372 17113 raft_consensus.cc:2804] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:45.539885 17113 raft_consensus.cc:697] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:29:45.540729 17113 consensus_queue.cc:237] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:45.495958 17134 consensus_queue.cc:237] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:45.547819 16787 tablet_bootstrap.cc:492] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:45.561578 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:45.562907 16788 tablet_bootstrap.cc:654] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:45.589669 16790 tablet_bootstrap.cc:654] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:45.604598 16733 raft_consensus.cc:2468] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:45.606387 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ad2867ed594d4794807e95f2994f46" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:45.607234 16631 leader_election.cc:304] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:45.607990 16482 leader_election.cc:304] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a
I20260709 12:29:45.609150 16482 leader_election.cc:304] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:29:45.609890 17080 raft_consensus.cc:2804] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:45.610611 17080 raft_consensus.cc:697] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:29:45.610728 17116 raft_consensus.cc:2749] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:45.614982 17049 raft_consensus.cc:2749] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:45.615329 17080 consensus_queue.cc:237] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:45.610809 16786 tablet_bootstrap.cc:492] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:45.618582 16786 ts_tablet_manager.cc:1403] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.638s	user 0.023s	sys 0.068s
I20260709 12:29:45.630486 16787 tablet_bootstrap.cc:654] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:45.632380 16786 raft_consensus.cc:359] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:45.633397 16786 raft_consensus.cc:385] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.633750 16786 raft_consensus.cc:740] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:45.663360 16786 consensus_queue.cc:260] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:45.664433 16787 tablet_bootstrap.cc:492] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:45.664959 16787 ts_tablet_manager.cc:1403] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.117s	user 0.008s	sys 0.005s
I20260709 12:29:45.665946 16786 ts_tablet_manager.cc:1434] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:29:45.667037 16786 tablet_bootstrap.cc:492] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:45.667732 16787 raft_consensus.cc:359] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:45.668640 16787 raft_consensus.cc:385] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.668919 16787 raft_consensus.cc:740] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:45.669570 16787 consensus_queue.cc:260] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:45.672573 16787 ts_tablet_manager.cc:1434] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:29:45.673897 16786 tablet_bootstrap.cc:654] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:45.683220 16788 tablet_bootstrap.cc:492] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:45.683755 16788 ts_tablet_manager.cc:1403] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.271s	user 0.009s	sys 0.003s
I20260709 12:29:45.684191 16787 tablet_bootstrap.cc:492] T 75800960202940669b8d3541a84fdb28 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:45.685418 16416 catalog_manager.cc:5697] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:45.690845 16787 tablet_bootstrap.cc:654] T 75800960202940669b8d3541a84fdb28 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:45.690327 16790 tablet_bootstrap.cc:492] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:45.691531 16790 ts_tablet_manager.cc:1403] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.158s	user 0.012s	sys 0.004s
I20260709 12:29:45.694221 16790 raft_consensus.cc:359] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:45.695384 16788 raft_consensus.cc:359] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:45.696861 16788 raft_consensus.cc:385] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.697116 16788 raft_consensus.cc:740] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:45.697794 16788 consensus_queue.cc:260] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:45.698637 16790 raft_consensus.cc:385] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.699008 16790 raft_consensus.cc:740] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:45.699721 16790 consensus_queue.cc:260] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:45.700248 16788 ts_tablet_manager.cc:1434] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:29:45.700734 16786 tablet_bootstrap.cc:492] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:45.700551 16787 tablet_bootstrap.cc:492] T 75800960202940669b8d3541a84fdb28 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:45.701280 16788 tablet_bootstrap.cc:492] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:45.701382 16786 ts_tablet_manager.cc:1403] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.035s	user 0.004s	sys 0.009s
I20260709 12:29:45.701408 16787 ts_tablet_manager.cc:1403] T 75800960202940669b8d3541a84fdb28 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 12:29:45.702683 16790 ts_tablet_manager.cc:1434] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:29:45.704659 16790 tablet_bootstrap.cc:492] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:45.706108 16786 raft_consensus.cc:359] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:45.706863 16786 raft_consensus.cc:385] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.708649 16786 raft_consensus.cc:740] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:45.709692 16786 consensus_queue.cc:260] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:45.704528 16787 raft_consensus.cc:359] T 75800960202940669b8d3541a84fdb28 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:45.710615 16787 raft_consensus.cc:385] T 75800960202940669b8d3541a84fdb28 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.710919 16787 raft_consensus.cc:740] T 75800960202940669b8d3541a84fdb28 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:45.711591 16787 consensus_queue.cc:260] T 75800960202940669b8d3541a84fdb28 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:45.713681 16787 ts_tablet_manager.cc:1434] T 75800960202940669b8d3541a84fdb28 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.003s
I20260709 12:29:45.715178 16787 tablet_bootstrap.cc:492] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:45.716063 16786 ts_tablet_manager.cc:1434] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 12:29:45.716454 16788 tablet_bootstrap.cc:654] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:45.717161 16786 tablet_bootstrap.cc:492] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:45.723409 16787 tablet_bootstrap.cc:654] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:45.726076 16790 tablet_bootstrap.cc:654] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:45.726666 17108 raft_consensus.cc:493] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:45.727259 17108 raft_consensus.cc:515] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:45.729959 16786 tablet_bootstrap.cc:654] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:45.731398 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95064ed3f05a4169a3ff0f2123274cb7" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:45.732296 16666 raft_consensus.cc:2393] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in current term 1: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
I20260709 12:29:45.734750 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95064ed3f05a4169a3ff0f2123274cb7" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:45.735626 17108 leader_election.cc:290] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:45.737583 16481 leader_election.cc:304] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:45.739215 17134 raft_consensus.cc:493] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:45.741146 17134 raft_consensus.cc:515] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:45.743686 17134 leader_election.cc:290] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:45.744417 17108 raft_consensus.cc:3060] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.746657 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c73b3d790842ed9389c18ddb50e3c1" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
W20260709 12:29:45.753444 16630 leader_election.cc:343] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:45.761598 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c73b3d790842ed9389c18ddb50e3c1" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
W20260709 12:29:45.763391 16631 leader_election.cc:343] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:45.763871 16631 leader_election.cc:304] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:29:45.765497 17080 raft_consensus.cc:2749] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:45.768507 16788 tablet_bootstrap.cc:492] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:45.769047 16788 ts_tablet_manager.cc:1403] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.002s
I20260709 12:29:45.771564 16790 tablet_bootstrap.cc:492] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:45.771878 16741 raft_consensus.cc:1275] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:45.772063 16790 ts_tablet_manager.cc:1403] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.068s	user 0.019s	sys 0.025s
I20260709 12:29:45.773494 17114 consensus_queue.cc:1048] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:45.773916 16787 tablet_bootstrap.cc:492] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:45.775226 16787 ts_tablet_manager.cc:1403] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.032s
I20260709 12:29:45.774986 16790 raft_consensus.cc:359] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:45.777180 17108 raft_consensus.cc:2749] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:45.778415 16787 raft_consensus.cc:359] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:45.779256 16787 raft_consensus.cc:385] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.779619 16787 raft_consensus.cc:740] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:45.780692 16787 consensus_queue.cc:260] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:45.771850 16788 raft_consensus.cc:359] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:45.782096 16788 raft_consensus.cc:385] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.782378 16788 raft_consensus.cc:740] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:45.782804 16790 raft_consensus.cc:385] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.783129 16790 raft_consensus.cc:740] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:45.783754 16790 consensus_queue.cc:260] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:45.785710 16787 ts_tablet_manager.cc:1434] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:29:45.785867 16790 ts_tablet_manager.cc:1434] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:29:45.787739 16790 tablet_bootstrap.cc:492] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:45.789630 16788 consensus_queue.cc:260] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:45.792850 16788 ts_tablet_manager.cc:1434] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:29:45.793839 16788 tablet_bootstrap.cc:492] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:45.795615 16790 tablet_bootstrap.cc:654] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:45.799644 16787 tablet_bootstrap.cc:492] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:45.801441 16786 tablet_bootstrap.cc:492] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:45.801921 16786 ts_tablet_manager.cc:1403] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.085s	user 0.008s	sys 0.004s
I20260709 12:29:45.805959 16665 raft_consensus.cc:1275] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:45.809238 17095 consensus_queue.cc:1048] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:45.816490 17134 raft_consensus.cc:493] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:45.817112 17134 raft_consensus.cc:515] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:45.819723 17134 leader_election.cc:290] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:45.822196 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cf6ac39c0248398e411dcce49bf021" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
W20260709 12:29:45.823711 16630 leader_election.cc:343] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:45.823469 16786 raft_consensus.cc:359] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:45.824469 16786 raft_consensus.cc:385] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.824819 16786 raft_consensus.cc:740] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:45.825868 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cf6ac39c0248398e411dcce49bf021" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:45.825708 16786 consensus_queue.cc:260] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
W20260709 12:29:45.827512 16633 leader_election.cc:343] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:45.830381 16633 leader_election.cc:304] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:45.831725 16786 ts_tablet_manager.cc:1434] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:29:45.831954 17080 raft_consensus.cc:2749] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:45.833009 16786 tablet_bootstrap.cc:492] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:45.844437 16787 tablet_bootstrap.cc:654] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:45.846762 16788 tablet_bootstrap.cc:654] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:45.857872 16412 catalog_manager.cc:5697] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 2, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:45.859999 16790 tablet_bootstrap.cc:492] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:45.859596 16412 catalog_manager.cc:5697] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:45.860517 16790 ts_tablet_manager.cc:1403] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.073s	user 0.024s	sys 0.017s
I20260709 12:29:45.865957 17140 raft_consensus.cc:493] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:45.866536 16790 raft_consensus.cc:359] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:45.867338 16790 raft_consensus.cc:385] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.866488 17140 raft_consensus.cc:515] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:45.867724 16790 raft_consensus.cc:740] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:45.869390 17140 leader_election.cc:290] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:45.869745 16790 consensus_queue.cc:260] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:45.870967 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75800960202940669b8d3541a84fdb28" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:45.872082 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75800960202940669b8d3541a84fdb28" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:45.872718 16666 raft_consensus.cc:2468] T 75800960202940669b8d3541a84fdb28 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 0.
I20260709 12:29:45.871258 16786 tablet_bootstrap.cc:654] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:45.873875 16707 leader_election.cc:343] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:45.874960 16790 ts_tablet_manager.cc:1434] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:29:45.878409 16790 tablet_bootstrap.cc:492] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:45.874861 16707 leader_election.cc:304] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:45.879323 17130 raft_consensus.cc:2804] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:45.879693 17130 raft_consensus.cc:493] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:45.880002 17130 raft_consensus.cc:3060] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.884480 16790 tablet_bootstrap.cc:654] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:45.889616 17130 raft_consensus.cc:515] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:45.894869 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75800960202940669b8d3541a84fdb28" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:45.895432 16659 raft_consensus.cc:3060] T 75800960202940669b8d3541a84fdb28 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.898015 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75800960202940669b8d3541a84fdb28" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
W20260709 12:29:45.900197 16707 leader_election.cc:343] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:45.902645 17114 raft_consensus.cc:493] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:45.903148 17114 raft_consensus.cc:515] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:45.903813 16659 raft_consensus.cc:2468] T 75800960202940669b8d3541a84fdb28 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 1.
I20260709 12:29:45.905583 17114 leader_election.cc:290] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:45.907416 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ce8db6ce4ee6bfef51b5c677c3ba" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:45.908218 16517 raft_consensus.cc:2468] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:45.908485 16788 tablet_bootstrap.cc:492] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:45.909039 16788 ts_tablet_manager.cc:1403] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.115s	user 0.014s	sys 0.000s
I20260709 12:29:45.909674 16559 leader_election.cc:304] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:45.910691 17114 raft_consensus.cc:2804] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:45.911123 17114 raft_consensus.cc:493] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:45.911545 17114 raft_consensus.cc:3060] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.911710 17130 leader_election.cc:290] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:45.906301 16707 leader_election.cc:304] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:45.915210 16787 tablet_bootstrap.cc:492] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:45.923236 17130 raft_consensus.cc:2804] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:45.924408 17130 raft_consensus.cc:697] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:29:45.911564 16788 raft_consensus.cc:359] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:45.922683 16413 catalog_manager.cc:5697] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 0 to 1, leader changed from <none> to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 1 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:45.925559 16788 raft_consensus.cc:385] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.926129 16787 ts_tablet_manager.cc:1403] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.127s	user 0.007s	sys 0.010s
I20260709 12:29:45.926703 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ce8db6ce4ee6bfef51b5c677c3ba" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:45.927340 16659 raft_consensus.cc:2468] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:45.925863 16788 raft_consensus.cc:740] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:45.930379 16787 raft_consensus.cc:359] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:45.931339 16787 raft_consensus.cc:385] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:45.931619 16787 raft_consensus.cc:740] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:45.932561 16787 consensus_queue.cc:260] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:45.934810 17130 consensus_queue.cc:237] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:45.936926 16787 ts_tablet_manager.cc:1434] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:29:45.937868 16787 tablet_bootstrap.cc:492] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:45.944006 16787 tablet_bootstrap.cc:654] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:45.945591 16788 consensus_queue.cc:260] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:45.948208 16788 ts_tablet_manager.cc:1434] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:29:45.949258 16788 tablet_bootstrap.cc:492] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:45.953831 16972 raft_consensus.cc:493] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:45.956595 16972 raft_consensus.cc:515] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:45.961197 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1966b49831ff47a3ba7263b77ac4e86b" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:45.961879 16733 raft_consensus.cc:2468] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:45.964097 16557 leader_election.cc:304] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:45.965303 17095 raft_consensus.cc:2804] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:45.965687 17095 raft_consensus.cc:493] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:45.967519 17095 raft_consensus.cc:3060] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:45.968608 16415 catalog_manager.cc:5697] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:45.971957 17134 consensus_queue.cc:1048] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:45.989436 16972 leader_election.cc:290] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:45.989663 16790 tablet_bootstrap.cc:492] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:45.990231 16790 ts_tablet_manager.cc:1403] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.112s	user 0.021s	sys 0.017s
I20260709 12:29:46.000612 16790 raft_consensus.cc:359] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:45.993891 16788 tablet_bootstrap.cc:654] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:46.001665 16790 raft_consensus.cc:385] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:46.002123 16790 raft_consensus.cc:740] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:46.005191 16790 consensus_queue.cc:260] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:46.010317 16790 ts_tablet_manager.cc:1434] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.002s
I20260709 12:29:46.011358 16790 tablet_bootstrap.cc:492] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:46.002723 17146 raft_consensus.cc:493] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:46.022228 17120 consensus_queue.cc:1048] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:46.024596 16787 tablet_bootstrap.cc:492] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:46.025084 16787 ts_tablet_manager.cc:1403] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.087s	user 0.018s	sys 0.010s
I20260709 12:29:46.029340 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1966b49831ff47a3ba7263b77ac4e86b" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:46.029991 16518 raft_consensus.cc:2468] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:46.019826 16517 raft_consensus.cc:3060] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:46.047771 17132 consensus_queue.cc:1048] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:46.048786 16786 tablet_bootstrap.cc:492] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:46.049346 16786 ts_tablet_manager.cc:1403] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.217s	user 0.048s	sys 0.030s
I20260709 12:29:46.020803 17146 raft_consensus.cc:515] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:46.052045 16972 raft_consensus.cc:493] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:46.057317 16972 raft_consensus.cc:515] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:46.043434 17108 consensus_queue.cc:1048] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:29:46.060971 16787 raft_consensus.cc:359] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:46.061766 16787 raft_consensus.cc:385] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:46.062068 16787 raft_consensus.cc:740] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:46.062616 17146 leader_election.cc:290] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:46.062412 17114 raft_consensus.cc:515] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:46.062793 16787 consensus_queue.cc:260] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:46.063069 17095 raft_consensus.cc:515] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:46.064718 17095 leader_election.cc:290] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:46.064646 17114 leader_election.cc:290] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:46.065111 16787 ts_tablet_manager.cc:1434] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.040s	user 0.002s	sys 0.003s
I20260709 12:29:46.066009 16972 leader_election.cc:290] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:46.066336 16787 tablet_bootstrap.cc:492] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:46.070645 16790 tablet_bootstrap.cc:654] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:46.129657 16415 catalog_manager.cc:5697] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 0 to 1, leader changed from <none> to cd924581228b49d889b0e1553519722a (127.8.111.68). New cstate: current_term: 1 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:46.151257 16787 tablet_bootstrap.cc:654] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:46.152297 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425340b667774e9083a7c360e90ff2e5" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:46.165081 17049 raft_consensus.cc:493] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:46.153669 16661 raft_consensus.cc:2468] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:46.191637 17140 raft_consensus.cc:493] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:46.165935 17049 raft_consensus.cc:515] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:46.192531 17140 raft_consensus.cc:515] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:46.193243 16790 tablet_bootstrap.cc:492] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:46.194203 16790 ts_tablet_manager.cc:1403] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.183s	user 0.006s	sys 0.024s
I20260709 12:29:46.151285 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ce8db6ce4ee6bfef51b5c677c3ba" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:46.219707 17120 raft_consensus.cc:493] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:46.220656 17120 raft_consensus.cc:515] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:46.242642 16659 raft_consensus.cc:3060] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:46.243177 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ce8db6ce4ee6bfef51b5c677c3ba" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:46.244253 16513 raft_consensus.cc:3060] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:46.270335 17095 raft_consensus.cc:493] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:46.271397 17095 raft_consensus.cc:515] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:46.286758 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eef363dbdce4d7bbd0b446385d8eb9e" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:46.248973 17140 leader_election.cc:290] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:46.291242 16659 raft_consensus.cc:2468] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:46.329744 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53516641dc3421cac583bbe728f6e14" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:46.330582 17120 leader_election.cc:290] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:46.332593 16787 tablet_bootstrap.cc:492] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:46.340601 17049 leader_election.cc:290] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:46.338018 16512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425340b667774e9083a7c360e90ff2e5" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
W20260709 12:29:46.349030 16707 leader_election.cc:343] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:46.361537 16633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:36499, user_credentials={real_user=slave}} blocked reactor thread for 45418.5us
I20260709 12:29:46.370224 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eef363dbdce4d7bbd0b446385d8eb9e" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:46.371142 16661 raft_consensus.cc:2468] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 0.
I20260709 12:29:46.236948 16790 raft_consensus.cc:359] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:46.372489 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ec89af83a842909ba5e19282a9e12d" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:46.374420 16790 raft_consensus.cc:385] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:46.379324 16790 raft_consensus.cc:740] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:46.352571 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1966b49831ff47a3ba7263b77ac4e86b" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:46.392172 16559 leader_election.cc:304] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:46.394088 16790 consensus_queue.cc:260] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:46.396847 16512 raft_consensus.cc:2468] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:46.397145 16787 ts_tablet_manager.cc:1403] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.331s	user 0.023s	sys 0.027s
I20260709 12:29:46.398559 16559 leader_election.cc:304] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:46.398991 16971 raft_consensus.cc:2804] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:46.399434 16971 raft_consensus.cc:493] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:46.399730 16790 ts_tablet_manager.cc:1434] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.205s	user 0.006s	sys 0.005s
I20260709 12:29:46.400339 17118 raft_consensus.cc:2804] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:46.400990 17118 raft_consensus.cc:697] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:46.401158 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425340b667774e9083a7c360e90ff2e5" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:46.382556 17095 leader_election.cc:290] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:46.406339 17118 consensus_queue.cc:237] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:46.407773 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c73b3d790842ed9389c18ddb50e3c1" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
W20260709 12:29:46.408459 16630 leader_election.cc:343] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:46.381801 17120 raft_consensus.cc:493] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:46.399780 16971 raft_consensus.cc:3060] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:46.401201 16787 raft_consensus.cc:359] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:46.427603 16787 raft_consensus.cc:385] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:46.427904 16787 raft_consensus.cc:740] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:46.426793 16511 raft_consensus.cc:3060] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:46.420635 17120 raft_consensus.cc:515] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:46.427021 16739 raft_consensus.cc:3060] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:46.440703 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c73b3d790842ed9389c18ddb50e3c1" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:46.441316 16510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425340b667774e9083a7c360e90ff2e5" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:46.441581 16663 raft_consensus.cc:2468] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:46.442600 16514 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1966b49831ff47a3ba7263b77ac4e86b" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:46.443518 16514 raft_consensus.cc:3060] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:46.445076 17108 consensus_queue.cc:1048] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 12:29:46.438868 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ec89af83a842909ba5e19282a9e12d" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:46.445484 16786 raft_consensus.cc:359] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:46.446177 16790 tablet_bootstrap.cc:492] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:46.455888 16786 raft_consensus.cc:385] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:46.456297 16786 raft_consensus.cc:740] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
W20260709 12:29:46.479980 16557 leader_election.cc:343] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:46.480623 16557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 46018.3us
I20260709 12:29:46.462663 16787 consensus_queue.cc:260] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:46.484138 16786 consensus_queue.cc:260] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:46.506531 17120 leader_election.cc:290] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:46.508870 16513 raft_consensus.cc:2468] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:46.512233 16739 raft_consensus.cc:2468] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:46.510995 16971 raft_consensus.cc:515] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:46.514479 16593 raft_consensus.cc:2393] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99ca36f8a50c459388f31022b1455ed6 in current term 1: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
I20260709 12:29:46.516925 16971 leader_election.cc:290] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:46.519057 16786 ts_tablet_manager.cc:1434] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.469s	user 0.009s	sys 0.003s
I20260709 12:29:46.527218 17080 consensus_queue.cc:1048] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:46.539902 16482 leader_election.cc:304] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a
I20260709 12:29:46.541714 16786 tablet_bootstrap.cc:492] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:46.544979 16790 tablet_bootstrap.cc:654] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:46.588129 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425340b667774e9083a7c360e90ff2e5" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:46.588959 16664 raft_consensus.cc:3060] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:46.594740 16515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19834ede0784553865ac5c4cd1024f0" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:46.595088 16788 tablet_bootstrap.cc:492] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:46.602835 16788 ts_tablet_manager.cc:1403] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.654s	user 0.009s	sys 0.013s
I20260709 12:29:46.602720 16630 leader_election.cc:304] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:46.606760 16788 raft_consensus.cc:359] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:46.609625 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425340b667774e9083a7c360e90ff2e5" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:46.612972 16514 raft_consensus.cc:2468] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:46.615072 16787 ts_tablet_manager.cc:1434] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.217s	user 0.003s	sys 0.006s
I20260709 12:29:46.618993 16788 raft_consensus.cc:385] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:46.620568 16788 raft_consensus.cc:740] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:46.622797 16518 raft_consensus.cc:3060] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:46.631352 16633 leader_election.cc:343] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:46.630252 16788 consensus_queue.cc:260] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:46.663430 16559 leader_election.cc:304] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: cd924581228b49d889b0e1553519722a
I20260709 12:29:46.661432 16557 leader_election.cc:304] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:46.653137 17118 consensus_queue.cc:1048] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
W20260709 12:29:46.679684 17200 log.cc:927] Time spent T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:29:46.680648 16664 raft_consensus.cc:2468] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:46.682101 16788 ts_tablet_manager.cc:1434] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.079s	user 0.015s	sys 0.009s
I20260709 12:29:46.683451 16788 tablet_bootstrap.cc:492] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:46.684221 16786 tablet_bootstrap.cc:654] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:46.686892 16787 tablet_bootstrap.cc:492] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
W20260709 12:29:46.691031 16557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 50441.2us
I20260709 12:29:46.688814 17146 raft_consensus.cc:2749] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:46.699066 17206 raft_consensus.cc:2804] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:46.699553 17206 raft_consensus.cc:493] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:46.699939 17206 raft_consensus.cc:3060] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:46.725994 16788 tablet_bootstrap.cc:654] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:46.729426 16707 leader_election.cc:304] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:46.732445 16790 tablet_bootstrap.cc:492] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:46.733006 16790 ts_tablet_manager.cc:1403] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.287s	user 0.024s	sys 0.007s
I20260709 12:29:46.745078 17201 raft_consensus.cc:2804] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:46.745836 17201 raft_consensus.cc:697] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:46.748083 17134 raft_consensus.cc:493] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:46.748656 17134 raft_consensus.cc:515] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
W20260709 12:29:46.750248 17159 log.cc:927] Time spent T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6: Append to log took a long time: real 0.155s	user 0.002s	sys 0.000s
I20260709 12:29:46.752424 17134 leader_election.cc:290] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:46.754073 17201 consensus_queue.cc:237] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:46.758960 16787 tablet_bootstrap.cc:654] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:46.805879 16559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:33625, user_credentials={real_user=slave}} blocked reactor thread for 133622us
I20260709 12:29:46.819756 16790 raft_consensus.cc:359] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:46.820555 16790 raft_consensus.cc:385] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:46.820801 16790 raft_consensus.cc:740] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
W20260709 12:29:46.827903 16704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 46360.7us
I20260709 12:29:46.829129 17190 raft_consensus.cc:2804] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:46.829610 17190 raft_consensus.cc:493] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:46.830008 17190 raft_consensus.cc:3060] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:46.831864 16481 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 61181.3us
I20260709 12:29:46.832861 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53516641dc3421cac583bbe728f6e14" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:46.833527 16740 raft_consensus.cc:2468] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
W20260709 12:29:46.835875 17205 log.cc:927] Time spent T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:29:46.843135 16413 catalog_manager.cc:5697] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:46.855794 16790 consensus_queue.cc:260] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:46.862221 16559 leader_election.cc:304] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:46.863600 16790 ts_tablet_manager.cc:1434] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.130s	user 0.008s	sys 0.000s
I20260709 12:29:46.864806 16790 tablet_bootstrap.cc:492] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:46.865314 17097 raft_consensus.cc:2804] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:46.865867 17097 raft_consensus.cc:697] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:46.846616 17206 raft_consensus.cc:515] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:46.866874 17097 consensus_queue.cc:237] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:46.869889 17113 raft_consensus.cc:2749] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:46.827087 16518 raft_consensus.cc:2468] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:46.857074 16786 tablet_bootstrap.cc:492] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:46.883435 16786 ts_tablet_manager.cc:1403] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.342s	user 0.030s	sys 0.021s
I20260709 12:29:46.913815 16788 tablet_bootstrap.cc:492] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:46.914404 16788 ts_tablet_manager.cc:1403] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.231s	user 0.026s	sys 0.014s
I20260709 12:29:46.922092 16786 raft_consensus.cc:359] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:46.924840 16788 raft_consensus.cc:359] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:46.925554 16788 raft_consensus.cc:385] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:46.925841 16788 raft_consensus.cc:740] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:46.926028 17206 leader_election.cc:290] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:46.926432 16786 raft_consensus.cc:385] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:46.927147 16786 raft_consensus.cc:740] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:46.927949 17212 raft_consensus.cc:493] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:46.928463 17212 raft_consensus.cc:515] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:46.931109 17212 leader_election.cc:290] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:46.931869 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c73b3d790842ed9389c18ddb50e3c1" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:46.932520 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eef363dbdce4d7bbd0b446385d8eb9e" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:46.941146 16788 consensus_queue.cc:260] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:46.943054 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39b696cc72749608ab54eae0a99b093" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:46.943712 16788 ts_tablet_manager.cc:1434] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.029s	user 0.001s	sys 0.004s
I20260709 12:29:46.944643 16788 tablet_bootstrap.cc:492] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:46.947544 16786 consensus_queue.cc:260] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:46.932538 16659 raft_consensus.cc:3060] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:46.926882 17190 raft_consensus.cc:515] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:46.951086 16658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eef363dbdce4d7bbd0b446385d8eb9e" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:46.963824 16658 raft_consensus.cc:2468] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 0.
I20260709 12:29:46.951747 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c73b3d790842ed9389c18ddb50e3c1" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:46.964051 16740 raft_consensus.cc:2393] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in current term 1: Already voted for candidate cd924581228b49d889b0e1553519722a in this term.
I20260709 12:29:46.966233 16484 leader_election.cc:304] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:29:46.967128 17212 raft_consensus.cc:2804] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:46.967536 17212 raft_consensus.cc:493] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:46.967855 17212 raft_consensus.cc:3060] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:46.968607 16557 leader_election.cc:343] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:46.970343 17190 leader_election.cc:290] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:46.975320 17212 raft_consensus.cc:515] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:46.979380 16658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eef363dbdce4d7bbd0b446385d8eb9e" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:46.979984 16658 raft_consensus.cc:3060] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:46.983541 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eef363dbdce4d7bbd0b446385d8eb9e" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:46.984362 16739 raft_consensus.cc:2393] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in current term 1: Already voted for candidate cd924581228b49d889b0e1553519722a in this term.
I20260709 12:29:46.986887 17212 leader_election.cc:290] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:46.988809 16786 ts_tablet_manager.cc:1434] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.105s	user 0.004s	sys 0.006s
I20260709 12:29:46.998265 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39b696cc72749608ab54eae0a99b093" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:47.001641 16631 leader_election.cc:304] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:47.003360 17134 raft_consensus.cc:2804] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:47.003774 17134 raft_consensus.cc:493] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:47.004122 17134 raft_consensus.cc:3060] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:47.005334 16790 tablet_bootstrap.cc:654] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:46.952944 16463 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:46.990185 16786 tablet_bootstrap.cc:492] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
W20260709 12:29:47.043535 16707 consensus_peers.cc:597] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:47.038149 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eef363dbdce4d7bbd0b446385d8eb9e" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:47.047724 17114 raft_consensus.cc:493] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:47.048301 17114 raft_consensus.cc:515] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:47.033061 16659 raft_consensus.cc:2468] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:47.055864 17114 leader_election.cc:290] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:47.048883 16658 raft_consensus.cc:2468] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:29:47.058616 16484 leader_election.cc:304] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: cd924581228b49d889b0e1553519722a
I20260709 12:29:47.060145 17212 raft_consensus.cc:2804] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:47.049034 17095 consensus_queue.cc:1048] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:29:47.060730 17212 raft_consensus.cc:697] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:29:47.061966 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60b7bf1ed30467e9437c2b078e41808" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:47.062734 17207 consensus_queue.cc:1048] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:47.064466 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60b7bf1ed30467e9437c2b078e41808" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:47.061650 17212 consensus_queue.cc:237] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:47.045737 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eef363dbdce4d7bbd0b446385d8eb9e" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:47.066829 16971 raft_consensus.cc:493] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:47.042153 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19834ede0784553865ac5c4cd1024f0" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:47.068086 16787 tablet_bootstrap.cc:492] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
W20260709 12:29:47.067268 16559 leader_election.cc:343] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:47.075490 16787 ts_tablet_manager.cc:1403] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.389s	user 0.012s	sys 0.008s
W20260709 12:29:47.075634 16557 leader_election.cc:343] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:47.075868 16559 leader_election.cc:304] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: cd924581228b49d889b0e1553519722a
I20260709 12:29:47.081947 16788 tablet_bootstrap.cc:654] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:47.074892 16971 raft_consensus.cc:515] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:47.095016 16971 leader_election.cc:290] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:47.095783 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53516641dc3421cac583bbe728f6e14" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:47.098780 16786 tablet_bootstrap.cc:654] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:47.100486 16707 leader_election.cc:304] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:47.108889 17214 raft_consensus.cc:2804] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:47.109537 17214 raft_consensus.cc:697] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:47.109380 17195 consensus_queue.cc:1048] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:29:47.111617 17214 consensus_queue.cc:237] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:47.116941 17134 raft_consensus.cc:515] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:47.103190 17190 raft_consensus.cc:2749] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:47.129729 16661 raft_consensus.cc:2393] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f5ebf768d584b17897ebb5b4575ece5 in current term 1: Already voted for candidate 99ca36f8a50c459388f31022b1455ed6 in this term.
I20260709 12:29:47.133090 16557 leader_election.cc:304] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
W20260709 12:29:47.133994 16557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 59695.4us
I20260709 12:29:47.135234 17097 raft_consensus.cc:2749] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:47.138495 16787 raft_consensus.cc:359] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:47.139321 16787 raft_consensus.cc:385] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:47.144490 16790 tablet_bootstrap.cc:492] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:47.144980 16790 ts_tablet_manager.cc:1403] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.280s	user 0.005s	sys 0.019s
I20260709 12:29:47.151504 16787 raft_consensus.cc:740] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:47.152674 16787 consensus_queue.cc:260] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:47.154341 16790 raft_consensus.cc:359] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:47.155053 16790 raft_consensus.cc:385] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:47.155406 16790 raft_consensus.cc:740] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:47.133942 17134 leader_election.cc:290] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
W20260709 12:29:47.100256 16630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 48824.5us
W20260709 12:29:47.158478 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 81466.4us
W20260709 12:29:47.159248 16631 leader_election.cc:343] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:47.160362 16631 leader_election.cc:343] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:47.160327 17187 consensus_queue.cc:1048] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:47.160908 16631 leader_election.cc:304] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:29:47.157769 16790 consensus_queue.cc:260] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
W20260709 12:29:47.162070 16630 leader_election.cc:343] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:47.163792 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53516641dc3421cac583bbe728f6e14" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:47.164435 16740 raft_consensus.cc:2468] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:47.179203 16557 leader_election.cc:304] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:47.180178 17146 raft_consensus.cc:2749] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:47.162593 16630 leader_election.cc:304] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:29:47.194721 16790 ts_tablet_manager.cc:1434] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.002s
I20260709 12:29:47.196460 17207 raft_consensus.cc:2804] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:47.196879 17207 raft_consensus.cc:493] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:47.197227 17207 raft_consensus.cc:3060] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:47.204722 16790 tablet_bootstrap.cc:492] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:47.207657 17134 raft_consensus.cc:2749] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:47.221555 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53516641dc3421cac583bbe728f6e14" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:47.222227 16741 raft_consensus.cc:3060] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:47.233522 16788 tablet_bootstrap.cc:492] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:47.233968 16788 ts_tablet_manager.cc:1403] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.290s	user 0.009s	sys 0.014s
I20260709 12:29:47.234549 16787 ts_tablet_manager.cc:1434] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.159s	user 0.008s	sys 0.001s
I20260709 12:29:47.231051 17134 raft_consensus.cc:493] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:47.229975 16630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 67953.6us
I20260709 12:29:47.273231 16788 raft_consensus.cc:359] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:47.274032 16788 raft_consensus.cc:385] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:47.236886 17095 consensus_queue.cc:1048] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:29:47.253933 17134 raft_consensus.cc:515] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:47.296402 17134 leader_election.cc:290] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:47.278748 16787 tablet_bootstrap.cc:492] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6: Bootstrap starting.
I20260709 12:29:47.283038 17207 raft_consensus.cc:515] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:47.288797 16790 tablet_bootstrap.cc:654] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:47.299501 16788 raft_consensus.cc:740] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:47.298981 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:47.302461 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
W20260709 12:29:47.320775 16633 leader_election.cc:343] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:47.332540 16741 raft_consensus.cc:2468] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:47.339319 16788 consensus_queue.cc:260] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:47.366659 16788 ts_tablet_manager.cc:1434] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.132s	user 0.005s	sys 0.004s
W20260709 12:29:47.356609 16631 leader_election.cc:343] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:47.368288 16631 leader_election.cc:304] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:29:47.369215 17238 raft_consensus.cc:2749] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:47.370232 16631 leader_election.cc:304] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:47.371099 17238 raft_consensus.cc:2804] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:47.389796 16790 tablet_bootstrap.cc:492] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:47.390410 16790 ts_tablet_manager.cc:1403] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.186s	user 0.017s	sys 0.003s
I20260709 12:29:47.375269 17206 consensus_queue.cc:1048] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:29:47.382433 17238 raft_consensus.cc:697] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:29:47.395614 17238 consensus_queue.cc:237] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:47.396965 16786 tablet_bootstrap.cc:492] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:47.397511 16786 ts_tablet_manager.cc:1403] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.408s	user 0.025s	sys 0.023s
I20260709 12:29:47.391743 17219 consensus_queue.cc:1048] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:29:47.389741 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53516641dc3421cac583bbe728f6e14" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:47.399765 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53516641dc3421cac583bbe728f6e14" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:47.400168 16790 raft_consensus.cc:359] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:47.400718 16592 raft_consensus.cc:2393] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 99ca36f8a50c459388f31022b1455ed6 in current term 1: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
I20260709 12:29:47.400379 16786 raft_consensus.cc:359] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:47.400990 16790 raft_consensus.cc:385] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:47.401191 16786 raft_consensus.cc:385] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:47.401659 16786 raft_consensus.cc:740] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:47.394040 16788 tablet_bootstrap.cc:492] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:47.401345 16790 raft_consensus.cc:740] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:47.402621 16790 consensus_queue.cc:260] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:47.404098 17207 leader_election.cc:290] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:47.404887 16790 ts_tablet_manager.cc:1434] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:29:47.406252 16790 tablet_bootstrap.cc:492] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:47.408233 16788 tablet_bootstrap.cc:654] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:47.408074 17223 raft_consensus.cc:493] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:47.409636 17223 raft_consensus.cc:515] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:47.413225 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
W20260709 12:29:47.414688 16704 leader_election.cc:343] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:47.416311 16790 tablet_bootstrap.cc:654] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:47.392714 16412 catalog_manager.cc:5697] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 0 to 1, leader changed from <none> to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 1 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:47.408901 16787 tablet_bootstrap.cc:654] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:47.424063 16786 consensus_queue.cc:260] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:47.425209 17095 consensus_queue.cc:1048] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:47.425420 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53516641dc3421cac583bbe728f6e14" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:47.426350 16741 raft_consensus.cc:2393] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f5ebf768d584b17897ebb5b4575ece5 in current term 1: Already voted for candidate 99ca36f8a50c459388f31022b1455ed6 in this term.
I20260709 12:29:47.426896 16786 ts_tablet_manager.cc:1434] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 12:29:47.427301 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:47.427642 16557 leader_election.cc:304] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a
I20260709 12:29:47.428261 16786 tablet_bootstrap.cc:492] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:47.428494 17095 raft_consensus.cc:2749] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:29:47.430567 16707 leader_election.cc:343] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:47.431033 16707 leader_election.cc:304] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
W20260709 12:29:47.443429 17248 log.cc:927] Time spent T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:29:47.432322 17190 raft_consensus.cc:2749] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:47.431377 17223 leader_election.cc:290] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:47.467185 16786 tablet_bootstrap.cc:654] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:47.475382 16413 catalog_manager.cc:5697] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:47.486694 16413 catalog_manager.cc:5697] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:47.489219 16413 catalog_manager.cc:5697] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:47.500500 16788 tablet_bootstrap.cc:492] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:47.508600 16788 ts_tablet_manager.cc:1403] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.125s	user 0.007s	sys 0.011s
I20260709 12:29:47.511773 16788 raft_consensus.cc:359] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:47.512471 16788 raft_consensus.cc:385] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:47.512737 16788 raft_consensus.cc:740] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:47.513392 16788 consensus_queue.cc:260] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:47.515638 16788 ts_tablet_manager.cc:1434] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:29:47.516649 16788 tablet_bootstrap.cc:492] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:47.523026 16788 tablet_bootstrap.cc:654] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:47.536327 16790 tablet_bootstrap.cc:492] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:47.536839 16790 ts_tablet_manager.cc:1403] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.131s	user 0.026s	sys 0.021s
I20260709 12:29:47.550371 17219 consensus_queue.cc:1048] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:47.561452 16790 raft_consensus.cc:359] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:47.562207 16790 raft_consensus.cc:385] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:47.562887 16790 raft_consensus.cc:740] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:47.563580 16790 consensus_queue.cc:260] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:47.565083 16790 ts_tablet_manager.cc:1434] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.000s
I20260709 12:29:47.566094 16790 tablet_bootstrap.cc:492] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:47.568903 16787 tablet_bootstrap.cc:492] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6: No bootstrap required, opened a new log
I20260709 12:29:47.569404 16787 ts_tablet_manager.cc:1403] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6: Time spent bootstrapping tablet: real 0.291s	user 0.014s	sys 0.002s
I20260709 12:29:47.591531 16786 tablet_bootstrap.cc:492] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:47.592133 16786 ts_tablet_manager.cc:1403] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.164s	user 0.015s	sys 0.000s
I20260709 12:29:47.596526 16786 raft_consensus.cc:359] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:47.597546 16786 raft_consensus.cc:385] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:47.600046 16786 raft_consensus.cc:740] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:47.601121 16786 consensus_queue.cc:260] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:47.599709 16788 tablet_bootstrap.cc:492] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:47.604321 16788 ts_tablet_manager.cc:1403] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.088s	user 0.011s	sys 0.018s
I20260709 12:29:47.605994 16786 ts_tablet_manager.cc:1434] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:29:47.602325 16790 tablet_bootstrap.cc:654] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:47.607348 16786 tablet_bootstrap.cc:492] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:47.609127 17049 raft_consensus.cc:493] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:47.609766 17049 raft_consensus.cc:515] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:47.605963 16741 raft_consensus.cc:3060] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:47.612413 17049 leader_election.cc:290] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:47.615419 16786 tablet_bootstrap.cc:654] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:47.619731 16788 raft_consensus.cc:359] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:47.620599 16788 raft_consensus.cc:385] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:47.620914 16788 raft_consensus.cc:740] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:47.621810 16788 consensus_queue.cc:260] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:47.582219 16787 raft_consensus.cc:359] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:47.622886 16787 raft_consensus.cc:385] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:47.623193 16787 raft_consensus.cc:740] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Initialized, Role: FOLLOWER
I20260709 12:29:47.624305 16788 ts_tablet_manager.cc:1434] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:29:47.625502 16788 tablet_bootstrap.cc:492] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:47.623970 16787 consensus_queue.cc:260] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:47.628818 16787 ts_tablet_manager.cc:1434] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6: Time spent starting tablet: real 0.059s	user 0.009s	sys 0.000s
I20260709 12:29:47.629310 16790 tablet_bootstrap.cc:492] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:47.629842 16790 ts_tablet_manager.cc:1403] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.001s
I20260709 12:29:47.632799 16790 raft_consensus.cc:359] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:47.636723 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cf6ac39c0248398e411dcce49bf021" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:47.637565 16659 raft_consensus.cc:2468] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 0.
I20260709 12:29:47.633493 16790 raft_consensus.cc:385] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:47.638480 16790 raft_consensus.cc:740] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:47.645488 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cf6ac39c0248398e411dcce49bf021" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:47.646222 16590 raft_consensus.cc:2468] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 0.
I20260709 12:29:47.645401 17212 consensus_queue.cc:1048] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:29:47.648423 16484 leader_election.cc:304] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:29:47.649530 17212 raft_consensus.cc:2804] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:47.649945 17212 raft_consensus.cc:493] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:47.650539 16790 consensus_queue.cc:260] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:47.651476 17212 raft_consensus.cc:3060] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:47.652200 16788 tablet_bootstrap.cc:654] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:47.655344 16790 ts_tablet_manager.cc:1434] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 12:29:47.656517 16790 tablet_bootstrap.cc:492] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:47.667016 16790 tablet_bootstrap.cc:654] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:47.677529 17212 raft_consensus.cc:515] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:47.697711 17226 raft_consensus.cc:493] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:47.699235 17114 consensus_queue.cc:1048] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:47.708402 17226 raft_consensus.cc:515] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:47.719220 17226 leader_election.cc:290] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:47.720557 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60b7bf1ed30467e9437c2b078e41808" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:47.721529 16511 raft_consensus.cc:2468] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 0.
I20260709 12:29:47.722847 16788 tablet_bootstrap.cc:492] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:47.722671 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60b7bf1ed30467e9437c2b078e41808" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:47.723014 16707 leader_election.cc:304] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:47.723434 16788 ts_tablet_manager.cc:1403] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.098s	user 0.018s	sys 0.006s
I20260709 12:29:47.723508 16590 raft_consensus.cc:2468] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 0.
I20260709 12:29:47.724686 17195 raft_consensus.cc:2804] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:47.725164 17195 raft_consensus.cc:493] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:47.726622 17195 raft_consensus.cc:3060] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:47.730161 17212 leader_election.cc:290] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:47.735621 16790 tablet_bootstrap.cc:492] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:47.736199 16790 ts_tablet_manager.cc:1403] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.008s
I20260709 12:29:47.736428 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cf6ac39c0248398e411dcce49bf021" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:47.736958 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cf6ac39c0248398e411dcce49bf021" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:47.737668 16665 raft_consensus.cc:3060] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:47.737093 16590 raft_consensus.cc:3060] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:47.739236 16790 raft_consensus.cc:359] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:47.746766 16790 raft_consensus.cc:385] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:47.747088 16790 raft_consensus.cc:740] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:47.742175 16788 raft_consensus.cc:359] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:47.749296 16788 raft_consensus.cc:385] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:47.749604 16788 raft_consensus.cc:740] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:47.750392 16788 consensus_queue.cc:260] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:47.751920 16790 consensus_queue.cc:260] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:47.754312 16790 ts_tablet_manager.cc:1434] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:29:47.755501 16790 tablet_bootstrap.cc:492] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:47.755949 17195 raft_consensus.cc:515] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:47.759065 16511 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60b7bf1ed30467e9437c2b078e41808" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:47.759703 16511 raft_consensus.cc:3060] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:47.761366 16788 ts_tablet_manager.cc:1434] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:29:47.765051 16788 tablet_bootstrap.cc:492] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5: Bootstrap starting.
I20260709 12:29:47.773195 16790 tablet_bootstrap.cc:654] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:47.773588 17049 consensus_queue.cc:1048] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:47.790922 16788 tablet_bootstrap.cc:654] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:47.795553 16665 raft_consensus.cc:2468] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:29:47.802026 17049 raft_consensus.cc:493] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:47.818717 17049 raft_consensus.cc:515] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:47.821023 17049 leader_election.cc:290] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:47.821792 16658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:47.822500 16658 raft_consensus.cc:2468] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 0.
I20260709 12:29:47.823400 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:47.823539 16484 leader_election.cc:304] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:29:47.824539 17049 raft_consensus.cc:2804] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:29:47.824796 16482 leader_election.cc:343] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:47.824932 17049 raft_consensus.cc:493] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:47.825284 17049 raft_consensus.cc:3060] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:47.804479 16590 raft_consensus.cc:2468] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:29:47.804798 16786 tablet_bootstrap.cc:492] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:47.835232 16786 ts_tablet_manager.cc:1403] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.228s	user 0.057s	sys 0.072s
I20260709 12:29:47.809046 16788 tablet_bootstrap.cc:492] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5: No bootstrap required, opened a new log
I20260709 12:29:47.840023 16788 ts_tablet_manager.cc:1403] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.001s
I20260709 12:29:47.839845 16484 leader_election.cc:304] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:29:47.843288 16788 raft_consensus.cc:359] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:47.844087 16788 raft_consensus.cc:385] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:47.844509 16788 raft_consensus.cc:740] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Initialized, Role: FOLLOWER
I20260709 12:29:47.845505 16788 consensus_queue.cc:260] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:47.848553 17212 raft_consensus.cc:2804] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:47.849109 17212 raft_consensus.cc:697] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:29:47.853870 17095 raft_consensus.cc:493] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:47.854432 17095 raft_consensus.cc:515] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:47.857569 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39b696cc72749608ab54eae0a99b093" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:47.858497 16416 catalog_manager.cc:5697] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:47.859236 16557 leader_election.cc:343] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:47.861593 17095 leader_election.cc:290] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:47.843809 16786 raft_consensus.cc:359] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:47.867108 16786 raft_consensus.cc:385] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:47.850021 17212 consensus_queue.cc:237] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:47.867486 16786 raft_consensus.cc:740] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:47.863441 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39b696cc72749608ab54eae0a99b093" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:47.878893 16788 ts_tablet_manager.cc:1434] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 12:29:47.881170 16786 consensus_queue.cc:260] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:47.867158 17049 raft_consensus.cc:515] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:47.893839 16786 ts_tablet_manager.cc:1434] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.001s
I20260709 12:29:47.868419 16659 raft_consensus.cc:2468] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:47.877027 16511 raft_consensus.cc:2468] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 1.
I20260709 12:29:47.907936 16559 leader_election.cc:304] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: cd924581228b49d889b0e1553519722a
I20260709 12:29:47.916914 16786 tablet_bootstrap.cc:492] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:47.925825 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60b7bf1ed30467e9437c2b078e41808" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:47.927469 16590 raft_consensus.cc:3060] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:47.917929 17206 raft_consensus.cc:2804] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:47.930382 17206 raft_consensus.cc:493] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:47.930718 17206 raft_consensus.cc:3060] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:47.920166 17195 leader_election.cc:290] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:47.955857 17207 raft_consensus.cc:493] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:47.986047 17274 raft_consensus.cc:493] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:47.986670 17274 raft_consensus.cc:515] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:47.987303 16707 leader_election.cc:304] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:47.988178 17195 raft_consensus.cc:2804] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:47.988724 17195 raft_consensus.cc:697] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:29:47.997089 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:47.997957 16740 raft_consensus.cc:2468] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 0.
W20260709 12:29:47.999038 16559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:36499, user_credentials={real_user=slave}} blocked reactor thread for 69435.8us
I20260709 12:29:47.999241 16482 leader_election.cc:304] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:47.992419 17080 raft_consensus.cc:493] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:47.982868 17207 raft_consensus.cc:515] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:48.035892 16786 tablet_bootstrap.cc:654] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:48.036573 16790 tablet_bootstrap.cc:492] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:48.037107 16790 ts_tablet_manager.cc:1403] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.282s	user 0.057s	sys 0.047s
I20260709 12:29:48.012578 17080 raft_consensus.cc:515] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:48.043092 17080 leader_election.cc:290] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:48.044106 17270 raft_consensus.cc:2804] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:48.044315 16590 raft_consensus.cc:2468] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 1.
I20260709 12:29:48.044559 17270 raft_consensus.cc:493] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:48.045004 17270 raft_consensus.cc:3060] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:48.047523 17226 raft_consensus.cc:493] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:48.048020 17226 raft_consensus.cc:515] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:48.052613 17207 leader_election.cc:290] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:48.032452 17049 leader_election.cc:290] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:48.050205 17226 leader_election.cc:290] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
W20260709 12:29:48.055567 16557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 124473us
I20260709 12:29:48.032007 17273 raft_consensus.cc:493] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:48.064123 16482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 64929us
I20260709 12:29:48.072276 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:48.072885 16740 raft_consensus.cc:3060] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:48.075223 16513 raft_consensus.cc:3060] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:48.079237 17238 consensus_queue.cc:1048] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:48.081453 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:48.082093 16665 raft_consensus.cc:3060] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:48.084275 16740 raft_consensus.cc:2468] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:29:48.094170 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1765c0523b546c198e7a014b0866bbc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:48.031808 17195 consensus_queue.cc:237] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:48.100960 16790 raft_consensus.cc:359] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:48.101801 16790 raft_consensus.cc:385] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:48.102373 16790 raft_consensus.cc:740] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:48.105888 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a084469fa354084b2130b4656a965d1" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:48.072032 17273 raft_consensus.cc:515] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:48.111937 17273 leader_election.cc:290] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:48.116923 16790 consensus_queue.cc:260] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:48.146341 17274 leader_election.cc:290] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:48.149081 17206 raft_consensus.cc:515] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:48.152966 17206 leader_election.cc:290] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:48.153090 17270 raft_consensus.cc:515] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:48.164309 16658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39b696cc72749608ab54eae0a99b093" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:48.165158 16658 raft_consensus.cc:3060] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:48.167570 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1765c0523b546c198e7a014b0866bbc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:48.168118 16592 raft_consensus.cc:2468] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 0.
I20260709 12:29:48.141496 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1765c0523b546c198e7a014b0866bbc" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:48.171094 16659 raft_consensus.cc:2468] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:48.174858 16559 leader_election.cc:304] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:48.175700 17095 raft_consensus.cc:2804] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:48.176113 17095 raft_consensus.cc:493] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:48.176508 17095 raft_consensus.cc:3060] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:48.181468 16630 leader_election.cc:304] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:48.182492 17187 raft_consensus.cc:2804] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:48.182884 17187 raft_consensus.cc:493] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:48.183262 17187 raft_consensus.cc:3060] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:48.185686 16790 ts_tablet_manager.cc:1434] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.148s	user 0.007s	sys 0.004s
I20260709 12:29:48.187137 16790 tablet_bootstrap.cc:492] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:48.191884 16517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a084469fa354084b2130b4656a965d1" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:48.192587 16517 raft_consensus.cc:2468] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 0.
I20260709 12:29:48.193578 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1765c0523b546c198e7a014b0866bbc" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:48.193857 17270 leader_election.cc:290] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:48.134702 16482 leader_election.cc:304] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
W20260709 12:29:48.195217 16482 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 60622.1us
I20260709 12:29:48.198082 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:48.198761 16741 raft_consensus.cc:3060] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:48.199445 16665 raft_consensus.cc:2468] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:29:48.209324 17277 raft_consensus.cc:2804] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:48.210119 17277 raft_consensus.cc:697] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
W20260709 12:29:48.211140 16463 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:48.211405 17277 consensus_queue.cc:237] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
W20260709 12:29:48.212364 16633 leader_election.cc:343] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:48.213079 17187 raft_consensus.cc:515] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:48.215287 17095 raft_consensus.cc:515] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:48.217594 17095 leader_election.cc:290] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:48.220599 17187 leader_election.cc:290] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:48.229370 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1765c0523b546c198e7a014b0866bbc" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:48.282958 16658 raft_consensus.cc:2468] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:48.285240 16790 tablet_bootstrap.cc:654] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:48.295126 17187 consensus_queue.cc:1048] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:48.295733 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:48.290904 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1765c0523b546c198e7a014b0866bbc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:48.298899 16559 leader_election.cc:304] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:48.302466 16741 raft_consensus.cc:2468] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:29:48.302639 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39b696cc72749608ab54eae0a99b093" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:48.307168 17275 raft_consensus.cc:2804] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:48.307603 17275 raft_consensus.cc:493] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:48.307925 17275 raft_consensus.cc:3060] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:48.311800 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1765c0523b546c198e7a014b0866bbc" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:48.312399 16590 raft_consensus.cc:2393] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 99ca36f8a50c459388f31022b1455ed6 in current term 1: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
I20260709 12:29:48.312611 16661 raft_consensus.cc:2393] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f5ebf768d584b17897ebb5b4575ece5 in current term 1: Already voted for candidate 99ca36f8a50c459388f31022b1455ed6 in this term.
I20260709 12:29:48.314564 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:48.315364 16659 raft_consensus.cc:2393] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a in current term 1: Already voted for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in this term.
I20260709 12:29:48.315951 17276 raft_consensus.cc:493] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:48.316258 16786 tablet_bootstrap.cc:492] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:48.316738 16786 ts_tablet_manager.cc:1403] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.402s	user 0.028s	sys 0.028s
I20260709 12:29:48.316417 17276 raft_consensus.cc:515] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:48.318058 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1765c0523b546c198e7a014b0866bbc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:48.318614 17276 leader_election.cc:290] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:48.319382 16482 leader_election.cc:304] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:48.327430 17272 raft_consensus.cc:2804] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:48.327977 17272 raft_consensus.cc:697] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:29:48.328507 16707 leader_election.cc:304] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:48.328897 17272 consensus_queue.cc:237] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
W20260709 12:29:48.342626 16559 leader_election.cc:343] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:48.343568 16559 leader_election.cc:343] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:48.325500 17275 raft_consensus.cc:515] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
W20260709 12:29:48.342665 16633 leader_election.cc:343] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:48.341941 16786 raft_consensus.cc:359] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:48.345561 16786 raft_consensus.cc:385] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:48.345871 16786 raft_consensus.cc:740] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:48.346534 17275 leader_election.cc:290] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:48.346794 16786 consensus_queue.cc:260] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:48.352455 16790 tablet_bootstrap.cc:492] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:48.352933 16790 ts_tablet_manager.cc:1403] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.166s	user 0.012s	sys 0.001s
I20260709 12:29:48.353957 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:48.354684 16592 raft_consensus.cc:2468] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 0.
I20260709 12:29:48.355543 16630 leader_election.cc:304] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:48.356076 16790 raft_consensus.cc:359] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:48.356741 17187 raft_consensus.cc:2749] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:48.356945 16415 catalog_manager.cc:5697] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 0 to 1, leader changed from <none> to cd924581228b49d889b0e1553519722a (127.8.111.68). New cstate: current_term: 1 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:48.356746 16790 raft_consensus.cc:385] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:48.361305 16790 raft_consensus.cc:740] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:48.361984 16790 consensus_queue.cc:260] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:48.362315 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:48.363030 16592 raft_consensus.cc:3060] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:48.367695 16557 leader_election.cc:343] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:48.368188 17223 raft_consensus.cc:2749] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:48.374363 17271 raft_consensus.cc:493] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:29:48.379303 17271 raft_consensus.cc:515] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:48.382261 16790 ts_tablet_manager.cc:1434] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:29:48.375032 16518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:48.384284 16416 catalog_manager.cc:5697] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 0 to 1, leader changed from <none> to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 1 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:48.387635 16416 catalog_manager.cc:5697] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 0 to 1, leader changed from <none> to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 1 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:48.393002 17271 leader_election.cc:290] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:48.394138 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75800960202940669b8d3541a84fdb28" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:48.394712 16786 ts_tablet_manager.cc:1434] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.000s
W20260709 12:29:48.394202 16557 leader_election.cc:343] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:48.396221 16786 tablet_bootstrap.cc:492] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:48.393030 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75800960202940669b8d3541a84fdb28" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:48.399170 16484 leader_election.cc:304] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a
I20260709 12:29:48.400580 17271 raft_consensus.cc:2749] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:48.404210 16592 raft_consensus.cc:2468] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:29:48.411077 16559 leader_election.cc:304] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: cd924581228b49d889b0e1553519722a
I20260709 12:29:48.417935 17275 raft_consensus.cc:2804] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:48.418460 17275 raft_consensus.cc:697] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:48.426643 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:48.427500 16735 raft_consensus.cc:2393] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f5ebf768d584b17897ebb5b4575ece5 in current term 1: Already voted for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in this term.
I20260709 12:29:48.419248 17275 consensus_queue.cc:237] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:48.430446 16786 tablet_bootstrap.cc:654] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:48.437199 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a084469fa354084b2130b4656a965d1" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:48.443579 16559 leader_election.cc:304] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:48.444371 17214 raft_consensus.cc:2749] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:48.444833 17271 consensus_queue.cc:1048] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:48.445930 16786 tablet_bootstrap.cc:492] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:48.447649 16786 ts_tablet_manager.cc:1403] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.002s
I20260709 12:29:48.450589 16786 raft_consensus.cc:359] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:48.451328 16786 raft_consensus.cc:385] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:48.451610 16786 raft_consensus.cc:740] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:48.463321 16413 catalog_manager.cc:5697] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 0 to 1, leader changed from <none> to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 1 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:48.411085 16790 tablet_bootstrap.cc:492] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:48.471742 16786 consensus_queue.cc:260] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:48.474115 16786 ts_tablet_manager.cc:1434] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:29:48.475143 17282 raft_consensus.cc:493] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:48.475632 17282 raft_consensus.cc:515] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:48.477701 17282 leader_election.cc:290] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:48.475194 16786 tablet_bootstrap.cc:492] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a: Bootstrap starting.
I20260709 12:29:48.469801 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a084469fa354084b2130b4656a965d1" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:48.478681 16513 raft_consensus.cc:3060] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:48.482635 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39b696cc72749608ab54eae0a99b093" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:48.483634 16659 raft_consensus.cc:2393] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a in current term 1: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
I20260709 12:29:48.485954 16559 leader_election.cc:304] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:29:48.491686 16513 raft_consensus.cc:2468] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:48.492578 17214 raft_consensus.cc:2749] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:29:48.504244 16557 leader_election.cc:343] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:48.506409 16790 tablet_bootstrap.cc:654] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:48.506963 16786 tablet_bootstrap.cc:654] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:48.510092 16559 leader_election.cc:304] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: cd924581228b49d889b0e1553519722a
I20260709 12:29:48.510860 17276 raft_consensus.cc:2804] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:48.511336 17276 raft_consensus.cc:697] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:48.512131 17276 consensus_queue.cc:237] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:48.519167 17277 consensus_queue.cc:1048] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:48.561018 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39b696cc72749608ab54eae0a99b093" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:48.567754 16704 leader_election.cc:304] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:48.570957 17277 raft_consensus.cc:493] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:48.571636 17277 raft_consensus.cc:515] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:48.578329 17282 raft_consensus.cc:3060] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:48.618188 16786 tablet_bootstrap.cc:492] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a: No bootstrap required, opened a new log
I20260709 12:29:48.618846 16786 ts_tablet_manager.cc:1403] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a: Time spent bootstrapping tablet: real 0.144s	user 0.017s	sys 0.000s
I20260709 12:29:48.618103 16415 catalog_manager.cc:5697] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:48.607189 17195 raft_consensus.cc:493] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:48.622360 17195 raft_consensus.cc:515] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:48.624787 17195 leader_election.cc:290] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:48.627008 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a084469fa354084b2130b4656a965d1" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:48.627866 16513 raft_consensus.cc:2393] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a in current term 1: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
I20260709 12:29:48.637228 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a084469fa354084b2130b4656a965d1" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:48.642292 16786 raft_consensus.cc:359] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:48.643714 16786 raft_consensus.cc:385] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:48.644049 16786 raft_consensus.cc:740] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Initialized, Role: FOLLOWER
I20260709 12:29:48.652014 16704 leader_election.cc:304] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:48.650565 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19834ede0784553865ac5c4cd1024f0" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:48.657115 16790 tablet_bootstrap.cc:492] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a: No bootstrap required, opened a new log
I20260709 12:29:48.657706 16790 ts_tablet_manager.cc:1403] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.247s	user 0.036s	sys 0.035s
I20260709 12:29:48.657752 16659 raft_consensus.cc:2468] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 0.
I20260709 12:29:48.658953 16786 consensus_queue.cc:260] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:48.664189 17191 raft_consensus.cc:3060] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:48.670723 16484 leader_election.cc:304] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:29:48.671623 17212 raft_consensus.cc:2804] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:48.670006 17277 leader_election.cc:290] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:48.672111 17212 raft_consensus.cc:493] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:48.672561 17212 raft_consensus.cc:3060] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:48.679502 17282 raft_consensus.cc:2749] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:48.680066 17212 raft_consensus.cc:515] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:48.682933 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19834ede0784553865ac5c4cd1024f0" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:48.683487 16659 raft_consensus.cc:3060] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:48.683772 16790 raft_consensus.cc:359] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:48.684458 16790 raft_consensus.cc:385] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:48.684701 16790 raft_consensus.cc:740] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:48.685349 16790 consensus_queue.cc:260] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:48.687279 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19834ede0784553865ac5c4cd1024f0" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:48.687937 16735 raft_consensus.cc:2468] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 0.
I20260709 12:29:48.692946 16786 ts_tablet_manager.cc:1434] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.005s
I20260709 12:29:48.693861 16790 ts_tablet_manager.cc:1434] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.036s	user 0.002s	sys 0.005s
I20260709 12:29:48.694919 17272 consensus_queue.cc:1048] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:48.698460 16659 raft_consensus.cc:2468] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:29:48.704605 16484 leader_election.cc:304] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:29:48.705534 17272 raft_consensus.cc:2804] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:48.705982 17272 raft_consensus.cc:697] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:29:48.706766 17272 consensus_queue.cc:237] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:48.711076 17212 leader_election.cc:290] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:48.711249 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19834ede0784553865ac5c4cd1024f0" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:48.711831 16741 raft_consensus.cc:3060] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:48.712476 17191 raft_consensus.cc:2749] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:48.721095 16741 raft_consensus.cc:2468] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:29:48.725927 16416 catalog_manager.cc:5697] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:48.746470 17212 consensus_queue.cc:1048] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:48.756064 17195 consensus_queue.cc:1048] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:48.778795 17282 consensus_queue.cc:1048] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:48.786902 16416 catalog_manager.cc:5697] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 0 to 1, leader changed from <none> to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 1 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } }
W20260709 12:29:48.798003 17303 log.cc:927] Time spent T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:29:48.800344 17277 raft_consensus.cc:493] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:48.800976 17277 raft_consensus.cc:515] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:48.803082 17277 leader_election.cc:290] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:48.804577 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1765c0523b546c198e7a014b0866bbc" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:48.805400 16591 raft_consensus.cc:2393] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in current term 1: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
I20260709 12:29:48.821744 17212 consensus_queue.cc:1048] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:48.838574 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1765c0523b546c198e7a014b0866bbc" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:48.839726 16661 raft_consensus.cc:2393] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in current term 1: Already voted for candidate 99ca36f8a50c459388f31022b1455ed6 in this term.
I20260709 12:29:48.883734 16484 leader_election.cc:304] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:48.886404 17272 raft_consensus.cc:3060] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:48.939585 17272 raft_consensus.cc:2749] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:48.948841 17206 consensus_queue.cc:1048] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:48.953332 17212 consensus_queue.cc:1048] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:49.018778 17206 consensus_queue.cc:1048] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:49.020390 17276 consensus_queue.cc:1048] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:49.073546 17285 consensus_queue.cc:1048] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:49.115072 17272 consensus_queue.cc:1048] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:49.139861 17279 consensus_queue.cc:1048] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:29:49.250764 16463 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:49.898910 17187 raft_consensus.cc:493] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:49.899516 17187 raft_consensus.cc:515] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:49.902469 17187 leader_election.cc:290] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:49.903295 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1765c0523b546c198e7a014b0866bbc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:29:49.904071 16513 raft_consensus.cc:2468] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:49.905280 16633 leader_election.cc:304] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:29:49.906464 17187 raft_consensus.cc:2804] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:49.906823 17187 raft_consensus.cc:493] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:49.907137 17187 raft_consensus.cc:3060] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:49.911422 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1765c0523b546c198e7a014b0866bbc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:49.912081 16589 raft_consensus.cc:2468] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:49.917196 17187 raft_consensus.cc:515] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:49.919330 17187 leader_election.cc:290] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:49.919870 16513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1765c0523b546c198e7a014b0866bbc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:29:49.920306 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1765c0523b546c198e7a014b0866bbc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:49.920495 16513 raft_consensus.cc:3060] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:49.920878 16589 raft_consensus.cc:3060] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:49.926759 16589 raft_consensus.cc:2468] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 2.
I20260709 12:29:49.928802 16630 leader_election.cc:304] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:49.929859 17187 raft_consensus.cc:2804] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:49.930610 17187 raft_consensus.cc:697] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:29:49.931468 17187 consensus_queue.cc:237] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:49.933401 16513 raft_consensus.cc:2468] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 2.
I20260709 12:29:49.941640 16415 catalog_manager.cc:5697] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 0 to 2, leader changed from <none> to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 2 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:50.487076 16589 raft_consensus.cc:1275] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:50.488662 17322 consensus_queue.cc:1048] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:50.503648 16514 raft_consensus.cc:1275] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:50.507408 17322 consensus_queue.cc:1048] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:51.633637  8637 tablet_server.cc:179] TabletServer@127.8.111.65:0 shutting down...
W20260709 12:29:51.646509 16707 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:29:51.656052 16707 consensus_peers.cc:597] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:51.663252 16633 consensus_peers.cc:597] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:51.668605 16633 consensus_peers.cc:597] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:51.714979  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:29:51.715948 16559 consensus_peers.cc:597] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:51.716986  8637 tablet_replica.cc:333] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
W20260709 12:29:51.718072 16559 consensus_peers.cc:597] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:51.718140  8637 raft_consensus.cc:2243] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:51.719378  8637 raft_consensus.cc:2272] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.722348  8637 tablet_replica.cc:333] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
W20260709 12:29:51.722740 16559 consensus_peers.cc:597] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:51.723363  8637 raft_consensus.cc:2243] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.724013  8637 raft_consensus.cc:2272] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.726794  8637 tablet_replica.cc:333] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.727774  8637 raft_consensus.cc:2243] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.728310  8637 raft_consensus.cc:2272] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.731010  8637 tablet_replica.cc:333] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.731972  8637 raft_consensus.cc:2243] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.732506  8637 raft_consensus.cc:2272] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.735306  8637 tablet_replica.cc:333] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.736285  8637 raft_consensus.cc:2243] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.736910  8637 raft_consensus.cc:2272] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:51.738204 16559 consensus_peers.cc:597] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:51.739861  8637 tablet_replica.cc:333] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.740911  8637 raft_consensus.cc:2243] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.741497  8637 raft_consensus.cc:2272] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.744174  8637 tablet_replica.cc:333] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.745060  8637 raft_consensus.cc:2243] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.745642  8637 raft_consensus.cc:2272] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.748445  8637 tablet_replica.cc:333] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.749389  8637 raft_consensus.cc:2243] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.749970  8637 raft_consensus.cc:2272] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.752933  8637 tablet_replica.cc:333] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.753808  8637 raft_consensus.cc:2243] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:51.754920  8637 raft_consensus.cc:2272] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.757541  8637 tablet_replica.cc:333] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.758541  8637 raft_consensus.cc:2243] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.759197  8637 raft_consensus.cc:2272] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:51.761432 16707 consensus_peers.cc:597] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:51.762439  8637 tablet_replica.cc:333] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.763446  8637 raft_consensus.cc:2243] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.764153  8637 raft_consensus.cc:2272] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.767179  8637 tablet_replica.cc:333] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.768131  8637 raft_consensus.cc:2243] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.768780  8637 raft_consensus.cc:2272] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.772040  8637 tablet_replica.cc:333] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.773116  8637 raft_consensus.cc:2243] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.773803  8637 raft_consensus.cc:2272] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.778488  8637 tablet_replica.cc:333] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.789505  8637 raft_consensus.cc:2243] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.790233  8637 raft_consensus.cc:2272] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.796854  8637 tablet_replica.cc:333] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.797883  8637 raft_consensus.cc:2243] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.798667  8637 raft_consensus.cc:2272] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:51.795349 16559 consensus_peers.cc:597] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:51.799602 16559 consensus_peers.cc:597] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:51.801730  8637 tablet_replica.cc:333] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.806062  8637 raft_consensus.cc:2243] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.806659  8637 raft_consensus.cc:2272] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.809577  8637 tablet_replica.cc:333] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.810447  8637 raft_consensus.cc:2243] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:29:51.811146 16559 consensus_peers.cc:597] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:51.811437  8637 raft_consensus.cc:2272] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.815163  8637 tablet_replica.cc:333] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.816062  8637 raft_consensus.cc:2243] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:51.817131  8637 raft_consensus.cc:2272] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.822140  8637 tablet_replica.cc:333] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.823079  8637 raft_consensus.cc:2243] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.823734  8637 raft_consensus.cc:2272] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:51.824182 16559 consensus_peers.cc:597] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:51.824352 16633 consensus_peers.cc:597] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:51.826234  8637 tablet_replica.cc:333] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.826969  8637 raft_consensus.cc:2243] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.827477  8637 raft_consensus.cc:2272] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.830382  8637 tablet_replica.cc:333] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.831375  8637 raft_consensus.cc:2243] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:51.832468  8637 raft_consensus.cc:2272] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.835392  8637 tablet_replica.cc:333] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.836340  8637 raft_consensus.cc:2243] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:51.837527  8637 raft_consensus.cc:2272] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.840497  8637 tablet_replica.cc:333] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.841250  8637 raft_consensus.cc:2243] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.841694  8637 raft_consensus.cc:2272] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.843734  8637 tablet_replica.cc:333] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.844492  8637 raft_consensus.cc:2243] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.845007  8637 raft_consensus.cc:2272] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.847421  8637 tablet_replica.cc:333] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.848295  8637 raft_consensus.cc:2243] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:51.849179  8637 raft_consensus.cc:2272] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:51.851418 16559 consensus_peers.cc:597] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:51.851591  8637 tablet_replica.cc:333] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.852375  8637 raft_consensus.cc:2243] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.852839  8637 raft_consensus.cc:2272] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.855336  8637 tablet_replica.cc:333] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.856117  8637 raft_consensus.cc:2243] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.856628  8637 raft_consensus.cc:2272] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.859392  8637 tablet_replica.cc:333] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.860033  8637 raft_consensus.cc:2243] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:51.860929  8637 raft_consensus.cc:2272] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.863431  8637 tablet_replica.cc:333] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.864297  8637 raft_consensus.cc:2243] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.864857  8637 raft_consensus.cc:2272] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.867264  8637 tablet_replica.cc:333] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.867985  8637 raft_consensus.cc:2243] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.868541  8637 raft_consensus.cc:2272] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.871455  8637 tablet_replica.cc:333] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.872270  8637 raft_consensus.cc:2243] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:51.873247  8637 raft_consensus.cc:2272] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.875942  8637 tablet_replica.cc:333] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.876607  8637 raft_consensus.cc:2243] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.877045  8637 raft_consensus.cc:2272] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.879241  8637 tablet_replica.cc:333] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.879822  8637 raft_consensus.cc:2243] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.880251  8637 raft_consensus.cc:2272] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.882545  8637 tablet_replica.cc:333] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.883191  8637 raft_consensus.cc:2243] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.883621  8637 raft_consensus.cc:2272] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.885635  8637 tablet_replica.cc:333] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.886489  8637 raft_consensus.cc:2243] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.887069  8637 raft_consensus.cc:2272] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.889937  8637 tablet_replica.cc:333] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.890777  8637 raft_consensus.cc:2243] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.891323  8637 raft_consensus.cc:2272] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.894068  8637 tablet_replica.cc:333] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.894797  8637 raft_consensus.cc:2243] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.895244  8637 raft_consensus.cc:2272] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.897336  8637 tablet_replica.cc:333] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.898083  8637 raft_consensus.cc:2243] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.898806  8637 raft_consensus.cc:2272] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:51.901326 16707 consensus_peers.cc:597] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:51.901737  8637 tablet_replica.cc:333] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
W20260709 12:29:51.902398 16633 consensus_peers.cc:597] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:51.902652  8637 raft_consensus.cc:2243] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:51.903635  8637 raft_consensus.cc:2272] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.905994  8637 tablet_replica.cc:333] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.906788  8637 raft_consensus.cc:2243] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:51.907778  8637 raft_consensus.cc:2272] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.910481  8637 tablet_replica.cc:333] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.911275  8637 raft_consensus.cc:2243] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.911840  8637 raft_consensus.cc:2272] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:51.912982 16707 consensus_peers.cc:597] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:51.914302  8637 tablet_replica.cc:333] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.915110  8637 raft_consensus.cc:2243] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.915648  8637 raft_consensus.cc:2272] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.918322  8637 tablet_replica.cc:333] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.919047  8637 raft_consensus.cc:2243] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.919551  8637 raft_consensus.cc:2272] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.922010  8637 tablet_replica.cc:333] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.922578  8637 raft_consensus.cc:2243] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.923053  8637 raft_consensus.cc:2272] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:51.925529  8637 tablet_replica.cc:333] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a: stopping tablet replica
I20260709 12:29:51.926173  8637 raft_consensus.cc:2243] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:51.926755  8637 raft_consensus.cc:2272] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:51.929710 16559 consensus_peers.cc:597] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:51.952579 16633 consensus_peers.cc:597] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:51.958120 16559 consensus_peers.cc:597] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:51.959944 16633 consensus_peers.cc:597] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:51.961102 16707 consensus_peers.cc:597] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:51.972308 16633 consensus_peers.cc:597] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:51.980528 16707 consensus_peers.cc:597] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:52.045151 16559 consensus_peers.cc:597] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:52.076886 16559 consensus_peers.cc:597] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:52.077459 16559 consensus_peers.cc:597] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:52.083853 16633 consensus_peers.cc:597] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:52.101644 16707 consensus_peers.cc:597] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:52.139971 16707 consensus_peers.cc:597] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:52.146467 16633 consensus_peers.cc:597] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:52.147261 16559 consensus_peers.cc:597] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:52.172015 16633 consensus_peers.cc:597] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:52.178756 16559 consensus_peers.cc:597] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:52.675060 17336 raft_consensus.cc:493] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:52.676319 17336 raft_consensus.cc:515] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:52.678524 17336 leader_election.cc:290] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:52.679834 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19834ede0784553865ac5c4cd1024f0" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
W20260709 12:29:52.684826 16707 leader_election.cc:336] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:52.685374 16707 leader_election.cc:304] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:52.686691 17336 raft_consensus.cc:2749] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:52.883450 17336 raft_consensus.cc:493] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:52.884024 17336 raft_consensus.cc:515] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:52.886134 17336 leader_election.cc:290] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:52.886837 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
W20260709 12:29:52.890542 16707 leader_election.cc:336] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:52.890910 16707 leader_election.cc:304] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:52.891732 17336 raft_consensus.cc:2749] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:52.933087 17336 raft_consensus.cc:493] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:52.933645 17336 raft_consensus.cc:515] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:52.935737 17336 leader_election.cc:290] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:52.937502 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d285abc27263437a85f24a1d8f993be1" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
W20260709 12:29:52.940171 16707 leader_election.cc:336] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:52.940555 16707 leader_election.cc:304] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:52.941138 17336 raft_consensus.cc:2749] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:52.982257 17335 raft_consensus.cc:493] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:52.982741 17335 raft_consensus.cc:515] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:52.984490 17335 leader_election.cc:290] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:52.985450 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
W20260709 12:29:52.988510 16633 leader_election.cc:336] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:52.988974 16633 leader_election.cc:304] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:52.989900 17335 raft_consensus.cc:2749] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:52.990195 17341 raft_consensus.cc:493] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:52.991111 17341 raft_consensus.cc:515] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:52.995548 17341 leader_election.cc:290] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:52.998265 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cf6ac39c0248398e411dcce49bf021" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:53.001183 17335 raft_consensus.cc:493] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.001737 17335 raft_consensus.cc:515] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
W20260709 12:29:53.002032 16559 leader_election.cc:336] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.003674 17335 leader_election.cc:290] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:53.003917 16559 leader_election.cc:304] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:53.004441 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf661e435740adbb0269128765d10e" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:53.006937 17114 raft_consensus.cc:2749] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:29:53.008960 16633 leader_election.cc:336] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
W20260709 12:29:53.009230  8637 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 16539)
I20260709 12:29:53.009419 16633 leader_election.cc:304] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:29:53.010165 17335 raft_consensus.cc:2749] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:53.035328 17336 raft_consensus.cc:493] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.035893 17336 raft_consensus.cc:515] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:53.038074 17336 leader_election.cc:290] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:53.039299 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a9660f852f43f19f20f687b10acdd2" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
W20260709 12:29:53.041549 16707 leader_election.cc:336] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.041911 16707 leader_election.cc:304] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:53.042506 17336 raft_consensus.cc:2749] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:53.055395 17322 raft_consensus.cc:493] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.055934 17322 raft_consensus.cc:515] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:53.057600 17322 leader_election.cc:290] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:53.058151 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19834ede0784553865ac5c4cd1024f0" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:53.058768 16733 raft_consensus.cc:2468] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:53.059738 16631 leader_election.cc:304] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:53.060516 17322 raft_consensus.cc:2804] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:53.060878 17322 raft_consensus.cc:493] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.061236 17322 raft_consensus.cc:3060] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:53.064138 16633 leader_election.cc:336] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.067533 17322 raft_consensus.cc:515] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:53.069123 17322 leader_election.cc:290] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:53.069906 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19834ede0784553865ac5c4cd1024f0" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:53.070494 16733 raft_consensus.cc:3060] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:53.074311 16633 leader_election.cc:336] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.078064 16733 raft_consensus.cc:2468] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 2.
I20260709 12:29:53.078783 17322 raft_consensus.cc:493] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.079419 17322 raft_consensus.cc:515] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:53.080687 16631 leader_election.cc:304] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:53.081498 17335 raft_consensus.cc:2804] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:53.082020 17335 raft_consensus.cc:697] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:29:53.083038 17335 consensus_queue.cc:237] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:53.087311 17322 leader_election.cc:290] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:53.087533 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cf6ac39c0248398e411dcce49bf021" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:53.088254 16589 raft_consensus.cc:2468] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:53.089246 16630 leader_election.cc:304] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:29:53.090559 17322 raft_consensus.cc:2804] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:53.091137 17322 raft_consensus.cc:493] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.091614 17322 raft_consensus.cc:3060] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:53.092528 17346 raft_consensus.cc:493] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.093197 17346 raft_consensus.cc:515] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
W20260709 12:29:53.094123 16633 leader_election.cc:336] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.097190 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:53.100155 17346 leader_election.cc:290] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:53.102767 17322 raft_consensus.cc:515] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:53.104851 17346 raft_consensus.cc:493] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.106367 17322 leader_election.cc:290] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:53.105365 17346 raft_consensus.cc:515] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:53.109581 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cf6ac39c0248398e411dcce49bf021" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:53.113734 16589 raft_consensus.cc:3060] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:53.115015 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
W20260709 12:29:53.113291 16633 leader_election.cc:336] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.116918 16416 catalog_manager.cc:5697] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 1 to 2, leader changed from 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65) to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 2 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:53.119450 16707 leader_election.cc:336] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.120042 16707 leader_election.cc:304] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:53.121285 17336 raft_consensus.cc:2749] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:53.126834 17346 leader_election.cc:290] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:53.129873 16589 raft_consensus.cc:2468] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 2.
W20260709 12:29:53.130474 16707 leader_election.cc:336] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.131090 16630 leader_election.cc:304] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:53.131193 16707 leader_election.cc:304] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:29:53.132552 17346 raft_consensus.cc:2749] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:53.132637 17339 raft_consensus.cc:493] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.133284 17339 raft_consensus.cc:515] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:53.135840 17339 leader_election.cc:290] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:53.136382 17339 raft_consensus.cc:2804] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:53.136883 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eef363dbdce4d7bbd0b446385d8eb9e" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:53.136896 17339 raft_consensus.cc:697] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:29:53.144759 17339 consensus_queue.cc:237] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:53.145407 17114 raft_consensus.cc:493] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.146083 17114 raft_consensus.cc:515] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:53.148636 17114 leader_election.cc:290] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:53.152771 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b4874f353b48ef8bdfa4c28549a207" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:53.142237 17341 raft_consensus.cc:493] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.156464 17341 raft_consensus.cc:515] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
W20260709 12:29:53.158633 16633 leader_election.cc:336] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.159235 16633 leader_election.cc:304] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:29:53.160126 17335 raft_consensus.cc:2749] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:53.160809 17341 leader_election.cc:290] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:53.159541 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:53.166785 17335 raft_consensus.cc:493] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.162335 16733 raft_consensus.cc:2468] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:53.167338 17335 raft_consensus.cc:515] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:53.168716 16557 leader_election.cc:304] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
W20260709 12:29:53.169505 16559 leader_election.cc:336] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.169737 17345 raft_consensus.cc:2804] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:53.170045 17335 leader_election.cc:290] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:53.170063 16559 leader_election.cc:304] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:29:53.177749 17114 raft_consensus.cc:2749] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:53.180255 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b4874f353b48ef8bdfa4c28549a207" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:29:53.170159 17345 raft_consensus.cc:493] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.181685 17345 raft_consensus.cc:3060] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:53.182523 16559 leader_election.cc:336] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.176914 17335 raft_consensus.cc:493] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.194976 17346 raft_consensus.cc:493] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.195926 17346 raft_consensus.cc:515] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:53.199810 16590 raft_consensus.cc:2468] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:53.199215 17346 leader_election.cc:290] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:53.202958 17335 raft_consensus.cc:515] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:53.205395 17335 leader_election.cc:290] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
W20260709 12:29:53.206308 16707 leader_election.cc:336] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.207646 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:53.208247 16733 raft_consensus.cc:2468] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:53.210969 16631 leader_election.cc:304] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:53.219935 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eef363dbdce4d7bbd0b446385d8eb9e" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
W20260709 12:29:53.220074 16633 leader_election.cc:336] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.220839 16659 raft_consensus.cc:2468] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 1.
I20260709 12:29:53.222085 16707 leader_election.cc:304] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:53.223268 17346 raft_consensus.cc:2804] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:53.223698 17346 raft_consensus.cc:493] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.224138 17346 raft_consensus.cc:3060] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:53.226961 17322 raft_consensus.cc:2804] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:53.227456 17322 raft_consensus.cc:493] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.227936 17322 raft_consensus.cc:3060] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:53.228935 16630 leader_election.cc:304] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:53.226042 17345 raft_consensus.cc:515] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:53.237267 17339 raft_consensus.cc:2804] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:53.237690 17339 raft_consensus.cc:493] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
W20260709 12:29:53.229421 16633 leader_election.cc:336] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.238860 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:53.238119 17339 raft_consensus.cc:3060] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:53.245857 17356 raft_consensus.cc:493] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.251096 16741 raft_consensus.cc:3060] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:53.254446 16559 leader_election.cc:336] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.255841 17356 raft_consensus.cc:515] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:53.238001 17345 leader_election.cc:290] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:53.259217 17356 leader_election.cc:290] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:53.241952 17322 raft_consensus.cc:515] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:53.267771 16416 catalog_manager.cc:5697] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 1 to 2, leader changed from 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65) to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 2 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:53.273291 16741 raft_consensus.cc:2468] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 2.
I20260709 12:29:53.267481 17322 leader_election.cc:290] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:53.274802 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a9660f852f43f19f20f687b10acdd2" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:53.275542 16733 raft_consensus.cc:2468] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:53.276686 16557 leader_election.cc:304] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:53.279026 16631 leader_election.cc:304] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:53.280025 17335 raft_consensus.cc:493] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.281322 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:53.281037 17335 raft_consensus.cc:515] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:53.266414 17346 raft_consensus.cc:515] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:53.281955 16733 raft_consensus.cc:3060] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:53.282369 17336 raft_consensus.cc:493] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.288081 17346 leader_election.cc:290] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:53.288117 17336 raft_consensus.cc:515] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:53.291994 17336 leader_election.cc:290] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:53.282670 17358 raft_consensus.cc:2804] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:53.293133 17358 raft_consensus.cc:493] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.293578 17358 raft_consensus.cc:3060] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:53.293635 16633 leader_election.cc:336] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.295863 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eef363dbdce4d7bbd0b446385d8eb9e" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:53.296428 16664 raft_consensus.cc:3060] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:53.297372 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf661e435740adbb0269128765d10e" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:53.298030 16666 raft_consensus.cc:2468] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 1.
I20260709 12:29:53.300150 16733 raft_consensus.cc:2468] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 2.
I20260709 12:29:53.285235 17335 leader_election.cc:290] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:53.278990 17357 raft_consensus.cc:2804] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:53.308928 17357 raft_consensus.cc:697] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:53.309806 17357 consensus_queue.cc:237] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
W20260709 12:29:53.310842 16633 leader_election.cc:336] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.307399 17339 raft_consensus.cc:515] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
W20260709 12:29:53.311386 16633 leader_election.cc:336] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.310606 17358 raft_consensus.cc:515] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:53.314033 17341 raft_consensus.cc:493] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.314582 17341 raft_consensus.cc:515] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:53.310073 16664 raft_consensus.cc:2468] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 2.
W20260709 12:29:53.315841 16707 leader_election.cc:336] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.317870 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d285abc27263437a85f24a1d8f993be1" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:53.318531 16733 raft_consensus.cc:2468] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:29:53.318749 17339 leader_election.cc:290] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:29:53.319881 17341 leader_election.cc:290] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
W20260709 12:29:53.324777 16633 leader_election.cc:336] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.327148 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:29:53.327955 16733 raft_consensus.cc:2468] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:53.317188 16631 leader_election.cc:304] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:53.329025 16557 leader_election.cc:304] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:53.327078 16707 leader_election.cc:304] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:53.331048 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b4874f353b48ef8bdfa4c28549a207" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:29:53.331687 17346 raft_consensus.cc:2804] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:53.331720 16590 raft_consensus.cc:3060] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:53.332119 17346 raft_consensus.cc:493] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.332427 16631 leader_election.cc:304] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:53.333564 17335 raft_consensus.cc:2804] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:53.333984 17335 raft_consensus.cc:493] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.334388 17335 raft_consensus.cc:3060] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:53.335490 17358 leader_election.cc:290] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:29:53.338325 17346 raft_consensus.cc:3060] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:53.331944 17339 raft_consensus.cc:2804] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:53.343207 17341 raft_consensus.cc:2804] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:53.343637 17341 raft_consensus.cc:493] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.344044 17341 raft_consensus.cc:3060] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:53.349723 16633 leader_election.cc:336] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.351500 17114 raft_consensus.cc:493] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.351897 17341 raft_consensus.cc:515] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:53.352035 17114 raft_consensus.cc:515] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:53.353971 17114 leader_election.cc:290] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:53.354123 17341 leader_election.cc:290] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
W20260709 12:29:53.341455 16559 leader_election.cc:336] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.358556 17346 raft_consensus.cc:515] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:53.338938 16707 leader_election.cc:304] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:53.355444 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:53.360412 16733 raft_consensus.cc:3060] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:53.360808 17346 leader_election.cc:290] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
W20260709 12:29:53.360901 16707 leader_election.cc:336] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.361481 17346 raft_consensus.cc:2804] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:53.349220 16416 catalog_manager.cc:5697] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 1 to 2, leader changed from 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65) to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:53.355898 17339 raft_consensus.cc:697] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:29:53.366725 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf661e435740adbb0269128765d10e" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:53.367319 16664 raft_consensus.cc:3060] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:53.367247 17339 consensus_queue.cc:237] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:53.370025 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:29:53.370683 16659 raft_consensus.cc:2468] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:29:53.370734 16590 raft_consensus.cc:2468] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 2.
I20260709 12:29:53.374243 16664 raft_consensus.cc:2468] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 2.
I20260709 12:29:53.377348 17346 raft_consensus.cc:697] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:29:53.378293 17346 consensus_queue.cc:237] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:53.384058 17335 raft_consensus.cc:515] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:53.384936 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4a9660f852f43f19f20f687b10acdd2" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:53.385555 16741 raft_consensus.cc:3060] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:53.379665 16733 raft_consensus.cc:2468] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 2.
I20260709 12:29:53.388972 16557 leader_election.cc:304] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
W20260709 12:29:53.390180 16559 leader_election.cc:336] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
W20260709 12:29:53.390771 16559 leader_election.cc:336] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.391985 17357 raft_consensus.cc:2804] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:53.392910 16630 leader_election.cc:304] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:53.394623 17358 raft_consensus.cc:2804] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:53.395125 17358 raft_consensus.cc:697] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:29:53.395352 17357 raft_consensus.cc:697] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:53.396041 17358 consensus_queue.cc:237] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:53.396294 17357 consensus_queue.cc:237] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:53.400774 16741 raft_consensus.cc:2468] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 2.
I20260709 12:29:53.401960 16707 leader_election.cc:304] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:53.403996 17336 raft_consensus.cc:2804] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:53.403543 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d285abc27263437a85f24a1d8f993be1" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:29:53.404301 16559 leader_election.cc:304] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:53.404779 16741 raft_consensus.cc:3060] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:53.406787 17114 raft_consensus.cc:2804] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:53.407169 17114 raft_consensus.cc:493] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:29:53.407570 17114 raft_consensus.cc:3060] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:53.403177 16416 catalog_manager.cc:5697] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 1 to 2, leader changed from 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65) to cd924581228b49d889b0e1553519722a (127.8.111.68). New cstate: current_term: 2 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:53.409709 16631 leader_election.cc:304] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:53.404592 17336 raft_consensus.cc:697] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:29:53.415967 16741 raft_consensus.cc:2468] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 2.
I20260709 12:29:53.417423 16631 leader_election.cc:304] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:29:53.414260 17356 raft_consensus.cc:2804] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:53.455495 17356 raft_consensus.cc:697] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:29:53.459832 17356 consensus_queue.cc:237] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:53.452292 17335 leader_election.cc:290] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:53.454514 17367 raft_consensus.cc:2804] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:29:53.478492 16707 leader_election.cc:336] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.482090 17367 raft_consensus.cc:697] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:29:53.487099 17367 consensus_queue.cc:237] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
W20260709 12:29:53.488080 16633 leader_election.cc:336] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.493521 17114 raft_consensus.cc:515] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:53.479188 17336 consensus_queue.cc:237] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:53.509466 17114 leader_election.cc:290] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:29:53.524318 16416 catalog_manager.cc:5697] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 1 to 2, leader changed from 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65) to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 2 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:53.545984 16413 catalog_manager.cc:5697] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 1 to 2, leader changed from 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65) to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:53.563593 16589 raft_consensus.cc:1275] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:53.567735 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:29:53.568295 16664 raft_consensus.cc:3060] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:53.569721 16559 leader_election.cc:336] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:29:53.575641 16664 raft_consensus.cc:2468] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 2.
I20260709 12:29:53.579831 17367 consensus_queue.cc:1048] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:29:53.586079 16559 leader_election.cc:304] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:29:53.591360 17376 raft_consensus.cc:2804] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:53.591915 17376 raft_consensus.cc:697] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:29:53.592847 17376 consensus_queue.cc:237] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:53.588649 16416 catalog_manager.cc:5697] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 1 to 2, leader changed from 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65) to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 2 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:53.595201 16416 catalog_manager.cc:5697] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 1 to 2, leader changed from 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65) to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 2 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:53.596607 16416 catalog_manager.cc:5697] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 1 to 2, leader changed from 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65) to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 2 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:53.603329 16413 catalog_manager.cc:5697] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 1 to 2, leader changed from 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65) to cd924581228b49d889b0e1553519722a (127.8.111.68). New cstate: current_term: 2 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:53.613492 16633 consensus_peers.cc:597] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:53.649128 16416 catalog_manager.cc:5697] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 1 to 2, leader changed from 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65) to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
W20260709 12:29:53.657285 16633 consensus_peers.cc:597] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:53.687024 16733 raft_consensus.cc:1275] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:53.688241 17356 consensus_queue.cc:1048] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:29:53.753832 16559 consensus_peers.cc:597] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:53.799424 16661 raft_consensus.cc:1275] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Refusing update from remote peer cd924581228b49d889b0e1553519722a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:53.801162 17346 consensus_queue.cc:1048] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:29:53.822813 16707 consensus_peers.cc:597] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:53.860046 16559 consensus_peers.cc:597] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:53.865411 16741 raft_consensus.cc:1275] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:53.866725 17114 consensus_queue.cc:1048] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:53.906700 16741 raft_consensus.cc:1275] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:53.908190 17367 consensus_queue.cc:1048] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:29:53.910377 16633 consensus_peers.cc:597] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:53.927320 16741 raft_consensus.cc:1275] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:53.931784 17358 consensus_queue.cc:1048] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:53.938715 16735 raft_consensus.cc:1275] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:53.941085 17114 consensus_queue.cc:1048] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:53.944578 16591 raft_consensus.cc:1275] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:53.946223 17367 consensus_queue.cc:1048] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:29:53.968560 16633 consensus_peers.cc:597] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:53.986523 16633 consensus_peers.cc:597] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:53.992496 16633 consensus_peers.cc:597] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:53.996265 16741 raft_consensus.cc:1275] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:54.002024 17358 consensus_queue.cc:1048] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:29:54.009724  8637 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 16539)
I20260709 12:29:54.056291 16661 raft_consensus.cc:1275] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Refusing update from remote peer cd924581228b49d889b0e1553519722a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:29:54.059558 16559 consensus_peers.cc:597] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:54.060590 17370 consensus_queue.cc:1048] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 12:29:54.075331 16559 consensus_peers.cc:597] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:54.081600 16633 consensus_peers.cc:597] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.089355 16707 consensus_peers.cc:597] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:54.095054 16559 consensus_peers.cc:597] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.117034 16559 consensus_peers.cc:597] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.134155 16633 consensus_peers.cc:597] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:54.156425 16661 raft_consensus.cc:1275] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:54.157632 17114 consensus_queue.cc:1048] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:29:54.185920 16559 consensus_peers.cc:597] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.197690 16559 consensus_peers.cc:597] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.224731 16559 consensus_peers.cc:597] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.259152 16633 consensus_peers.cc:597] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:54.288932  8637 tablet_server.cc:196] TabletServer@127.8.111.65:0 shutdown complete.
W20260709 12:29:54.325735 16559 consensus_peers.cc:597] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.347242 16707 consensus_peers.cc:597] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.353454 16707 consensus_peers.cc:597] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.360744 16559 consensus_peers.cc:597] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.363725 16707 consensus_peers.cc:597] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:54.374920  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:54.384774 17396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:54.384868 17395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:54.384965 16633 consensus_peers.cc:597] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.385365 17398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:54.386655  8637 server_base.cc:1061] running on GCE node
I20260709 12:29:54.389184  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:54.389505  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:54.389782  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600194389753 us; error 0 us; skew 500 ppm
I20260709 12:29:54.390414  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 12:29:54.391827 16707 consensus_peers.cc:597] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:54.393852  8637 webserver.cc:533] Webserver started at http://127.8.111.65:37971/ using document root <none> and password file <none>
I20260709 12:29:54.394520  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:54.394747  8637 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:29:54.399331  8637 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:29:54.407084 17403 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:54.407927  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:29:54.408260  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-0-root
uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
format_stamp: "Formatted at 2026-07-09 12:29:36 on dist-test-slave-044g"
I20260709 12:29:54.408644  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599876290468-8637-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:29:54.420580 16559 consensus_peers.cc:597] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:54.424597  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:54.428385  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260709 12:29:54.428982 16633 consensus_peers.cc:597] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:54.430845  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:54.437322 17410 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:29:54.450569 16559 consensus_peers.cc:597] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.466249 16633 consensus_peers.cc:597] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.498112 16633 consensus_peers.cc:597] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.519788 16707 consensus_peers.cc:597] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.525569 16559 consensus_peers.cc:597] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.547287 16707 consensus_peers.cc:597] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.557963 16559 consensus_peers.cc:597] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.565049 16559 consensus_peers.cc:597] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.642210 16633 consensus_peers.cc:597] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.657166 16559 consensus_peers.cc:597] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:54.695781  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:29:54.696179  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.260s	user 0.006s	sys 0.004s
I20260709 12:29:54.696540  8637 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
W20260709 12:29:54.698393 16707 consensus_peers.cc:597] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:54.702550 17410 tablet_bootstrap.cc:492] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:54.722121 17410 tablet_bootstrap.cc:492] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:54.723018 17410 tablet_bootstrap.cc:492] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:54.723601 17410 ts_tablet_manager.cc:1403] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 12:29:54.726056 17410 raft_consensus.cc:359] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:54.726707 17410 raft_consensus.cc:740] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:54.727420 17410 consensus_queue.cc:260] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:54.730515 17410 ts_tablet_manager.cc:1434] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:29:54.731352 17410 tablet_bootstrap.cc:492] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
W20260709 12:29:54.743031 16559 consensus_peers.cc:597] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:54.748504 16707 consensus_peers.cc:597] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:54.752461 17410 tablet_bootstrap.cc:492] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:54.753346 17410 tablet_bootstrap.cc:492] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:54.753950 17410 ts_tablet_manager.cc:1403] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.000s
I20260709 12:29:54.756151 17410 raft_consensus.cc:359] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:54.756706 17410 raft_consensus.cc:740] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:54.757315 17410 consensus_queue.cc:260] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:54.758694 17410 ts_tablet_manager.cc:1434] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.004s
I20260709 12:29:54.759341 17410 tablet_bootstrap.cc:492] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:54.774132 17410 tablet_bootstrap.cc:492] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:54.774899 17410 tablet_bootstrap.cc:492] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:54.775393 17410 ts_tablet_manager.cc:1403] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 12:29:54.777105 17410 raft_consensus.cc:359] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:54.777598 17410 raft_consensus.cc:740] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:54.778164 17410 consensus_queue.cc:260] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:54.779445 17410 ts_tablet_manager.cc:1434] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:29:54.780010 17410 tablet_bootstrap.cc:492] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:54.791105 17410 tablet_bootstrap.cc:492] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:54.791935 17410 tablet_bootstrap.cc:492] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:54.792887 17410 ts_tablet_manager.cc:1403] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:29:54.796970 17410 raft_consensus.cc:359] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:54.797585 17410 raft_consensus.cc:740] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:54.798228 17410 consensus_queue.cc:260] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:54.799608 17410 ts_tablet_manager.cc:1434] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:29:54.800228 17410 tablet_bootstrap.cc:492] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:54.810876 17410 tablet_bootstrap.cc:492] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:54.811818 17410 tablet_bootstrap.cc:492] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:54.812431 17410 ts_tablet_manager.cc:1403] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 12:29:54.815452 17410 raft_consensus.cc:359] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
W20260709 12:29:54.815726 16633 consensus_peers.cc:597] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:54.816073 17410 raft_consensus.cc:740] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:54.816699 17410 consensus_queue.cc:260] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:54.820411 17410 ts_tablet_manager.cc:1434] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:29:54.821175 17410 tablet_bootstrap.cc:492] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:54.836808 17410 tablet_bootstrap.cc:492] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:54.837739 17410 tablet_bootstrap.cc:492] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:54.839159 17410 ts_tablet_manager.cc:1403] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 12:29:54.841445 17410 raft_consensus.cc:359] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:54.841945 17410 raft_consensus.cc:740] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:54.842648 17410 consensus_queue.cc:260] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:54.844091 17410 ts_tablet_manager.cc:1434] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:29:54.844831 17410 tablet_bootstrap.cc:492] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
W20260709 12:29:54.849431 16633 consensus_peers.cc:597] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:54.861163 17410 tablet_bootstrap.cc:492] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:54.862175 17410 tablet_bootstrap.cc:492] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:54.862834 17410 ts_tablet_manager.cc:1403] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:29:54.865581 17410 raft_consensus.cc:359] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:54.866079 17410 raft_consensus.cc:740] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:54.866665 17410 consensus_queue.cc:260] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:54.868187 17410 ts_tablet_manager.cc:1434] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 12:29:54.868798 17410 tablet_bootstrap.cc:492] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:54.881150 17410 tablet_bootstrap.cc:492] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:54.882103 17410 tablet_bootstrap.cc:492] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:54.882671 17410 ts_tablet_manager.cc:1403] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:29:54.885181 17410 raft_consensus.cc:359] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:54.885870 17410 raft_consensus.cc:740] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:54.886557 17410 consensus_queue.cc:260] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:54.888162 17410 ts_tablet_manager.cc:1434] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:54.888830 17410 tablet_bootstrap.cc:492] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:54.900372 17410 tablet_bootstrap.cc:492] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:54.901064 17410 tablet_bootstrap.cc:492] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:54.901536 17410 ts_tablet_manager.cc:1403] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 12:29:54.903146 17410 raft_consensus.cc:359] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:54.903606 17410 raft_consensus.cc:740] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:54.904191 17410 consensus_queue.cc:260] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:54.905788 17410 ts_tablet_manager.cc:1434] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:29:54.906514 17410 tablet_bootstrap.cc:492] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:54.924187 17410 tablet_bootstrap.cc:492] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:54.925067 17410 tablet_bootstrap.cc:492] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:54.925657 17410 ts_tablet_manager.cc:1403] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.004s
I20260709 12:29:54.927983 17410 raft_consensus.cc:359] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:54.928638 17410 raft_consensus.cc:740] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:54.929184 17410 consensus_queue.cc:260] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:54.931178 17410 ts_tablet_manager.cc:1434] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:29:54.931845 17410 tablet_bootstrap.cc:492] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:54.933993  8637 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:29:54.934320  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.238s	user 0.205s	sys 0.012s
I20260709 12:29:54.943027 17410 tablet_bootstrap.cc:492] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:54.944015 17410 tablet_bootstrap.cc:492] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:54.944705 17410 ts_tablet_manager.cc:1403] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 12:29:54.947253 17410 raft_consensus.cc:359] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:54.947906 17410 raft_consensus.cc:740] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:54.948571 17410 consensus_queue.cc:260] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:54.950147 17410 ts_tablet_manager.cc:1434] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:54.951047 17410 tablet_bootstrap.cc:492] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:54.968808 17410 tablet_bootstrap.cc:492] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:54.969585 17410 tablet_bootstrap.cc:492] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:54.970218 17410 ts_tablet_manager.cc:1403] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 12:29:54.972998 17410 raft_consensus.cc:359] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:54.973697 17410 raft_consensus.cc:740] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:54.974545 17410 consensus_queue.cc:260] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:54.976730 17410 ts_tablet_manager.cc:1434] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 12:29:54.977563 17410 tablet_bootstrap.cc:492] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:54.992466 17410 tablet_bootstrap.cc:492] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:54.993353 17410 tablet_bootstrap.cc:492] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:54.993945 17410 ts_tablet_manager.cc:1403] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 12:29:54.996212 17410 raft_consensus.cc:359] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:54.996871 17410 raft_consensus.cc:740] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:54.997757 17410 consensus_queue.cc:260] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:54.999941 17410 ts_tablet_manager.cc:1434] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:29:55.000718 17410 tablet_bootstrap.cc:492] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.014986 17410 tablet_bootstrap.cc:492] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.015766 17410 tablet_bootstrap.cc:492] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.016296 17410 ts_tablet_manager.cc:1403] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:29:55.018430 17410 raft_consensus.cc:359] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
W20260709 12:29:55.018564 16559 consensus_peers.cc:597] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:55.019639 17410 raft_consensus.cc:740] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.020442 17410 consensus_queue.cc:260] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:55.022380 17410 ts_tablet_manager.cc:1434] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:29:55.023043 17410 tablet_bootstrap.cc:492] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.041318 17410 tablet_bootstrap.cc:492] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.042536 17410 tablet_bootstrap.cc:492] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.044992 17410 ts_tablet_manager.cc:1403] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
I20260709 12:29:55.048979 17410 raft_consensus.cc:359] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:55.049849 17410 raft_consensus.cc:740] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.050679 17410 consensus_queue.cc:260] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:55.059471 17410 ts_tablet_manager.cc:1434] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.005s
I20260709 12:29:55.061408 17410 tablet_bootstrap.cc:492] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.068523  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.65:36499
I20260709 12:29:55.068675 17483 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.65:36499 every 8 connection(s)
I20260709 12:29:55.102373 17410 tablet_bootstrap.cc:492] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.103295 17410 tablet_bootstrap.cc:492] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.103888 17410 ts_tablet_manager.cc:1403] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.043s	user 0.029s	sys 0.008s
I20260709 12:29:55.106392 17410 raft_consensus.cc:359] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:55.107267 17410 raft_consensus.cc:740] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.108055 17410 consensus_queue.cc:260] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:55.110682 17410 ts_tablet_manager.cc:1434] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:29:55.111675 17410 tablet_bootstrap.cc:492] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.157435 17410 tablet_bootstrap.cc:492] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.158630 17410 tablet_bootstrap.cc:492] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.159456 17410 ts_tablet_manager.cc:1403] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.004s
I20260709 12:29:55.162868 17410 raft_consensus.cc:359] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:55.163735 17410 raft_consensus.cc:740] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.164587 17410 consensus_queue.cc:260] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:55.167421 17410 ts_tablet_manager.cc:1434] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:29:55.168195 17410 tablet_bootstrap.cc:492] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.186908 17485 heartbeater.cc:344] Connected to a master server at 127.8.111.126:41553
I20260709 12:29:55.187434 17485 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:55.188681 17485 heartbeater.cc:507] Master 127.8.111.126:41553 requested a full tablet report, sending...
I20260709 12:29:55.193742 17410 tablet_bootstrap.cc:492] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.195022 17410 tablet_bootstrap.cc:492] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.195851 17410 ts_tablet_manager.cc:1403] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.012s
I20260709 12:29:55.198501 17410 raft_consensus.cc:359] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:55.199141 17410 raft_consensus.cc:740] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.199771 17410 consensus_queue.cc:260] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:29:55.201239 17410 ts_tablet_manager.cc:1434] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:29:55.202004 17410 tablet_bootstrap.cc:492] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.223476 16413 ts_manager.cc:194] Re-registered known tserver with Master: 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:29:55.228920 17410 tablet_bootstrap.cc:492] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.229950 17410 tablet_bootstrap.cc:492] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.230594 17410 ts_tablet_manager.cc:1403] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.012s
I20260709 12:29:55.233099 17410 raft_consensus.cc:359] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:55.233621 17457 raft_consensus.cc:3060] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:55.233738 17410 raft_consensus.cc:740] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.234618 17410 consensus_queue.cc:260] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:55.236511 17410 ts_tablet_manager.cc:1434] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:29:55.237279 17410 tablet_bootstrap.cc:492] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.276338 17410 tablet_bootstrap.cc:492] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.277172 17410 tablet_bootstrap.cc:492] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.277688 17410 ts_tablet_manager.cc:1403] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.016s
I20260709 12:29:55.280010 17410 raft_consensus.cc:359] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:55.280467 17454 raft_consensus.cc:3060] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:55.280644 17410 raft_consensus.cc:740] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.281514 17410 consensus_queue.cc:260] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:55.283069 17410 ts_tablet_manager.cc:1434] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:29:55.283663 17410 tablet_bootstrap.cc:492] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.297475 17410 tablet_bootstrap.cc:492] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.298250 17410 tablet_bootstrap.cc:492] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.298787 17410 ts_tablet_manager.cc:1403] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:29:55.299798 16413 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56942
I20260709 12:29:55.300621 17410 raft_consensus.cc:359] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:55.301282 17410 raft_consensus.cc:740] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.301990 17410 consensus_queue.cc:260] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:55.303560 17410 ts_tablet_manager.cc:1434] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:55.304246 17410 tablet_bootstrap.cc:492] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.304896 17485 heartbeater.cc:499] Master 127.8.111.126:41553 was elected leader, sending a full tablet report...
I20260709 12:29:55.319969 17410 tablet_bootstrap.cc:492] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.320902 17410 tablet_bootstrap.cc:492] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.321914 17410 ts_tablet_manager.cc:1403] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 12:29:55.325279 17410 raft_consensus.cc:359] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.325958 17410 raft_consensus.cc:740] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.326650 17410 consensus_queue.cc:260] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.328583 17410 ts_tablet_manager.cc:1434] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:29:55.329360 17410 tablet_bootstrap.cc:492] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.343583 17410 tablet_bootstrap.cc:492] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.344535 17410 tablet_bootstrap.cc:492] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.345168 17410 ts_tablet_manager.cc:1403] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:29:55.347627 17410 raft_consensus.cc:359] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:55.348272 17410 raft_consensus.cc:740] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.348902 17410 consensus_queue.cc:260] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:55.351037 17410 ts_tablet_manager.cc:1434] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:29:55.351802 17410 tablet_bootstrap.cc:492] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.372606 17410 tablet_bootstrap.cc:492] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.373584 17410 tablet_bootstrap.cc:492] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.374239 17410 ts_tablet_manager.cc:1403] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 12:29:55.377281 17410 raft_consensus.cc:359] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:55.378017 17410 raft_consensus.cc:740] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.378806 17410 consensus_queue.cc:260] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:55.380646 17410 ts_tablet_manager.cc:1434] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:29:55.381399 17410 tablet_bootstrap.cc:492] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.395081 17454 raft_consensus.cc:3060] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:55.398344 17410 tablet_bootstrap.cc:492] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.399689 17410 tablet_bootstrap.cc:492] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.400713 17410 ts_tablet_manager.cc:1403] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.003s
I20260709 12:29:55.403340 17410 raft_consensus.cc:359] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:55.404116 17410 raft_consensus.cc:740] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.405081 17410 consensus_queue.cc:260] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:55.407191 17410 ts_tablet_manager.cc:1434] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:29:55.407910 17410 tablet_bootstrap.cc:492] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.422602 17410 tablet_bootstrap.cc:492] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.423622 17410 tablet_bootstrap.cc:492] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.424563 17410 ts_tablet_manager.cc:1403] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:29:55.426970 17410 raft_consensus.cc:359] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.427520 17410 raft_consensus.cc:740] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.428138 17410 consensus_queue.cc:260] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.430403 17410 ts_tablet_manager.cc:1434] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:29:55.431473 17410 tablet_bootstrap.cc:492] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.445820 17410 tablet_bootstrap.cc:492] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.446797 17410 tablet_bootstrap.cc:492] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.447469 17410 ts_tablet_manager.cc:1403] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 12:29:55.449196 17454 raft_consensus.cc:3060] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:55.449664 17410 raft_consensus.cc:359] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.450239 17410 raft_consensus.cc:740] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.450947 17410 consensus_queue.cc:260] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.452888 17410 ts_tablet_manager.cc:1434] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:55.453888 17410 tablet_bootstrap.cc:492] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.471015 17410 tablet_bootstrap.cc:492] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.471848 17410 tablet_bootstrap.cc:492] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.472239 17454 raft_consensus.cc:3060] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:55.472388 17410 ts_tablet_manager.cc:1403] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:29:55.474401 17410 raft_consensus.cc:359] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.475031 17410 raft_consensus.cc:740] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.475654 17410 consensus_queue.cc:260] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.477103 17410 ts_tablet_manager.cc:1434] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 12:29:55.477830 17410 tablet_bootstrap.cc:492] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.497987 17410 tablet_bootstrap.cc:492] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.499001 17410 tablet_bootstrap.cc:492] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.499583 17410 ts_tablet_manager.cc:1403] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.004s
I20260709 12:29:55.502000 17410 raft_consensus.cc:359] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:55.502681 17410 raft_consensus.cc:740] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.503433 17410 consensus_queue.cc:260] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:55.505378 17410 ts_tablet_manager.cc:1434] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:55.506132 17410 tablet_bootstrap.cc:492] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.519304 17410 tablet_bootstrap.cc:492] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.520206 17410 tablet_bootstrap.cc:492] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.520879 17410 ts_tablet_manager.cc:1403] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:29:55.522935 17410 raft_consensus.cc:359] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.523392 17410 raft_consensus.cc:740] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.523977 17410 consensus_queue.cc:260] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.525794 17410 ts_tablet_manager.cc:1434] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:55.526455 17410 tablet_bootstrap.cc:492] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.540361 17457 raft_consensus.cc:3060] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:55.542163 17410 tablet_bootstrap.cc:492] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.543145 17410 tablet_bootstrap.cc:492] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.543807 17410 ts_tablet_manager.cc:1403] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:29:55.546221 17410 raft_consensus.cc:359] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:55.546885 17410 raft_consensus.cc:740] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.547652 17410 consensus_queue.cc:260] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:55.549583 17410 ts_tablet_manager.cc:1434] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:29:55.550350 17410 tablet_bootstrap.cc:492] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.574184 17410 tablet_bootstrap.cc:492] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.575150 17410 tablet_bootstrap.cc:492] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.575763 17410 ts_tablet_manager.cc:1403] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.000s
I20260709 12:29:55.578529 17410 raft_consensus.cc:359] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:55.579391 17410 raft_consensus.cc:740] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.580350 17410 consensus_queue.cc:260] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:55.582929 17410 ts_tablet_manager.cc:1434] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:29:55.583671 17410 tablet_bootstrap.cc:492] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.598920 17410 tablet_bootstrap.cc:492] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.599983 17410 tablet_bootstrap.cc:492] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.600690 17410 ts_tablet_manager.cc:1403] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 12:29:55.603014 17410 raft_consensus.cc:359] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.603652 17410 raft_consensus.cc:740] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.604238 17410 consensus_queue.cc:260] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.605758 17410 ts_tablet_manager.cc:1434] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:55.606808 17410 tablet_bootstrap.cc:492] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.618830 17410 tablet_bootstrap.cc:492] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.619508 17410 tablet_bootstrap.cc:492] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.620005 17410 ts_tablet_manager.cc:1403] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:29:55.621616 17410 raft_consensus.cc:359] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.622076 17410 raft_consensus.cc:740] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.622613 17410 consensus_queue.cc:260] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.624006 17410 ts_tablet_manager.cc:1434] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:29:55.625238 17410 tablet_bootstrap.cc:492] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.640292 17410 tablet_bootstrap.cc:492] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.641283 17410 tablet_bootstrap.cc:492] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.641871 17410 ts_tablet_manager.cc:1403] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 12:29:55.644011 17410 raft_consensus.cc:359] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:55.644645 17410 raft_consensus.cc:740] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.645273 17410 consensus_queue.cc:260] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:55.647452 17410 ts_tablet_manager.cc:1434] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 12:29:55.648649 17410 tablet_bootstrap.cc:492] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.676170 17410 tablet_bootstrap.cc:492] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.677245 17410 tablet_bootstrap.cc:492] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.677953 17410 ts_tablet_manager.cc:1403] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.010s
I20260709 12:29:55.680461 17410 raft_consensus.cc:359] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:55.681164 17410 raft_consensus.cc:740] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.681912 17410 consensus_queue.cc:260] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:55.684166 17410 ts_tablet_manager.cc:1434] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 12:29:55.685014 17410 tablet_bootstrap.cc:492] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.705613 17457 raft_consensus.cc:3060] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:55.738799 17456 raft_consensus.cc:3060] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:55.767688 17410 tablet_bootstrap.cc:492] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.768750 17410 tablet_bootstrap.cc:492] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.769560 17410 ts_tablet_manager.cc:1403] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.085s	user 0.043s	sys 0.036s
I20260709 12:29:55.771850 17410 raft_consensus.cc:359] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.772495 17410 raft_consensus.cc:740] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.773626 17410 consensus_queue.cc:260] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.775098 17410 ts_tablet_manager.cc:1434] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:29:55.775810 17410 tablet_bootstrap.cc:492] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.793612 17457 raft_consensus.cc:3060] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:55.796554 17410 tablet_bootstrap.cc:492] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.797551 17410 tablet_bootstrap.cc:492] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.798156 17410 ts_tablet_manager.cc:1403] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 12:29:55.800585 17410 raft_consensus.cc:359] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:55.801227 17410 raft_consensus.cc:740] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.802024 17410 consensus_queue.cc:260] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:55.804083 17410 ts_tablet_manager.cc:1434] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:29:55.804821 17410 tablet_bootstrap.cc:492] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.824987 17410 tablet_bootstrap.cc:492] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.825866 17410 tablet_bootstrap.cc:492] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.826490 17410 ts_tablet_manager.cc:1403] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 12:29:55.828756 17410 raft_consensus.cc:359] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:55.829391 17410 raft_consensus.cc:740] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.830173 17410 consensus_queue.cc:260] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:55.832079 17410 ts_tablet_manager.cc:1434] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:55.832827 17410 tablet_bootstrap.cc:492] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.846424 17410 tablet_bootstrap.cc:492] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.847254 17410 tablet_bootstrap.cc:492] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.847806 17410 ts_tablet_manager.cc:1403] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:29:55.850013 17410 raft_consensus.cc:359] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:55.850646 17410 raft_consensus.cc:740] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.851351 17410 consensus_queue.cc:260] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:55.853334 17410 ts_tablet_manager.cc:1434] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:29:55.854084 17410 tablet_bootstrap.cc:492] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.874217 17410 tablet_bootstrap.cc:492] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.875168 17410 tablet_bootstrap.cc:492] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.875722 17410 ts_tablet_manager.cc:1403] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 12:29:55.877740 17410 raft_consensus.cc:359] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.878245 17410 raft_consensus.cc:740] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.878911 17410 consensus_queue.cc:260] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.880807 17410 ts_tablet_manager.cc:1434] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:55.882259 17410 tablet_bootstrap.cc:492] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.895704 17410 tablet_bootstrap.cc:492] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.896672 17410 tablet_bootstrap.cc:492] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.897351 17410 ts_tablet_manager.cc:1403] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:29:55.900496 17410 raft_consensus.cc:359] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.901170 17410 raft_consensus.cc:740] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.901840 17410 consensus_queue.cc:260] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.903728 17410 ts_tablet_manager.cc:1434] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:29:55.904811 17410 tablet_bootstrap.cc:492] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.918617 17410 tablet_bootstrap.cc:492] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.922200 17410 tablet_bootstrap.cc:492] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.922995 17410 ts_tablet_manager.cc:1403] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 12:29:55.930028 17410 raft_consensus.cc:359] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:55.930852 17410 raft_consensus.cc:740] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.931824 17410 consensus_queue.cc:260] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:29:55.934197 17410 ts_tablet_manager.cc:1434] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:29:55.935113 17410 tablet_bootstrap.cc:492] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:55.978264 17457 raft_consensus.cc:3060] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:55.979156 17410 tablet_bootstrap.cc:492] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:55.980135 17410 tablet_bootstrap.cc:492] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:55.980921 17410 ts_tablet_manager.cc:1403] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.046s	user 0.035s	sys 0.007s
I20260709 12:29:55.983603 17410 raft_consensus.cc:359] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.984299 17410 raft_consensus.cc:740] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:55.985155 17410 consensus_queue.cc:260] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:29:55.988725 17410 ts_tablet_manager.cc:1434] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:55.989529 17410 tablet_bootstrap.cc:492] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap starting.
I20260709 12:29:56.013140 17410 tablet_bootstrap.cc:492] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:56.014065 17410 tablet_bootstrap.cc:492] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Bootstrap complete.
I20260709 12:29:56.014755 17410 ts_tablet_manager.cc:1403] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.003s
I20260709 12:29:56.016784 17410 raft_consensus.cc:359] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:56.017335 17410 raft_consensus.cc:740] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Initialized, Role: FOLLOWER
I20260709 12:29:56.017973 17410 consensus_queue.cc:260] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:29:56.020061 17410 ts_tablet_manager.cc:1434] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:56.066208 17457 raft_consensus.cc:3060] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:56.417891 16630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 58696.5us
I20260709 12:30:05.190034  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:05.251161 16661 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d82d757f6a34783b2b2055824f65e88"
dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
mode: GRACEFUL
new_leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:48578
I20260709 12:30:05.252064 16661 raft_consensus.cc:606] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Received request to transfer leadership to TS 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:05.265679 16591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95064ed3f05a4169a3ff0f2123274cb7"
dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
mode: GRACEFUL
new_leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:51982
I20260709 12:30:05.266224 16591 raft_consensus.cc:606] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Received request to transfer leadership to TS 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:05.268785 16661 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2ec89af83a842909ba5e19282a9e12d"
dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
mode: GRACEFUL
new_leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:48578
I20260709 12:30:05.269310 16661 raft_consensus.cc:606] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Received request to transfer leadership to TS 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:05.271764 16664 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c53516641dc3421cac583bbe728f6e14"
dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
mode: GRACEFUL
new_leader_uuid: "cd924581228b49d889b0e1553519722a"
 from {username='slave'} at 127.0.0.1:48578
I20260709 12:30:05.272145 16664 raft_consensus.cc:606] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Received request to transfer leadership to TS cd924581228b49d889b0e1553519722a
I20260709 12:30:05.274344 16664 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d285abc27263437a85f24a1d8f993be1"
dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
mode: GRACEFUL
new_leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:48578
I20260709 12:30:05.274757 16664 raft_consensus.cc:606] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Received request to transfer leadership to TS 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:05.276932 16664 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e405df92b54c47daa8ae52a9fc87b7ac"
dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
mode: GRACEFUL
new_leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:48578
I20260709 12:30:05.277274 16664 raft_consensus.cc:606] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Received request to transfer leadership to TS 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:05.278225  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:30:05.279515  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:05.280454  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:05.293147 17560 raft_consensus.cc:993] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5: : Instructing follower 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:05.293766 17566 raft_consensus.cc:1081] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Signalling peer 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:05.295398 17457 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95064ed3f05a4169a3ff0f2123274cb7"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:44912
I20260709 12:30:05.295951 17457 raft_consensus.cc:493] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:05.296342 17457 raft_consensus.cc:3060] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:05.304030 17457 raft_consensus.cc:515] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:05.306667 17457 leader_election.cc:290] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:05.322302 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95064ed3f05a4169a3ff0f2123274cb7" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:05.323065 16591 raft_consensus.cc:3055] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:05.323372 16591 raft_consensus.cc:740] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:05.324200 16591 consensus_queue.cc:260] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:05.325532 16591 raft_consensus.cc:3060] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:05.329270 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95064ed3f05a4169a3ff0f2123274cb7" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:05.329869 16664 raft_consensus.cc:3060] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:05.335064 17569 raft_consensus.cc:993] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6: : Instructing follower 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:05.335515 17569 raft_consensus.cc:1081] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Signalling peer 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:05.337795 17456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d82d757f6a34783b2b2055824f65e88"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:44904
I20260709 12:30:05.338291 16664 raft_consensus.cc:2468] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:05.339417 17456 raft_consensus.cc:493] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:05.339809 17456 raft_consensus.cc:3060] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:05.340150 17407 leader_election.cc:304] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:30:05.346587 17456 raft_consensus.cc:515] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:05.348711 17456 leader_election.cc:290] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:05.357808 16591 raft_consensus.cc:2468] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:05.359203 17578 raft_consensus.cc:2804] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:05.367259 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d82d757f6a34783b2b2055824f65e88" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:05.368285 16664 raft_consensus.cc:3055] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:05.370417 16664 raft_consensus.cc:740] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:05.371485 16664 consensus_queue.cc:260] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:05.383198 16664 raft_consensus.cc:3060] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:05.383807 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d82d757f6a34783b2b2055824f65e88" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:05.384591 16735 raft_consensus.cc:3060] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:05.380188 17578 raft_consensus.cc:697] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:05.386655 17569 raft_consensus.cc:993] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6: : Instructing follower 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:05.387238 17569 raft_consensus.cc:1081] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Signalling peer 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:05.389467 17457 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2ec89af83a842909ba5e19282a9e12d"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:44904
I20260709 12:30:05.390022 17457 raft_consensus.cc:493] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:05.390389 17457 raft_consensus.cc:3060] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:05.388643 17578 consensus_queue.cc:237] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:05.401196 16664 raft_consensus.cc:2468] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:05.402388 17407 leader_election.cc:304] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:30:05.403277 17580 raft_consensus.cc:2804] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:05.405129 16735 raft_consensus.cc:2468] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:05.413447 17580 raft_consensus.cc:697] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:05.414474 17580 consensus_queue.cc:237] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:05.425935 17457 raft_consensus.cc:515] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:05.437223 17457 leader_election.cc:290] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:05.437865 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ec89af83a842909ba5e19282a9e12d" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:05.438651 16664 raft_consensus.cc:3055] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:05.438833 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ec89af83a842909ba5e19282a9e12d" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:05.438400 16416 catalog_manager.cc:5697] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 1 to 2, leader changed from 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 2 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:05.439128 16664 raft_consensus.cc:740] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:05.439495 16735 raft_consensus.cc:3060] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:05.440593 16664 consensus_queue.cc:260] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:05.442540 16664 raft_consensus.cc:3060] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:05.447634 16735 raft_consensus.cc:2468] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:05.449012 17405 leader_election.cc:304] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:05.449844 17580 raft_consensus.cc:2804] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:05.450340 16664 raft_consensus.cc:2468] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:05.450377 17580 raft_consensus.cc:697] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:05.451747 17580 consensus_queue.cc:237] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:05.462919 16416 catalog_manager.cc:5697] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 1 to 2, leader changed from 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 2 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:05.464039 16416 catalog_manager.cc:5697] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 1 to 2, leader changed from 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 2 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:05.483134 17565 raft_consensus.cc:993] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6: : Instructing follower 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:05.483660 17569 raft_consensus.cc:1081] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Signalling peer 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:05.485795 17457 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d285abc27263437a85f24a1d8f993be1"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:44904
I20260709 12:30:05.486243 17457 raft_consensus.cc:493] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:05.486536 17457 raft_consensus.cc:3060] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:05.491068 17457 raft_consensus.cc:515] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:05.492426 17457 leader_election.cc:290] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:05.493362 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d285abc27263437a85f24a1d8f993be1" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:05.493358 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d285abc27263437a85f24a1d8f993be1" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:05.493968 16735 raft_consensus.cc:3060] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:05.494061 16664 raft_consensus.cc:3055] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:05.494478 16664 raft_consensus.cc:740] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:05.495054 16664 consensus_queue.cc:260] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:05.495992 16664 raft_consensus.cc:3060] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:05.498383 16735 raft_consensus.cc:2468] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 3.
I20260709 12:30:05.499512 17405 leader_election.cc:304] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:05.500269 17580 raft_consensus.cc:2804] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:05.500720 17580 raft_consensus.cc:697] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:05.501300 16664 raft_consensus.cc:2468] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 3.
I20260709 12:30:05.501551 17580 consensus_queue.cc:237] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:05.514249 16416 catalog_manager.cc:5697] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 2 to 3, leader changed from 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 3 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:05.522382 17572 raft_consensus.cc:993] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6: : Instructing follower cd924581228b49d889b0e1553519722a to start an election
I20260709 12:30:05.522888 17572 raft_consensus.cc:1081] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Signalling peer cd924581228b49d889b0e1553519722a to start an election
I20260709 12:30:05.524461 16735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c53516641dc3421cac583bbe728f6e14"
dest_uuid: "cd924581228b49d889b0e1553519722a"
 from {username='slave'} at 127.0.0.1:58206
I20260709 12:30:05.525009 16735 raft_consensus.cc:493] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:05.525391 16735 raft_consensus.cc:3060] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:05.531761 16735 raft_consensus.cc:515] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:05.533923 16735 leader_election.cc:290] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:05.534545 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53516641dc3421cac583bbe728f6e14" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:05.534813 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53516641dc3421cac583bbe728f6e14" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:05.535123 16591 raft_consensus.cc:3060] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:05.535434 16664 raft_consensus.cc:3055] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:05.535748 16664 raft_consensus.cc:740] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:05.536453 16664 consensus_queue.cc:260] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:05.537616 16664 raft_consensus.cc:3060] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:05.541390 16591 raft_consensus.cc:2468] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 2.
I20260709 12:30:05.542928 16704 leader_election.cc:304] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:05.544165 17584 raft_consensus.cc:2804] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:05.544365 16664 raft_consensus.cc:2468] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 2.
I20260709 12:30:05.544682 17584 raft_consensus.cc:697] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:30:05.546190 17584 consensus_queue.cc:237] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:05.551548 17565 raft_consensus.cc:993] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6: : Instructing follower 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:05.551995 17569 raft_consensus.cc:1081] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Signalling peer 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:05.553642 17457 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e405df92b54c47daa8ae52a9fc87b7ac"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:44904
I20260709 12:30:05.554261 17457 raft_consensus.cc:493] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:05.554685 17457 raft_consensus.cc:3060] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:05.556959 16416 catalog_manager.cc:5697] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 1 to 2, leader changed from 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67) to cd924581228b49d889b0e1553519722a (127.8.111.68). New cstate: current_term: 2 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:05.560011 17457 raft_consensus.cc:515] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:05.562248 17457 leader_election.cc:290] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:05.565021 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e405df92b54c47daa8ae52a9fc87b7ac" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:05.565629 16591 raft_consensus.cc:3060] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:05.567230 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e405df92b54c47daa8ae52a9fc87b7ac" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:05.568780 16664 raft_consensus.cc:3055] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:05.568977 16664 raft_consensus.cc:740] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:05.569650 16664 consensus_queue.cc:260] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:05.571460 16664 raft_consensus.cc:3060] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:05.572322 16591 raft_consensus.cc:2468] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:05.574334 17404 leader_election.cc:304] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:05.575169 17580 raft_consensus.cc:2804] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:05.575687 17580 raft_consensus.cc:697] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:05.576489 17580 consensus_queue.cc:237] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:05.577239 16664 raft_consensus.cc:2468] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:05.586453 16416 catalog_manager.cc:5697] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 1 to 2, leader changed from 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 2 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:05.801445 16661 raft_consensus.cc:1275] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:05.802548 17580 consensus_queue.cc:1048] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:05.814188 16591 raft_consensus.cc:1275] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:05.815845 17580 consensus_queue.cc:1048] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:05.838380 16661 raft_consensus.cc:1275] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:05.839797 17580 consensus_queue.cc:1048] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:05.850469 16735 raft_consensus.cc:1275] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:05.851835 17578 consensus_queue.cc:1048] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:05.867463 16661 raft_consensus.cc:1275] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:05.869030 17578 consensus_queue.cc:1048] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:05.881822 16735 raft_consensus.cc:1275] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:05.883457 17580 consensus_queue.cc:1048] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:05.896431 16664 raft_consensus.cc:1275] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:05.897668 17580 consensus_queue.cc:1048] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:05.909709 16735 raft_consensus.cc:1275] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:05.918637 17580 consensus_queue.cc:1048] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:05.993553 16664 raft_consensus.cc:1275] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:05.995201 17578 consensus_queue.cc:1048] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:06.011637 16589 raft_consensus.cc:1275] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:06.013149 17605 consensus_queue.cc:1048] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:06.067485 16589 raft_consensus.cc:1275] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Refusing update from remote peer cd924581228b49d889b0e1553519722a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:06.068742 17584 consensus_queue.cc:1048] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:06.078359 16659 raft_consensus.cc:1275] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Refusing update from remote peer cd924581228b49d889b0e1553519722a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:06.079958 17611 consensus_queue.cc:1048] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:06.327000  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:06.421092 16591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2738a61896734d42b9febbcbf8848761"
dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
mode: GRACEFUL
new_leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:51982
I20260709 12:30:06.422227 16591 raft_consensus.cc:606] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Received request to transfer leadership to TS 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:06.425611 16591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d56d3967e8f4a15b1883473e50c4c85"
dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
mode: GRACEFUL
new_leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:51982
I20260709 12:30:06.426251 16591 raft_consensus.cc:606] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Received request to transfer leadership to TS 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:06.429072 16591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d8898ec613947bfa3b95ae941e1245d"
dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
mode: GRACEFUL
new_leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:51982
I20260709 12:30:06.429629 16591 raft_consensus.cc:606] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Received request to transfer leadership to TS 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:06.431875 16591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a17be6871edc41768bb5b3a6e2d1cf2a"
dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
mode: GRACEFUL
new_leader_uuid: "cd924581228b49d889b0e1553519722a"
 from {username='slave'} at 127.0.0.1:51982
I20260709 12:30:06.432556 16591 raft_consensus.cc:606] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Received request to transfer leadership to TS cd924581228b49d889b0e1553519722a
I20260709 12:30:06.435493 16591 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3262489dd274a878ecf95eb28323a5b"
dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
mode: GRACEFUL
new_leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:51982
I20260709 12:30:06.436174 16591 raft_consensus.cc:606] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Received request to transfer leadership to TS 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:06.437644  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:30:06.439406  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:06.440397  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:06.489048 17615 raft_consensus.cc:993] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5: : Instructing follower cd924581228b49d889b0e1553519722a to start an election
I20260709 12:30:06.489881 17615 raft_consensus.cc:1081] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Signalling peer cd924581228b49d889b0e1553519722a to start an election
I20260709 12:30:06.490576 17566 raft_consensus.cc:993] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5: : Instructing follower 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:06.491189 17615 raft_consensus.cc:1081] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Signalling peer 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:06.492606 16733 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a17be6871edc41768bb5b3a6e2d1cf2a"
dest_uuid: "cd924581228b49d889b0e1553519722a"
 from {username='slave'} at 127.0.0.1:58230
I20260709 12:30:06.493139 16733 raft_consensus.cc:493] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:06.493501 16733 raft_consensus.cc:3060] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:06.507522 17457 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d8898ec613947bfa3b95ae941e1245d"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:44912
I20260709 12:30:06.511406 17457 raft_consensus.cc:493] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:06.513751 17457 raft_consensus.cc:3060] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:06.546546 17457 raft_consensus.cc:515] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:06.557135 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8898ec613947bfa3b95ae941e1245d" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:06.558190 16741 raft_consensus.cc:3060] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:06.559355 17457 leader_election.cc:290] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:06.560612 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8898ec613947bfa3b95ae941e1245d" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:06.560961 17616 raft_consensus.cc:993] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5: : Instructing follower 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:06.546466 16733 raft_consensus.cc:515] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:06.561298 16589 raft_consensus.cc:3055] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:06.563335 16589 raft_consensus.cc:740] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:06.564527 16589 consensus_queue.cc:260] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:06.565891 16733 leader_election.cc:290] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:06.567456 16741 raft_consensus.cc:2468] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:06.567709 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17be6871edc41768bb5b3a6e2d1cf2a" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:06.561478 17566 raft_consensus.cc:1081] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Signalling peer 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:06.568434 16591 raft_consensus.cc:3055] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:06.568786 16591 raft_consensus.cc:740] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:06.565987 16589 raft_consensus.cc:3060] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:06.569594 16591 consensus_queue.cc:260] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:06.571205 16591 raft_consensus.cc:3060] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:06.573261 17456 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2738a61896734d42b9febbcbf8848761"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:44912
I20260709 12:30:06.573824 17456 raft_consensus.cc:493] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:06.590592 17405 leader_election.cc:304] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:06.591950 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17be6871edc41768bb5b3a6e2d1cf2a" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:06.595005 16664 raft_consensus.cc:3060] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:06.593864 17456 raft_consensus.cc:3060] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:06.601706 17578 raft_consensus.cc:2804] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:06.602296 17578 raft_consensus.cc:697] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:06.603708 17578 consensus_queue.cc:237] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:06.608484 17560 raft_consensus.cc:993] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5: : Instructing follower 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:06.609020 17560 raft_consensus.cc:1081] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Signalling peer 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:06.613487 16664 raft_consensus.cc:2468] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 2.
I20260709 12:30:06.615945 17457 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d56d3967e8f4a15b1883473e50c4c85"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:44912
I20260709 12:30:06.623234 17457 raft_consensus.cc:493] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:06.623713 17457 raft_consensus.cc:3060] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:06.609411 16591 raft_consensus.cc:2468] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 2.
I20260709 12:30:06.640379 17456 raft_consensus.cc:515] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:06.641160 16589 raft_consensus.cc:2468] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:06.644052 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2738a61896734d42b9febbcbf8848761" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:06.644351 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2738a61896734d42b9febbcbf8848761" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:06.644721 16661 raft_consensus.cc:3060] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:06.645023 16589 raft_consensus.cc:3055] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:06.645426 16589 raft_consensus.cc:740] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:06.646955 16589 consensus_queue.cc:260] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:06.649230 16589 raft_consensus.cc:3060] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:06.648337 17456 leader_election.cc:290] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:06.654845 17457 raft_consensus.cc:515] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:06.662667 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56d3967e8f4a15b1883473e50c4c85" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:06.663439 16590 raft_consensus.cc:3055] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:06.663710 16590 raft_consensus.cc:740] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:06.664556 16590 consensus_queue.cc:260] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:06.665546 16589 raft_consensus.cc:2468] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:06.665804 16590 raft_consensus.cc:3060] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:06.669574 17404 leader_election.cc:304] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:06.670693 17605 raft_consensus.cc:2804] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:06.671250 17605 raft_consensus.cc:697] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:06.672520 17605 consensus_queue.cc:237] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:06.674088 16412 catalog_manager.cc:5697] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 1 to 2, leader changed from 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 2 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:06.655515 16704 leader_election.cc:304] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:06.679689 17611 raft_consensus.cc:2804] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:06.656718 16661 raft_consensus.cc:2468] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:06.680189 17611 raft_consensus.cc:697] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:30:06.681170 17611 consensus_queue.cc:237] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:06.685068 17457 leader_election.cc:290] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:06.688006 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56d3967e8f4a15b1883473e50c4c85" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:06.689980 16590 raft_consensus.cc:2468] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:06.691248 17404 leader_election.cc:304] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:06.693357 17578 raft_consensus.cc:2804] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:06.693868 17578 raft_consensus.cc:697] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:06.688745 16664 raft_consensus.cc:3060] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:06.694885 17578 consensus_queue.cc:237] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:06.705585 16664 raft_consensus.cc:2468] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:06.715016 16413 catalog_manager.cc:5697] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 1 to 2, leader changed from 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66) to cd924581228b49d889b0e1553519722a (127.8.111.68). New cstate: current_term: 2 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:06.729970 16412 catalog_manager.cc:5697] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 1 to 2, leader changed from 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 2 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:06.731555 16412 catalog_manager.cc:5697] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 1 to 2, leader changed from 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 2 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:06.883417 17560 raft_consensus.cc:993] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5: : Instructing follower 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:06.883876 17566 raft_consensus.cc:1081] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Signalling peer 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:06.885309 17455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3262489dd274a878ecf95eb28323a5b"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:44912
I20260709 12:30:06.885869 17455 raft_consensus.cc:493] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:06.886219 17455 raft_consensus.cc:3060] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:06.892457 17455 raft_consensus.cc:515] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:06.894187 17455 leader_election.cc:290] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:06.894917 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3262489dd274a878ecf95eb28323a5b" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:06.895362 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3262489dd274a878ecf95eb28323a5b" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:06.895545 16733 raft_consensus.cc:3060] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:06.896132 16590 raft_consensus.cc:3055] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:06.896497 16590 raft_consensus.cc:740] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:06.897363 16590 consensus_queue.cc:260] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:06.898706 16590 raft_consensus.cc:3060] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:06.902348 16733 raft_consensus.cc:2468] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:06.903949 17405 leader_election.cc:304] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:06.904817 17578 raft_consensus.cc:2804] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:06.905287 17578 raft_consensus.cc:697] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:06.905712 16590 raft_consensus.cc:2468] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:06.907197 17578 consensus_queue.cc:237] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:06.918673 16412 catalog_manager.cc:5697] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 1 to 2, leader changed from 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 2 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:07.030499 16741 raft_consensus.cc:1275] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:07.031682 17605 consensus_queue.cc:1048] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:07.044852 16590 raft_consensus.cc:1275] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:07.046331 17605 consensus_queue.cc:1048] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:07.089521 16664 raft_consensus.cc:1275] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:07.090845 17605 consensus_queue.cc:1048] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:07.106505 16590 raft_consensus.cc:1275] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:07.108583 17578 consensus_queue.cc:1048] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:07.127966 16589 raft_consensus.cc:1275] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Refusing update from remote peer cd924581228b49d889b0e1553519722a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:07.129760 17584 consensus_queue.cc:1048] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:07.139410 16664 raft_consensus.cc:1275] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Refusing update from remote peer cd924581228b49d889b0e1553519722a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:07.141173 17584 consensus_queue.cc:1048] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:07.198567 16664 raft_consensus.cc:1275] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:07.199702 17578 consensus_queue.cc:1048] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:07.208985 16589 raft_consensus.cc:1275] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:07.211172 17580 consensus_queue.cc:1048] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:07.314586 16590 raft_consensus.cc:1275] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:07.315874 17578 consensus_queue.cc:1048] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:07.325408 16733 raft_consensus.cc:1275] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:07.327207 17605 consensus_queue.cc:1048] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:07.542960  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:07.792017 16592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38c2fffde641468f9399b51e98f495eb"
dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
mode: GRACEFUL
new_leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:51982
I20260709 12:30:07.792695 16592 raft_consensus.cc:606] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Received request to transfer leadership to TS 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:07.797184 16592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d9befeb38274b3fbca494f3044f9822"
dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
mode: GRACEFUL
new_leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:51982
I20260709 12:30:07.797807 16592 raft_consensus.cc:606] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Received request to transfer leadership to TS 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:07.827430 16592 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "450ac00038aa4947961ef3398fd75ca4"
dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
mode: GRACEFUL
new_leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:51982
I20260709 12:30:07.828125 16592 raft_consensus.cc:606] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Received request to transfer leadership to TS 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:07.834127 16590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d31544c1e5974ed9bf1a91c63adb99b8"
dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
mode: GRACEFUL
new_leader_uuid: "cd924581228b49d889b0e1553519722a"
 from {username='slave'} at 127.0.0.1:51982
I20260709 12:30:07.834904 16590 raft_consensus.cc:606] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Received request to transfer leadership to TS cd924581228b49d889b0e1553519722a
I20260709 12:30:07.837760 16590 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcd2958b516b4504aec8657e0fe2ec24"
dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
mode: GRACEFUL
new_leader_uuid: "99ca36f8a50c459388f31022b1455ed6"
 from {username='slave'} at 127.0.0.1:51982
I20260709 12:30:07.838376 16590 raft_consensus.cc:606] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Received request to transfer leadership to TS 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:07.843853  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:30:07.860157 17641 raft_consensus.cc:993] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5: : Instructing follower cd924581228b49d889b0e1553519722a to start an election
I20260709 12:30:07.860805 17641 raft_consensus.cc:1081] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Signalling peer cd924581228b49d889b0e1553519722a to start an election
I20260709 12:30:07.894994 17566 raft_consensus.cc:993] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5: : Instructing follower 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:07.895519 17566 raft_consensus.cc:1081] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Signalling peer 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:07.896973  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:07.897435 17455 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d9befeb38274b3fbca494f3044f9822"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:44912
I20260709 12:30:07.897985 17455 raft_consensus.cc:493] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:07.898391 17455 raft_consensus.cc:3060] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:07.899035  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:07.909611 16734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d31544c1e5974ed9bf1a91c63adb99b8"
dest_uuid: "cd924581228b49d889b0e1553519722a"
 from {username='slave'} at 127.0.0.1:58230
I20260709 12:30:07.910251 16734 raft_consensus.cc:493] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:07.910660 16734 raft_consensus.cc:3060] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:07.929886 17455 raft_consensus.cc:515] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:07.954721 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9befeb38274b3fbca494f3044f9822" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:07.955364 16592 raft_consensus.cc:3055] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:07.955679 16592 raft_consensus.cc:740] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:07.956602 16592 consensus_queue.cc:260] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:07.957748 16592 raft_consensus.cc:3060] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:07.965930 16592 raft_consensus.cc:2468] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:07.967599 17404 leader_election.cc:304] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:07.969163 17605 raft_consensus.cc:2804] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:07.932204 16734 raft_consensus.cc:515] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:07.969957 17605 raft_consensus.cc:697] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:07.974063 17605 consensus_queue.cc:237] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:07.975459 17455 leader_election.cc:290] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:07.977522 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d31544c1e5974ed9bf1a91c63adb99b8" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:07.978117 16664 raft_consensus.cc:3060] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:07.971930 16734 leader_election.cc:290] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
W20260709 12:30:07.981223 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 110366us
I20260709 12:30:07.979719 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9befeb38274b3fbca494f3044f9822" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:07.985338 16664 raft_consensus.cc:2468] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 2.
I20260709 12:30:07.985617 16661 raft_consensus.cc:3060] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:07.988845 16664 raft_consensus.cc:1240] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:07.994818 17641 consensus_queue.cc:1059] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:07.995875 17642 raft_consensus.cc:3055] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:07.996265 17642 raft_consensus.cc:740] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:07.997077 17642 consensus_queue.cc:260] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:07.997541 16707 leader_election.cc:304] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:07.998406 17566 raft_consensus.cc:993] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5: : Instructing follower 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:07.998558 17584 raft_consensus.cc:2804] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:07.998905 17642 raft_consensus.cc:3060] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:07.999064 17643 raft_consensus.cc:1081] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Signalling peer 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:07.999167 17584 raft_consensus.cc:697] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:30:08.000456 17584 consensus_queue.cc:237] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:08.001111 17457 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "450ac00038aa4947961ef3398fd75ca4"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:44912
I20260709 12:30:08.001694 17457 raft_consensus.cc:493] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:08.002038 17457 raft_consensus.cc:3060] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:08.009285 17643 raft_consensus.cc:993] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5: : Instructing follower 99ca36f8a50c459388f31022b1455ed6 to start an election
I20260709 12:30:08.009801 17643 raft_consensus.cc:1081] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Signalling peer 99ca36f8a50c459388f31022b1455ed6 to start an election
I20260709 12:30:08.012063 17457 raft_consensus.cc:515] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:08.017483 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ac00038aa4947961ef3398fd75ca4" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:08.017704 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d31544c1e5974ed9bf1a91c63adb99b8" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:08.018186 16589 raft_consensus.cc:3055] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:08.018067 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ac00038aa4947961ef3398fd75ca4" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:08.018774 16589 raft_consensus.cc:740] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:08.019069 16735 raft_consensus.cc:3060] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:08.020128 16589 consensus_queue.cc:260] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:08.021610 16589 raft_consensus.cc:3060] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:08.021973 17457 leader_election.cc:290] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:08.025755 16592 raft_consensus.cc:2468] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 2.
I20260709 12:30:08.030195 16589 raft_consensus.cc:2468] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:08.031440 17404 leader_election.cc:304] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:08.032300 17578 raft_consensus.cc:2804] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:08.032774 17578 raft_consensus.cc:697] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:08.033725 17578 consensus_queue.cc:237] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:08.035820 16413 catalog_manager.cc:5697] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 1 to 2, leader changed from 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66) to cd924581228b49d889b0e1553519722a (127.8.111.68). New cstate: current_term: 2 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:08.038785 16666 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fcd2958b516b4504aec8657e0fe2ec24"
dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
 from {username='slave'} at 127.0.0.1:48814
I20260709 12:30:08.042513 16666 raft_consensus.cc:493] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:08.043036 16666 raft_consensus.cc:3060] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:08.048539 16661 raft_consensus.cc:2468] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:08.051806 16735 raft_consensus.cc:2468] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:08.066816 16412 catalog_manager.cc:5697] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 1 to 2, leader changed from 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 2 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:08.074687 16666 raft_consensus.cc:515] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:08.080744 16666 leader_election.cc:290] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:08.081023 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd2958b516b4504aec8657e0fe2ec24" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:08.081815 16589 raft_consensus.cc:3055] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:08.082003 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd2958b516b4504aec8657e0fe2ec24" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:08.082187 16589 raft_consensus.cc:740] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:08.082701 16735 raft_consensus.cc:3060] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:08.083211 16589 consensus_queue.cc:260] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:08.084942 16589 raft_consensus.cc:3060] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:08.095396 16589 raft_consensus.cc:2468] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 2.
I20260709 12:30:08.096614 16735 raft_consensus.cc:2468] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 2.
I20260709 12:30:08.096869 16630 leader_election.cc:304] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:08.097909 17644 raft_consensus.cc:2804] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:08.098448 17644 raft_consensus.cc:697] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:08.099625 17644 consensus_queue.cc:237] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:08.103988 16412 catalog_manager.cc:5697] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 1 to 2, leader changed from 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 2 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:08.119097 16412 catalog_manager.cc:5697] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 1 to 2, leader changed from 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66) to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 2 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:08.268431 17638 raft_consensus.cc:993] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5: : Instructing follower 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:08.269050 17638 raft_consensus.cc:1081] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Signalling peer 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:08.270686 17458 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38c2fffde641468f9399b51e98f495eb"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:44912
I20260709 12:30:08.271186 17458 raft_consensus.cc:493] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:08.271559 17458 raft_consensus.cc:3060] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:08.278098 17458 raft_consensus.cc:515] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:08.279839 17458 leader_election.cc:290] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:08.280596 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c2fffde641468f9399b51e98f495eb" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:08.281045 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c2fffde641468f9399b51e98f495eb" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:08.281200 16735 raft_consensus.cc:3060] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:08.281688 16589 raft_consensus.cc:3055] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:08.282020 16589 raft_consensus.cc:740] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:08.282783 16589 consensus_queue.cc:260] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:08.283883 16589 raft_consensus.cc:3060] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:08.287524 16735 raft_consensus.cc:2468] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:08.288556 17405 leader_election.cc:304] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:08.289194 17578 raft_consensus.cc:2804] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:08.289621 17578 raft_consensus.cc:697] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:08.289711 16589 raft_consensus.cc:2468] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:08.290635 17578 consensus_queue.cc:237] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:08.299629 16412 catalog_manager.cc:5697] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 1 to 2, leader changed from 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 2 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:08.379575 16666 raft_consensus.cc:1275] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:08.381541 17578 consensus_queue.cc:1048] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:08.399960 16589 raft_consensus.cc:1275] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:08.401504 17578 consensus_queue.cc:1048] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:08.501740 16589 raft_consensus.cc:1275] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Refusing update from remote peer cd924581228b49d889b0e1553519722a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:08.502985 17584 consensus_queue.cc:1048] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:08.513231 16666 raft_consensus.cc:1275] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Refusing update from remote peer cd924581228b49d889b0e1553519722a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:08.514737 17584 consensus_queue.cc:1048] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:08.515444 16735 raft_consensus.cc:1275] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:08.516933 17578 consensus_queue.cc:1048] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:08.536702 16589 raft_consensus.cc:1275] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:08.538328 17580 consensus_queue.cc:1048] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:08.596788 16592 raft_consensus.cc:1275] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:08.598248 17650 consensus_queue.cc:1048] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:08.609669 16735 raft_consensus.cc:1275] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:08.611330 17572 consensus_queue.cc:1048] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:30:08.681077 16614 debug-util.cc:398] Leaking SignalData structure 0x7b0800271680 after lost signal to thread 8640
W20260709 12:30:08.682085 16614 debug-util.cc:398] Leaking SignalData structure 0x7b08002386a0 after lost signal to thread 16450
W20260709 12:30:08.683261 16614 debug-util.cc:398] Leaking SignalData structure 0x7b080014f5a0 after lost signal to thread 16617
W20260709 12:30:08.684255 16614 debug-util.cc:398] Leaking SignalData structure 0x7b080028f400 after lost signal to thread 16691
W20260709 12:30:08.685401 16614 debug-util.cc:398] Leaking SignalData structure 0x7b080021f260 after lost signal to thread 16765
W20260709 12:30:08.686563 16614 debug-util.cc:398] Leaking SignalData structure 0x7b080030d500 after lost signal to thread 17483
I20260709 12:30:08.824054 16735 raft_consensus.cc:1275] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:08.825868 17578 consensus_queue.cc:1048] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:08.838265 16590 raft_consensus.cc:1275] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:08.839876 17675 consensus_queue.cc:1048] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:08.977917  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:09.029893 16666 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2acb6cd36ac547548487db51c2510029"
dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
mode: GRACEFUL
new_leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:48578
I20260709 12:30:09.030700 16666 raft_consensus.cc:606] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Received request to transfer leadership to TS 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:09.072350 16735 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc"
dest_uuid: "cd924581228b49d889b0e1553519722a"
mode: GRACEFUL
new_leader_uuid: "99ca36f8a50c459388f31022b1455ed6"
 from {username='slave'} at 127.0.0.1:55242
I20260709 12:30:09.072991 16735 raft_consensus.cc:606] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Received request to transfer leadership to TS 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:09.074355  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:30:09.076224  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:09.077011  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:09.154567 17572 raft_consensus.cc:993] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6: : Instructing follower 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:09.155153 17572 raft_consensus.cc:1081] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Signalling peer 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:09.163472 17453 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2acb6cd36ac547548487db51c2510029"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:44904
I20260709 12:30:09.164106 17453 raft_consensus.cc:493] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:09.164497 17453 raft_consensus.cc:3060] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:09.173131 17453 raft_consensus.cc:515] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:09.175686 17453 leader_election.cc:290] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:09.176086 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:09.176894 16666 raft_consensus.cc:3055] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:09.177407 16666 raft_consensus.cc:740] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:09.179059 16666 consensus_queue.cc:260] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:09.180744 16666 raft_consensus.cc:3060] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:09.180682 16734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:09.181584 16734 raft_consensus.cc:3060] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:09.190802 16666 raft_consensus.cc:2468] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:09.193336 17407 leader_election.cc:304] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:30:09.194319 17578 raft_consensus.cc:2804] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:09.194422 16734 raft_consensus.cc:2468] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:09.194919 17578 raft_consensus.cc:697] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:09.196056 17578 consensus_queue.cc:237] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:09.209213 16412 catalog_manager.cc:5697] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 1 to 2, leader changed from 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 2 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:09.306393 17645 raft_consensus.cc:993] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a: : Instructing follower 99ca36f8a50c459388f31022b1455ed6 to start an election
I20260709 12:30:09.306917 17645 raft_consensus.cc:1081] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Signalling peer 99ca36f8a50c459388f31022b1455ed6 to start an election
I20260709 12:30:09.309381 16666 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc"
dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
 from {username='slave'} at 127.0.0.1:48810
I20260709 12:30:09.309937 16666 raft_consensus.cc:493] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:09.310305 16666 raft_consensus.cc:3060] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:09.317418 16666 raft_consensus.cc:515] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:09.321282 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:09.321911 16592 raft_consensus.cc:3060] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:09.331749 16592 raft_consensus.cc:2468] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 2.
I20260709 12:30:09.334600 16666 leader_election.cc:290] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:09.338627 16630 leader_election.cc:304] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:09.340018 17572 raft_consensus.cc:2804] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:09.340569 17572 raft_consensus.cc:697] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:09.341531 17572 consensus_queue.cc:237] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:09.346112 16734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:09.346863 16734 raft_consensus.cc:3055] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:09.347223 16734 raft_consensus.cc:740] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:30:09.348140 16734 consensus_queue.cc:260] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:09.349610 16734 raft_consensus.cc:3060] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:09.388338 16734 raft_consensus.cc:2468] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 2.
I20260709 12:30:10.554441 17692 raft_consensus.cc:493] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:30:10.555202 17692 raft_consensus.cc:515] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:10.553900 17694 raft_consensus.cc:493] T 2976cad482cd47bbadc454f8570dbb0d P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:30:10.558826 17694 raft_consensus.cc:515] T 2976cad482cd47bbadc454f8570dbb0d P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:10.561582 17694 leader_election.cc:290] T 2976cad482cd47bbadc454f8570dbb0d P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:10.562215 17693 raft_consensus.cc:493] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:30:10.565857 17693 raft_consensus.cc:515] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:10.567278 17584 raft_consensus.cc:493] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:10.568032 17584 raft_consensus.cc:515] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:10.568770 17693 leader_election.cc:290] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:10.571007 17584 leader_election.cc:290] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.577978 17692 leader_election.cc:290] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:10.579339 17690 raft_consensus.cc:493] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.579535 17691 raft_consensus.cc:493] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.580124 17690 raft_consensus.cc:515] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.580199 17691 raft_consensus.cc:515] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:10.581601 16592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51978 (request call id 480) took 1230 ms. Trace:
I20260709 12:30:10.583146 17690 leader_election.cc:290] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.583789 17690 raft_consensus.cc:493] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:30:10.584548 17646 raft_consensus.cc:493] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:10.584491 17690 raft_consensus.cc:515] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:10.585187 17646 raft_consensus.cc:515] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:10.585947 17584 raft_consensus.cc:493] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:10.586437 17645 raft_consensus.cc:493] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:10.586562 17584 raft_consensus.cc:515] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:10.582021 16592 rpcz_store.cc:276] 0709 12:30:09.350896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:30:09.352138 (+  1242us) service_pool.cc:224] Handling call
0709 12:30:10.581046 (+1228908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:30:10.581223 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:30:10.581281 (+    58us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:30:10.581326 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:30:10.581361 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:30:10.581416 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:30:10.581517 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:30:10.587085 17645 raft_consensus.cc:515] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:10.589218 17584 leader_election.cc:290] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:10.589581 17645 leader_election.cc:290] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:10.591111 17691 leader_election.cc:290] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:10.592486 17646 leader_election.cc:290] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:10.593420 17694 raft_consensus.cc:493] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:10.592554 17691 raft_consensus.cc:493] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
W20260709 12:30:10.596866 17404 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.059s	user 0.009s	sys 0.010s
I20260709 12:30:10.597402 17691 raft_consensus.cc:515] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
W20260709 12:30:10.597869 17404 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.061s	user 0.009s	sys 0.010s
I20260709 12:30:10.599762 17691 leader_election.cc:290] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:10.586845 17690 leader_election.cc:290] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:10.605724 17694 raft_consensus.cc:515] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.607906 17694 leader_election.cc:290] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.614169 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ec89af83a842909ba5e19282a9e12d" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:10.615994 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45c0ead4eb3497c91c28c55ee353d83" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:10.617602 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932859a73dad4a39b5874461e99676cc" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:10.631713 17699 raft_consensus.cc:493] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.632445 17699 raft_consensus.cc:515] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.633726 16736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2976cad482cd47bbadc454f8570dbb0d" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:10.633949 17700 raft_consensus.cc:493] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.702207 17645 raft_consensus.cc:493] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.702621 17700 raft_consensus.cc:515] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.702879 17645 raft_consensus.cc:515] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:10.703363 17699 leader_election.cc:290] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:10.703889 17699 raft_consensus.cc:493] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.704300 17699 raft_consensus.cc:515] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:10.704851 17700 leader_election.cc:290] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:10.704950 17645 leader_election.cc:290] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.635402 17703 raft_consensus.cc:493] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.638546 17695 raft_consensus.cc:493] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.705657 17703 raft_consensus.cc:515] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.640636 17701 raft_consensus.cc:493] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:10.643810 17704 raft_consensus.cc:493] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:30:10.644011 17705 raft_consensus.cc:493] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:10.652419 17708 raft_consensus.cc:493] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:10.659039 17693 raft_consensus.cc:493] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:10.660406 17706 raft_consensus.cc:493] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:10.662204 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d77d239e0634d6894726f6bba42be5e" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:10.662779 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d285abc27263437a85f24a1d8f993be1" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:10.662925 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39b696cc72749608ab54eae0a99b093" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:10.664518 17694 raft_consensus.cc:493] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.664906 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf661e435740adbb0269128765d10e" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:10.638824 17646 raft_consensus.cc:493] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
W20260709 12:30:10.649722 17572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.276s	user 0.000s	sys 0.016s
I20260709 12:30:10.633062 17578 raft_consensus.cc:493] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.636315 17584 raft_consensus.cc:493] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:10.679080 17676 raft_consensus.cc:493] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:10.685122 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c2fffde641468f9399b51e98f495eb" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
W20260709 12:30:10.688098 17405 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.104s	user 0.007s	sys 0.005s
I20260709 12:30:10.689395 17698 raft_consensus.cc:493] T 2fb661ebdebf474db7f6380eb0e49d7f P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:30:10.691673 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932859a73dad4a39b5874461e99676cc" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:10.639549 16738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda99eaeca1149d48e54e0d83c3ec4cb" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:10.705798 17695 raft_consensus.cc:515] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:10.708509 17703 leader_election.cc:290] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:10.743117 17703 raft_consensus.cc:493] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:10.743551 17712 raft_consensus.cc:493] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:10.708752 17701 raft_consensus.cc:515] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.744289 17712 raft_consensus.cc:515] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:10.708966 17704 raft_consensus.cc:515] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:10.746690 17722 raft_consensus.cc:493] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:30:10.747224 17722 raft_consensus.cc:515] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:10.747833 17713 raft_consensus.cc:493] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:10.709578 17708 raft_consensus.cc:515] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:10.749605 17701 leader_election.cc:290] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:10.750675 17708 leader_election.cc:290] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:10.750928 17701 raft_consensus.cc:493] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:10.714663 17706 raft_consensus.cc:515] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:10.751530 17701 raft_consensus.cc:515] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.753396 17706 leader_election.cc:290] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.714942 16735 raft_consensus.cc:2468] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:30:10.743703 17703 raft_consensus.cc:515] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:10.716336 17694 raft_consensus.cc:515] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.748332 17713 raft_consensus.cc:515] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:10.756057 17703 leader_election.cc:290] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:10.706261 17699 leader_election.cc:290] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.756852 17694 leader_election.cc:290] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.729543 17696 raft_consensus.cc:493] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.726524 17688 raft_consensus.cc:493] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.757859 17713 leader_election.cc:290] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.757690 17696 raft_consensus.cc:515] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.758071 17688 raft_consensus.cc:515] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:10.759958 17712 leader_election.cc:290] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
W20260709 12:30:10.731262 17407 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.016s	sys 0.008s
I20260709 12:30:10.735783 17584 raft_consensus.cc:515] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:10.761634 17688 leader_election.cc:290] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
W20260709 12:30:10.761806 17407 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.016s	sys 0.008s
I20260709 12:30:10.714614 17693 raft_consensus.cc:515] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.762975 17584 leader_election.cc:290] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:10.736794 17676 raft_consensus.cc:515] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:10.764114 17693 leader_election.cc:290] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.765514 17676 leader_election.cc:290] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:10.766042 17676 raft_consensus.cc:493] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:30:10.765965 17693 raft_consensus.cc:493] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:10.766987 17676 raft_consensus.cc:515] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:10.767554 17693 raft_consensus.cc:515] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:10.753424 17701 leader_election.cc:290] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:10.769223 17676 leader_election.cc:290] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
W20260709 12:30:10.738054 17405 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.154s	user 0.008s	sys 0.005s
I20260709 12:30:10.738634 17675 raft_consensus.cc:493] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:10.771070 17457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38c2fffde641468f9399b51e98f495eb" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:10.734943 17578 raft_consensus.cc:515] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:10.773706 17578 leader_election.cc:290] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.731014 17646 raft_consensus.cc:515] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:10.740006 17695 leader_election.cc:290] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.776343 17646 leader_election.cc:290] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:10.776950 16739 raft_consensus.cc:2468] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 3.
I20260709 12:30:10.778218 17693 leader_election.cc:290] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:10.779888 17722 leader_election.cc:290] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.771418 17675 raft_consensus.cc:515] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:10.714167 17697 raft_consensus.cc:493] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.727751 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eef363dbdce4d7bbd0b446385d8eb9e" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:10.782019 17697 raft_consensus.cc:515] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.728319 17700 raft_consensus.cc:493] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.783293 17675 leader_election.cc:290] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
W20260709 12:30:10.733596 17572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.360s	user 0.001s	sys 0.017s
I20260709 12:30:10.783659 17700 raft_consensus.cc:515] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:10.784657 17697 leader_election.cc:290] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.785933 17700 leader_election.cc:290] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.709518 17691 raft_consensus.cc:493] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.740945 17710 raft_consensus.cc:493] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.787150 17691 raft_consensus.cc:515] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.787417 17710 raft_consensus.cc:515] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.741912 17718 raft_consensus.cc:493] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.788481 17718 raft_consensus.cc:515] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:10.789381 17691 leader_election.cc:290] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.789815 17710 leader_election.cc:290] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:10.748361 17704 leader_election.cc:290] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:10.790867 17718 leader_election.cc:290] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:10.791021 17704 raft_consensus.cc:493] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:10.709185 17705 raft_consensus.cc:515] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.738308 16589 raft_consensus.cc:2468] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 1.
I20260709 12:30:10.791563 17704 raft_consensus.cc:515] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.760015 17696 leader_election.cc:290] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.793162 17457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ec89af83a842909ba5e19282a9e12d" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:10.793742 17704 leader_election.cc:290] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:10.718295 17690 raft_consensus.cc:493] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:10.794508 17690 raft_consensus.cc:515] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.793192 17705 leader_election.cc:290] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:10.796654 17690 leader_election.cc:290] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.789937 17691 raft_consensus.cc:493] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:30:10.797953 17457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45c0ead4eb3497c91c28c55ee353d83" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:10.798420 17691 raft_consensus.cc:515] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:10.800872 17691 leader_election.cc:290] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:10.741860 17698 raft_consensus.cc:515] T 2fb661ebdebf474db7f6380eb0e49d7f P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:10.801761 16413 catalog_manager.cc:5697] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 1 to 2, leader changed from cd924581228b49d889b0e1553519722a (127.8.111.68) to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 2 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:10.803753 17698 leader_election.cc:290] T 2fb661ebdebf474db7f6380eb0e49d7f P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:10.804754 16666 raft_consensus.cc:1275] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:10.806023 17458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda99eaeca1149d48e54e0d83c3ec4cb" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:10.807524 17704 raft_consensus.cc:493] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:10.808364 17704 raft_consensus.cc:515] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.812500 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eef363dbdce4d7bbd0b446385d8eb9e" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:10.815014 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425340b667774e9083a7c360e90ff2e5" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:10.815285 17704 leader_election.cc:290] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:10.815866 16666 raft_consensus.cc:2468] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:30:10.816452 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bbf661e435740adbb0269128765d10e" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
W20260709 12:30:10.723928 16707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:33625, user_credentials={real_user=slave}} blocked reactor thread for 49345.7us
I20260709 12:30:10.820155 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d285abc27263437a85f24a1d8f993be1" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:10.821884 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e405df92b54c47daa8ae52a9fc87b7ac" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:10.822786 17690 raft_consensus.cc:493] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:10.822989 17691 raft_consensus.cc:493] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:10.823403 17690 raft_consensus.cc:515] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.823559 17691 raft_consensus.cc:515] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.825510 17697 raft_consensus.cc:493] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.826033 17697 raft_consensus.cc:515] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:10.827827 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ce8db6ce4ee6bfef51b5c677c3ba" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:10.828411 17697 leader_election.cc:290] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:10.828714 17454 raft_consensus.cc:2468] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:30:10.830164 17457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7f1ce17c243358d69760e6457d24a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:10.831118 17457 raft_consensus.cc:2468] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:30:10.832861 17457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2738a61896734d42b9febbcbf8848761" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:10.833508 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7805d2575cfc4de984937de995038b47" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:10.834880 17457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ec89af83a842909ba5e19282a9e12d" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:10.835130 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ce8db6ce4ee6bfef51b5c677c3ba" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:10.836616 16666 raft_consensus.cc:2468] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:30:10.838189 17700 raft_consensus.cc:493] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:30:10.838574 17690 leader_election.cc:290] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.838883 17700 raft_consensus.cc:515] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:10.841174 17700 leader_election.cc:290] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.848973 17457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425340b667774e9083a7c360e90ff2e5" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:10.850136 17457 raft_consensus.cc:2468] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:30:10.849128 16633 leader_election.cc:304] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:30:10.852833 17457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9befeb38274b3fbca494f3044f9822" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:10.853677 17697 raft_consensus.cc:2804] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:10.854122 17697 raft_consensus.cc:493] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.854650 17697 raft_consensus.cc:3060] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:10.855225 17457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95064ed3f05a4169a3ff0f2123274cb7" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:10.859710 17455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56d3967e8f4a15b1883473e50c4c85" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:10.859597 17696 raft_consensus.cc:493] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.852901 16633 leader_election.cc:304] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:30:10.860781 17696 raft_consensus.cc:515] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:10.861925 16633 leader_election.cc:304] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:30:10.862527 17690 raft_consensus.cc:2804] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:10.863181 17690 raft_consensus.cc:493] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.863690 17690 raft_consensus.cc:3060] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:10.864898 17696 leader_election.cc:290] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:10.870682 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1954b02f86b546d382996faa0aa9fd89" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:10.871470 17453 raft_consensus.cc:2468] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:30:10.879575 16633 leader_election.cc:304] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:30:10.880347 17693 raft_consensus.cc:2804] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:10.880806 17693 raft_consensus.cc:493] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.881234 17693 raft_consensus.cc:3060] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:10.885517 17696 raft_consensus.cc:2804] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:10.886171 17696 raft_consensus.cc:493] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.886765 17696 raft_consensus.cc:3060] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:10.887130 17700 raft_consensus.cc:493] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.888082 17646 raft_consensus.cc:493] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:10.887892 17700 raft_consensus.cc:515] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.888605 17646 raft_consensus.cc:515] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:10.890334 17700 leader_election.cc:290] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:10.890753 17646 leader_election.cc:290] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:10.734071 17717 raft_consensus.cc:493] T 23de375943ed49b2b9da4652fa088021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:10.898880 17717 raft_consensus.cc:515] T 23de375943ed49b2b9da4652fa088021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:10.899808 17700 raft_consensus.cc:493] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.933328 17700 raft_consensus.cc:515] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:10.935254 16631 leader_election.cc:304] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
W20260709 12:30:10.907051 16704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 213073us
I20260709 12:30:10.915252 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:10.936502 16631 leader_election.cc:304] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:30:10.911895 17723 raft_consensus.cc:493] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:10.916782 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45c0ead4eb3497c91c28c55ee353d83" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:10.937439 17723 raft_consensus.cc:515] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:10.939606 17723 leader_election.cc:290] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:10.917687 17709 raft_consensus.cc:493] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:10.940265 17709 raft_consensus.cc:515] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.940989 17711 raft_consensus.cc:493] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.941502 17711 raft_consensus.cc:515] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:10.942461 17709 leader_election.cc:290] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:10.918234 17701 raft_consensus.cc:493] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:10.943127 17701 raft_consensus.cc:515] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.943632 17711 leader_election.cc:290] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.944435 17711 raft_consensus.cc:493] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.945104 17701 leader_election.cc:290] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:10.918946 17702 raft_consensus.cc:493] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:10.919525 17712 raft_consensus.cc:493] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:10.946089 17718 raft_consensus.cc:493] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.946545 17712 raft_consensus.cc:515] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.946882 17718 raft_consensus.cc:515] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:10.947826 17717 leader_election.cc:290] T 23de375943ed49b2b9da4652fa088021 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:10.948603 17712 leader_election.cc:290] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:10.926180 16658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19834ede0784553865ac5c4cd1024f0" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:10.949563 17718 leader_election.cc:290] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:10.927898 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1954b02f86b546d382996faa0aa9fd89" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:10.950484 17718 raft_consensus.cc:493] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
W20260709 12:30:10.950780 16633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:36499, user_credentials={real_user=slave}} blocked reactor thread for 71273.2us
I20260709 12:30:10.951035 17694 raft_consensus.cc:2749] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:10.951589 17692 raft_consensus.cc:2749] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:10.951175 17718 raft_consensus.cc:515] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:10.944979 17711 raft_consensus.cc:515] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:10.952812 16631 leader_election.cc:304] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:10.953491 17692 raft_consensus.cc:2804] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:10.953826 17692 raft_consensus.cc:493] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.928536 17691 leader_election.cc:290] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.951824 17694 raft_consensus.cc:493] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.949798 17709 raft_consensus.cc:493] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:10.927487 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b4874f353b48ef8bdfa4c28549a207" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:10.945786 17702 raft_consensus.cc:515] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.935464 17700 leader_election.cc:290] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.953958 17718 leader_election.cc:290] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.968194 17572 raft_consensus.cc:493] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:10.956976 17711 leader_election.cc:290] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:10.954195 17692 raft_consensus.cc:3060] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:10.969051 17709 raft_consensus.cc:515] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:10.971195 17702 leader_election.cc:290] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:10.959968 17701 raft_consensus.cc:493] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:10.973783 17701 raft_consensus.cc:515] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.974040 17694 raft_consensus.cc:515] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.975395 16658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d77d239e0634d6894726f6bba42be5e" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:10.977043 17701 leader_election.cc:290] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:10.977414 17646 raft_consensus.cc:493] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.972025 17709 leader_election.cc:290] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:10.969094 17719 raft_consensus.cc:493] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.968967 17572 raft_consensus.cc:515] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:10.978129 17646 raft_consensus.cc:515] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:10.983021 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d77d239e0634d6894726f6bba42be5e" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:10.984437 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:10.994992 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d82d757f6a34783b2b2055824f65e88" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:10.997506 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d285abc27263437a85f24a1d8f993be1" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:10.998610 17584 raft_consensus.cc:493] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:10.999008 16704 leader_election.cc:304] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:11.000255 16631 leader_election.cc:304] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:10.980191 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.001384 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:10.982048 17718 raft_consensus.cc:493] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:10.877782 17697 raft_consensus.cc:515] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:10.980451 17694 leader_election.cc:290] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:11.003516 16666 raft_consensus.cc:2468] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 2.
I20260709 12:30:11.007503 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ac00038aa4947961ef3398fd75ca4" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.008901 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a084469fa354084b2130b4656a965d1" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.008981 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.009613 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:11.010037 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3262489dd274a878ecf95eb28323a5b" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.010968 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425340b667774e9083a7c360e90ff2e5" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.005159 17584 raft_consensus.cc:515] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:11.006141 17699 raft_consensus.cc:493] T f063389a54a742ab8d764101a9168d1b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:11.016714 16664 raft_consensus.cc:2468] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 2.
I20260709 12:30:11.017652 17407 leader_election.cc:304] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:30:11.025446 16631 leader_election.cc:304] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.027773 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60b7bf1ed30467e9437c2b078e41808" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.027837 16584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.029381 16736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7805d2575cfc4de984937de995038b47" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.031653 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ad2867ed594d4794807e95f2994f46" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.026019 17407 leader_election.cc:304] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:30:11.033990 16707 leader_election.cc:304] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.034004 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.034974 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.040824 17584 leader_election.cc:290] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:11.042161 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39b696cc72749608ab54eae0a99b093" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.038403 16707 leader_election.cc:304] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:11.042512 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b4874f353b48ef8bdfa4c28549a207" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.043231 16592 raft_consensus.cc:2468] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:11.043444 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1966b49831ff47a3ba7263b77ac4e86b" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.014554 17453 raft_consensus.cc:2468] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 2.
I20260709 12:30:11.044045 16733 raft_consensus.cc:2468] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:30:11.048082 17730 raft_consensus.cc:2749] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.051863 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1966b49831ff47a3ba7263b77ac4e86b" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.052078 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.030112 17688 raft_consensus.cc:2804] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:11.053001 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.036232 16584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1954b02f86b546d382996faa0aa9fd89" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.036278 17710 raft_consensus.cc:2804] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:11.015316 17718 raft_consensus.cc:515] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:11.015772 17705 consensus_queue.cc:1048] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:30:11.029948 17699 raft_consensus.cc:515] T f063389a54a742ab8d764101a9168d1b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:11.045387 17711 raft_consensus.cc:2749] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.056432 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.057907 17714 raft_consensus.cc:2804] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:11.077675 17699 leader_election.cc:290] T f063389a54a742ab8d764101a9168d1b P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:11.077750 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.058506 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8898ec613947bfa3b95ae941e1245d" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.058750 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ce8db6ce4ee6bfef51b5c677c3ba" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.058877 17716 raft_consensus.cc:2804] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:30:11.079138 17716 raft_consensus.cc:493] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:11.078018 17714 raft_consensus.cc:493] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:11.079557 17716 raft_consensus.cc:3060] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:11.079821 17714 raft_consensus.cc:3060] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.080402 17690 raft_consensus.cc:515] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.081511 17404 leader_election.cc:304] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:11.053644 17688 raft_consensus.cc:493] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:11.082702 17688 raft_consensus.cc:3060] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.084337 17675 raft_consensus.cc:2804] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:11.084761 17675 raft_consensus.cc:493] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:11.085121 17675 raft_consensus.cc:3060] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:11.060231 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb661ebdebf474db7f6380eb0e49d7f" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.057034 17710 raft_consensus.cc:493] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:11.086872 17710 raft_consensus.cc:3060] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.060416 17646 leader_election.cc:290] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:11.050545 17693 raft_consensus.cc:515] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.091091 17693 leader_election.cc:290] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:11.061358 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:11.091740 17718 leader_election.cc:290] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:11.091856 16664 raft_consensus.cc:2468] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:11.092644 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e405df92b54c47daa8ae52a9fc87b7ac" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.063030 16586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1966b49831ff47a3ba7263b77ac4e86b" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.093199 16735 raft_consensus.cc:2468] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:10.989696 17719 raft_consensus.cc:515] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:11.064110 17692 raft_consensus.cc:515] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.094591 17697 leader_election.cc:290] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:11.095616 17719 leader_election.cc:290] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:11.095891 17692 leader_election.cc:290] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:11.096688 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.065485 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.066401 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ad2867ed594d4794807e95f2994f46" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.094627 16658 raft_consensus.cc:2393] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a in current term 2: Already voted for candidate 99ca36f8a50c459388f31022b1455ed6 in this term.
I20260709 12:30:11.097687 17454 raft_consensus.cc:2468] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:30:11.098127 16736 raft_consensus.cc:1275] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:11.067458 17458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8e6882ec7b344f7b4783d7610f69d82" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.068500 17456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cf6ac39c0248398e411dcce49bf021" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.070004 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb661ebdebf474db7f6380eb0e49d7f" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.072729 17584 raft_consensus.cc:2749] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.099902 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19834ede0784553865ac5c4cd1024f0" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.100258 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d45c0ead4eb3497c91c28c55ee353d83" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.097368 16733 raft_consensus.cc:2468] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:11.073365 16707 leader_election.cc:304] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:11.073536 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56d3967e8f4a15b1883473e50c4c85" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.101187 16736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb661ebdebf474db7f6380eb0e49d7f" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.073933 17572 leader_election.cc:290] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:11.096958 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d60b7bf1ed30467e9437c2b078e41808" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.101655 17584 raft_consensus.cc:2749] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.102449 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.107944 17725 raft_consensus.cc:493] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:11.108530 17725 raft_consensus.cc:515] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.104874 16733 raft_consensus.cc:2468] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:30:11.113121 17714 raft_consensus.cc:515] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:11.114243 17719 raft_consensus.cc:493] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:11.114825 17719 raft_consensus.cc:515] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:11.115279 17714 leader_election.cc:290] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:11.117457 17719 leader_election.cc:290] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:11.118772 17690 leader_election.cc:290] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:11.119549 17696 raft_consensus.cc:515] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.120728 16665 raft_consensus.cc:2393] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in current term 2: Already voted for candidate 99ca36f8a50c459388f31022b1455ed6 in this term.
I20260709 12:30:11.121783 17696 leader_election.cc:290] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:11.123251 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ad2867ed594d4794807e95f2994f46" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.123538 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.123870 16736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.124154 16739 raft_consensus.cc:2468] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:11.124538 16736 raft_consensus.cc:2468] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:30:11.093199 17716 raft_consensus.cc:515] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:11.130954 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ad2867ed594d4794807e95f2994f46" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.132104 17710 raft_consensus.cc:515] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.133002 17456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1765c0523b546c198e7a014b0866bbc" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.134488 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a084469fa354084b2130b4656a965d1" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.135061 16735 raft_consensus.cc:2468] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 1.
I20260709 12:30:11.137471 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd2958b516b4504aec8657e0fe2ec24" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.136564 17458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2738a61896734d42b9febbcbf8848761" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
W20260709 12:30:11.138947 16707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:36499, user_credentials={real_user=slave}} blocked reactor thread for 65665.4us
I20260709 12:30:11.139051 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7f1ce17c243358d69760e6457d24a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:11.141078 17725 leader_election.cc:290] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:11.144444 17456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ce8db6ce4ee6bfef51b5c677c3ba" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:11.141729 16738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c73b3d790842ed9389c18ddb50e3c1" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.145649 16738 raft_consensus.cc:2468] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 1.
I20260709 12:30:11.145835 17458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1954b02f86b546d382996faa0aa9fd89" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:11.146091 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53516641dc3421cac583bbe728f6e14" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.146575 16736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ec89af83a842909ba5e19282a9e12d" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.147121 17710 leader_election.cc:290] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:11.147300 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95064ed3f05a4169a3ff0f2123274cb7" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.147701 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.148382 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.148588 17455 raft_consensus.cc:1240] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:11.149631 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.150641 16586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a084469fa354084b2130b4656a965d1" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.152119 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ce8db6ce4ee6bfef51b5c677c3ba" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.154297 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932859a73dad4a39b5874461e99676cc" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.154826 16588 raft_consensus.cc:3060] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.155521 17455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.155768 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ac00038aa4947961ef3398fd75ca4" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.155938 17458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3262489dd274a878ecf95eb28323a5b" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.157773 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d285abc27263437a85f24a1d8f993be1" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.158502 17458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d82d757f6a34783b2b2055824f65e88" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.158581 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425340b667774e9083a7c360e90ff2e5" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:11.159277 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.160295 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a084469fa354084b2130b4656a965d1" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.160888 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.161531 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c73b3d790842ed9389c18ddb50e3c1" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
W20260709 12:30:11.163347 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 137952us
I20260709 12:30:11.164261 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.164390 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb661ebdebf474db7f6380eb0e49d7f" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.160943 17452 raft_consensus.cc:2468] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 1.
I20260709 12:30:11.165483 16586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f063389a54a742ab8d764101a9168d1b" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.167527 17688 raft_consensus.cc:515] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.168641 17457 raft_consensus.cc:1240] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:11.169667 17688 leader_election.cc:290] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:11.171947 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1966b49831ff47a3ba7263b77ac4e86b" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.173019 17584 raft_consensus.cc:493] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:11.173467 17584 raft_consensus.cc:515] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:11.175439 17584 leader_election.cc:290] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:11.175989 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f063389a54a742ab8d764101a9168d1b" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.177440 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23de375943ed49b2b9da4652fa088021" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.179209 16736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8898ec613947bfa3b95ae941e1245d" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.180014 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.180672 16587 raft_consensus.cc:2468] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 2.
I20260709 12:30:11.181612 17675 raft_consensus.cc:515] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.182397 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425340b667774e9083a7c360e90ff2e5" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.181927 16588 raft_consensus.cc:2468] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 2.
I20260709 12:30:11.188444 16586 raft_consensus.cc:1240] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Rejecting Update request from peer 99ca36f8a50c459388f31022b1455ed6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:11.189656 16633 leader_election.cc:304] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:30:11.191335 17696 raft_consensus.cc:2804] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:11.191730 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8898ec613947bfa3b95ae941e1245d" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.191748 17696 raft_consensus.cc:493] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:11.193766 17696 raft_consensus.cc:3060] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:11.182925 17716 leader_election.cc:290] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 4 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:11.183120 16704 leader_election.cc:304] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:11.195021 16704 leader_election.cc:304] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:11.199072 16666 raft_consensus.cc:1240] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:11.199404 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8e6882ec7b344f7b4783d7610f69d82" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:11.183706 16707 leader_election.cc:304] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:11.201718 17405 leader_election.cc:304] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.202915 16665 raft_consensus.cc:1240] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:11.203178 16659 raft_consensus.cc:1240] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:11.204736 17719 raft_consensus.cc:2749] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.205161 17405 leader_election.cc:304] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.206233 17719 raft_consensus.cc:2804] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:11.206744 17719 raft_consensus.cc:493] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:11.207115 17719 raft_consensus.cc:3060] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.201429 17718 raft_consensus.cc:2804] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:11.210566 17718 raft_consensus.cc:493] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:11.210955 17718 raft_consensus.cc:3060] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:11.211496 17731 raft_consensus.cc:2804] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:11.212107 17731 raft_consensus.cc:697] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:30:11.213073 17731 consensus_queue.cc:237] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:11.215068 17719 raft_consensus.cc:515] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:11.216005 17675 leader_election.cc:290] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:11.215415 17405 leader_election.cc:304] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:11.216713 16586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b4874f353b48ef8bdfa4c28549a207" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.217366 16586 raft_consensus.cc:3060] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:11.217656 17710 raft_consensus.cc:2804] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:11.217883 17719 leader_election.cc:290] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:11.218106 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1966b49831ff47a3ba7263b77ac4e86b" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.218142 17710 raft_consensus.cc:493] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:11.219187 17710 raft_consensus.cc:3060] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:11.223738 17457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.230369 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd2958b516b4504aec8657e0fe2ec24" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:11.228543 17405 leader_election.cc:304] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.231817 16659 raft_consensus.cc:1240] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Rejecting Update request from peer 32b697d90f0c4cdfb0a3f55e33a5b37a for earlier term 3. Current term is 4. Ops: []
I20260709 12:30:11.231662 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41cf6ac39c0248398e411dcce49bf021" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:11.233001 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e405df92b54c47daa8ae52a9fc87b7ac" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:11.233397 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2976cad482cd47bbadc454f8570dbb0d" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.231653 17646 raft_consensus.cc:2804] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:11.234634 17646 raft_consensus.cc:493] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:11.234699 16658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ce8db6ce4ee6bfef51b5c677c3ba" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:11.234869 17722 raft_consensus.cc:2749] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.235088 17646 raft_consensus.cc:3060] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:11.235512 16658 raft_consensus.cc:2393] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in current term 2: Already voted for candidate 99ca36f8a50c459388f31022b1455ed6 in this term.
I20260709 12:30:11.232640 17405 leader_election.cc:304] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.223069 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.237349 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56d3967e8f4a15b1883473e50c4c85" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:11.238265 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39b696cc72749608ab54eae0a99b093" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.238533 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e405df92b54c47daa8ae52a9fc87b7ac" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.239770 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d77d239e0634d6894726f6bba42be5e" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.240710 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7f1ce17c243358d69760e6457d24a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.240906 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2738a61896734d42b9febbcbf8848761" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.241748 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c73b3d790842ed9389c18ddb50e3c1" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.241946 16584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c53516641dc3421cac583bbe728f6e14" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.242780 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9befeb38274b3fbca494f3044f9822" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.243027 16584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.243999 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d56d3967e8f4a15b1883473e50c4c85" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.244877 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425340b667774e9083a7c360e90ff2e5" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.222057 17696 raft_consensus.cc:515] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.245653 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ce8db6ce4ee6bfef51b5c677c3ba" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.247495 17696 leader_election.cc:290] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:11.250605 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95064ed3f05a4169a3ff0f2123274cb7" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.250789 16664 raft_consensus.cc:1240] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:11.253587 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425340b667774e9083a7c360e90ff2e5" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:11.253643 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1954b02f86b546d382996faa0aa9fd89" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.254401 16665 raft_consensus.cc:2393] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in current term 2: Already voted for candidate 99ca36f8a50c459388f31022b1455ed6 in this term.
I20260709 12:30:11.255286 16658 raft_consensus.cc:1240] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:11.255755 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f063389a54a742ab8d764101a9168d1b" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
W20260709 12:30:11.229342 16707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:33625, user_credentials={real_user=slave}} blocked reactor thread for 45694.6us
I20260709 12:30:11.256009 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1765c0523b546c198e7a014b0866bbc" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:11.257351 16707 leader_election.cc:304] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.257858 17407 leader_election.cc:304] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.258399 17584 raft_consensus.cc:2804] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:11.258850 17584 raft_consensus.cc:493] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:11.259100 17407 leader_election.cc:304] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.259286 17584 raft_consensus.cc:3060] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:11.260633 17405 leader_election.cc:304] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.261922 17407 leader_election.cc:304] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.262228 16707 leader_election.cc:304] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.218912 17675 consensus_queue.cc:1048] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:30:11.261441 17676 raft_consensus.cc:2749] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.264243 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2738a61896734d42b9febbcbf8848761" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:11.264799 17705 raft_consensus.cc:3060] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.265569 17714 raft_consensus.cc:3060] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.267782 17708 raft_consensus.cc:2749] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.268561 17700 consensus_queue.cc:1059] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:30:11.269527 17700 raft_consensus.cc:3055] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:30:11.269845 17700 raft_consensus.cc:740] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:11.263918 17719 raft_consensus.cc:2804] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:11.270712 17700 consensus_queue.cc:260] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:11.271477 17719 raft_consensus.cc:493] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:11.271881 17719 raft_consensus.cc:3060] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:11.273540 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23de375943ed49b2b9da4652fa088021" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:11.274843 17700 raft_consensus.cc:3060] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:11.277796 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95064ed3f05a4169a3ff0f2123274cb7" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:11.266012 16631 leader_election.cc:304] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:11.299661 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f063389a54a742ab8d764101a9168d1b" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:11.299904 17716 raft_consensus.cc:2804] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:11.300299 16631 leader_election.cc:304] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.278378 17710 raft_consensus.cc:515] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:11.303661 17710 leader_election.cc:290] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:11.280083 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425340b667774e9083a7c360e90ff2e5" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.281036 17718 raft_consensus.cc:515] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:11.282078 16586 raft_consensus.cc:2468] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 3.
I20260709 12:30:11.283474 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:11.283905 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d77d239e0634d6894726f6bba42be5e" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.285192 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1954b02f86b546d382996faa0aa9fd89" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.285885 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.286872 16663 raft_consensus.cc:1240] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:30:11.287779 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b4874f353b48ef8bdfa4c28549a207" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:11.288527 17696 consensus_queue.cc:1059] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:11.289053 16659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9befeb38274b3fbca494f3044f9822" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:11.289229 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968c7db76fe442fa81826c4035acb91" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:11.290475 16630 leader_election.cc:304] T 2976cad482cd47bbadc454f8570dbb0d P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.295002 17705 raft_consensus.cc:2749] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.295549 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a39b696cc72749608ab54eae0a99b093" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:11.296329 17719 raft_consensus.cc:515] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.296578 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c73b3d790842ed9389c18ddb50e3c1" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:11.308861 17710 raft_consensus.cc:2804] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:11.318136 16630 leader_election.cc:304] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.297469 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7f1ce17c243358d69760e6457d24a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.320315 16630 leader_election.cc:304] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.298245 16658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b4874f353b48ef8bdfa4c28549a207" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:11.300387 17716 raft_consensus.cc:493] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:11.280362 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ce8db6ce4ee6bfef51b5c677c3ba" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.315837 16587 raft_consensus.cc:1240] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Rejecting Update request from peer 99ca36f8a50c459388f31022b1455ed6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:30:11.306624 16707 leader_election.cc:304] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
W20260709 12:30:11.307418 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:33625, user_credentials={real_user=slave}} blocked reactor thread for 44484.3us
I20260709 12:30:11.309727 16664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932859a73dad4a39b5874461e99676cc" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:11.312968 16666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:11.329751 16707 leader_election.cc:304] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.314145 17584 raft_consensus.cc:515] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:11.316524  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:11.317332 17404 leader_election.cc:304] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:11.319332 17710 raft_consensus.cc:493] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
W20260709 12:30:11.306550 17405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 45987.6us
I20260709 12:30:11.322504 17733 raft_consensus.cc:2749] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.319298 17692 raft_consensus.cc:2749] T 2976cad482cd47bbadc454f8570dbb0d P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.325834 17716 raft_consensus.cc:3060] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.339727 17405 leader_election.cc:304] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.331898 16707 leader_election.cc:304] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.330163 17407 leader_election.cc:304] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.335242 17584 leader_election.cc:290] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:11.321836 17572 raft_consensus.cc:2749] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.321718 17697 raft_consensus.cc:2749] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.325089 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:11.324254 16630 leader_election.cc:304] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.348428 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.333891 17699 raft_consensus.cc:2749] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.351119 16707 leader_election.cc:304] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:11.352428 16707 leader_election.cc:304] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:11.352761 16630 leader_election.cc:304] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.333751 17711 raft_consensus.cc:2749] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.354677 17405 leader_election.cc:304] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.339989 17722 raft_consensus.cc:2804] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:11.337816 17710 raft_consensus.cc:3060] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:11.356426 17578 raft_consensus.cc:2749] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.356580 16559 leader_election.cc:304] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: cd924581228b49d889b0e1553519722a
I20260709 12:30:11.358049 16707 leader_election.cc:304] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.358982 17584 raft_consensus.cc:2749] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.359072 16630 leader_election.cc:304] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.359329 16707 leader_election.cc:304] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.355270 17645 raft_consensus.cc:2749] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:30:11.357679 17732 raft_consensus.cc:3055] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:11.364001 17714 raft_consensus.cc:2749] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.355340 17692 raft_consensus.cc:2749] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.361469 17703 raft_consensus.cc:2749] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.354010 17715 raft_consensus.cc:2749] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.365227 17695 raft_consensus.cc:2749] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.364866 16707 leader_election.cc:304] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.356477 17706 raft_consensus.cc:2749] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.367057 17718 leader_election.cc:290] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:11.380033 17695 raft_consensus.cc:2804] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:11.355481 17733 raft_consensus.cc:2749] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.380453 17695 raft_consensus.cc:493] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:11.380910 17695 raft_consensus.cc:3060] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.361927 17722 raft_consensus.cc:697] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:11.386263 17722 consensus_queue.cc:237] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.391633 17695 raft_consensus.cc:515] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:11.371059 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.393654 17695 leader_election.cc:290] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:11.394143 17716 raft_consensus.cc:515] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:11.394708 16707 leader_election.cc:304] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.395853 16707 leader_election.cc:304] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.396641 17721 raft_consensus.cc:2749] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.397044 17695 raft_consensus.cc:2749] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.399070 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a084469fa354084b2130b4656a965d1" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.374949 17719 leader_election.cc:290] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:11.400791 16736 raft_consensus.cc:1240] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Rejecting Update request from peer 99ca36f8a50c459388f31022b1455ed6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:30:11.375425 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.358630 17405 leader_election.cc:304] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 9f5ebf768d584b17897ebb5b4575ece5
W20260709 12:30:11.402186 17405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 43648.1us
I20260709 12:30:11.402829 17405 leader_election.cc:304] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.403584 16736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:11.403930 17405 leader_election.cc:304] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.404266 17646 raft_consensus.cc:515] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:11.404968 17405 leader_election.cc:304] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.377712 17732 raft_consensus.cc:740] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:11.368314 17717 raft_consensus.cc:2804] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:11.405503 16736 raft_consensus.cc:2393] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99ca36f8a50c459388f31022b1455ed6 in current term 3: Already voted for candidate cd924581228b49d889b0e1553519722a in this term.
I20260709 12:30:11.405423 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d77d239e0634d6894726f6bba42be5e" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:11.405730 17717 raft_consensus.cc:493] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:30:11.405987 17716 leader_election.cc:290] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:11.406262 17717 raft_consensus.cc:3060] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.406653 16738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d285abc27263437a85f24a1d8f993be1" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:11.410848 17732 consensus_queue.cc:260] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:11.411962 17732 raft_consensus.cc:3060] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.414661 17703 raft_consensus.cc:2804] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:11.414706 17700 raft_consensus.cc:2749] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.415194 17703 raft_consensus.cc:493] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:11.415652 17703 raft_consensus.cc:3060] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.415675 17705 raft_consensus.cc:2804] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:11.416213 17705 raft_consensus.cc:493] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:11.416587 17705 raft_consensus.cc:3060] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:30:11.364634 16559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:36499, user_credentials={real_user=slave}} blocked reactor thread for 58386.8us
I20260709 12:30:11.419490 17700 raft_consensus.cc:2804] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:30:11.419654 16630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 60656.4us
I20260709 12:30:11.420368 17716 raft_consensus.cc:2749] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.420627 16630 leader_election.cc:304] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.419938 17700 raft_consensus.cc:493] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:11.421305 17700 raft_consensus.cc:3060] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.419683 17405 leader_election.cc:304] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.424131 17646 leader_election.cc:290] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:11.424935 17675 raft_consensus.cc:2804] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:11.425318 17675 raft_consensus.cc:493] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:11.425679 17675 raft_consensus.cc:3060] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.426458 17716 raft_consensus.cc:2749] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:30:11.427078 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:33625, user_credentials={real_user=slave}} blocked reactor thread for 96979us
I20260709 12:30:11.427325 17688 raft_consensus.cc:2749] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.428229 17457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97b4874f353b48ef8bdfa4c28549a207" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.429003 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9befeb38274b3fbca494f3044f9822" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.429347 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d8898ec613947bfa3b95ae941e1245d" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.430997 17700 raft_consensus.cc:515] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:11.436784 17457 raft_consensus.cc:1240] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Rejecting Update request from peer 99ca36f8a50c459388f31022b1455ed6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:30:11.421864 16630 leader_election.cc:304] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.439059 16738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1966b49831ff47a3ba7263b77ac4e86b" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:11.440789 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d285abc27263437a85f24a1d8f993be1" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:11.440816 17716 raft_consensus.cc:2749] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.441807 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:11.444905 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:11.445451 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:11.446244 16661 raft_consensus.cc:2393] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in current term 3: Already voted for candidate 99ca36f8a50c459388f31022b1455ed6 in this term.
I20260709 12:30:11.447083 17457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968c7db76fe442fa81826c4035acb91" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:11.448557 17452 raft_consensus.cc:2468] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 4.
I20260709 12:30:11.445289 17675 raft_consensus.cc:515] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:11.448709 16736 raft_consensus.cc:1240] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Rejecting Update request from peer 32b697d90f0c4cdfb0a3f55e33a5b37a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:30:11.453755 16630 leader_election.cc:304] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.454649 17455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:11.455114 17710 raft_consensus.cc:515] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:11.425534 16559 leader_election.cc:304] T 2fb661ebdebf474db7f6380eb0e49d7f P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.465073 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:11.456621 17716 consensus_queue.cc:1059] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:11.457472 17675 leader_election.cc:290] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:11.459851 17405 leader_election.cc:304] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.458143 16738 raft_consensus.cc:1240] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:11.477715 16631 leader_election.cc:304] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.472338 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a084469fa354084b2130b4656a965d1" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.474743 17702 consensus_queue.cc:1059] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:11.479197 17716 consensus_queue.cc:1059] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:11.480008 17729 raft_consensus.cc:3055] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:11.480661 17729 raft_consensus.cc:740] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:11.480424 17701 consensus_queue.cc:1059] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:11.481621 17719 raft_consensus.cc:2749] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.481518 17729 consensus_queue.cc:260] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:11.479921 17725 raft_consensus.cc:3055] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:11.482476 17725 raft_consensus.cc:740] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:11.482885 17729 raft_consensus.cc:3060] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:11.483379 17725 consensus_queue.cc:260] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.476351 17733 raft_consensus.cc:3055] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:11.476540 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c73b3d790842ed9389c18ddb50e3c1" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:11.484687 17733 raft_consensus.cc:740] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:11.470839 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:11.485576 17733 consensus_queue.cc:260] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:11.489827 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.481667 17701 raft_consensus.cc:3055] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:11.490947 17701 raft_consensus.cc:740] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:11.492115 17701 consensus_queue.cc:260] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.475203 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:11.465238 17692 raft_consensus.cc:2749] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.468518 17709 raft_consensus.cc:2749] T 2fb661ebdebf474db7f6380eb0e49d7f P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.484337 17700 leader_election.cc:290] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:11.496241 16707 leader_election.cc:304] T f063389a54a742ab8d764101a9168d1b P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.497853 17646 raft_consensus.cc:2749] T f063389a54a742ab8d764101a9168d1b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:30:11.503973 17405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 44200.6us
I20260709 12:30:11.504276 16707 leader_election.cc:304] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.485571 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.505501 16740 raft_consensus.cc:1240] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Rejecting Update request from peer 99ca36f8a50c459388f31022b1455ed6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:11.505508 17692 raft_consensus.cc:3060] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:11.509089 16707 leader_election.cc:304] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.511683 16633 leader_election.cc:304] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: cd924581228b49d889b0e1553519722a
I20260709 12:30:11.516032 17584 raft_consensus.cc:2749] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:30:11.518373 16559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:36499, user_credentials={real_user=slave}} blocked reactor thread for 48991.2us
I20260709 12:30:11.519280 17709 consensus_queue.cc:1059] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:11.520330 17709 raft_consensus.cc:3055] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:11.520381 16559 leader_election.cc:304] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.519472 16707 leader_election.cc:304] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.520821 17709 raft_consensus.cc:740] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:11.521503 17455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a084469fa354084b2130b4656a965d1" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:11.521960 17715 raft_consensus.cc:2749] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.522264 17455 raft_consensus.cc:2393] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a in current term 2: Already voted for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in this term.
I20260709 12:30:11.521775 17709 consensus_queue.cc:260] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.504949 17701 raft_consensus.cc:3060] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.516470 17453 raft_consensus.cc:1240] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 LEADER]: Rejecting Update request from peer 99ca36f8a50c459388f31022b1455ed6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:30:11.523833 16736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a084469fa354084b2130b4656a965d1" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:11.524160 17702 raft_consensus.cc:2749] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.507982 17675 consensus_queue.cc:1059] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:30:11.525621 17675 raft_consensus.cc:3055] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:11.508179 17646 raft_consensus.cc:2749] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.527287 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:11.510828 17733 raft_consensus.cc:3060] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:11.530128 16738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
W20260709 12:30:11.531244 16558 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:30:11.522572 16707 leader_election.cc:304] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.532042 17731 raft_consensus.cc:2749] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.532645 17725 raft_consensus.cc:3060] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.525995 17675 raft_consensus.cc:740] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:11.535025 16707 leader_election.cc:304] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:11.535969 17731 raft_consensus.cc:2749] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.535746 17675 consensus_queue.cc:260] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:11.537019 17675 raft_consensus.cc:3060] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:11.531208 17703 raft_consensus.cc:515] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:11.538833 17709 raft_consensus.cc:3060] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.539870 17405 leader_election.cc:304] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.540679 17703 leader_election.cc:290] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:11.541105 17405 leader_election.cc:304] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.541322 17703 raft_consensus.cc:2749] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.541894 17719 raft_consensus.cc:2749] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.543426 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.505049 17710 leader_election.cc:290] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:11.554210 17572 raft_consensus.cc:2804] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:30:11.555467 17572 raft_consensus.cc:697] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 4 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:11.555585 16630 leader_election.cc:304] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.556799 16630 leader_election.cc:304] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.557631 16665 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8e6882ec7b344f7b4783d7610f69d82"
dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
mode: GRACEFUL
new_leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:48578
I20260709 12:30:11.556476 17572 consensus_queue.cc:237] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:11.558373 16665 raft_consensus.cc:606] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Received request to transfer leadership to TS 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:11.559900 16630 leader_election.cc:304] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.560112 17691 raft_consensus.cc:2749] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.560842 17691 raft_consensus.cc:2749] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.561457 17733 raft_consensus.cc:2749] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.550316 17405 leader_election.cc:304] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.562996 17705 raft_consensus.cc:515] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:11.567193 16412 catalog_manager.cc:5697] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 1 to 2, leader changed from 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67) to cd924581228b49d889b0e1553519722a (127.8.111.68). New cstate: current_term: 2 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:11.569275 17705 leader_election.cc:290] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:11.569532 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.575845 16630 leader_election.cc:304] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.557706 17717 raft_consensus.cc:515] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:11.580451 16736 raft_consensus.cc:1240] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:30:11.579468 16630 leader_election.cc:304] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.580969 17690 raft_consensus.cc:2749] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.581562 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:11.582414 17716 raft_consensus.cc:2749] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.583906 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:11.584162 17717 leader_election.cc:290] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:11.580010 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:11.585541 17407 leader_election.cc:304] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.577301 17710 raft_consensus.cc:2749] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.587743 16660 raft_consensus.cc:2410] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:30:11.588986 17692 raft_consensus.cc:2749] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.590473 17407 leader_election.cc:304] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.589921 16707 leader_election.cc:304] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.591262 17710 raft_consensus.cc:2749] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.591662 17715 raft_consensus.cc:2749] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.593353 17701 consensus_queue.cc:1059] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:11.595886 17701 raft_consensus.cc:3055] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:11.596277 17701 raft_consensus.cc:740] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:11.598711 17452 raft_consensus.cc:2410] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:30:11.598389 17701 consensus_queue.cc:260] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:11.599822 17701 raft_consensus.cc:3060] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:11.562095 17733 consensus_queue.cc:1059] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:30:11.600840 17733 consensus_queue.cc:1243] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Peer 32b697d90f0c4cdfb0a3f55e33a5b37a log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:30:11.601310 17696 consensus_queue.cc:1059] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:11.603132 17405 leader_election.cc:304] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.605777 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ad2867ed594d4794807e95f2994f46" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:11.606953 17405 leader_election.cc:304] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.608327 17710 raft_consensus.cc:2749] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.609036 17710 raft_consensus.cc:2749] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.609903 17729 raft_consensus.cc:3055] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:11.610940 17729 raft_consensus.cc:740] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:11.584220 16630 leader_election.cc:304] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.612396  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:30:11.613350 17696 raft_consensus.cc:2749] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.614050  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:11.613368 16413 catalog_manager.cc:5697] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 2 to 3, leader changed from 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 3 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:11.614849  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:11.617754 16590 raft_consensus.cc:1275] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Refusing update from remote peer cd924581228b49d889b0e1553519722a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:11.614562 17729 consensus_queue.cc:260] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.620172 17715 consensus_queue.cc:1048] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:11.619576 17729 raft_consensus.cc:3060] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:11.627009 17705 raft_consensus.cc:2749] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:30:11.579466 16559 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:30:11.634590 16707 leader_election.cc:304] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:11.663568 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c73b3d790842ed9389c18ddb50e3c1" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.664022 17717 consensus_queue.cc:1059] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:11.664634 17725 consensus_queue.cc:1059] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:11.671587 17715 raft_consensus.cc:2749] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.664904 16416 catalog_manager.cc:5697] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 3 to 4, leader changed from 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65) to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 4 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:11.667059 17452 raft_consensus.cc:1240] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:11.671689 17725 raft_consensus.cc:3055] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:11.674247 16707 leader_election.cc:304] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:11.674634 17725 raft_consensus.cc:740] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:11.675535 17725 consensus_queue.cc:260] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.676026 17709 raft_consensus.cc:3055] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:11.676589 17709 raft_consensus.cc:740] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:11.676715 17725 raft_consensus.cc:3060] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.677199 17721 raft_consensus.cc:2749] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.677630 17709 consensus_queue.cc:260] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.678748 17709 raft_consensus.cc:3060] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:30:11.680275 17480 debug-util.cc:398] Leaking SignalData structure 0x7b0800131f80 after lost signal to thread 8640
W20260709 12:30:11.681418 17480 debug-util.cc:398] Leaking SignalData structure 0x7b0800320240 after lost signal to thread 16450
W20260709 12:30:11.682940 17480 debug-util.cc:398] Leaking SignalData structure 0x7b080032de00 after lost signal to thread 16617
W20260709 12:30:11.684155 17480 debug-util.cc:398] Leaking SignalData structure 0x7b08002d83c0 after lost signal to thread 16691
W20260709 12:30:11.685348 17480 debug-util.cc:398] Leaking SignalData structure 0x7b080029d4c0 after lost signal to thread 16765
W20260709 12:30:11.686618 17480 debug-util.cc:398] Leaking SignalData structure 0x7b080009ab00 after lost signal to thread 17483
I20260709 12:30:11.696568 16660 raft_consensus.cc:1275] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Refusing update from remote peer cd924581228b49d889b0e1553519722a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:11.701701 17721 consensus_queue.cc:1048] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:11.665427 16559 leader_election.cc:304] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
W20260709 12:30:11.718865 16559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:33625, user_credentials={real_user=slave}} blocked reactor thread for 53517.6us
I20260709 12:30:11.719906 17709 raft_consensus.cc:2749] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.728669 16559 leader_election.cc:304] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.731163 17709 raft_consensus.cc:2749] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.730140 16559 leader_election.cc:304] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:11.743902 16559 leader_election.cc:304] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:11.744621 17709 raft_consensus.cc:2749] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.745365 17709 raft_consensus.cc:2749] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.757475 16559 leader_election.cc:304] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:11.761214 17709 raft_consensus.cc:2749] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.765748 16559 leader_election.cc:304] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:11.766378 16590 raft_consensus.cc:1240] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Rejecting Update request from peer cd924581228b49d889b0e1553519722a for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:11.766882 16559 leader_election.cc:304] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:11.771807 17701 raft_consensus.cc:2749] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.772507 17701 raft_consensus.cc:2749] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.772225 16559 leader_election.cc:304] T 23de375943ed49b2b9da4652fa088021 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.776396 17709 raft_consensus.cc:2749] T 23de375943ed49b2b9da4652fa088021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.776515 16559 leader_election.cc:304] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.776733 16738 raft_consensus.cc:1240] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:11.777261 17709 raft_consensus.cc:2749] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.777684 16559 leader_election.cc:304] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:11.778465 17709 raft_consensus.cc:2749] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.778901 16559 leader_election.cc:304] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:11.779297 17709 consensus_queue.cc:1059] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:11.783737 17729 raft_consensus.cc:993] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6: : Instructing follower 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:11.801915 17729 raft_consensus.cc:1081] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Signalling peer 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:11.784524 17645 consensus_queue.cc:1059] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:11.802110 17709 raft_consensus.cc:3055] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:11.802764 17709 raft_consensus.cc:740] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:11.803656 17709 consensus_queue.cc:260] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:11.804819 17709 raft_consensus.cc:3060] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.805521 17725 raft_consensus.cc:2749] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.806006 16559 leader_election.cc:304] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:11.806808 17725 raft_consensus.cc:2749] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:11.807119 17452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8e6882ec7b344f7b4783d7610f69d82"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:44904
I20260709 12:30:11.807735 17452 raft_consensus.cc:493] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:11.808146 17452 raft_consensus.cc:3060] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:30:11.812438 16630 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:30:11.820631 17452 raft_consensus.cc:515] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.829165 17645 raft_consensus.cc:3055] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:11.829664 17645 raft_consensus.cc:740] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:30:11.838626 17725 consensus_queue.cc:1059] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:30:11.839927 17701 raft_consensus.cc:3055] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:11.839839 17645 consensus_queue.cc:260] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:11.841580 17645 raft_consensus.cc:3060] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.840463 17701 raft_consensus.cc:740] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:11.842757 17701 consensus_queue.cc:260] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.843940 17701 raft_consensus.cc:3060] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:11.845072 17455 raft_consensus.cc:1240] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:30:11.845446 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8e6882ec7b344f7b4783d7610f69d82" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:11.846030 16587 raft_consensus.cc:3060] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.846083 17451 raft_consensus.cc:1240] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:30:11.846508 17452 leader_election.cc:290] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:11.845502 17453 raft_consensus.cc:1240] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:11.848869 16559 leader_election.cc:304] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:11.849574 17725 raft_consensus.cc:2749] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.850697 16630 leader_election.cc:304] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.853941 17729 raft_consensus.cc:2749] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.854897 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8e6882ec7b344f7b4783d7610f69d82" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:11.855516 16660 raft_consensus.cc:3055] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:11.855846 16660 raft_consensus.cc:740] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:11.855831 17725 consensus_queue.cc:1059] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:30:11.856963 16660 consensus_queue.cc:260] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.856964 17717 raft_consensus.cc:3055] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:11.858687 17717 raft_consensus.cc:740] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:11.859663 17717 consensus_queue.cc:260] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:11.861027 17717 raft_consensus.cc:3060] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:11.864169 17453 raft_consensus.cc:1240] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 2. Current term is 3. Ops: []
I20260709 12:30:11.864748 17725 consensus_queue.cc:1059] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:11.865819 17451 raft_consensus.cc:1240] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:11.865937 17725 raft_consensus.cc:3055] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:11.866387 17725 raft_consensus.cc:740] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:11.858137 16660 raft_consensus.cc:3060] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.867282 17725 consensus_queue.cc:260] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:11.868518 17725 raft_consensus.cc:3060] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.871852 16587 raft_consensus.cc:2468] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:11.880110 17404 leader_election.cc:304] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:11.880915 16590 raft_consensus.cc:1240] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Rejecting Update request from peer 99ca36f8a50c459388f31022b1455ed6 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:11.881158 17675 raft_consensus.cc:2804] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:11.881824 17675 raft_consensus.cc:697] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:11.882787 17675 consensus_queue.cc:237] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:11.880129 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ad2867ed594d4794807e95f2994f46" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:11.890534 16665 raft_consensus.cc:1275] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:11.892175 17705 consensus_queue.cc:1048] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:30:11.892769 16660 raft_consensus.cc:2468] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:11.902837 16559 leader_election.cc:304] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:30:11.904369 17701 raft_consensus.cc:2749] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:30:11.902963 17717 consensus_queue.cc:1059] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:30:11.905956 17701 raft_consensus.cc:3055] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:11.906482 17701 raft_consensus.cc:740] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:11.907573 17701 consensus_queue.cc:260] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:11.909454 17701 raft_consensus.cc:3060] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:11.929338 16416 catalog_manager.cc:5697] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 1 to 2, leader changed from 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 2 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:11.948793 16587 raft_consensus.cc:1275] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:11.950419 17710 consensus_queue.cc:1048] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:11.966684 16665 raft_consensus.cc:1240] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:11.968286 17717 consensus_queue.cc:1059] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:11.969333 17725 raft_consensus.cc:3055] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:11.969712 17725 raft_consensus.cc:740] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:11.970597 17725 consensus_queue.cc:260] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:11.971987 17725 raft_consensus.cc:3060] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:11.980037 16738 raft_consensus.cc:3060] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:11.988479 16738 raft_consensus.cc:1275] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:30:11.990211 17572 consensus_queue.cc:1048] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:30:12.027632 17452 raft_consensus.cc:1240] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:12.035979 17725 consensus_queue.cc:1059] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:12.037058 17701 raft_consensus.cc:3055] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:12.037501 17701 raft_consensus.cc:740] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:12.038447 17701 consensus_queue.cc:260] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:12.039983 17701 raft_consensus.cc:3060] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:12.069459 17452 raft_consensus.cc:1275] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:30:12.071735 17733 consensus_queue.cc:1048] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:30:12.086244 17452 raft_consensus.cc:1240] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:12.088001 17725 consensus_queue.cc:1059] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:12.089201 17725 raft_consensus.cc:3055] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:12.089619 17725 raft_consensus.cc:740] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:12.091022 17725 consensus_queue.cc:260] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:12.093230 17725 raft_consensus.cc:3060] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:12.474239 16665 raft_consensus.cc:1275] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:12.475764 17703 consensus_queue.cc:1048] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:12.503813 16587 raft_consensus.cc:1275] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:12.515352 17703 consensus_queue.cc:1048] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:12.727788 17725 raft_consensus.cc:493] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:12.728348 17725 raft_consensus.cc:515] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:12.730573 17725 leader_election.cc:290] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:12.731115 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ce8db6ce4ee6bfef51b5c677c3ba" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:12.731855 17451 raft_consensus.cc:2468] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 2.
I20260709 12:30:12.732115 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ce8db6ce4ee6bfef51b5c677c3ba" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:12.732795 16665 raft_consensus.cc:2468] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 2.
I20260709 12:30:12.735867 16559 leader_election.cc:304] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:12.737763 17725 raft_consensus.cc:2804] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:12.738180 17725 raft_consensus.cc:493] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:12.738611 17725 raft_consensus.cc:3060] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:12.753223 17725 raft_consensus.cc:515] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:12.755704 17703 raft_consensus.cc:493] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:12.756340 17703 raft_consensus.cc:515] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:12.758958 17703 leader_election.cc:290] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:12.760579 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:12.761657 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:12.761840 16739 raft_consensus.cc:2468] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 3.
I20260709 12:30:12.762346 16665 raft_consensus.cc:2468] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 3.
I20260709 12:30:12.763473 17405 leader_election.cc:304] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:12.766134 17703 raft_consensus.cc:2804] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:30:12.766578 17703 raft_consensus.cc:493] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:12.766942 17703 raft_consensus.cc:3060] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:12.769405 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ce8db6ce4ee6bfef51b5c677c3ba" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:12.770094 17451 raft_consensus.cc:3060] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:12.777577 17703 raft_consensus.cc:515] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:12.778216 17451 raft_consensus.cc:2468] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 3.
I20260709 12:30:12.779577 16559 leader_election.cc:304] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:12.782011 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:12.782022 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:12.782805 16665 raft_consensus.cc:3060] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:12.782928 16739 raft_consensus.cc:3060] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:12.795921 17725 leader_election.cc:290] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:12.797508 17725 raft_consensus.cc:2804] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:12.798844 17725 raft_consensus.cc:697] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:12.800951 17725 consensus_queue.cc:237] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:12.799587 17703 leader_election.cc:290] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 4 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:12.799486 16665 raft_consensus.cc:2468] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 4.
I20260709 12:30:12.806720 17407 leader_election.cc:304] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:30:12.808746 17703 raft_consensus.cc:2804] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:30:12.809336 17703 raft_consensus.cc:697] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:12.810385 17703 consensus_queue.cc:237] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:12.799486 16739 raft_consensus.cc:2468] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 4.
I20260709 12:30:12.804378 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ce5ce8db6ce4ee6bfef51b5c677c3ba" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:12.814042 16660 raft_consensus.cc:3060] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:12.824913 16660 raft_consensus.cc:2468] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 3.
I20260709 12:30:12.831339 16416 catalog_manager.cc:5697] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:12.839993 16413 catalog_manager.cc:5697] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:12.854122 17725 raft_consensus.cc:493] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:12.855007 17725 raft_consensus.cc:515] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:12.860954 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7f1ce17c243358d69760e6457d24a" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:12.863540 17725 leader_election.cc:290] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:12.864087 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7f1ce17c243358d69760e6457d24a" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:12.864840 16660 raft_consensus.cc:2468] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 2.
I20260709 12:30:12.870255 16559 leader_election.cc:304] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:12.873906 17725 raft_consensus.cc:2804] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:12.874439 17725 raft_consensus.cc:493] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:12.875221 17725 raft_consensus.cc:3060] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:12.903343 17725 raft_consensus.cc:515] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:12.907734 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7f1ce17c243358d69760e6457d24a" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:12.909165 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7f1ce17c243358d69760e6457d24a" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:12.909838 16660 raft_consensus.cc:3060] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:12.915649 17725 leader_election.cc:290] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:12.922664 16660 raft_consensus.cc:2468] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 3.
I20260709 12:30:12.923983 16559 leader_election.cc:304] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:12.924847 17725 raft_consensus.cc:2804] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:12.925387 17725 raft_consensus.cc:697] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:12.926344 17725 consensus_queue.cc:237] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:12.928922  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:12.938622 16413 catalog_manager.cc:5697] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:12.976877 17692 raft_consensus.cc:493] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:12.977458 17692 raft_consensus.cc:515] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:12.979714 17692 leader_election.cc:290] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:12.989032 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:12.989872 16739 raft_consensus.cc:2468] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 2.
I20260709 12:30:12.996912 17725 raft_consensus.cc:493] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:12.995958 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:12.997663 17451 raft_consensus.cc:2468] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 3.
I20260709 12:30:12.997459 17725 raft_consensus.cc:515] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:13.004334 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d77d239e0634d6894726f6bba42be5e" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:13.005105 16739 raft_consensus.cc:2468] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 2.
I20260709 12:30:13.006521 16557 leader_election.cc:304] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:13.002357 17725 leader_election.cc:290] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:13.007364 17725 raft_consensus.cc:2804] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:12.999619 16633 leader_election.cc:304] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:30:13.008121 17725 raft_consensus.cc:493] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:13.009837 17572 raft_consensus.cc:2804] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:30:13.025924 17725 raft_consensus.cc:3060] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.026000 17572 raft_consensus.cc:493] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:13.026587 17572 raft_consensus.cc:3060] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:13.024775 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d77d239e0634d6894726f6bba42be5e" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:13.030551 16665 raft_consensus.cc:2468] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 2.
I20260709 12:30:13.039104 17758 raft_consensus.cc:493] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:13.039662 17758 raft_consensus.cc:515] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:13.043843 17725 raft_consensus.cc:515] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:13.044790 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425340b667774e9083a7c360e90ff2e5" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:13.041999 17758 leader_election.cc:290] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:13.046872 17692 raft_consensus.cc:493] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:13.049059 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425340b667774e9083a7c360e90ff2e5" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:13.096076 17645 raft_consensus.cc:493] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:13.121799 17451 raft_consensus.cc:2468] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 2.
I20260709 12:30:13.122385 17645 raft_consensus.cc:515] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.123489 17770 raft_consensus.cc:493] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:13.123952 17769 raft_consensus.cc:493] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:13.124020 17770 raft_consensus.cc:515] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.124677 17769 raft_consensus.cc:515] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:13.126125 16559 leader_election.cc:304] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:13.126384 17770 leader_election.cc:290] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.126920 17770 raft_consensus.cc:493] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:13.126989 16665 raft_consensus.cc:2468] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 2.
I20260709 12:30:13.127170 17769 leader_election.cc:290] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:13.096791 17754 raft_consensus.cc:493] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:13.127914 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:13.120338 17768 raft_consensus.cc:493] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:13.128772 17452 raft_consensus.cc:2393] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a in current term 2: Already voted for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in this term.
I20260709 12:30:13.128427 17754 raft_consensus.cc:515] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.130944 17754 leader_election.cc:290] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.131713 17725 leader_election.cc:290] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:13.128032 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ad2867ed594d4794807e95f2994f46" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:13.119568 17572 raft_consensus.cc:515] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:13.124804 17645 leader_election.cc:290] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.135052 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c73b3d790842ed9389c18ddb50e3c1" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:13.135859 16665 raft_consensus.cc:2393] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a in current term 2: Already voted for candidate 99ca36f8a50c459388f31022b1455ed6 in this term.
I20260709 12:30:13.128782 17768 raft_consensus.cc:515] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.137558 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:13.138576 17453 raft_consensus.cc:2393] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a in current term 3: Already voted for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in this term.
I20260709 12:30:13.139555 16738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:13.132818 17770 raft_consensus.cc:515] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.140573 16738 raft_consensus.cc:3060] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:30:13.142345 17770 leader_election.cc:290] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.139635 17768 leader_election.cc:290] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.133581 17758 raft_consensus.cc:493] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:13.144479 17758 raft_consensus.cc:515] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:13.145313 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:13.119374 17710 raft_consensus.cc:493] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:30:13.146157 16590 raft_consensus.cc:2468] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 3.
I20260709 12:30:13.146622 17710 raft_consensus.cc:515] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.134920 17692 raft_consensus.cc:515] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:13.148854 17710 leader_election.cc:290] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.149329 17692 leader_election.cc:290] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:13.151904 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ad2867ed594d4794807e95f2994f46" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:13.153276 17404 leader_election.cc:304] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:13.158078 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:13.158720 17725 raft_consensus.cc:2804] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:13.158880 16593 raft_consensus.cc:2468] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 3.
I20260709 12:30:13.159184 17725 raft_consensus.cc:493] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:13.159600 17725 raft_consensus.cc:3060] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.160948 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c73b3d790842ed9389c18ddb50e3c1" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:13.161545 16591 raft_consensus.cc:2468] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 2.
I20260709 12:30:13.161646 16586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:13.161840 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ad2867ed594d4794807e95f2994f46" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:13.162300 16586 raft_consensus.cc:2468] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 3.
I20260709 12:30:13.162667 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:13.163059 17710 raft_consensus.cc:2804] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:30:13.163504 17710 raft_consensus.cc:493] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:13.163607 16739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d6724b5f4d23403097a81f5e83cf5e0e"
dest_uuid: "cd924581228b49d889b0e1553519722a"
mode: GRACEFUL
new_leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:55242
I20260709 12:30:13.164103 17710 raft_consensus.cc:3060] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:13.164536 16739 raft_consensus.cc:606] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Received request to transfer leadership to TS 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:13.165409 17451 raft_consensus.cc:2468] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 1.
I20260709 12:30:13.150389 17758 leader_election.cc:290] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:13.166775 17758 raft_consensus.cc:493] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:13.167284 17758 raft_consensus.cc:515] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:13.169425 17758 leader_election.cc:290] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:13.164201 16590 raft_consensus.cc:2393] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in current term 2: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
I20260709 12:30:13.169545 16736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:13.163524 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:13.170472 16736 raft_consensus.cc:2468] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 3.
I20260709 12:30:13.170899 17729 raft_consensus.cc:493] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:13.171370 17452 raft_consensus.cc:2393] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a in current term 3: Already voted for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in this term.
I20260709 12:30:13.171480 17729 raft_consensus.cc:515] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:13.173388 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:13.174016 16737 raft_consensus.cc:2468] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:13.174331 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ad2867ed594d4794807e95f2994f46" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:13.174454 17729 leader_election.cc:290] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.174957 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d77d239e0634d6894726f6bba42be5e" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:13.175444  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:30:13.175560 16739 raft_consensus.cc:3060] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.176817 16557 leader_election.cc:304] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:13.177191  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:13.177986  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:13.179127 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:13.179437 17718 raft_consensus.cc:493] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:13.179832 16593 raft_consensus.cc:2468] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 2.
I20260709 12:30:13.179922 17718 raft_consensus.cc:515] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:13.174907 16735 raft_consensus.cc:2468] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:13.182068 17718 leader_election.cc:290] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:13.182593 17718 raft_consensus.cc:493] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:13.183022 17718 raft_consensus.cc:515] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.163441 16585 raft_consensus.cc:2468] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 3.
I20260709 12:30:13.184890 17718 leader_election.cc:290] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.180971 16704 leader_election.cc:304] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:13.186746 17645 raft_consensus.cc:2804] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:13.187156 17645 raft_consensus.cc:493] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:13.187547 17645 raft_consensus.cc:3060] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:13.188771 16738 raft_consensus.cc:2468] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 4.
I20260709 12:30:13.189999 16630 leader_election.cc:304] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:13.190872 16704 leader_election.cc:304] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:13.192131 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:13.192343 17758 raft_consensus.cc:493] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:13.192847 16585 raft_consensus.cc:2468] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 3.
I20260709 12:30:13.194442 17770 raft_consensus.cc:2804] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:13.194892 17770 raft_consensus.cc:493] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:13.195308 17770 raft_consensus.cc:3060] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.195787 17729 raft_consensus.cc:2804] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:13.196290 17729 raft_consensus.cc:493] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:13.196758 17729 raft_consensus.cc:3060] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.199115 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1966b49831ff47a3ba7263b77ac4e86b" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:13.199121 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:13.200627 16585 raft_consensus.cc:2410] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:30:13.192832 17758 raft_consensus.cc:515] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.203624 17405 leader_election.cc:304] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:13.204509 16736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:13.205283 16736 raft_consensus.cc:2393] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9f5ebf768d584b17897ebb5b4575ece5 in current term 3: Already voted for candidate cd924581228b49d889b0e1553519722a in this term.
I20260709 12:30:13.205580 17703 raft_consensus.cc:2804] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:13.206019 17703 raft_consensus.cc:493] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting leader election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:30:13.206430 17703 raft_consensus.cc:3060] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:13.209620 17758 leader_election.cc:290] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:13.212164 17675 raft_consensus.cc:493] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:13.212643 16593 raft_consensus.cc:2468] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 2.
I20260709 12:30:13.212903 17675 raft_consensus.cc:515] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:13.215222 16704 leader_election.cc:304] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:13.215495 17675 leader_election.cc:290] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:13.216074 17769 raft_consensus.cc:2804] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:13.216581 17769 raft_consensus.cc:493] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:13.216876 16704 leader_election.cc:304] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:13.217180 17769 raft_consensus.cc:3060] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:13.221912 17754 raft_consensus.cc:2804] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:13.222555 17754 raft_consensus.cc:493] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:13.222728 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7f1ce17c243358d69760e6457d24a" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:13.223228 17754 raft_consensus.cc:3060] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.225144 16630 leader_election.cc:304] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:13.226480 17766 raft_consensus.cc:2804] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:30:13.226953 17766 raft_consensus.cc:493] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:13.227376 17766 raft_consensus.cc:3060] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:13.231500 16736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1966b49831ff47a3ba7263b77ac4e86b" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:13.232275 16736 raft_consensus.cc:2468] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 1.
I20260709 12:30:13.233141 17572 leader_election.cc:290] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 4 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:13.234462 17771 raft_consensus.cc:493] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:13.235221 17771 raft_consensus.cc:515] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:13.237725 17771 leader_election.cc:290] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:13.238198 17758 raft_consensus.cc:2804] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:30:13.239696 16557 leader_election.cc:304] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:13.238751 17758 raft_consensus.cc:493] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:13.240422 17758 raft_consensus.cc:3060] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:13.243023 17675 raft_consensus.cc:493] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:13.243605 17675 raft_consensus.cc:515] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:13.246335 17710 raft_consensus.cc:515] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.246858 17675 leader_election.cc:290] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:13.249163 17710 leader_election.cc:290] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 4 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.250422 16593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:13.251353 16593 raft_consensus.cc:3060] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:13.209758 16739 raft_consensus.cc:2468] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 3.
I20260709 12:30:13.253624 17754 raft_consensus.cc:515] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.253980 17774 raft_consensus.cc:493] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:13.254715 16738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:13.285056 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:13.282109 16665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7f1ce17c243358d69760e6457d24a" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:13.263546 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1966b49831ff47a3ba7263b77ac4e86b" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:13.267203 17675 raft_consensus.cc:493] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:13.303015 17452 raft_consensus.cc:2468] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 2.
I20260709 12:30:13.288164 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:13.303422 17774 raft_consensus.cc:515] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:13.277022 16557 leader_election.cc:304] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:13.223649 17703 raft_consensus.cc:515] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.305421 16661 raft_consensus.cc:2468] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 3.
I20260709 12:30:13.256045 16704 leader_election.cc:304] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:13.302904 16665 raft_consensus.cc:2368] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a for earlier term 2. Current term is 3.
I20260709 12:30:13.262923 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:13.308245 17767 raft_consensus.cc:2804] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:13.284647 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d77d239e0634d6894726f6bba42be5e" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:13.308758 17767 raft_consensus.cc:493] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:13.308969 16739 raft_consensus.cc:2393] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 99ca36f8a50c459388f31022b1455ed6 in current term 3: Already voted for candidate cd924581228b49d889b0e1553519722a in this term.
I20260709 12:30:13.309235 17767 raft_consensus.cc:3060] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:13.309689 16738 raft_consensus.cc:3060] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:13.256609 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1954b02f86b546d382996faa0aa9fd89" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:13.311375 16585 raft_consensus.cc:2468] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:13.281842 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea7880201e5f49299c203ac770ceb930" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:13.313109 17454 raft_consensus.cc:3060] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:13.312840 17404 leader_election.cc:304] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:13.298015 17771 raft_consensus.cc:2804] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:13.314292 17771 raft_consensus.cc:493] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:13.284498 16658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:13.314862 17771 raft_consensus.cc:3060] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.315641 16658 raft_consensus.cc:2410] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:30:13.256593 17645 raft_consensus.cc:515] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:13.276472 17453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:13.303334 17675 raft_consensus.cc:515] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.319911 17453 raft_consensus.cc:2468] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 3.
I20260709 12:30:13.323307 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1954b02f86b546d382996faa0aa9fd89" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:13.324018 17451 raft_consensus.cc:2468] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 2.
I20260709 12:30:13.326732 16631 leader_election.cc:304] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:13.327379 17710 raft_consensus.cc:2804] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:13.327817 17710 raft_consensus.cc:493] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:13.328212 17710 raft_consensus.cc:3060] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.328354 17692 raft_consensus.cc:2804] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:30:13.328907 17692 raft_consensus.cc:697] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 4 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:13.329859 16658 raft_consensus.cc:1275] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:30:13.329718 17692 consensus_queue.cc:237] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:13.330909 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1954b02f86b546d382996faa0aa9fd89" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:13.331547 16661 raft_consensus.cc:2468] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:13.333405 17768 raft_consensus.cc:493] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:13.324040 17770 raft_consensus.cc:515] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.333949 17768 raft_consensus.cc:515] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.336297 17768 leader_election.cc:290] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.309108 16660 raft_consensus.cc:3060] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.338303 17729 raft_consensus.cc:515] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:13.342553 17754 leader_election.cc:290] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.343518 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:13.344250 16585 raft_consensus.cc:2468] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 3.
I20260709 12:30:13.325848 17769 raft_consensus.cc:515] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.345389 16667 raft_consensus.cc:2468] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 3.
I20260709 12:30:13.346884 17769 leader_election.cc:290] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.347002 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1954b02f86b546d382996faa0aa9fd89" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:13.347687 16661 raft_consensus.cc:2468] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 2.
I20260709 12:30:13.326011 17725 raft_consensus.cc:515] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:13.348471 17404 leader_election.cc:304] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:13.349367 17772 raft_consensus.cc:2804] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:30:13.349745 17772 raft_consensus.cc:493] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:13.350050 17772 raft_consensus.cc:3060] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:13.349964 17725 leader_election.cc:290] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:13.351853 17725 raft_consensus.cc:2804] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:13.352005 17774 leader_election.cc:290] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:13.352351 17725 raft_consensus.cc:697] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:13.356360 16559 leader_election.cc:304] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: cd924581228b49d889b0e1553519722a
I20260709 12:30:13.357852 16559 leader_election.cc:304] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:13.358099 17772 raft_consensus.cc:515] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.359476 17454 raft_consensus.cc:2468] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 4.
I20260709 12:30:13.360865 17775 raft_consensus.cc:2804] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:13.361162 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:13.365568 16585 raft_consensus.cc:3060] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:13.365899 17675 leader_election.cc:290] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.366940 16707 leader_election.cc:304] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:13.367172 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:13.367687 17769 raft_consensus.cc:2804] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:13.367740 16590 raft_consensus.cc:2468] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:13.363471 17453 raft_consensus.cc:1275] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:13.368180 17769 raft_consensus.cc:493] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:13.368556 17769 raft_consensus.cc:3060] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.369329 17404 leader_election.cc:304] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:13.370369 17645 leader_election.cc:290] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:13.374382 17775 raft_consensus.cc:493] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:13.382474 17775 raft_consensus.cc:3060] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.364879 16586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ad2867ed594d4794807e95f2994f46" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:13.384716 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:13.385226 16586 raft_consensus.cc:2393] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in current term 2: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
I20260709 12:30:13.353263 17725 consensus_queue.cc:237] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:13.387643 17772 leader_election.cc:290] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 4 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.373998 16585 raft_consensus.cc:2468] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 4.
I20260709 12:30:13.374403 17770 leader_election.cc:290] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.363600 17703 leader_election.cc:290] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.390600 17404 leader_election.cc:304] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:13.381202 17675 raft_consensus.cc:2804] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:13.383138 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ad2867ed594d4794807e95f2994f46" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:13.391695 17675 raft_consensus.cc:493] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:13.392119 17675 raft_consensus.cc:3060] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.383744 16737 raft_consensus.cc:1275] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:30:13.383632 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:13.393241 16735 raft_consensus.cc:2468] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 3.
I20260709 12:30:13.384373 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:13.394080 16740 raft_consensus.cc:3060] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:13.396770 17775 raft_consensus.cc:515] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:13.400872 16740 raft_consensus.cc:2468] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 4.
I20260709 12:30:13.364010 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425340b667774e9083a7c360e90ff2e5" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:13.402045 17454 raft_consensus.cc:3060] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.405426 17407 leader_election.cc:400] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625) with higher term. Message: Invalid argument: T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a for earlier term 2. Current term is 3.
I20260709 12:30:13.405822 17407 leader_election.cc:403] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:30:13.406749 17703 raft_consensus.cc:3060] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.407284 17780 raft_consensus.cc:2804] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:30:13.409193 16557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 132252us
I20260709 12:30:13.416839 17766 raft_consensus.cc:515] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:13.417052 17703 raft_consensus.cc:2749] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625) with higher term. Message: Invalid argument: T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a for earlier term 2. Current term is 3.
I20260709 12:30:13.418133 17775 leader_election.cc:290] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
W20260709 12:30:13.418710 16704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 162728us
I20260709 12:30:13.438421 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c73b3d790842ed9389c18ddb50e3c1" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:13.438648 17675 raft_consensus.cc:515] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.441198 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:13.441886 16591 raft_consensus.cc:2368] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a for earlier term 3. Current term is 4.
I20260709 12:30:13.441789 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:13.442685 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:13.419478 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:13.417852 17782 consensus_queue.cc:1048] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:30:13.444445 16740 raft_consensus.cc:2393] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f5ebf768d584b17897ebb5b4575ece5 in current term 3: Already voted for candidate cd924581228b49d889b0e1553519722a in this term.
I20260709 12:30:13.445147 17770 raft_consensus.cc:493] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:13.445511 17772 consensus_queue.cc:1048] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:13.445609 17770 raft_consensus.cc:515] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.447793 17770 leader_election.cc:290] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.449151 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:13.449720 16590 raft_consensus.cc:3060] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.450515 16587 raft_consensus.cc:2468] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 2.
I20260709 12:30:13.442667 17675 leader_election.cc:290] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.451126 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a084469fa354084b2130b4656a965d1" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:13.452082 16589 raft_consensus.cc:2468] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 2.
W20260709 12:30:13.420130 16707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:36499, user_credentials={real_user=slave}} blocked reactor thread for 53281us
I20260709 12:30:13.421133 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1966b49831ff47a3ba7263b77ac4e86b" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:13.454193 17451 raft_consensus.cc:2393] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a in current term 2: Already voted for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in this term.
I20260709 12:30:13.422647 16738 raft_consensus.cc:2468] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 4.
I20260709 12:30:13.425107 17780 raft_consensus.cc:697] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:13.455587 17780 consensus_queue.cc:237] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.456331 16704 leader_election.cc:400] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 election: Vote denied by peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329) with higher term. Message: Invalid argument: T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a for earlier term 3. Current term is 4.
I20260709 12:30:13.456660 16704 leader_election.cc:403] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:30:13.457789 17718 raft_consensus.cc:2749] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329) with higher term. Message: Invalid argument: T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a for earlier term 3. Current term is 4.
I20260709 12:30:13.427582 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "425340b667774e9083a7c360e90ff2e5" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:13.458550 16661 raft_consensus.cc:3060] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.460541 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0de7225f1bc44a1a67f4f298d60a257" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:13.461264 17452 raft_consensus.cc:2368] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a for earlier term 3. Current term is 4.
I20260709 12:30:13.460119 16704 leader_election.cc:304] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:13.463727 16738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:13.410007 17710 raft_consensus.cc:515] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:13.463325 17405 leader_election.cc:304] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:13.428733 16660 raft_consensus.cc:2468] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 3.
I20260709 12:30:13.430078 17454 raft_consensus.cc:2468] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 3.
W20260709 12:30:13.431092 16559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:33625, user_credentials={real_user=slave}} blocked reactor thread for 73306.3us
I20260709 12:30:13.467473 17710 leader_election.cc:290] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:13.468118 17710 raft_consensus.cc:2804] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:30:13.468771 17710 raft_consensus.cc:697] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:13.431195 17776 raft_consensus.cc:2804] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:13.469717 17776 raft_consensus.cc:493] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:13.470095 17776 raft_consensus.cc:3060] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.470620 17775 consensus_queue.cc:1048] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:13.471006 17718 raft_consensus.cc:2804] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:13.471578 17718 raft_consensus.cc:697] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:30:13.472412 17718 consensus_queue.cc:237] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.472713 17710 consensus_queue.cc:237] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.474830 16559 leader_election.cc:304] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:13.476555 17775 raft_consensus.cc:2804] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:13.430936 16593 raft_consensus.cc:2468] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 4.
I20260709 12:30:13.478438 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1954b02f86b546d382996faa0aa9fd89" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:13.479020 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1954b02f86b546d382996faa0aa9fd89" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:13.479589 16660 raft_consensus.cc:3060] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.480211 16658 raft_consensus.cc:1275] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:13.482005 16658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:13.483253 17455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a084469fa354084b2130b4656a965d1" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:13.483868 17455 raft_consensus.cc:2468] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 2.
I20260709 12:30:13.484447 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:13.468057 16586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:13.485263 16586 raft_consensus.cc:2468] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 3.
I20260709 12:30:13.487746 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:13.470067 16704 leader_election.cc:304] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:13.488839 16661 raft_consensus.cc:2468] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 3.
I20260709 12:30:13.488996 17451 raft_consensus.cc:1275] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:13.488996 17770 raft_consensus.cc:2804] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:13.484380 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:13.490697 17770 raft_consensus.cc:493] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:13.491135 17770 raft_consensus.cc:3060] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.491472 17452 raft_consensus.cc:2393] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a in current term 2: Already voted for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in this term.
I20260709 12:30:13.494163 16630 leader_election.cc:304] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:13.434374 17729 leader_election.cc:290] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:13.345674 17758 raft_consensus.cc:515] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:13.498903 16589 raft_consensus.cc:2368] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 99ca36f8a50c459388f31022b1455ed6 for earlier term 3. Current term is 4.
I20260709 12:30:13.500062 17725 consensus_queue.cc:1048] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:13.502557 16630 leader_election.cc:400] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 election: Vote denied by peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329) with higher term. Message: Invalid argument: T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 99ca36f8a50c459388f31022b1455ed6 for earlier term 3. Current term is 4.
I20260709 12:30:13.502859 16630 leader_election.cc:403] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:30:13.503031 17766 leader_election.cc:290] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 4 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.503625 17766 raft_consensus.cc:3060] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:13.511183 16661 raft_consensus.cc:1275] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:13.522188 16738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:13.523133 16738 raft_consensus.cc:3060] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:13.526199 16590 raft_consensus.cc:2468] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 3.
I20260709 12:30:13.537984 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:13.538514 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:13.539175 16737 raft_consensus.cc:2468] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 3.
I20260709 12:30:13.569487 17778 raft_consensus.cc:493] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9f5ebf768d584b17897ebb5b4575ece5)
I20260709 12:30:13.570328 17778 raft_consensus.cc:515] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.579005 17758 leader_election.cc:290] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 4 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:13.593171 17770 raft_consensus.cc:515] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.595065 16660 raft_consensus.cc:2468] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 3.
I20260709 12:30:13.595916 17769 raft_consensus.cc:515] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.597590 17404 leader_election.cc:304] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: cd924581228b49d889b0e1553519722a
I20260709 12:30:13.600669 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:13.601608 16590 raft_consensus.cc:3060] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:13.606637 16707 leader_election.cc:304] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:13.612498 16590 raft_consensus.cc:2468] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 4.
I20260709 12:30:13.616981 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c73b3d790842ed9389c18ddb50e3c1" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:13.617967 16661 raft_consensus.cc:2393] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a in current term 2: Already voted for candidate 99ca36f8a50c459388f31022b1455ed6 in this term.
I20260709 12:30:13.619133 16630 leader_election.cc:304] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:13.614406 17407 leader_election.cc:304] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:30:13.624403 16739 raft_consensus.cc:2368] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a for earlier term 2. Current term is 3.
I20260709 12:30:13.630716 17785 raft_consensus.cc:493] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:13.626909 17767 raft_consensus.cc:515] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.631222 17785 raft_consensus.cc:515] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.631536 17771 raft_consensus.cc:515] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.632803 17767 leader_election.cc:290] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.633601 17785 leader_election.cc:290] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.633749 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:13.634596 17451 raft_consensus.cc:3060] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:13.613430 17675 raft_consensus.cc:2804] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:13.633647 17767 raft_consensus.cc:2749] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:30:13.625077 17783 raft_consensus.cc:2804] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:13.639210 17769 leader_election.cc:290] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.639353 17675 raft_consensus.cc:697] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:13.639773 17783 raft_consensus.cc:697] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:13.640475 17675 consensus_queue.cc:237] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.640681 17783 consensus_queue.cc:237] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:13.625229 17773 raft_consensus.cc:2804] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:30:13.642675 17773 raft_consensus.cc:697] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 4 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:13.633737 17771 leader_election.cc:290] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:13.643512 17773 consensus_queue.cc:237] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:13.644061 17778 leader_election.cc:290] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.647305 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:13.647426 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:13.648166 16592 raft_consensus.cc:2368] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a for earlier term 2. Current term is 3.
I20260709 12:30:13.648705 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ad2867ed594d4794807e95f2994f46" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:13.649233 16589 raft_consensus.cc:3060] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:30:13.655155 16707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:33625, user_credentials={real_user=slave}} blocked reactor thread for 48593.9us
I20260709 12:30:13.656168 17405 leader_election.cc:400] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Vote denied by peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573) with higher term. Message: Invalid argument: T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a for earlier term 2. Current term is 3.
I20260709 12:30:13.656600 17405 leader_election.cc:403] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:30:13.658876 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ce519a396e148d79231bf7cfbabc173" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:13.659153 16704 leader_election.cc:400] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329) with higher term. Message: Invalid argument: T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a for earlier term 2. Current term is 3.
I20260709 12:30:13.659598 16704 leader_election.cc:403] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:30:13.663065 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1966b49831ff47a3ba7263b77ac4e86b" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:13.663775 16735 raft_consensus.cc:3060] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.666740 16589 raft_consensus.cc:2468] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 3.
I20260709 12:30:13.669993 17456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ad2867ed594d4794807e95f2994f46" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:13.670955 17457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1966b49831ff47a3ba7263b77ac4e86b" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:13.674408 17785 raft_consensus.cc:3060] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.678073 16738 raft_consensus.cc:2468] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 4.
I20260709 12:30:13.679828 17767 raft_consensus.cc:3060] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.680673 16707 leader_election.cc:400] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 election: Vote denied by peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499) with higher term. Message: Invalid argument: T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a for earlier term 3. Current term is 4.
I20260709 12:30:13.692628 16707 leader_election.cc:403] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:30:13.694897 16735 raft_consensus.cc:2468] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 3.
I20260709 12:30:13.683209 17454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1966b49831ff47a3ba7263b77ac4e86b" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:13.691414 16704 leader_election.cc:304] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:13.696614 17457 raft_consensus.cc:2393] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a in current term 2: Already voted for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in this term.
I20260709 12:30:13.696095 16557 leader_election.cc:304] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:13.678719 17775 raft_consensus.cc:697] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:13.627070 17758 consensus_queue.cc:1048] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:30:13.696705 17645 raft_consensus.cc:2749] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499) with higher term. Message: Invalid argument: T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a for earlier term 3. Current term is 4.
I20260709 12:30:13.678660 17771 consensus_queue.cc:1048] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
W20260709 12:30:13.728317 16633 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:36499, user_credentials={real_user=slave}} blocked reactor thread for 45086.6us
I20260709 12:30:13.712129 16557 leader_election.cc:304] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:13.710299 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:13.727818 16585 raft_consensus.cc:2468] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 2.
W20260709 12:30:13.744406 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 87370.3us
I20260709 12:30:13.732770 17778 raft_consensus.cc:2804] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:13.762321 17770 leader_election.cc:290] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:13.758535 16588 raft_consensus.cc:2468] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:13.763289 17775 consensus_queue.cc:237] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:13.764822 17451 raft_consensus.cc:2468] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 4.
I20260709 12:30:13.767349 17766 raft_consensus.cc:2749] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329) with higher term. Message: Invalid argument: T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 99ca36f8a50c459388f31022b1455ed6 for earlier term 3. Current term is 4.
I20260709 12:30:13.757710 16658 raft_consensus.cc:2468] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 3.
I20260709 12:30:13.767957 17776 raft_consensus.cc:515] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:13.782624 17776 leader_election.cc:290] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:13.775710 16559 leader_election.cc:304] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: cd924581228b49d889b0e1553519722a
I20260709 12:30:13.793022 16661 raft_consensus.cc:2468] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 4.
W20260709 12:30:13.794145 16707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:36499, user_credentials={real_user=slave}} blocked reactor thread for 98727.5us
I20260709 12:30:13.739526 17791 raft_consensus.cc:2804] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:13.801012 17758 raft_consensus.cc:2804] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:13.801550 17758 raft_consensus.cc:697] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:13.802047 17791 raft_consensus.cc:697] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:13.803908 17791 consensus_queue.cc:237] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.802513 16587 raft_consensus.cc:2393] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in current term 3: Already voted for candidate 9f5ebf768d584b17897ebb5b4575ece5 in this term.
W20260709 12:30:13.810446 16557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 98407.7us
I20260709 12:30:13.812757 17404 leader_election.cc:304] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: cd924581228b49d889b0e1553519722a
I20260709 12:30:13.817024 17703 raft_consensus.cc:2804] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:13.817402 17703 raft_consensus.cc:493] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:13.817726 17703 raft_consensus.cc:3060] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:30:13.820799 16704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 129464us
I20260709 12:30:13.792690 17729 raft_consensus.cc:2804] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:30:13.826557 16630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 142459us
I20260709 12:30:13.827005 16704 leader_election.cc:304] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:13.796917 17778 raft_consensus.cc:697] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 3 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:30:13.829957 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a084469fa354084b2130b4656a965d1" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:13.830714 17452 raft_consensus.cc:3060] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:13.830309 17778 consensus_queue.cc:237] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:13.848412 17758 consensus_queue.cc:237] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:13.849184 17452 raft_consensus.cc:2468] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 3.
I20260709 12:30:13.810113 17776 raft_consensus.cc:2804] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:30:13.873556 17777 raft_consensus.cc:2804] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:30:13.908259 16559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.67:33625, user_credentials={real_user=slave}} blocked reactor thread for 132626us
I20260709 12:30:13.910841 16661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1954b02f86b546d382996faa0aa9fd89" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:13.911631 16661 raft_consensus.cc:2393] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f5ebf768d584b17897ebb5b4575ece5 in current term 3: Already voted for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in this term.
I20260709 12:30:13.878952 17776 raft_consensus.cc:697] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:13.916575 16667 raft_consensus.cc:1275] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:30:13.917704 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 50384.3us
I20260709 12:30:13.887603 16585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a084469fa354084b2130b4656a965d1" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
W20260709 12:30:13.926689 16704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 45953.6us
W20260709 12:30:13.932667 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:33625, user_credentials={real_user=slave}} blocked reactor thread for 68387.3us
I20260709 12:30:13.936781 17458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1954b02f86b546d382996faa0aa9fd89" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:13.937348 17805 consensus_queue.cc:1048] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:30:13.930802 16585 raft_consensus.cc:3060] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:30:13.967952 16707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:36499, user_credentials={real_user=slave}} blocked reactor thread for 97862.3us
W20260709 12:30:13.986387 17789 log.cc:927] Time spent T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:30:13.988303 16707 leader_election.cc:304] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:13.996429 16559 leader_election.cc:304] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:14.019219 17825 raft_consensus.cc:2749] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:30:14.006668 17799 raft_consensus.cc:2804] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:14.042901 17777 raft_consensus.cc:697] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:30:14.076836 16735 raft_consensus.cc:1275] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:30:14.080988 16707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:33625, user_credentials={real_user=slave}} blocked reactor thread for 76027.9us
I20260709 12:30:13.994853 17776 consensus_queue.cc:237] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:14.062089 17799 raft_consensus.cc:697] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 3 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:30:14.130528 16658 raft_consensus.cc:1275] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:14.094941 17766 raft_consensus.cc:493] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:14.094491 17710 consensus_queue.cc:1048] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
W20260709 12:30:14.150511 16707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:36499, user_credentials={real_user=slave}} blocked reactor thread for 54156.2us
I20260709 12:30:14.128590 17451 raft_consensus.cc:1275] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:30:14.088267 17799 consensus_queue.cc:237] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:14.196463 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:14.139135 17766 raft_consensus.cc:515] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:14.127774 17703 raft_consensus.cc:515] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
W20260709 12:30:14.231603 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 140925us
I20260709 12:30:14.232734 17457 raft_consensus.cc:1240] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Rejecting Update request from peer cd924581228b49d889b0e1553519722a for earlier term 2. Current term is 3. Ops: []
I20260709 12:30:14.151788 17784 consensus_queue.cc:1048] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 12:30:14.255373 16586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1966b49831ff47a3ba7263b77ac4e86b" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:14.254721 16416 catalog_manager.cc:5697] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 2 to 4, leader changed from 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 4 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:14.256476 16739 raft_consensus.cc:1275] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:30:14.257495 17785 consensus_meta.cc:287] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Time spent flushing consensus metadata: real 0.565s	user 0.011s	sys 0.000s
I20260709 12:30:14.257879 17785 raft_consensus.cc:2749] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer cd924581228b49d889b0e1553519722a (127.8.111.68:35573) with higher term. Message: Invalid argument: T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 32b697d90f0c4cdfb0a3f55e33a5b37a for earlier term 2. Current term is 3.
I20260709 12:30:14.259991 17766 leader_election.cc:290] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:14.263419 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c73b3d790842ed9389c18ddb50e3c1" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
W20260709 12:30:14.305011 17405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 83350us
I20260709 12:30:14.137883 17777 consensus_queue.cc:237] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
W20260709 12:30:14.324102 17767 consensus_meta.cc:287] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.009s
I20260709 12:30:14.312178 17729 raft_consensus.cc:493] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:30:14.324609 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 113775us
I20260709 12:30:14.324601 17767 raft_consensus.cc:2749] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329) with higher term. Message: Invalid argument: T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd924581228b49d889b0e1553519722a for earlier term 2. Current term is 3.
I20260709 12:30:14.315954 16588 raft_consensus.cc:2468] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 2.
I20260709 12:30:14.331480 17456 raft_consensus.cc:2468] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 3.
I20260709 12:30:14.335378 16630 leader_election.cc:304] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:14.337103 17822 raft_consensus.cc:2804] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:30:14.337646 17822 raft_consensus.cc:493] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:14.328939 17729 raft_consensus.cc:3060] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:30:14.346467 17773 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.000s	sys 0.009s
I20260709 12:30:14.338003 17822 raft_consensus.cc:3060] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:30:14.346915 17773 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.000s	sys 0.009s
W20260709 12:30:14.347245 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 99782.5us
I20260709 12:30:14.349519 16739 raft_consensus.cc:1275] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:14.352396 16585 raft_consensus.cc:2468] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 3.
I20260709 12:30:14.325191 17774 consensus_queue.cc:1048] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:30:14.362371 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c73b3d790842ed9389c18ddb50e3c1" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:14.366590 17780 consensus_queue.cc:1048] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:14.372105 17703 leader_election.cc:290] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:14.372380 16658 raft_consensus.cc:1275] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:14.374032 17835 consensus_queue.cc:1048] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:30:14.377231 16704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 449467us
I20260709 12:30:14.387647 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:14.367847 17822 raft_consensus.cc:515] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:14.403978 17729 raft_consensus.cc:515] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:14.384462 17800 consensus_queue.cc:1048] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:30:14.414788 17773 raft_consensus.cc:493] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:30:14.415489 17773 raft_consensus.cc:515] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:14.419552 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:14.423512 17815 raft_consensus.cc:993] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a: : Instructing follower 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:14.425168 17770 raft_consensus.cc:1081] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Signalling peer 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:14.428164 16737 raft_consensus.cc:1275] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:14.428315 16704 leader_election.cc:304] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:14.427068 16588 raft_consensus.cc:1275] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Refusing update from remote peer cd924581228b49d889b0e1553519722a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:14.431787 17812 raft_consensus.cc:2749] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:30:14.448621 16665 raft_consensus.cc:1240] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:30:14.454763 17457 raft_consensus.cc:3060] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:14.463243 16589 raft_consensus.cc:1275] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:30:14.463721 17457 raft_consensus.cc:1275] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:14.464735 16589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21548ea41a6a427fb041bbd4531e9d29" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:14.465325 16589 raft_consensus.cc:3060] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:14.466856 16735 raft_consensus.cc:1275] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:30:14.475018 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17be6871edc41768bb5b3a6e2d1cf2a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:14.475965 17825 consensus_queue.cc:1048] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:30:14.491933 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c73b3d790842ed9389c18ddb50e3c1" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:14.493479 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:14.494230 16741 raft_consensus.cc:3060] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:14.495518 16589 raft_consensus.cc:2468] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 3.
I20260709 12:30:14.445766 17822 leader_election.cc:290] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:14.463212 17729 leader_election.cc:290] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 4 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:14.508394 17404 leader_election.cc:304] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: cd924581228b49d889b0e1553519722a
I20260709 12:30:14.514226 16735 raft_consensus.cc:1275] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:14.515272 17457 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d6724b5f4d23403097a81f5e83cf5e0e"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:44906
I20260709 12:30:14.518240 17457 raft_consensus.cc:493] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:14.518748 17457 raft_consensus.cc:3060] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:14.463734 17725 consensus_queue.cc:1048] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:30:14.478598 17791 consensus_queue.cc:1059] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:30:14.512024 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c73b3d790842ed9389c18ddb50e3c1" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:14.533456 17854 raft_consensus.cc:2804] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:14.535382 16741 raft_consensus.cc:2468] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 4.
I20260709 12:30:14.498445 17767 consensus_queue.cc:1059] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:30:14.488145 17809 consensus_queue.cc:1048] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:30:14.529371 16586 raft_consensus.cc:1275] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Refusing update from remote peer cd924581228b49d889b0e1553519722a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:30:14.603417 16559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:33625, user_credentials={real_user=slave}} blocked reactor thread for 56545.9us
I20260709 12:30:14.529181 17773 leader_election.cc:290] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:14.527325 17805 consensus_queue.cc:1048] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 12:30:14.559176 16587 raft_consensus.cc:3060] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:14.610694 17457 raft_consensus.cc:515] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:14.606459 17799 consensus_queue.cc:1048] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:30:14.603271 17854 raft_consensus.cc:697] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:14.618595 17855 consensus_queue.cc:1048] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:30:14.622021 17854 consensus_queue.cc:237] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:14.653052 16590 raft_consensus.cc:1240] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Rejecting Update request from peer cd924581228b49d889b0e1553519722a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:30:14.667845 17457 leader_election.cc:290] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:14.668519 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6724b5f4d23403097a81f5e83cf5e0e" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:14.669251 16741 raft_consensus.cc:3055] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:14.669776 16741 raft_consensus.cc:740] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:30:14.670756 16741 consensus_queue.cc:260] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:14.671277 17836 raft_consensus.cc:3055] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:14.671834 17836 raft_consensus.cc:740] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:30:14.672150 16741 raft_consensus.cc:3060] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:14.672878 17836 consensus_queue.cc:260] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
W20260709 12:30:14.753461 16707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:33625, user_credentials={real_user=slave}} blocked reactor thread for 256311us
I20260709 12:30:14.760067 16741 raft_consensus.cc:2468] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:14.753343 17836 raft_consensus.cc:3060] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:14.765722 17457 raft_consensus.cc:1240] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Rejecting Update request from peer cd924581228b49d889b0e1553519722a for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:14.770357 17449 raft_consensus.cc:1275] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Refusing update from remote peer cd924581228b49d889b0e1553519722a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:14.763732 16631 leader_election.cc:304] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:14.779421 17800 raft_consensus.cc:3055] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:30:14.779861 17800 raft_consensus.cc:740] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:14.780715 17800 consensus_queue.cc:260] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
W20260709 12:30:14.782395 16630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 302965us
I20260709 12:30:14.793313 16663 raft_consensus.cc:1275] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:30:14.795189 17775 consensus_queue.cc:1048] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:14.807790 17456 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44906 (request call id 372) took 1138 ms. Trace:
I20260709 12:30:14.808104 17451 raft_consensus.cc:1275] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Refusing update from remote peer cd924581228b49d889b0e1553519722a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:14.808404 17456 rpcz_store.cc:276] 0709 12:30:13.669560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:30:13.669704 (+   144us) service_pool.cc:224] Handling call
0709 12:30:14.807530 (+1137826us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b5400052b54. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8e485571 00007f2f8e5202fa 00007f2f934e1b17 00007f2f8ca5c6d4 00007f2f8ca5c662 00007f2f8ca5c591 00007f2f8ca5c50c 00007f2f8ca5b7c2 00007f2f8c85748c 00007f2f8c8568c6 00007f2f8c85626f
0709 12:30:14.807687 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1442228608}
I20260709 12:30:14.810685 16587 raft_consensus.cc:2468] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 3.
I20260709 12:30:14.814922  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:14.815240 17830 raft_consensus.cc:2804] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:30:14.815956 17830 raft_consensus.cc:697] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 4 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:14.817042 17830 consensus_queue.cc:237] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:14.820793 16630 leader_election.cc:304] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: cd924581228b49d889b0e1553519722a
I20260709 12:30:14.822949 17405 leader_election.cc:304] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:14.844480 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17be6871edc41768bb5b3a6e2d1cf2a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:14.848687 17855 raft_consensus.cc:2804] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:14.899600 16591 raft_consensus.cc:1275] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:14.899930 16589 raft_consensus.cc:1275] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:30:14.896992 16631 leader_election.cc:304] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:30:14.855037 17729 raft_consensus.cc:2804] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:14.912567 16592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6724b5f4d23403097a81f5e83cf5e0e" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:14.915784 16592 raft_consensus.cc:3060] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:14.917346 16591 raft_consensus.cc:1275] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:14.936722 17875 consensus_queue.cc:1048] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:30:14.921427 17855 raft_consensus.cc:697] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:14.921840 17729 raft_consensus.cc:697] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 3 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
W20260709 12:30:15.020591 17872 log.cc:927] Time spent T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:30:15.020774 17829 consensus_queue.cc:1048] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.102s
I20260709 12:30:15.022827 17840 raft_consensus.cc:2749] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:30:15.023128 17873 log.cc:927] Time spent T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:30:14.942596 17848 consensus_queue.cc:1048] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 12:30:15.023821 16667 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48814 (request call id 853) took 1037 ms. Trace:
W20260709 12:30:15.024042 17869 log.cc:927] Time spent T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:30:15.025336 17870 log.cc:927] Time spent T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 12:30:15.020665 17865 log.cc:927] Time spent T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
W20260709 12:30:15.028026 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 91788.5us
I20260709 12:30:15.027964 16592 raft_consensus.cc:2468] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:15.024226 16667 rpcz_store.cc:276] 0709 12:30:13.986602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:30:13.986753 (+   151us) service_pool.cc:224] Handling call
0709 12:30:13.987100 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:30:13.987447 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:30:13.987483 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:30:14.375276 (+387793us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b1800369100. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f942f7ab1 00007f2f94304281 00007f2f8b3fd2a6 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8ce15a11 00007f2f8ce25372 00007f2f8e557a01 00007f2f8e51c43a
0709 12:30:14.510120 (+134844us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b2c0006dec8. stack: 00007f2f8b3fd343 00007f2f8b3fd240 00007f2f8ad8c1d4 00007f2f94aca304 00007f2f94aca299 00007f2f8ce15a11 00007f2f8ce25372 00007f2f8e557a01 00007f2f8e51c43a 00007f2f8e51b83e 00007f2f934e0419 00007f2f8ca57bd4 00007f2f8ca57b62 00007f2f8ca57a91 00007f2f8ca57a0c 00007f2f8ca56cc2
0709 12:30:14.510683 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:30:14.888595 (+377912us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:30:14.888630 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:30:14.888875 (+   245us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:30:15.023592 (+134717us) raft_consensus.cc:1685] finished
0709 12:30:15.023622 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:30:15.023770 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"spinlock_wait_cycles":14519296,"thread_start_us":377542,"threads_started":1,"wal-append.queue_time_us":447961}
I20260709 12:30:15.047027 16733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a17be6871edc41768bb5b3a6e2d1cf2a"
dest_uuid: "cd924581228b49d889b0e1553519722a"
mode: GRACEFUL
new_leader_uuid: "99ca36f8a50c459388f31022b1455ed6"
 from {username='slave'} at 127.0.0.1:55242
I20260709 12:30:15.047721 16733 raft_consensus.cc:606] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Received request to transfer leadership to TS 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:15.050666 17804 consensus_queue.cc:1048] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.133s
I20260709 12:30:15.052379  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:30:15.091629 17805 raft_consensus.cc:493] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:30:15.091917 17864 raft_consensus.cc:493] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:15.092250 17805 raft_consensus.cc:515] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:15.092372 17864 raft_consensus.cc:515] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:15.094340 17864 leader_election.cc:290] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:15.094352 17805 leader_election.cc:290] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:15.097450 16737 raft_consensus.cc:1275] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:30:15.068152 17782 consensus_queue.cc:1048] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:30:15.099609 17455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:15.060273 17855 consensus_queue.cc:237] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:15.101305 17447 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5daaf5ff8d2242d2bdfdff37cbbd6146" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:15.097900 16737 pending_rounds.cc:85] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a: Aborting all ops after (but not including) 1
I20260709 12:30:15.109201 16737 pending_rounds.cc:107] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:30:15.115538 16737 raft_consensus.cc:2889] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:30:15.118477 17675 consensus_queue.cc:1048] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:15.075035 17729 consensus_queue.cc:237] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:15.148855 17758 raft_consensus.cc:493] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:15.149470 17758 raft_consensus.cc:515] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:15.151563 17758 leader_election.cc:290] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:15.156206 17775 raft_consensus.cc:493] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:30:15.156749 17775 raft_consensus.cc:515] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:15.158938 17775 leader_election.cc:290] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:15.156231 16667 raft_consensus.cc:1240] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 3 LEADER]: Rejecting Update request from peer cd924581228b49d889b0e1553519722a for earlier term 2. Current term is 3. Ops: []
I20260709 12:30:15.167145 16416 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56942 (request call id 102) took 1432 ms. Trace:
I20260709 12:30:15.190763 17449 raft_consensus.cc:1275] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:15.193297 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:15.200348 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd90b9fc6af748cd9bdb02bd14568f64" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:15.201293 16741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5daaf5ff8d2242d2bdfdff37cbbd6146" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:15.200472 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17be6871edc41768bb5b3a6e2d1cf2a" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:15.200680 16740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:15.167583 16416 rpcz_store.cc:276] 0709 12:30:13.734833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:30:13.734991 (+   158us) service_pool.cc:224] Handling call
0709 12:30:15.167061 (+1432070us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:30:14.394583 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:30:14.395152 (+   569us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:30:14.395185 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:30:14.395201 (+    16us) tablet.cc:662] Decoding operations
0709 12:30:14.395510 (+   309us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:30:14.395803 (+   293us) write_op.cc:641] Partition lock acquired for write op
0709 12:30:14.395836 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:30:14.396031 (+   195us) tablet.cc:701] Row locks acquired
0709 12:30:14.396046 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:30:14.396171 (+   125us) write_op.cc:270] Start()
0709 12:30:14.396265 (+    94us) write_op.cc:276] Timestamp: P: 1783600214396135 usec, L: 0
0709 12:30:14.396285 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:30:14.396938 (+   653us) log.cc:844] Serialized 537 byte log entry
0709 12:30:14.643007 (+246069us) op_driver.cc:464] REPLICATION: finished
0709 12:30:14.886729 (+243722us) write_op.cc:301] APPLY: starting
0709 12:30:14.891078 (+  4349us) tablet.cc:1367] starting BulkCheckPresence
0709 12:30:14.895324 (+  4246us) tablet.cc:1370] finished BulkCheckPresence
0709 12:30:14.928433 (+ 33109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:30:15.019977 (+ 91544us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:30:15.020203 (+   226us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:30:15.020252 (+    49us) write_op.cc:312] APPLY: finished
0709 12:30:15.020446 (+   194us) log.cc:844] Serialized 22 byte log entry
0709 12:30:15.020665 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:30:15.020752 (+    87us) write_op.cc:454] Released schema lock
0709 12:30:15.020794 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:30:15.021170 (+   376us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:30:15.021208 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":205491,"apply.run_cpu_time_us":2832,"apply.run_wall_time_us":168463,"num_ops":1,"prepare.queue_time_us":82963,"prepare.run_cpu_time_us":10731,"prepare.run_wall_time_us":105292,"raft.queue_time_us":27320,"raft.run_cpu_time_us":82324,"raft.run_wall_time_us":107197,"replication_time_us":246564,"thread_start_us":244052,"threads_started":4,"wal-append.queue_time_us":139933}]]}
I20260709 12:30:15.215651  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:15.216355 16739 raft_consensus.cc:1240] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Rejecting Update request from peer 9f5ebf768d584b17897ebb5b4575ece5 for earlier term 3. Current term is 4. Ops: []
I20260709 12:30:15.216569  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:15.218415 17847 raft_consensus.cc:493] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:30:15.218904 17847 raft_consensus.cc:515] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:15.208654 17836 consensus_queue.cc:1048] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:30:15.221787 16590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d31544c1e5974ed9bf1a91c63adb99b8" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:15.218217 16557 leader_election.cc:304] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:30:15.232122 17805 raft_consensus.cc:2749] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:15.233480 16557 leader_election.cc:304] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:30:15.245978 16557 leader_election.cc:304] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:30:15.262840 17725 raft_consensus.cc:2749] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:30:15.271301 16586 raft_consensus.cc:1275] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:15.272460 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17be6871edc41768bb5b3a6e2d1cf2a" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:15.251235 17847 leader_election.cc:290] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:15.217898 17775 consensus_queue.cc:1048] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:30:15.277240 17758 raft_consensus.cc:2749] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:30:15.275437 17675 consensus_queue.cc:1048] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:30:15.299079 16586 raft_consensus.cc:1275] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Refusing update from remote peer cd924581228b49d889b0e1553519722a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:30:15.301278 16556 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:30:15.318373 16559 leader_election.cc:304] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a
I20260709 12:30:15.325897 17800 raft_consensus.cc:3060] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:15.357421 17776 raft_consensus.cc:2749] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:15.312659 16585 raft_consensus.cc:1240] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Rejecting Update request from peer cd924581228b49d889b0e1553519722a for earlier term 2. Current term is 3. Ops: []
I20260709 12:30:15.386963 16740 raft_consensus.cc:1275] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:30:15.391322 16736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d31544c1e5974ed9bf1a91c63adb99b8" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:15.392360 17811 consensus_queue.cc:1048] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:15.395025 17811 consensus_queue.cc:1059] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:15.401878 17815 raft_consensus.cc:3055] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:15.402334 17815 raft_consensus.cc:740] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:30:15.403115 17815 consensus_queue.cc:260] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:15.404263 17815 raft_consensus.cc:3060] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:15.399286 16631 leader_election.cc:304] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:30:15.422955 17883 raft_consensus.cc:2749] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:15.397233 17825 consensus_queue.cc:1048] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 12:30:15.529431 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 68248.9us
W20260709 12:30:15.537330 17900 log.cc:927] Time spent T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:30:15.607355 16591 raft_consensus.cc:1275] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:30:15.611953 17889 log.cc:927] Time spent T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:30:15.615197 17854 consensus_queue.cc:1048] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:30:15.604230 17894 log.cc:927] Time spent T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a: Append to log took a long time: real 0.299s	user 0.000s	sys 0.006s
I20260709 12:30:15.625175 16737 raft_consensus.cc:1275] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:30:15.652218 17801 consensus_queue.cc:1048] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:30:15.657232 17769 raft_consensus.cc:993] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a: : Instructing follower 99ca36f8a50c459388f31022b1455ed6 to start an election
I20260709 12:30:15.669446 17769 raft_consensus.cc:1081] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Signalling peer 99ca36f8a50c459388f31022b1455ed6 to start an election
W20260709 12:30:15.700155 17893 log.cc:927] Time spent T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5: Append to log took a long time: real 0.335s	user 0.007s	sys 0.000s
I20260709 12:30:15.689071 16662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a17be6871edc41768bb5b3a6e2d1cf2a"
dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
 from {username='slave'} at 127.0.0.1:48810
I20260709 12:30:15.705436 16588 raft_consensus.cc:1275] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:30:15.706095 16588 pending_rounds.cc:85] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5: Aborting all ops after (but not including) 2
I20260709 12:30:15.706362 16588 pending_rounds.cc:107] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:30:15.706614 16588 raft_consensus.cc:2889] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:30:15.705407 16662 raft_consensus.cc:493] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:15.707347 16662 raft_consensus.cc:3060] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:15.714154 16738 raft_consensus.cc:1275] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:30:15.714613 16738 pending_rounds.cc:85] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a: Aborting all ops after (but not including) 1
I20260709 12:30:15.714871 16738 pending_rounds.cc:107] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:30:15.715154 16738 raft_consensus.cc:2889] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:30:15.726423 17572 raft_consensus.cc:493] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:30:15.726948 17572 raft_consensus.cc:515] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:15.717803 16662 raft_consensus.cc:515] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:15.739867 17769 raft_consensus.cc:493] T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:15.762260 17769 raft_consensus.cc:515] T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:15.731524 17773 consensus_queue.cc:1048] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:30:15.745416 17572 leader_election.cc:290] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:15.747349 16584 raft_consensus.cc:1275] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:15.766243 16591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23de375943ed49b2b9da4652fa088021" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:15.751010 16739 raft_consensus.cc:1275] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:15.766935 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda99eaeca1149d48e54e0d83c3ec4cb" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
W20260709 12:30:15.837728 16707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:33625, user_credentials={real_user=slave}} blocked reactor thread for 63965.6us
I20260709 12:30:15.843844 17458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fda99eaeca1149d48e54e0d83c3ec4cb" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:15.845228 16662 leader_election.cc:290] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 election: Requested vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:15.859789 17769 leader_election.cc:290] T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:15.974644 17801 consensus_queue.cc:1048] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 12:30:15.974933 17889 log.cc:927] Time spent T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:30:16.004410 16584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17be6871edc41768bb5b3a6e2d1cf2a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
I20260709 12:30:16.052304 16584 raft_consensus.cc:3060] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:16.087457 17710 consensus_queue.cc:1048] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:16.099329 16584 raft_consensus.cc:2468] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 3.
I20260709 12:30:16.101475 16630 leader_election.cc:304] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:16.103118 17797 raft_consensus.cc:2804] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:16.103991 17797 raft_consensus.cc:697] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 3 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:16.105028 17797 consensus_queue.cc:237] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:16.146415 17758 raft_consensus.cc:493] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:16.147019 17758 raft_consensus.cc:515] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:16.149158 17758 leader_election.cc:290] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:16.171228 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3262489dd274a878ecf95eb28323a5b" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:16.243116 17572 raft_consensus.cc:493] T 689ed466680f40a59a88298ad3596652 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
W20260709 12:30:16.244414 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 70937us
W20260709 12:30:16.245043 17407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:33625, user_credentials={real_user=slave}} blocked reactor thread for 71733.6us
W20260709 12:30:16.247059 16707 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:33625, user_credentials={real_user=slave}} blocked reactor thread for 407965us
I20260709 12:30:16.268479 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3262489dd274a878ecf95eb28323a5b" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:16.270891 16631 leader_election.cc:304] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:30:16.164829 17808 consensus_queue.cc:1048] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 12:30:16.243791 17572 raft_consensus.cc:515] T 689ed466680f40a59a88298ad3596652 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:16.286240 17896 raft_consensus.cc:493] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:16.286841 17896 raft_consensus.cc:515] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:16.276470 17692 raft_consensus.cc:2749] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:16.288935 17896 leader_election.cc:290] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:16.290513 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23de375943ed49b2b9da4652fa088021" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:16.297015 16557 leader_election.cc:304] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:30:16.297803 16737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:16.293957 16416 catalog_manager.cc:5697] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 2 to 4, leader changed from 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66) to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 4 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:16.302187 16416 catalog_manager.cc:5697] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:16.307173 17572 leader_election.cc:290] T 689ed466680f40a59a88298ad3596652 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:16.308454 16416 catalog_manager.cc:5697] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } }
I20260709 12:30:16.308425 17898 raft_consensus.cc:2749] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:16.330461 16667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c6961f324049b8a5d9c13b648dc1bc" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:16.350600 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a17be6871edc41768bb5b3a6e2d1cf2a" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:16.351389 16739 raft_consensus.cc:3055] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:16.351779 16739 raft_consensus.cc:740] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:30:16.352735 16739 consensus_queue.cc:260] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:16.361287 16557 leader_election.cc:304] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5; no voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a
I20260709 12:30:16.354180 16739 raft_consensus.cc:3060] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:30:16.409530 16557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 48325.9us
W20260709 12:30:16.426548 16559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:36499, user_credentials={real_user=slave}} blocked reactor thread for 64561.7us
I20260709 12:30:16.440313 16739 raft_consensus.cc:2468] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 3.
I20260709 12:30:16.409477 17839 raft_consensus.cc:493] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 99ca36f8a50c459388f31022b1455ed6)
I20260709 12:30:16.426961 17449 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689ed466680f40a59a88298ad3596652" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" is_pre_election: true
I20260709 12:30:16.452438 17825 raft_consensus.cc:2749] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:30:16.473625 17918 log.cc:927] Time spent T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:30:16.474021 17919 log.cc:927] Time spent T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:30:16.480893 17710 raft_consensus.cc:493] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:30:16.482726 17710 raft_consensus.cc:515] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:16.484802 17710 leader_election.cc:290] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
I20260709 12:30:16.456749 17839 raft_consensus.cc:515] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:16.490095 17839 leader_election.cc:290] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:16.491073 16738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5daaf5ff8d2242d2bdfdff37cbbd6146" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:16.556921 16587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd2958b516b4504aec8657e0fe2ec24" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:16.559115 16588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5daaf5ff8d2242d2bdfdff37cbbd6146" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:16.586186 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689ed466680f40a59a88298ad3596652" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:16.600498 17404 leader_election.cc:304] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:30:16.606335 17710 raft_consensus.cc:2749] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:16.607070 17729 raft_consensus.cc:493] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader cd924581228b49d889b0e1553519722a)
I20260709 12:30:16.609588 16412 catalog_manager.cc:5697] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:16.614910 16416 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53824 (request call id 176) took 1356 ms. Trace:
I20260709 12:30:16.622195 16660 raft_consensus.cc:1240] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 3 LEADER]: Rejecting Update request from peer cd924581228b49d889b0e1553519722a for earlier term 2. Current term is 3. Ops: []
I20260709 12:30:16.637606 17729 raft_consensus.cc:515] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } }
I20260709 12:30:16.642313 16412 catalog_manager.cc:5697] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 2 to 3, leader changed from 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67) to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 3 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:16.644698 16412 catalog_manager.cc:5697] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:16.645752 17729 leader_election.cc:290] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:16.626163 16416 rpcz_store.cc:276] 0709 12:30:15.257946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:30:15.258071 (+   125us) service_pool.cc:224] Handling call
0709 12:30:16.614504 (+1356433us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:30:16.493583 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:30:16.494096 (+   513us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:30:16.494125 (+    29us) write_op.cc:435] Acquired schema lock
0709 12:30:16.494138 (+    13us) tablet.cc:662] Decoding operations
0709 12:30:16.494698 (+   560us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:30:16.494751 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:30:16.494775 (+    24us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:30:16.500435 (+  5660us) tablet.cc:701] Row locks acquired
0709 12:30:16.500453 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:30:16.500603 (+   150us) write_op.cc:270] Start()
0709 12:30:16.501589 (+   986us) write_op.cc:276] Timestamp: P: 1783600216500560 usec, L: 0
0709 12:30:16.501632 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:30:16.503248 (+  1616us) log.cc:844] Serialized 1299 byte log entry
0709 12:30:16.507719 (+  4471us) op_driver.cc:464] REPLICATION: finished
0709 12:30:16.508984 (+  1265us) write_op.cc:301] APPLY: starting
0709 12:30:16.509070 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:30:16.509223 (+   153us) tablet.cc:1370] finished BulkCheckPresence
0709 12:30:16.509336 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:30:16.509765 (+   429us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:30:16.509965 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:30:16.510015 (+    50us) write_op.cc:312] APPLY: finished
0709 12:30:16.510208 (+   193us) log.cc:844] Serialized 34 byte log entry
0709 12:30:16.510385 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:30:16.510472 (+    87us) write_op.cc:454] Released schema lock
0709 12:30:16.510509 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:30:16.510818 (+   309us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:30:16.510859 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":5,"spinlock_wait_cycles":26112,"child_traces":[["op",{"apply.queue_time_us":951,"apply.run_cpu_time_us":1816,"apply.run_wall_time_us":1850,"num_ops":3,"prepare.queue_time_us":160947,"prepare.run_cpu_time_us":3962,"prepare.run_wall_time_us":10776,"raft.queue_time_us":901,"raft.run_cpu_time_us":1127,"raft.run_wall_time_us":1140,"replication_time_us":5956,"thread_start_us":101788,"threads_started":4,"wal-append.queue_time_us":1101}]]}
I20260709 12:30:16.669169 16412 catalog_manager.cc:5697] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:16.679118 16587 raft_consensus.cc:1275] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:30:16.680902 17404 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 80871.4us
I20260709 12:30:16.690063 16584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932859a73dad4a39b5874461e99676cc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5" is_pre_election: true
I20260709 12:30:16.692425 17572 consensus_queue.cc:1048] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:30:16.737402 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcd2958b516b4504aec8657e0fe2ec24" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "99ca36f8a50c459388f31022b1455ed6" is_pre_election: true
I20260709 12:30:16.751994 16413 catalog_manager.cc:5697] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 2 to 4, leader changed from 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 4 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:16.783679 16707 leader_election.cc:304] T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:16.786288 17839 raft_consensus.cc:2749] T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:16.801891 16412 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53816 (request call id 169) took 1262 ms. Trace:
I20260709 12:30:16.804646 16413 catalog_manager.cc:5697] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 1 to 3, leader changed from 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 3 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:16.807271 16413 catalog_manager.cc:5697] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 1 to 3, leader changed from 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 3 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:16.821363 16412 rpcz_store.cc:276] 0709 12:30:15.539939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:30:15.540112 (+   173us) service_pool.cc:224] Handling call
0709 12:30:16.801829 (+1261717us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:30:16.716402 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:30:16.717184 (+   782us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:30:16.717258 (+    74us) write_op.cc:435] Acquired schema lock
0709 12:30:16.717280 (+    22us) tablet.cc:662] Decoding operations
0709 12:30:16.718046 (+   766us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:30:16.718138 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:30:16.718165 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:30:16.720583 (+  2418us) tablet.cc:701] Row locks acquired
0709 12:30:16.720634 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:30:16.720826 (+   192us) write_op.cc:270] Start()
0709 12:30:16.721009 (+   183us) write_op.cc:276] Timestamp: P: 1783600216720755 usec, L: 0
0709 12:30:16.721047 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:30:16.722009 (+   962us) log.cc:844] Serialized 1693 byte log entry
0709 12:30:16.727527 (+  5518us) op_driver.cc:464] REPLICATION: finished
0709 12:30:16.730582 (+  3055us) write_op.cc:301] APPLY: starting
0709 12:30:16.730688 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:30:16.730856 (+   168us) tablet.cc:1370] finished BulkCheckPresence
0709 12:30:16.730989 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:30:16.731719 (+   730us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:30:16.732098 (+   379us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:30:16.732168 (+    70us) write_op.cc:312] APPLY: finished
0709 12:30:16.732499 (+   331us) log.cc:844] Serialized 40 byte log entry
0709 12:30:16.732726 (+   227us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:30:16.732826 (+   100us) write_op.cc:454] Released schema lock
0709 12:30:16.732882 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:30:16.736498 (+  3616us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:30:16.736539 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":86333,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":2729,"apply.run_cpu_time_us":2743,"apply.run_wall_time_us":2743,"num_ops":4,"prepare.queue_time_us":3076,"prepare.run_cpu_time_us":4708,"prepare.run_wall_time_us":20113,"replication_time_us":6282}]]}
I20260709 12:30:16.855962 16707 leader_election.cc:304] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:16.853607 16413 catalog_manager.cc:5697] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 1 to 3, leader changed from 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 3 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:16.874137 17867 raft_consensus.cc:2749] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:16.878940 16413 catalog_manager.cc:5697] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 1 to 2, leader changed from cd924581228b49d889b0e1553519722a (127.8.111.68) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 2 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:16.888999 16631 leader_election.cc:304] T 689ed466680f40a59a88298ad3596652 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, cd924581228b49d889b0e1553519722a
I20260709 12:30:16.891894 17830 raft_consensus.cc:2749] T 689ed466680f40a59a88298ad3596652 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:16.918955 16738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "932859a73dad4a39b5874461e99676cc" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cd924581228b49d889b0e1553519722a" is_pre_election: true
I20260709 12:30:16.921263 16415 catalog_manager.cc:5697] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:16.922962 16735 raft_consensus.cc:1275] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:16.923592 16415 catalog_manager.cc:5697] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 1 to 3, leader changed from 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66) to cd924581228b49d889b0e1553519722a (127.8.111.68). New cstate: current_term: 3 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:16.925339 16415 catalog_manager.cc:5697] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 1 to 2, leader changed from 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66) to cd924581228b49d889b0e1553519722a (127.8.111.68). New cstate: current_term: 2 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:16.926924 16413 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:56942 (request call id 103) took 1595 ms. Trace:
I20260709 12:30:16.928663 16413 rpcz_store.cc:276] 0709 12:30:15.331466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:30:15.331605 (+   139us) service_pool.cc:224] Handling call
0709 12:30:16.926868 (+1595263us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:30:16.899564 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:30:16.900176 (+   612us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:30:16.900231 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:30:16.900248 (+    17us) tablet.cc:662] Decoding operations
0709 12:30:16.900992 (+   744us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:30:16.901045 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:30:16.901073 (+    28us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:30:16.901646 (+   573us) tablet.cc:701] Row locks acquired
0709 12:30:16.901665 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:30:16.901823 (+   158us) write_op.cc:270] Start()
0709 12:30:16.901933 (+   110us) write_op.cc:276] Timestamp: P: 1783600216901778 usec, L: 0
0709 12:30:16.901957 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:30:16.902885 (+   928us) log.cc:844] Serialized 2078 byte log entry
0709 12:30:16.905499 (+  2614us) op_driver.cc:464] REPLICATION: finished
0709 12:30:16.906121 (+   622us) write_op.cc:301] APPLY: starting
0709 12:30:16.906216 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:30:16.906430 (+   214us) tablet.cc:1370] finished BulkCheckPresence
0709 12:30:16.906551 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:30:16.907194 (+   643us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:30:16.907374 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:30:16.907418 (+    44us) write_op.cc:312] APPLY: finished
0709 12:30:16.907645 (+   227us) log.cc:844] Serialized 46 byte log entry
0709 12:30:16.907802 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:30:16.907904 (+   102us) write_op.cc:454] Released schema lock
0709 12:30:16.907945 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:30:16.909809 (+  1864us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:30:16.909841 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":37171,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":300,"apply.run_cpu_time_us":2121,"apply.run_wall_time_us":2129,"num_ops":5,"prepare.queue_time_us":281,"prepare.run_cpu_time_us":3434,"prepare.run_wall_time_us":8872,"replication_time_us":3371}]]}
I20260709 12:30:16.949740 16631 leader_election.cc:304] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6; no voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a
I20260709 12:30:16.950627 17572 raft_consensus.cc:2749] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:16.954253 17572 consensus_queue.cc:1048] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:16.959946 16416 catalog_manager.cc:5697] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 3 to 4, leader changed from 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66) to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 4 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:16.961943 16416 catalog_manager.cc:5697] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 2 to 3, leader changed from cd924581228b49d889b0e1553519722a (127.8.111.68) to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 3 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:16.970685 16416 catalog_manager.cc:5697] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 2 to 3, leader changed from cd924581228b49d889b0e1553519722a (127.8.111.68) to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 3 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:16.980515 16415 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:53826 (request call id 165) took 1241 ms. Trace:
I20260709 12:30:16.981139 16415 rpcz_store.cc:276] 0709 12:30:15.738884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:30:15.740801 (+  1917us) service_pool.cc:224] Handling call
0709 12:30:16.980447 (+1239646us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:30:16.938547 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:30:16.939133 (+   586us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:30:16.939169 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:30:16.939185 (+    16us) tablet.cc:662] Decoding operations
0709 12:30:16.939767 (+   582us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:30:16.939835 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:30:16.939871 (+    36us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:30:16.940239 (+   368us) tablet.cc:701] Row locks acquired
0709 12:30:16.940255 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:30:16.940401 (+   146us) write_op.cc:270] Start()
0709 12:30:16.940513 (+   112us) write_op.cc:276] Timestamp: P: 1783600216940354 usec, L: 0
0709 12:30:16.940556 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:30:16.941219 (+   663us) log.cc:844] Serialized 1307 byte log entry
0709 12:30:16.943013 (+  1794us) op_driver.cc:464] REPLICATION: finished
0709 12:30:16.943349 (+   336us) write_op.cc:301] APPLY: starting
0709 12:30:16.943437 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:30:16.943592 (+   155us) tablet.cc:1370] finished BulkCheckPresence
0709 12:30:16.943713 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:30:16.944130 (+   417us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:30:16.944310 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:30:16.944363 (+    53us) write_op.cc:312] APPLY: finished
0709 12:30:16.944587 (+   224us) log.cc:844] Serialized 34 byte log entry
0709 12:30:16.944748 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:30:16.944849 (+   101us) write_op.cc:454] Released schema lock
0709 12:30:16.944891 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:30:16.945232 (+   341us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:30:16.947702 (+  2470us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":20008,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":119,"apply.run_cpu_time_us":1825,"apply.run_wall_time_us":1825,"num_ops":3,"prepare.queue_time_us":2643,"prepare.run_cpu_time_us":2972,"prepare.run_wall_time_us":2972,"replication_time_us":2331}]]}
I20260709 12:30:17.120642  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:17.288111 17452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
mode: GRACEFUL
new_leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
 from {username='slave'} at 127.0.0.1:60688
I20260709 12:30:17.290896 17452 raft_consensus.cc:606] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 LEADER]: Received request to transfer leadership to TS 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:17.299288 17452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d9befeb38274b3fbca494f3044f9822"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
mode: GRACEFUL
new_leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
 from {username='slave'} at 127.0.0.1:60688
I20260709 12:30:17.303407 17452 raft_consensus.cc:606] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Received request to transfer leadership to TS 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:17.309783 16662 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a"
dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
mode: GRACEFUL
new_leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
 from {username='slave'} at 127.0.0.1:48578
I20260709 12:30:17.310422 16662 raft_consensus.cc:606] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 4 LEADER]: Received request to transfer leadership to TS 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:17.313597 17452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95064ed3f05a4169a3ff0f2123274cb7"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
mode: GRACEFUL
new_leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
 from {username='slave'} at 127.0.0.1:60688
I20260709 12:30:17.314414 17452 raft_consensus.cc:606] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Received request to transfer leadership to TS 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:17.324860 17452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2ec89af83a842909ba5e19282a9e12d"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
mode: GRACEFUL
new_leader_uuid: "cd924581228b49d889b0e1553519722a"
 from {username='slave'} at 127.0.0.1:60688
I20260709 12:30:17.325716 17452 raft_consensus.cc:606] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Received request to transfer leadership to TS cd924581228b49d889b0e1553519722a
I20260709 12:30:17.328754 17452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8e6882ec7b344f7b4783d7610f69d82"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
mode: GRACEFUL
new_leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
 from {username='slave'} at 127.0.0.1:60688
I20260709 12:30:17.329568 17452 raft_consensus.cc:606] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Received request to transfer leadership to TS 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:17.331113  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:30:17.333187  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:17.334824  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:17.376012 17729 raft_consensus.cc:993] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6: : Instructing follower 9f5ebf768d584b17897ebb5b4575ece5 to start an election
I20260709 12:30:17.376608 17729 raft_consensus.cc:1081] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 4 LEADER]: Signalling peer 9f5ebf768d584b17897ebb5b4575ece5 to start an election
I20260709 12:30:17.380391 16587 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a"
dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
 from {username='slave'} at 127.0.0.1:51990
I20260709 12:30:17.381100 16587 raft_consensus.cc:493] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:17.381486 16587 raft_consensus.cc:3060] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:30:17.400946 17710 raft_consensus.cc:993] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a: : Instructing follower 9f5ebf768d584b17897ebb5b4575ece5 to start an election
I20260709 12:30:17.401618 17710 raft_consensus.cc:1081] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Signalling peer 9f5ebf768d584b17897ebb5b4575ece5 to start an election
I20260709 12:30:17.403882 16588 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d9befeb38274b3fbca494f3044f9822"
dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
 from {username='slave'} at 127.0.0.1:51986
I20260709 12:30:17.404482 16588 raft_consensus.cc:493] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:17.404865 16588 raft_consensus.cc:3060] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:17.431020 16588 raft_consensus.cc:515] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:17.437199 16587 raft_consensus.cc:515] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:17.439973 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9befeb38274b3fbca494f3044f9822" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:17.440667 17452 raft_consensus.cc:3055] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:17.440980 17452 raft_consensus.cc:740] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:17.441941 17452 consensus_queue.cc:260] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:17.443226 17452 raft_consensus.cc:3060] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:17.467780 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d9befeb38274b3fbca494f3044f9822" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:17.468875 16662 raft_consensus.cc:3060] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:17.475701 16588 leader_election.cc:290] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:17.478827 17452 raft_consensus.cc:2468] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 3.
I20260709 12:30:17.480588 16559 leader_election.cc:304] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:17.481738 17896 raft_consensus.cc:2804] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:17.482347 17896 raft_consensus.cc:697] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:17.482678 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:17.483392 17452 raft_consensus.cc:3060] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:30:17.483603 17896 consensus_queue.cc:237] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:17.493641 16587 leader_election.cc:290] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 5 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:17.496281 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71752aae771f4c39b2d78e36222c8a4a" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:17.496949 16660 raft_consensus.cc:3055] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:30:17.497256 16660 raft_consensus.cc:740] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:17.498011 16660 consensus_queue.cc:260] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:17.500707 16660 raft_consensus.cc:3060] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:30:17.515372 16660 raft_consensus.cc:2468] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 5.
I20260709 12:30:17.516855 16559 leader_election.cc:304] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:17.518373 17896 raft_consensus.cc:2804] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:30:17.519089 17896 raft_consensus.cc:697] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 5 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:17.520056 17896 consensus_queue.cc:237] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:17.521483 16662 raft_consensus.cc:2468] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 3.
I20260709 12:30:17.521569 16413 catalog_manager.cc:5697] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 2 to 3, leader changed from 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65) to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 3 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:17.531422 17452 raft_consensus.cc:2468] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 5.
I20260709 12:30:17.571223 16413 catalog_manager.cc:5697] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 4 to 5, leader changed from 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67) to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 5 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:17.640820 17710 raft_consensus.cc:993] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: : Instructing follower 9f5ebf768d584b17897ebb5b4575ece5 to start an election
I20260709 12:30:17.641294 17710 raft_consensus.cc:1081] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 LEADER]: Signalling peer 9f5ebf768d584b17897ebb5b4575ece5 to start an election
I20260709 12:30:17.643108 16588 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0"
dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
 from {username='slave'} at 127.0.0.1:51986
I20260709 12:30:17.643662 16588 raft_consensus.cc:493] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:17.644017 16588 raft_consensus.cc:3060] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:30:17.654481 16588 raft_consensus.cc:515] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:17.657167 16588 leader_election.cc:290] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 5 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:17.657567 16735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:17.658172 16735 raft_consensus.cc:3060] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:30:17.663482 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010f5ea2dc68490290208a03251c29b0" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:17.664047 17452 raft_consensus.cc:3055] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:30:17.664323 17452 raft_consensus.cc:740] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:17.665019 17452 consensus_queue.cc:260] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:17.674721 17452 raft_consensus.cc:3060] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:30:17.674120 16735 raft_consensus.cc:2468] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 5.
I20260709 12:30:17.677073 16557 leader_election.cc:304] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f5ebf768d584b17897ebb5b4575ece5, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:17.678038 17932 raft_consensus.cc:2804] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:30:17.678737 17932 raft_consensus.cc:697] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 5 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:17.679667 17932 consensus_queue.cc:237] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:17.687816 17452 raft_consensus.cc:2468] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 5.
I20260709 12:30:17.710074 16413 catalog_manager.cc:5697] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 4 to 5, leader changed from 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65) to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 5 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:17.776465 17710 raft_consensus.cc:993] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a: : Instructing follower cd924581228b49d889b0e1553519722a to start an election
I20260709 12:30:17.777014 17854 raft_consensus.cc:1081] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Signalling peer cd924581228b49d889b0e1553519722a to start an election
I20260709 12:30:17.778368 16735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2ec89af83a842909ba5e19282a9e12d"
dest_uuid: "cd924581228b49d889b0e1553519722a"
 from {username='slave'} at 127.0.0.1:45486
I20260709 12:30:17.778798 16735 raft_consensus.cc:493] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:17.779085 16735 raft_consensus.cc:3060] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:17.787567 16735 raft_consensus.cc:515] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:17.789909 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ec89af83a842909ba5e19282a9e12d" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:17.790551 16662 raft_consensus.cc:3060] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:17.793953 16735 leader_election.cc:290] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:17.797478 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2ec89af83a842909ba5e19282a9e12d" candidate_uuid: "cd924581228b49d889b0e1553519722a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:17.800493 16662 raft_consensus.cc:2468] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 3.
I20260709 12:30:17.801008 17452 raft_consensus.cc:3055] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:17.801329 17452 raft_consensus.cc:740] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:17.801697 16707 leader_election.cc:304] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:17.802536 17867 raft_consensus.cc:2804] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:17.802241 17452 consensus_queue.cc:260] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:17.803005 17867 raft_consensus.cc:697] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 3 LEADER]: Becoming Leader. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:30:17.803532 17452 raft_consensus.cc:3060] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:17.803833 17867 consensus_queue.cc:237] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:17.813231 17452 raft_consensus.cc:2468] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd924581228b49d889b0e1553519722a in term 3.
I20260709 12:30:17.857677 16413 catalog_manager.cc:5697] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a reported cstate change: term changed from 2 to 3, leader changed from 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65) to cd924581228b49d889b0e1553519722a (127.8.111.68). New cstate: current_term: 3 leader_uuid: "cd924581228b49d889b0e1553519722a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:17.870452 17854 raft_consensus.cc:993] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a: : Instructing follower 9f5ebf768d584b17897ebb5b4575ece5 to start an election
I20260709 12:30:17.873879 17854 raft_consensus.cc:1081] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Signalling peer 9f5ebf768d584b17897ebb5b4575ece5 to start an election
I20260709 12:30:17.870981 17877 raft_consensus.cc:993] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a: : Instructing follower 9f5ebf768d584b17897ebb5b4575ece5 to start an election
I20260709 12:30:17.874532 17877 raft_consensus.cc:1081] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Signalling peer 9f5ebf768d584b17897ebb5b4575ece5 to start an election
I20260709 12:30:17.877511 16587 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95064ed3f05a4169a3ff0f2123274cb7"
dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
 from {username='slave'} at 127.0.0.1:51986
I20260709 12:30:17.878068 16587 raft_consensus.cc:493] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:17.878434 16587 raft_consensus.cc:3060] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:17.886350 16588 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8e6882ec7b344f7b4783d7610f69d82"
dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
 from {username='slave'} at 127.0.0.1:51986
I20260709 12:30:17.887043 16588 raft_consensus.cc:493] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:17.887482 16588 raft_consensus.cc:3060] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:17.921209 16587 raft_consensus.cc:515] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:17.924089 17458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95064ed3f05a4169a3ff0f2123274cb7" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:17.924741 17458 raft_consensus.cc:3055] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:17.925084 17458 raft_consensus.cc:740] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:17.925880 17458 consensus_queue.cc:260] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:17.926994 17458 raft_consensus.cc:3060] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:30:17.938342 16704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 115599us
I20260709 12:30:17.948390 16660 raft_consensus.cc:1275] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 5 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:30:17.951179 17932 consensus_queue.cc:1048] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:30:17.951606 16587 leader_election.cc:290] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:17.955078 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95064ed3f05a4169a3ff0f2123274cb7" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:17.955642 16660 raft_consensus.cc:3060] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:17.965713 16660 raft_consensus.cc:2468] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 3.
I20260709 12:30:17.947115 16588 raft_consensus.cc:515] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:17.970868 16559 leader_election.cc:304] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:17.944911 17458 raft_consensus.cc:2468] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 3.
I20260709 12:30:17.972658 17896 raft_consensus.cc:2804] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:17.973078 17896 raft_consensus.cc:697] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:17.973879 17896 consensus_queue.cc:237] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:17.978345 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8e6882ec7b344f7b4783d7610f69d82" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:17.979032 16660 raft_consensus.cc:3060] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:17.982551 17458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8e6882ec7b344f7b4783d7610f69d82" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:17.971047 16588 leader_election.cc:290] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:17.985522 17458 raft_consensus.cc:3055] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:17.986575 17458 raft_consensus.cc:740] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:17.993446 17458 consensus_queue.cc:260] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:17.996450 17458 raft_consensus.cc:3060] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:18.001547 17452 raft_consensus.cc:1275] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 5 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:30:18.003324 17932 consensus_queue.cc:1048] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:30:18.004397 16660 raft_consensus.cc:2468] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 3.
I20260709 12:30:18.007691 17458 raft_consensus.cc:2468] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 3.
I20260709 12:30:18.014714 16416 catalog_manager.cc:5697] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 2 to 3, leader changed from 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65) to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 3 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:18.012223 16559 leader_election.cc:304] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:18.032469 17932 raft_consensus.cc:2804] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:18.033232 17932 raft_consensus.cc:697] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:18.034111 17932 consensus_queue.cc:237] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:18.101171 16416 catalog_manager.cc:5697] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 2 to 3, leader changed from 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65) to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 3 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:18.102645 17452 raft_consensus.cc:1275] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:18.106102 17932 consensus_queue.cc:1048] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:30:18.113231 16662 raft_consensus.cc:1275] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:18.121665 17896 consensus_queue.cc:1048] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:18.209929 17452 raft_consensus.cc:1275] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 5 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:30:18.214334 17957 consensus_queue.cc:1048] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:30:18.269593 16735 raft_consensus.cc:1275] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 5 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:30:18.276069 17932 consensus_queue.cc:1048] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:30:18.311259 17452 raft_consensus.cc:1275] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Refusing update from remote peer cd924581228b49d889b0e1553519722a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:18.312943 17945 consensus_queue.cc:1048] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:30:18.353320 16662 raft_consensus.cc:1275] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Refusing update from remote peer cd924581228b49d889b0e1553519722a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:18.356186 17946 consensus_queue.cc:1048] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:30:18.384195 17452 raft_consensus.cc:1275] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:18.386256 17932 consensus_queue.cc:1048] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:18.435422  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:30:18.446378 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 73660.8us
I20260709 12:30:18.475297 16662 raft_consensus.cc:1275] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:18.476734 17957 consensus_queue.cc:1048] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:18.507164 16739 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5daaf5ff8d2242d2bdfdff37cbbd6146"
dest_uuid: "cd924581228b49d889b0e1553519722a"
mode: GRACEFUL
new_leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
 from {username='slave'} at 127.0.0.1:55242
I20260709 12:30:18.507747 16739 raft_consensus.cc:606] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Received request to transfer leadership to TS 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:18.521368 16662 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7805d2575cfc4de984937de995038b47"
dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
mode: GRACEFUL
new_leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:48578
I20260709 12:30:18.522025 16662 raft_consensus.cc:606] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Received request to transfer leadership to TS 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:18.524570  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:30:18.526309  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:18.527029 17572 raft_consensus.cc:993] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6: : Instructing follower 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:18.527637 17572 raft_consensus.cc:1081] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Signalling peer 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:18.529011  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:18.529112 17452 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7805d2575cfc4de984937de995038b47"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:44904
I20260709 12:30:18.529670 17452 raft_consensus.cc:493] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:18.530004 17452 raft_consensus.cc:3060] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:30:18.531128 16631 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 53900.1us
I20260709 12:30:18.537386 17452 raft_consensus.cc:515] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:18.539979 16662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7805d2575cfc4de984937de995038b47" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:18.540573 16662 raft_consensus.cc:3055] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:18.540901 16662 raft_consensus.cc:740] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:18.541664 16662 consensus_queue.cc:260] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:18.542783 16662 raft_consensus.cc:3060] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:18.569000 16663 raft_consensus.cc:1275] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:18.569660 17452 leader_election.cc:290] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:18.570168 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7805d2575cfc4de984937de995038b47" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:18.570793 16739 raft_consensus.cc:3060] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:18.571030 17957 consensus_queue.cc:1048] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:18.574205 16662 raft_consensus.cc:2468] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:18.575516 17407 leader_election.cc:304] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:30:18.576679 17877 raft_consensus.cc:2804] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:18.577142 17877 raft_consensus.cc:697] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:18.577934 16739 raft_consensus.cc:2468] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 2.
I20260709 12:30:18.577989 17877 consensus_queue.cc:237] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:18.623143 17451 raft_consensus.cc:1275] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:18.626232 17957 consensus_queue.cc:1048] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:30:18.663460 16416 catalog_manager.cc:5697] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 1 to 2, leader changed from 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 2 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:18.773240 17867 raft_consensus.cc:993] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a: : Instructing follower 9f5ebf768d584b17897ebb5b4575ece5 to start an election
I20260709 12:30:18.773757 17867 raft_consensus.cc:1081] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Signalling peer 9f5ebf768d584b17897ebb5b4575ece5 to start an election
I20260709 12:30:18.780963 16587 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5daaf5ff8d2242d2bdfdff37cbbd6146"
dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
 from {username='slave'} at 127.0.0.1:51978
I20260709 12:30:18.781546 16587 raft_consensus.cc:493] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:18.782320 16587 raft_consensus.cc:3060] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:18.789986 16587 raft_consensus.cc:515] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:18.805886 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5daaf5ff8d2242d2bdfdff37cbbd6146" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:18.806550 16739 raft_consensus.cc:3055] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:18.806854 16739 raft_consensus.cc:740] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cd924581228b49d889b0e1553519722a, State: Running, Role: LEADER
I20260709 12:30:18.807777 16739 consensus_queue.cc:260] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:18.808990 16739 raft_consensus.cc:3060] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:18.814955 17451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5daaf5ff8d2242d2bdfdff37cbbd6146" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:18.815506 16587 leader_election.cc:290] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:18.815711 17451 raft_consensus.cc:3060] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:18.830158 17451 raft_consensus.cc:2468] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 2.
I20260709 12:30:18.831501 16559 leader_election.cc:304] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:18.832394 17948 raft_consensus.cc:2804] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:18.832916 17948 raft_consensus.cc:697] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:18.833809 17948 consensus_queue.cc:237] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:18.843211 16739 raft_consensus.cc:2468] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 2.
I20260709 12:30:18.877771 16416 catalog_manager.cc:5697] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 1 to 2, leader changed from cd924581228b49d889b0e1553519722a (127.8.111.68) to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:19.075054 16733 raft_consensus.cc:1275] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:19.078135 17969 consensus_queue.cc:1048] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:19.100955 16660 raft_consensus.cc:1275] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:19.102690 17854 consensus_queue.cc:1048] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:19.447180 17451 raft_consensus.cc:1275] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:19.449595 17932 consensus_queue.cc:1048] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:19.454643 16733 raft_consensus.cc:1275] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:19.457419 17932 consensus_queue.cc:1048] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:19.667537  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:19.795969 17452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2acb6cd36ac547548487db51c2510029"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
mode: GRACEFUL
new_leader_uuid: "99ca36f8a50c459388f31022b1455ed6"
 from {username='slave'} at 127.0.0.1:60688
I20260709 12:30:19.796751 17452 raft_consensus.cc:606] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 LEADER]: Received request to transfer leadership to TS 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:19.801970  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:30:19.805369  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:19.806234  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:30:20.061223 16704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:35329, user_credentials={real_user=slave}} blocked reactor thread for 154341us
W20260709 12:30:20.067005 16557 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.68:35573, user_credentials={real_user=slave}} blocked reactor thread for 81915.2us
I20260709 12:30:20.270066 17710 raft_consensus.cc:993] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a: : Instructing follower 99ca36f8a50c459388f31022b1455ed6 to start an election
I20260709 12:30:20.270591 17710 raft_consensus.cc:1081] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 LEADER]: Signalling peer 99ca36f8a50c459388f31022b1455ed6 to start an election
I20260709 12:30:20.272500 16660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2acb6cd36ac547548487db51c2510029"
dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
 from {username='slave'} at 127.0.0.1:48580
I20260709 12:30:20.273036 16660 raft_consensus.cc:493] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:20.273363 16660 raft_consensus.cc:3060] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:30:20.281546 16660 raft_consensus.cc:515] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:20.284664 16660 leader_election.cc:290] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 5 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:20.285801 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:20.286511 17452 raft_consensus.cc:3055] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:30:20.286829 17452 raft_consensus.cc:740] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:20.287791 17452 consensus_queue.cc:260] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:20.289832 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2acb6cd36ac547548487db51c2510029" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:20.290431 16739 raft_consensus.cc:3060] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:30:20.294646 17452 raft_consensus.cc:3060] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:30:20.312224 16739 raft_consensus.cc:2468] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 5.
I20260709 12:30:20.313962 16631 leader_election.cc:304] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, cd924581228b49d889b0e1553519722a; no voters: 
I20260709 12:30:20.314881 17967 raft_consensus.cc:2804] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:30:20.315327 17967 raft_consensus.cc:697] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 5 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:20.316169 17967 consensus_queue.cc:237] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:20.325344 17452 raft_consensus.cc:2468] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 5.
I20260709 12:30:20.365717 16413 catalog_manager.cc:5697] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 4 to 5, leader changed from 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65) to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 5 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:20.798161 16733 raft_consensus.cc:1275] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 5 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:30:20.800570 17729 consensus_queue.cc:1048] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:30:20.850509 17452 raft_consensus.cc:1275] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 5 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:30:20.852103 17729 consensus_queue.cc:1048] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:30:20.904415  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:21.003136 16663 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e19834ede0784553865ac5c4cd1024f0"
dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
mode: GRACEFUL
new_leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:48578
I20260709 12:30:21.004326 16663 raft_consensus.cc:606] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Received request to transfer leadership to TS 32b697d90f0c4cdfb0a3f55e33a5b37a
I20260709 12:30:21.012882  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:30:21.015858  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:21.017426  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:21.178068 17729 raft_consensus.cc:993] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6: : Instructing follower 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:21.178764 17967 raft_consensus.cc:1081] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Signalling peer 32b697d90f0c4cdfb0a3f55e33a5b37a to start an election
I20260709 12:30:21.182400 17458 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e19834ede0784553865ac5c4cd1024f0"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
 from {username='slave'} at 127.0.0.1:44904
I20260709 12:30:21.183036 17458 raft_consensus.cc:493] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:21.183434 17458 raft_consensus.cc:3060] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:21.197786 17458 raft_consensus.cc:515] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:21.200194 17458 leader_election.cc:290] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 election: Requested vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), cd924581228b49d889b0e1553519722a (127.8.111.68:35573)
I20260709 12:30:21.200963 16663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19834ede0784553865ac5c4cd1024f0" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:21.202407 16733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19834ede0784553865ac5c4cd1024f0" candidate_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:21.202867 16663 raft_consensus.cc:3055] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:21.203011 16733 raft_consensus.cc:3060] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:21.203255 16663 raft_consensus.cc:740] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:21.204150 16663 consensus_queue.cc:260] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:21.205269 16663 raft_consensus.cc:3060] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:21.217170 16663 raft_consensus.cc:2468] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 3.
I20260709 12:30:21.218721 17407 leader_election.cc:304] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:30:21.220474 17854 raft_consensus.cc:2804] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:21.221061 17854 raft_consensus.cc:697] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 LEADER]: Becoming Leader. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:21.222023 17854 consensus_queue.cc:237] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:21.230638 16733 raft_consensus.cc:2468] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32b697d90f0c4cdfb0a3f55e33a5b37a in term 3.
I20260709 12:30:21.239173 16416 catalog_manager.cc:5697] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a reported cstate change: term changed from 2 to 3, leader changed from 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67) to 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65). New cstate: current_term: 3 leader_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:21.647568 16733 raft_consensus.cc:1275] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:21.649220 17984 consensus_queue.cc:1048] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:21.676128 16663 raft_consensus.cc:1275] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Refusing update from remote peer 32b697d90f0c4cdfb0a3f55e33a5b37a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:21.679178 17854 consensus_queue.cc:1048] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:22.062628  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:22.119504 17452 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e19834ede0784553865ac5c4cd1024f0"
dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
mode: GRACEFUL
new_leader_uuid: "99ca36f8a50c459388f31022b1455ed6"
 from {username='slave'} at 127.0.0.1:60688
I20260709 12:30:22.120132 17452 raft_consensus.cc:606] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 LEADER]: Received request to transfer leadership to TS 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:22.122057  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:30:22.123885  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:22.124680  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:22.212986 18010 raft_consensus.cc:993] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a: : Instructing follower 99ca36f8a50c459388f31022b1455ed6 to start an election
I20260709 12:30:22.213721 17877 raft_consensus.cc:1081] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 LEADER]: Signalling peer 99ca36f8a50c459388f31022b1455ed6 to start an election
I20260709 12:30:22.215461 16662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e19834ede0784553865ac5c4cd1024f0"
dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
 from {username='slave'} at 127.0.0.1:48580
I20260709 12:30:22.216018 16662 raft_consensus.cc:493] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:22.216352 16662 raft_consensus.cc:3060] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:22.229862 16662 raft_consensus.cc:515] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:22.232965 16662 leader_election.cc:290] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 4 election: Requested vote from peers cd924581228b49d889b0e1553519722a (127.8.111.68:35573), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
I20260709 12:30:22.233374 17452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19834ede0784553865ac5c4cd1024f0" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:22.235096 17452 raft_consensus.cc:3055] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:30:22.235378 17452 raft_consensus.cc:740] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32b697d90f0c4cdfb0a3f55e33a5b37a, State: Running, Role: LEADER
I20260709 12:30:22.236001 16739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19834ede0784553865ac5c4cd1024f0" candidate_uuid: "99ca36f8a50c459388f31022b1455ed6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cd924581228b49d889b0e1553519722a"
I20260709 12:30:22.236091 17452 consensus_queue.cc:260] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:22.236666 16739 raft_consensus.cc:3060] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:22.237208 17452 raft_consensus.cc:3060] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:22.246592 17452 raft_consensus.cc:2468] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 4.
I20260709 12:30:22.247056 16739 raft_consensus.cc:2468] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99ca36f8a50c459388f31022b1455ed6 in term 4.
I20260709 12:30:22.248095 16633 leader_election.cc:304] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6; no voters: 
I20260709 12:30:22.248893 18001 raft_consensus.cc:2804] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:30:22.249631 18001 raft_consensus.cc:697] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 4 LEADER]: Becoming Leader. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:22.250461 18001 consensus_queue.cc:237] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:22.267150 16416 catalog_manager.cc:5697] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 reported cstate change: term changed from 3 to 4, leader changed from 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65) to 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67). New cstate: current_term: 4 leader_uuid: "99ca36f8a50c459388f31022b1455ed6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:22.707718 17452 raft_consensus.cc:1275] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:30:22.708921 17729 consensus_queue.cc:1048] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:30:22.814683 16739 raft_consensus.cc:1275] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Refusing update from remote peer 99ca36f8a50c459388f31022b1455ed6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:30:22.816414 17729 consensus_queue.cc:1048] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:30:23.177953  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:23.223423 16662 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e968c7db76fe442fa81826c4035acb91"
dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
mode: GRACEFUL
new_leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
 from {username='slave'} at 127.0.0.1:48578
I20260709 12:30:23.223920 16662 raft_consensus.cc:606] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Received request to transfer leadership to TS 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:23.225212  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:30:23.226382  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:23.226953  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:23.346815 18001 raft_consensus.cc:993] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6: : Instructing follower 9f5ebf768d584b17897ebb5b4575ece5 to start an election
I20260709 12:30:23.347265 18017 raft_consensus.cc:1081] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Signalling peer 9f5ebf768d584b17897ebb5b4575ece5 to start an election
I20260709 12:30:23.348651 16587 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e968c7db76fe442fa81826c4035acb91"
dest_uuid: "9f5ebf768d584b17897ebb5b4575ece5"
 from {username='slave'} at 127.0.0.1:51990
I20260709 12:30:23.349053 16587 raft_consensus.cc:493] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:23.349272 16587 raft_consensus.cc:3060] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:23.354575 16587 raft_consensus.cc:515] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:23.357366 16587 leader_election.cc:290] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 election: Requested vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625)
I20260709 12:30:23.358510 16660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968c7db76fe442fa81826c4035acb91" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "99ca36f8a50c459388f31022b1455ed6"
I20260709 12:30:23.357833 17458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e968c7db76fe442fa81826c4035acb91" candidate_uuid: "9f5ebf768d584b17897ebb5b4575ece5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a"
I20260709 12:30:23.359042 16660 raft_consensus.cc:3055] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:23.359208 17458 raft_consensus.cc:3060] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:23.359382 16660 raft_consensus.cc:740] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 99ca36f8a50c459388f31022b1455ed6, State: Running, Role: LEADER
I20260709 12:30:23.360164 16660 consensus_queue.cc:260] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:23.361196 16660 raft_consensus.cc:3060] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:23.369602 16660 raft_consensus.cc:2468] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 2.
I20260709 12:30:23.371111 16559 leader_election.cc:304] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 99ca36f8a50c459388f31022b1455ed6, 9f5ebf768d584b17897ebb5b4575ece5; no voters: 
I20260709 12:30:23.372053 17458 raft_consensus.cc:2468] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f5ebf768d584b17897ebb5b4575ece5 in term 2.
I20260709 12:30:23.372352 17948 raft_consensus.cc:2804] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:23.372916 17948 raft_consensus.cc:697] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 LEADER]: Becoming Leader. State: Replica: 9f5ebf768d584b17897ebb5b4575ece5, State: Running, Role: LEADER
I20260709 12:30:23.373869 17948 consensus_queue.cc:237] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } }
I20260709 12:30:23.385914 16416 catalog_manager.cc:5697] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 reported cstate change: term changed from 1 to 2, leader changed from 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67) to 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "9f5ebf768d584b17897ebb5b4575ece5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:23.861824 16660 raft_consensus.cc:1275] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:23.864218 17948 consensus_queue.cc:1048] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:23.902727 17452 raft_consensus.cc:1275] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Refusing update from remote peer 9f5ebf768d584b17897ebb5b4575ece5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:23.904488 18025 consensus_queue.cc:1048] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:24.262343  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:24.301066  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:24.302524  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:24.303047  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:24.342195  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:24.377444  8637 tablet_server.cc:179] TabletServer@127.8.111.65:36499 shutting down...
W20260709 12:30:24.384706 16559 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 298 similar messages]
W20260709 12:30:24.395218 16559 consensus_peers.cc:597] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.404726 16707 consensus_peers.cc:597] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:24.430749  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:24.431876  8637 tablet_replica.cc:333] stopping tablet replica
W20260709 12:30:24.432114 16559 consensus_peers.cc:597] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.432045 16707 consensus_peers.cc:597] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:24.432938  8637 raft_consensus.cc:2243] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.433517  8637 raft_consensus.cc:2272] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.435665  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.436200  8637 raft_consensus.cc:2243] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.436856  8637 raft_consensus.cc:2272] T 38c2fffde641468f9399b51e98f495eb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.438683  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.439369  8637 raft_consensus.cc:2243] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.441706  8637 raft_consensus.cc:2272] T 425340b667774e9083a7c360e90ff2e5 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:24.442405 16559 consensus_peers.cc:597] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:24.444842  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.445714  8637 raft_consensus.cc:2243] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.446141  8637 raft_consensus.cc:2272] T 71752aae771f4c39b2d78e36222c8a4a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.448642  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.449548  8637 raft_consensus.cc:2243] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.450064  8637 raft_consensus.cc:2272] T e19834ede0784553865ac5c4cd1024f0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.452459  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.453032  8637 raft_consensus.cc:2243] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.453740  8637 raft_consensus.cc:2272] T 5d82d757f6a34783b2b2055824f65e88 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.455664  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.456351  8637 raft_consensus.cc:2243] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.457216  8637 raft_consensus.cc:2272] T 6d8898ec613947bfa3b95ae941e1245d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.459432  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.459968  8637 raft_consensus.cc:2243] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.460712  8637 raft_consensus.cc:2272] T d6724b5f4d23403097a81f5e83cf5e0e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.462916  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.463567  8637 raft_consensus.cc:2243] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.464125  8637 raft_consensus.cc:2272] T 010f5ea2dc68490290208a03251c29b0 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.466233  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.466924  8637 raft_consensus.cc:2243] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.467609  8637 raft_consensus.cc:2272] T 97b4874f353b48ef8bdfa4c28549a207 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.469660  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.470199  8637 raft_consensus.cc:2243] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.470868  8637 raft_consensus.cc:2272] T 2eef363dbdce4d7bbd0b446385d8eb9e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.473496  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.474138  8637 raft_consensus.cc:2243] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.474583  8637 raft_consensus.cc:2272] T fda99eaeca1149d48e54e0d83c3ec4cb P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.476485  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.477029  8637 raft_consensus.cc:2243] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.477421  8637 raft_consensus.cc:2272] T 41cf6ac39c0248398e411dcce49bf021 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.479290  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.479913  8637 raft_consensus.cc:2243] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.480306  8637 raft_consensus.cc:2272] T e968c7db76fe442fa81826c4035acb91 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.483183  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.483747  8637 raft_consensus.cc:2243] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.484171  8637 raft_consensus.cc:2272] T a2ec89af83a842909ba5e19282a9e12d P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.486230  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.486841  8637 raft_consensus.cc:2243] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.487237  8637 raft_consensus.cc:2272] T d45c0ead4eb3497c91c28c55ee353d83 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.489511  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.490362  8637 raft_consensus.cc:2243] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.490907  8637 raft_consensus.cc:2272] T 8bbf661e435740adbb0269128765d10e P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.493213  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.493930  8637 raft_consensus.cc:2243] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.494443  8637 raft_consensus.cc:2272] T d4a9660f852f43f19f20f687b10acdd2 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.496843  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.497342  8637 raft_consensus.cc:2243] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.497720  8637 raft_consensus.cc:2272] T 3d9befeb38274b3fbca494f3044f9822 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.499621  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.500406  8637 raft_consensus.cc:2243] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.500869  8637 raft_consensus.cc:2272] T 2ca7f1ce17c243358d69760e6457d24a P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.503108  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.503614  8637 raft_consensus.cc:2243] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.503999  8637 raft_consensus.cc:2272] T 95064ed3f05a4169a3ff0f2123274cb7 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.505697  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.506202  8637 raft_consensus.cc:2243] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.506667  8637 raft_consensus.cc:2272] T e1765c0523b546c198e7a014b0866bbc P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.508852  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.509429  8637 raft_consensus.cc:2243] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.509859  8637 raft_consensus.cc:2272] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:24.511075 16633 consensus_peers.cc:597] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:24.512307  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.513118  8637 raft_consensus.cc:2243] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.513885  8637 raft_consensus.cc:2272] T 5d56d3967e8f4a15b1883473e50c4c85 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.516213  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.516788  8637 raft_consensus.cc:2243] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.517194  8637 raft_consensus.cc:2272] T 1966b49831ff47a3ba7263b77ac4e86b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.519100  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.519639  8637 raft_consensus.cc:2243] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.519984  8637 raft_consensus.cc:2272] T 2fb661ebdebf474db7f6380eb0e49d7f P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.521881  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.522411  8637 raft_consensus.cc:2243] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.522775  8637 raft_consensus.cc:2272] T d60b7bf1ed30467e9437c2b078e41808 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.524791  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.525410  8637 raft_consensus.cc:2243] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.526335  8637 raft_consensus.cc:2272] T f3262489dd274a878ecf95eb28323a5b P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:24.528220 16707 consensus_peers.cc:597] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:24.529215  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.530014  8637 raft_consensus.cc:2243] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.530791  8637 raft_consensus.cc:2272] T 7805d2575cfc4de984937de995038b47 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.532716  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.533247  8637 raft_consensus.cc:2243] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.534030  8637 raft_consensus.cc:2272] T 450ac00038aa4947961ef3398fd75ca4 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.536006  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.536525  8637 raft_consensus.cc:2243] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.537331  8637 raft_consensus.cc:2272] T 2738a61896734d42b9febbcbf8848761 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.539753  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.540442  8637 raft_consensus.cc:2243] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.540910  8637 raft_consensus.cc:2272] T ea7880201e5f49299c203ac770ceb930 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.543162  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.543896  8637 raft_consensus.cc:2243] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:30:24.544726 16633 consensus_peers.cc:597] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:24.544780  8637 raft_consensus.cc:2272] T 1954b02f86b546d382996faa0aa9fd89 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.546939  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.547544  8637 raft_consensus.cc:2243] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.548035  8637 raft_consensus.cc:2272] T a7ad2867ed594d4794807e95f2994f46 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:24.549479 16707 consensus_peers.cc:597] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:24.550498  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.551031  8637 raft_consensus.cc:2243] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.551381  8637 raft_consensus.cc:2272] T 2acb6cd36ac547548487db51c2510029 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.553504  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.554163  8637 raft_consensus.cc:2243] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.554642  8637 raft_consensus.cc:2272] T 689ed466680f40a59a88298ad3596652 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.557078  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.557586  8637 raft_consensus.cc:2243] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.558060  8637 raft_consensus.cc:2272] T c8e6882ec7b344f7b4783d7610f69d82 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.559970  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.560662  8637 raft_consensus.cc:2243] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.561357  8637 raft_consensus.cc:2272] T 5a084469fa354084b2130b4656a965d1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.564085  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.564951  8637 raft_consensus.cc:2243] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:30:24.565623 16633 consensus_peers.cc:597] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:24.566394  8637 raft_consensus.cc:2272] T d0de7225f1bc44a1a67f4f298d60a257 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:24.568759 16559 consensus_peers.cc:597] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:24.569264  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.570526  8637 raft_consensus.cc:2243] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.571090  8637 raft_consensus.cc:2272] T d285abc27263437a85f24a1d8f993be1 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.574081  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.574782  8637 raft_consensus.cc:2243] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.575649  8637 raft_consensus.cc:2272] T 21548ea41a6a427fb041bbd4531e9d29 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.577693  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.578203  8637 raft_consensus.cc:2243] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.578626  8637 raft_consensus.cc:2272] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.580653  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.581257  8637 raft_consensus.cc:2243] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.581678  8637 raft_consensus.cc:2272] T 75800960202940669b8d3541a84fdb28 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.583562  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.584041  8637 raft_consensus.cc:2243] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.584800  8637 raft_consensus.cc:2272] T e405df92b54c47daa8ae52a9fc87b7ac P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.586656  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:24.587114  8637 raft_consensus.cc:2243] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.587903  8637 raft_consensus.cc:2272] T fd90b9fc6af748cd9bdb02bd14568f64 P 32b697d90f0c4cdfb0a3f55e33a5b37a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:24.603137 16707 consensus_peers.cc:597] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.630570 16633 consensus_peers.cc:597] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.645965 16707 consensus_peers.cc:597] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.666373 16559 consensus_peers.cc:597] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.668555 16559 consensus_peers.cc:597] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.674757 16633 consensus_peers.cc:597] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.681963 16707 consensus_peers.cc:597] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:24.696728  8637 tablet_server.cc:196] TabletServer@127.8.111.65:36499 shutdown complete.
W20260709 12:30:24.709954 16633 consensus_peers.cc:597] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.713519 16559 consensus_peers.cc:597] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.737793 16707 consensus_peers.cc:597] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.738967 16633 consensus_peers.cc:597] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.757330 16707 consensus_peers.cc:597] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:24.783867  8637 tablet_server.cc:179] TabletServer@127.8.111.66:0 shutting down...
W20260709 12:30:24.788834 16559 consensus_peers.cc:597] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.793751 16707 consensus_peers.cc:597] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.796324 16630 consensus_peers.cc:597] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Couldn't send request to peer 9f5ebf768d584b17897ebb5b4575ece5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.797397 16704 consensus_peers.cc:597] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a -> Peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Couldn't send request to peer 9f5ebf768d584b17897ebb5b4575ece5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.798112 16704 consensus_peers.cc:597] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a -> Peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Couldn't send request to peer 9f5ebf768d584b17897ebb5b4575ece5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.800012 16633 consensus_peers.cc:597] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.804872 16559 consensus_peers.cc:597] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.815479 16704 consensus_peers.cc:597] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a -> Peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Couldn't send request to peer 9f5ebf768d584b17897ebb5b4575ece5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.820613 16630 consensus_peers.cc:597] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 -> Peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Couldn't send request to peer 9f5ebf768d584b17897ebb5b4575ece5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.829186 16630 consensus_peers.cc:597] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 -> Peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Couldn't send request to peer 9f5ebf768d584b17897ebb5b4575ece5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:24.840323 16633 consensus_peers.cc:597] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:24.847394  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:24.848183  8637 tablet_replica.cc:333] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.848893  8637 raft_consensus.cc:2243] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.849385  8637 raft_consensus.cc:2272] T c2c73b3d790842ed9389c18ddb50e3c1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.851444  8637 tablet_replica.cc:333] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.852016  8637 raft_consensus.cc:2243] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.852775  8637 raft_consensus.cc:2272] T 425340b667774e9083a7c360e90ff2e5 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.854707  8637 tablet_replica.cc:333] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.855289  8637 raft_consensus.cc:2243] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.856033  8637 raft_consensus.cc:2272] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.857856  8637 tablet_replica.cc:333] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.858448  8637 raft_consensus.cc:2243] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.858877  8637 raft_consensus.cc:2272] T 5a084469fa354084b2130b4656a965d1 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.860805  8637 tablet_replica.cc:333] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.861388  8637 raft_consensus.cc:2243] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.861821  8637 raft_consensus.cc:2272] T d0de7225f1bc44a1a67f4f298d60a257 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.863788  8637 tablet_replica.cc:333] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.864367  8637 raft_consensus.cc:2243] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.864861  8637 raft_consensus.cc:2272] T e1765c0523b546c198e7a014b0866bbc P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.867053  8637 tablet_replica.cc:333] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.868217  8637 raft_consensus.cc:2243] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.869318  8637 raft_consensus.cc:2272] T a39b696cc72749608ab54eae0a99b093 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.872316  8637 tablet_replica.cc:333] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.873111  8637 raft_consensus.cc:2243] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:30:24.873594 16559 consensus_peers.cc:597] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 -> Peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Couldn't send request to peer 32b697d90f0c4cdfb0a3f55e33a5b37a. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:24.874029  8637 raft_consensus.cc:2272] T 95064ed3f05a4169a3ff0f2123274cb7 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.876549  8637 tablet_replica.cc:333] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.877288  8637 raft_consensus.cc:2243] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.877792  8637 raft_consensus.cc:2272] T 932859a73dad4a39b5874461e99676cc P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:24.879093 16630 consensus_peers.cc:597] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 -> Peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Couldn't send request to peer 9f5ebf768d584b17897ebb5b4575ece5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:24.880156  8637 tablet_replica.cc:333] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.880823  8637 raft_consensus.cc:2243] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.881242  8637 raft_consensus.cc:2272] T fcd2958b516b4504aec8657e0fe2ec24 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.883579  8637 tablet_replica.cc:333] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.884125  8637 raft_consensus.cc:2243] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.884577  8637 raft_consensus.cc:2272] T 5d56d3967e8f4a15b1883473e50c4c85 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.886754  8637 tablet_replica.cc:333] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.887311  8637 raft_consensus.cc:2243] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.887749  8637 raft_consensus.cc:2272] T 21548ea41a6a427fb041bbd4531e9d29 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.889688  8637 tablet_replica.cc:333] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.890244  8637 raft_consensus.cc:2243] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.890692  8637 raft_consensus.cc:2272] T 2976cad482cd47bbadc454f8570dbb0d P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.892777  8637 tablet_replica.cc:333] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.893461  8637 raft_consensus.cc:2243] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.893951  8637 raft_consensus.cc:2272] T 1954b02f86b546d382996faa0aa9fd89 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.896415  8637 tablet_replica.cc:333] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.897090  8637 raft_consensus.cc:2243] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.897652  8637 raft_consensus.cc:2272] T a7ad2867ed594d4794807e95f2994f46 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.900501  8637 tablet_replica.cc:333] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.901476  8637 raft_consensus.cc:2243] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.902083  8637 raft_consensus.cc:2272] T c53516641dc3421cac583bbe728f6e14 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.904685  8637 tablet_replica.cc:333] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.905288  8637 raft_consensus.cc:2243] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.905746  8637 raft_consensus.cc:2272] T fd90b9fc6af748cd9bdb02bd14568f64 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.908077  8637 tablet_replica.cc:333] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.908694  8637 raft_consensus.cc:2243] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.909430  8637 raft_consensus.cc:2272] T 71752aae771f4c39b2d78e36222c8a4a P 9f5ebf768d584b17897ebb5b4575ece5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.911283  8637 tablet_replica.cc:333] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.911808  8637 raft_consensus.cc:2243] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.912230  8637 raft_consensus.cc:2272] T a17be6871edc41768bb5b3a6e2d1cf2a P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.913930  8637 tablet_replica.cc:333] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.914485  8637 raft_consensus.cc:2243] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.915234  8637 raft_consensus.cc:2272] T c8e6882ec7b344f7b4783d7610f69d82 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.917510  8637 tablet_replica.cc:333] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.918216  8637 raft_consensus.cc:2243] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.918715  8637 raft_consensus.cc:2272] T 38c2fffde641468f9399b51e98f495eb P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.920524  8637 tablet_replica.cc:333] T 23de375943ed49b2b9da4652fa088021 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.921200  8637 raft_consensus.cc:2243] T 23de375943ed49b2b9da4652fa088021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.921694  8637 raft_consensus.cc:2272] T 23de375943ed49b2b9da4652fa088021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.924151  8637 tablet_replica.cc:333] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.924746  8637 raft_consensus.cc:2243] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.925349  8637 raft_consensus.cc:2272] T d31544c1e5974ed9bf1a91c63adb99b8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.927322  8637 tablet_replica.cc:333] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.928095  8637 raft_consensus.cc:2243] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.928625  8637 raft_consensus.cc:2272] T e405df92b54c47daa8ae52a9fc87b7ac P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.930492  8637 tablet_replica.cc:333] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.930959  8637 raft_consensus.cc:2243] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.931646  8637 raft_consensus.cc:2272] T 3d77d239e0634d6894726f6bba42be5e P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.933357  8637 tablet_replica.cc:333] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.933816  8637 raft_consensus.cc:2243] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.934190  8637 raft_consensus.cc:2272] T d6724b5f4d23403097a81f5e83cf5e0e P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.936169  8637 tablet_replica.cc:333] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.936755  8637 raft_consensus.cc:2243] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.937211  8637 raft_consensus.cc:2272] T 450ac00038aa4947961ef3398fd75ca4 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.939266  8637 tablet_replica.cc:333] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.940066  8637 raft_consensus.cc:2243] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.940747  8637 raft_consensus.cc:2272] T 2738a61896734d42b9febbcbf8848761 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.943153  8637 tablet_replica.cc:333] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.943933  8637 raft_consensus.cc:2243] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.944839  8637 raft_consensus.cc:2272] T 010f5ea2dc68490290208a03251c29b0 P 9f5ebf768d584b17897ebb5b4575ece5 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.947016  8637 tablet_replica.cc:333] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.947554  8637 raft_consensus.cc:2243] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.948187  8637 raft_consensus.cc:2272] T 97b4874f353b48ef8bdfa4c28549a207 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.949924  8637 tablet_replica.cc:333] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.950500  8637 raft_consensus.cc:2243] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.950907  8637 raft_consensus.cc:2272] T d60b7bf1ed30467e9437c2b078e41808 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.953420  8637 tablet_replica.cc:333] T 2fb661ebdebf474db7f6380eb0e49d7f P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.954026  8637 raft_consensus.cc:2243] T 2fb661ebdebf474db7f6380eb0e49d7f P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.954541  8637 raft_consensus.cc:2272] T 2fb661ebdebf474db7f6380eb0e49d7f P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.956583  8637 tablet_replica.cc:333] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.957250  8637 raft_consensus.cc:2243] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.957720  8637 raft_consensus.cc:2272] T f3262489dd274a878ecf95eb28323a5b P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:24.958993 16704 consensus_peers.cc:597] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a -> Peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Couldn't send request to peer 9f5ebf768d584b17897ebb5b4575ece5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:24.960067  8637 tablet_replica.cc:333] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.960680  8637 raft_consensus.cc:2243] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.961143  8637 raft_consensus.cc:2272] T 6d8898ec613947bfa3b95ae941e1245d P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.962975  8637 tablet_replica.cc:333] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.963476  8637 raft_consensus.cc:2243] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.964177  8637 raft_consensus.cc:2272] T 7ce519a396e148d79231bf7cfbabc173 P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.965945  8637 tablet_replica.cc:333] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.966606  8637 raft_consensus.cc:2243] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.967048  8637 raft_consensus.cc:2272] T f063389a54a742ab8d764101a9168d1b P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.968909  8637 tablet_replica.cc:333] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.969414  8637 raft_consensus.cc:2243] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.969848  8637 raft_consensus.cc:2272] T 41cf6ac39c0248398e411dcce49bf021 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.972234  8637 tablet_replica.cc:333] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.972930  8637 raft_consensus.cc:2243] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.973781  8637 raft_consensus.cc:2272] T e968c7db76fe442fa81826c4035acb91 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.976178  8637 tablet_replica.cc:333] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.976807  8637 raft_consensus.cc:2243] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.977756  8637 raft_consensus.cc:2272] T 1966b49831ff47a3ba7263b77ac4e86b P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.980079  8637 tablet_replica.cc:333] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.980533  8637 raft_consensus.cc:2243] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.980940  8637 raft_consensus.cc:2272] T f0c6961f324049b8a5d9c13b648dc1bc P 9f5ebf768d584b17897ebb5b4575ece5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.982724  8637 tablet_replica.cc:333] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.983229  8637 raft_consensus.cc:2243] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.983927  8637 raft_consensus.cc:2272] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P 9f5ebf768d584b17897ebb5b4575ece5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.985670  8637 tablet_replica.cc:333] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.986092  8637 raft_consensus.cc:2243] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:24.986481  8637 raft_consensus.cc:2272] T d3719aa0cfe94cd3ad30412f3ad684a8 P 9f5ebf768d584b17897ebb5b4575ece5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.988265  8637 tablet_replica.cc:333] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.988677  8637 raft_consensus.cc:2243] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.989316  8637 raft_consensus.cc:2272] T 2ca7f1ce17c243358d69760e6457d24a P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:24.990984  8637 tablet_replica.cc:333] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5: stopping tablet replica
I20260709 12:30:24.991345  8637 raft_consensus.cc:2243] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:24.992003  8637 raft_consensus.cc:2272] T 3d9befeb38274b3fbca494f3044f9822 P 9f5ebf768d584b17897ebb5b4575ece5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:25.003708 16704 consensus_peers.cc:597] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a -> Peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Couldn't send request to peer 9f5ebf768d584b17897ebb5b4575ece5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:25.018965 16704 consensus_peers.cc:597] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a -> Peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Couldn't send request to peer 9f5ebf768d584b17897ebb5b4575ece5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:25.074211 16630 consensus_peers.cc:597] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Couldn't send request to peer 9f5ebf768d584b17897ebb5b4575ece5. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:35329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:25.080547 16630 consensus_peers.cc:597] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Couldn't send request to peer 9f5ebf768d584b17897ebb5b4575ece5. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:35329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:25.093117 16704 consensus_peers.cc:597] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a -> Peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Couldn't send request to peer 9f5ebf768d584b17897ebb5b4575ece5. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:35329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:25.093681  8637 tablet_server.cc:196] TabletServer@127.8.111.66:0 shutdown complete.
W20260709 12:30:25.097370 16630 consensus_peers.cc:597] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 -> Peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Couldn't send request to peer 9f5ebf768d584b17897ebb5b4575ece5. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:35329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:25.177575 16704 consensus_peers.cc:597] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a -> Peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Couldn't send request to peer 9f5ebf768d584b17897ebb5b4575ece5. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:35329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:25.186028  8637 tablet_server.cc:179] TabletServer@127.8.111.67:0 shutting down...
I20260709 12:30:25.229650  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:25.230674  8637 tablet_replica.cc:333] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.231310  8637 raft_consensus.cc:2243] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.232126  8637 raft_consensus.cc:2272] T e19834ede0784553865ac5c4cd1024f0 P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.234117  8637 tablet_replica.cc:333] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.234752  8637 raft_consensus.cc:2243] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.235280  8637 raft_consensus.cc:2272] T 425340b667774e9083a7c360e90ff2e5 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.237771  8637 tablet_replica.cc:333] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.238593  8637 raft_consensus.cc:2243] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.239089  8637 raft_consensus.cc:2272] T c53516641dc3421cac583bbe728f6e14 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.241473  8637 tablet_replica.cc:333] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.242030  8637 raft_consensus.cc:2243] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.242775  8637 raft_consensus.cc:2272] T c2c73b3d790842ed9389c18ddb50e3c1 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.244767  8637 tablet_replica.cc:333] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.245311  8637 raft_consensus.cc:2243] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.245755  8637 raft_consensus.cc:2272] T 4ce5ce8db6ce4ee6bfef51b5c677c3ba P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.247581  8637 tablet_replica.cc:333] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.248102  8637 raft_consensus.cc:2243] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.248510  8637 raft_consensus.cc:2272] T 932859a73dad4a39b5874461e99676cc P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.250383  8637 tablet_replica.cc:333] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.250905  8637 raft_consensus.cc:2243] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.251588  8637 raft_consensus.cc:2272] T fcd2958b516b4504aec8657e0fe2ec24 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.253501  8637 tablet_replica.cc:333] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.254261  8637 raft_consensus.cc:2243] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.254808  8637 raft_consensus.cc:2272] T a2ec89af83a842909ba5e19282a9e12d P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.257454  8637 tablet_replica.cc:333] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
W20260709 12:30:25.258106 16707 consensus_peers.cc:597] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a -> Peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Couldn't send request to peer 99ca36f8a50c459388f31022b1455ed6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:25.258215  8637 raft_consensus.cc:2243] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.259357  8637 raft_consensus.cc:2272] T e1765c0523b546c198e7a014b0866bbc P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.262109  8637 tablet_replica.cc:333] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.262814  8637 raft_consensus.cc:2243] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.263304  8637 raft_consensus.cc:2272] T a39b696cc72749608ab54eae0a99b093 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.265895  8637 tablet_replica.cc:333] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
W20260709 12:30:25.266523 16704 consensus_peers.cc:597] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a -> Peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Couldn't send request to peer 9f5ebf768d584b17897ebb5b4575ece5. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:35329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:25.266610  8637 raft_consensus.cc:2243] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:30:25.267107 16707 consensus_peers.cc:597] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a -> Peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Couldn't send request to peer 99ca36f8a50c459388f31022b1455ed6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:25.267374  8637 raft_consensus.cc:2272] T 95064ed3f05a4169a3ff0f2123274cb7 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.269938  8637 tablet_replica.cc:333] T 2976cad482cd47bbadc454f8570dbb0d P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.270747  8637 raft_consensus.cc:2243] T 2976cad482cd47bbadc454f8570dbb0d P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.271425  8637 raft_consensus.cc:2272] T 2976cad482cd47bbadc454f8570dbb0d P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:25.273046 16707 consensus_peers.cc:597] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a -> Peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Couldn't send request to peer 99ca36f8a50c459388f31022b1455ed6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:25.274035  8637 tablet_replica.cc:333] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.274912  8637 raft_consensus.cc:2243] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.275466  8637 raft_consensus.cc:2272] T 2eef363dbdce4d7bbd0b446385d8eb9e P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:25.276160 16630 consensus_peers.cc:597] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 -> Peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Couldn't send request to peer 9f5ebf768d584b17897ebb5b4575ece5. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.66:35329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:25.276364 16707 consensus_peers.cc:597] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a -> Peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Couldn't send request to peer 99ca36f8a50c459388f31022b1455ed6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:25.277808  8637 tablet_replica.cc:333] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.278510  8637 raft_consensus.cc:2243] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.278944  8637 raft_consensus.cc:2272] T fda99eaeca1149d48e54e0d83c3ec4cb P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.281270  8637 tablet_replica.cc:333] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.281886  8637 raft_consensus.cc:2243] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.282610  8637 raft_consensus.cc:2272] T 2acb6cd36ac547548487db51c2510029 P 99ca36f8a50c459388f31022b1455ed6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.284277  8637 tablet_replica.cc:333] T 689ed466680f40a59a88298ad3596652 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.284835  8637 raft_consensus.cc:2243] T 689ed466680f40a59a88298ad3596652 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.285216  8637 raft_consensus.cc:2272] T 689ed466680f40a59a88298ad3596652 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.287081  8637 tablet_replica.cc:333] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.287601  8637 raft_consensus.cc:2243] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.288335  8637 raft_consensus.cc:2272] T f063389a54a742ab8d764101a9168d1b P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.290215  8637 tablet_replica.cc:333] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.290848  8637 raft_consensus.cc:2243] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.291324  8637 raft_consensus.cc:2272] T 7ce519a396e148d79231bf7cfbabc173 P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.293895  8637 tablet_replica.cc:333] T 75800960202940669b8d3541a84fdb28 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.294652  8637 raft_consensus.cc:2243] T 75800960202940669b8d3541a84fdb28 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.295122  8637 raft_consensus.cc:2272] T 75800960202940669b8d3541a84fdb28 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.297425  8637 tablet_replica.cc:333] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.297950  8637 raft_consensus.cc:2243] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.298425  8637 raft_consensus.cc:2272] T e405df92b54c47daa8ae52a9fc87b7ac P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.300447  8637 tablet_replica.cc:333] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.300976  8637 raft_consensus.cc:2243] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.301357  8637 raft_consensus.cc:2272] T d31544c1e5974ed9bf1a91c63adb99b8 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.303166  8637 tablet_replica.cc:333] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.303680  8637 raft_consensus.cc:2243] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.304076  8637 raft_consensus.cc:2272] T 97b4874f353b48ef8bdfa4c28549a207 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.305822  8637 tablet_replica.cc:333] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.306419  8637 raft_consensus.cc:2243] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.306802  8637 raft_consensus.cc:2272] T 71752aae771f4c39b2d78e36222c8a4a P 99ca36f8a50c459388f31022b1455ed6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.308506  8637 tablet_replica.cc:333] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.309044  8637 raft_consensus.cc:2243] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.309855  8637 raft_consensus.cc:2272] T a17be6871edc41768bb5b3a6e2d1cf2a P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.312206  8637 tablet_replica.cc:333] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.312922  8637 raft_consensus.cc:2243] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:30:25.313205 16707 consensus_peers.cc:597] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a -> Peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Couldn't send request to peer 99ca36f8a50c459388f31022b1455ed6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:25.313395  8637 raft_consensus.cc:2272] T 5d56d3967e8f4a15b1883473e50c4c85 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.315367  8637 tablet_replica.cc:333] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.315914  8637 raft_consensus.cc:2243] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.316648  8637 raft_consensus.cc:2272] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.318349  8637 tablet_replica.cc:333] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.318846  8637 raft_consensus.cc:2243] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.319263  8637 raft_consensus.cc:2272] T c8e6882ec7b344f7b4783d7610f69d82 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.321048  8637 tablet_replica.cc:333] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.321632  8637 raft_consensus.cc:2243] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.322026  8637 raft_consensus.cc:2272] T 5d82d757f6a34783b2b2055824f65e88 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.323891  8637 tablet_replica.cc:333] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.324425  8637 raft_consensus.cc:2243] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.325112  8637 raft_consensus.cc:2272] T d4a9660f852f43f19f20f687b10acdd2 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.326968  8637 tablet_replica.cc:333] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.327468  8637 raft_consensus.cc:2243] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.327868  8637 raft_consensus.cc:2272] T 8bbf661e435740adbb0269128765d10e P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.329704  8637 tablet_replica.cc:333] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.330206  8637 raft_consensus.cc:2243] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.330915  8637 raft_consensus.cc:2272] T d45c0ead4eb3497c91c28c55ee353d83 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.333178  8637 tablet_replica.cc:333] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.333849  8637 raft_consensus.cc:2243] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.334756  8637 raft_consensus.cc:2272] T d285abc27263437a85f24a1d8f993be1 P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.337222  8637 tablet_replica.cc:333] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.337823  8637 raft_consensus.cc:2243] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.338735  8637 raft_consensus.cc:2272] T 23de375943ed49b2b9da4652fa088021 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.340780  8637 tablet_replica.cc:333] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.341279  8637 raft_consensus.cc:2243] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.341684  8637 raft_consensus.cc:2272] T 1954b02f86b546d382996faa0aa9fd89 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.343602  8637 tablet_replica.cc:333] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.344111  8637 raft_consensus.cc:2243] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.344519  8637 raft_consensus.cc:2272] T 3d77d239e0634d6894726f6bba42be5e P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.346215  8637 tablet_replica.cc:333] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.346745  8637 raft_consensus.cc:2243] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.347117  8637 raft_consensus.cc:2272] T 7805d2575cfc4de984937de995038b47 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.348848  8637 tablet_replica.cc:333] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.349300  8637 raft_consensus.cc:2243] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.349982  8637 raft_consensus.cc:2272] T 41cf6ac39c0248398e411dcce49bf021 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.351761  8637 tablet_replica.cc:333] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.352210  8637 raft_consensus.cc:2243] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.352591  8637 raft_consensus.cc:2272] T e968c7db76fe442fa81826c4035acb91 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.354343  8637 tablet_replica.cc:333] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.354817  8637 raft_consensus.cc:2243] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.355523  8637 raft_consensus.cc:2272] T ea7880201e5f49299c203ac770ceb930 P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.357254  8637 tablet_replica.cc:333] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.357667  8637 raft_consensus.cc:2243] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.358006  8637 raft_consensus.cc:2272] T 2738a61896734d42b9febbcbf8848761 P 99ca36f8a50c459388f31022b1455ed6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.359620  8637 tablet_replica.cc:333] T d3719aa0cfe94cd3ad30412f3ad684a8 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.360014  8637 raft_consensus.cc:2243] T d3719aa0cfe94cd3ad30412f3ad684a8 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.360329  8637 raft_consensus.cc:2272] T d3719aa0cfe94cd3ad30412f3ad684a8 P 99ca36f8a50c459388f31022b1455ed6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.362025  8637 tablet_replica.cc:333] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.362519  8637 raft_consensus.cc:2243] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.362916  8637 raft_consensus.cc:2272] T 2ca7f1ce17c243358d69760e6457d24a P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.364609  8637 tablet_replica.cc:333] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.365070  8637 raft_consensus.cc:2243] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.365453  8637 raft_consensus.cc:2272] T 3d9befeb38274b3fbca494f3044f9822 P 99ca36f8a50c459388f31022b1455ed6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.367093  8637 tablet_replica.cc:333] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6: stopping tablet replica
I20260709 12:30:25.367517  8637 raft_consensus.cc:2243] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.368203  8637 raft_consensus.cc:2272] T f0c6961f324049b8a5d9c13b648dc1bc P 99ca36f8a50c459388f31022b1455ed6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.441576  8637 tablet_server.cc:196] TabletServer@127.8.111.67:0 shutdown complete.
W20260709 12:30:25.448653 16707 consensus_peers.cc:597] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a -> Peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Couldn't send request to peer 99ca36f8a50c459388f31022b1455ed6. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.67:33625: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:25.484249 17982 raft_consensus.cc:493] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:25.484819 17982 raft_consensus.cc:515] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99ca36f8a50c459388f31022b1455ed6" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 33625 } } peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } }
I20260709 12:30:25.486532 17982 leader_election.cc:290] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625), 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499)
W20260709 12:30:25.490631 16707 leader_election.cc:336] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Network error: Client connection negotiation failed: client connection to 127.8.111.67:33625: connect: Connection refused (error 111)
W20260709 12:30:25.491278 16707 leader_election.cc:336] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
I20260709 12:30:25.491711 16707 leader_election.cc:304] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 99ca36f8a50c459388f31022b1455ed6
I20260709 12:30:25.492364 17982 raft_consensus.cc:2749] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:25.510172  8637 tablet_server.cc:179] TabletServer@127.8.111.68:0 shutting down...
I20260709 12:30:25.540102 17982 raft_consensus.cc:493] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 32b697d90f0c4cdfb0a3f55e33a5b37a)
I20260709 12:30:25.540773 17982 raft_consensus.cc:515] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd924581228b49d889b0e1553519722a" member_type: VOTER last_known_addr { host: "127.8.111.68" port: 35573 } } peers { permanent_uuid: "32b697d90f0c4cdfb0a3f55e33a5b37a" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36499 } } peers { permanent_uuid: "9f5ebf768d584b17897ebb5b4575ece5" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 35329 } }
I20260709 12:30:25.542742 17982 leader_election.cc:290] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499), 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329)
W20260709 12:30:25.546605 16707 leader_election.cc:336] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 32b697d90f0c4cdfb0a3f55e33a5b37a (127.8.111.65:36499): Network error: Client connection negotiation failed: client connection to 127.8.111.65:36499: connect: Connection refused (error 111)
W20260709 12:30:25.547839 16704 leader_election.cc:336] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9f5ebf768d584b17897ebb5b4575ece5 (127.8.111.66:35329): Network error: Client connection negotiation failed: client connection to 127.8.111.66:35329: connect: Connection refused (error 111)
I20260709 12:30:25.548206 16704 leader_election.cc:304] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd924581228b49d889b0e1553519722a; no voters: 32b697d90f0c4cdfb0a3f55e33a5b37a, 9f5ebf768d584b17897ebb5b4575ece5
I20260709 12:30:25.548759 17982 raft_consensus.cc:2749] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:25.554575  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:25.555352  8637 tablet_replica.cc:333] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.555936  8637 raft_consensus.cc:2243] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.556485  8637 raft_consensus.cc:2272] T e19834ede0784553865ac5c4cd1024f0 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.558822  8637 tablet_replica.cc:333] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.559628  8637 raft_consensus.cc:2243] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.560112  8637 raft_consensus.cc:2272] T a39b696cc72749608ab54eae0a99b093 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.562444  8637 tablet_replica.cc:333] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.562994  8637 raft_consensus.cc:2243] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.563417  8637 raft_consensus.cc:2272] T c2c73b3d790842ed9389c18ddb50e3c1 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.565512  8637 tablet_replica.cc:333] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.566331  8637 raft_consensus.cc:2243] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.566820  8637 raft_consensus.cc:2272] T 010f5ea2dc68490290208a03251c29b0 P cd924581228b49d889b0e1553519722a [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:25.568463 16707 consensus_peers.cc:597] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a -> Peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Couldn't send request to peer 99ca36f8a50c459388f31022b1455ed6. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.67:33625: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:25.568969  8637 tablet_replica.cc:333] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.569538  8637 raft_consensus.cc:2243] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.570218  8637 raft_consensus.cc:2272] T 932859a73dad4a39b5874461e99676cc P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.572012  8637 tablet_replica.cc:333] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.572474  8637 raft_consensus.cc:2243] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.572805  8637 raft_consensus.cc:2272] T fcd2958b516b4504aec8657e0fe2ec24 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.574858  8637 tablet_replica.cc:333] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.575320  8637 raft_consensus.cc:2243] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.575959  8637 raft_consensus.cc:2272] T a2ec89af83a842909ba5e19282a9e12d P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.577615  8637 tablet_replica.cc:333] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.578109  8637 raft_consensus.cc:2243] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.578820  8637 raft_consensus.cc:2272] T 2976cad482cd47bbadc454f8570dbb0d P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.580523  8637 tablet_replica.cc:333] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.581009  8637 raft_consensus.cc:2243] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.581657  8637 raft_consensus.cc:2272] T 2eef363dbdce4d7bbd0b446385d8eb9e P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.583544  8637 tablet_replica.cc:333] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.584024  8637 raft_consensus.cc:2243] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.584690  8637 raft_consensus.cc:2272] T fda99eaeca1149d48e54e0d83c3ec4cb P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.586405  8637 tablet_replica.cc:333] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.586877  8637 raft_consensus.cc:2243] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.587211  8637 raft_consensus.cc:2272] T 21548ea41a6a427fb041bbd4531e9d29 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.588804  8637 tablet_replica.cc:333] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.589339  8637 raft_consensus.cc:2243] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.589700  8637 raft_consensus.cc:2272] T 2acb6cd36ac547548487db51c2510029 P cd924581228b49d889b0e1553519722a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.591300  8637 tablet_replica.cc:333] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.591822  8637 raft_consensus.cc:2243] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.592432  8637 raft_consensus.cc:2272] T 689ed466680f40a59a88298ad3596652 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.594022  8637 tablet_replica.cc:333] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.594616  8637 raft_consensus.cc:2243] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.595256  8637 raft_consensus.cc:2272] T 75800960202940669b8d3541a84fdb28 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.597220  8637 tablet_replica.cc:333] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.597734  8637 raft_consensus.cc:2243] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.598542  8637 raft_consensus.cc:2272] T d31544c1e5974ed9bf1a91c63adb99b8 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.600485  8637 tablet_replica.cc:333] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.601016  8637 raft_consensus.cc:2243] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.601421  8637 raft_consensus.cc:2272] T a17be6871edc41768bb5b3a6e2d1cf2a P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.603235  8637 tablet_replica.cc:333] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.603751  8637 raft_consensus.cc:2243] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.604457  8637 raft_consensus.cc:2272] T a7ad2867ed594d4794807e95f2994f46 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.606328  8637 tablet_replica.cc:333] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.606869  8637 raft_consensus.cc:2243] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.607257  8637 raft_consensus.cc:2272] T 5d82d757f6a34783b2b2055824f65e88 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.608963  8637 tablet_replica.cc:333] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.609452  8637 raft_consensus.cc:2243] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.610164  8637 raft_consensus.cc:2272] T d3719aa0cfe94cd3ad30412f3ad684a8 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.612010  8637 tablet_replica.cc:333] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.612561  8637 raft_consensus.cc:2243] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.613113  8637 raft_consensus.cc:2272] T 14c4bbfcbd3a427d9ddbbeb3b17c3b4f P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.615242  8637 tablet_replica.cc:333] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.615764  8637 raft_consensus.cc:2243] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.616168  8637 raft_consensus.cc:2272] T 38c2fffde641468f9399b51e98f495eb P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.617887  8637 tablet_replica.cc:333] T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.618544  8637 raft_consensus.cc:2243] T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.618938  8637 raft_consensus.cc:2272] T 23de375943ed49b2b9da4652fa088021 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.621006  8637 tablet_replica.cc:333] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.621548  8637 raft_consensus.cc:2243] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.622313  8637 raft_consensus.cc:2272] T 5a084469fa354084b2130b4656a965d1 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.624440  8637 tablet_replica.cc:333] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.624953  8637 raft_consensus.cc:2243] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.625351  8637 raft_consensus.cc:2272] T d0de7225f1bc44a1a67f4f298d60a257 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.627099  8637 tablet_replica.cc:333] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.627599  8637 raft_consensus.cc:2243] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.627985  8637 raft_consensus.cc:2272] T d285abc27263437a85f24a1d8f993be1 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.630052  8637 tablet_replica.cc:333] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.630606  8637 raft_consensus.cc:2243] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.631371  8637 raft_consensus.cc:2272] T c53516641dc3421cac583bbe728f6e14 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.633671  8637 tablet_replica.cc:333] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.634245  8637 raft_consensus.cc:2243] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.634809  8637 raft_consensus.cc:2272] T fd90b9fc6af748cd9bdb02bd14568f64 P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:25.635383 16707 consensus_peers.cc:597] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a -> Peer 99ca36f8a50c459388f31022b1455ed6 (127.8.111.67:33625): Couldn't send request to peer 99ca36f8a50c459388f31022b1455ed6. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.67:33625: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:25.636759  8637 tablet_replica.cc:333] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.637375  8637 raft_consensus.cc:2243] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.638052  8637 raft_consensus.cc:2272] T 8bbf661e435740adbb0269128765d10e P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.639873  8637 tablet_replica.cc:333] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.640399  8637 raft_consensus.cc:2243] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.640947  8637 raft_consensus.cc:2272] T d4a9660f852f43f19f20f687b10acdd2 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.643409  8637 tablet_replica.cc:333] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.644099  8637 raft_consensus.cc:2243] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.644447  8637 raft_consensus.cc:2272] T d45c0ead4eb3497c91c28c55ee353d83 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.646092  8637 tablet_replica.cc:333] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.646608  8637 raft_consensus.cc:2243] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.647274  8637 raft_consensus.cc:2272] T d60b7bf1ed30467e9437c2b078e41808 P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.648980  8637 tablet_replica.cc:333] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.649457  8637 raft_consensus.cc:2243] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.650105  8637 raft_consensus.cc:2272] T 2fb661ebdebf474db7f6380eb0e49d7f P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.651834  8637 tablet_replica.cc:333] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.652418  8637 raft_consensus.cc:2243] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.652772  8637 raft_consensus.cc:2272] T f3262489dd274a878ecf95eb28323a5b P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.654407  8637 tablet_replica.cc:333] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.654879  8637 raft_consensus.cc:2243] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.655221  8637 raft_consensus.cc:2272] T 7805d2575cfc4de984937de995038b47 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.656932  8637 tablet_replica.cc:333] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.657379  8637 raft_consensus.cc:2243] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.657718  8637 raft_consensus.cc:2272] T 1966b49831ff47a3ba7263b77ac4e86b P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.659479  8637 tablet_replica.cc:333] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.659914  8637 raft_consensus.cc:2243] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.660377  8637 raft_consensus.cc:2272] T f0c6961f324049b8a5d9c13b648dc1bc P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.662070  8637 tablet_replica.cc:333] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.662606  8637 raft_consensus.cc:2243] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.662976  8637 raft_consensus.cc:2272] T 7ce519a396e148d79231bf7cfbabc173 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.664546  8637 tablet_replica.cc:333] T f063389a54a742ab8d764101a9168d1b P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.664961  8637 raft_consensus.cc:2243] T f063389a54a742ab8d764101a9168d1b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.665279  8637 raft_consensus.cc:2272] T f063389a54a742ab8d764101a9168d1b P cd924581228b49d889b0e1553519722a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.666925  8637 tablet_replica.cc:333] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.667331  8637 raft_consensus.cc:2243] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.667680  8637 raft_consensus.cc:2272] T ea7880201e5f49299c203ac770ceb930 P cd924581228b49d889b0e1553519722a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.669209  8637 tablet_replica.cc:333] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.669631  8637 raft_consensus.cc:2243] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.669970  8637 raft_consensus.cc:2272] T 450ac00038aa4947961ef3398fd75ca4 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.671964  8637 tablet_replica.cc:333] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.672405  8637 raft_consensus.cc:2243] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.672744  8637 raft_consensus.cc:2272] T 6d8898ec613947bfa3b95ae941e1245d P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.674382  8637 tablet_replica.cc:333] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.674774  8637 raft_consensus.cc:2243] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.675123  8637 raft_consensus.cc:2272] T 3d77d239e0634d6894726f6bba42be5e P cd924581228b49d889b0e1553519722a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.676736  8637 tablet_replica.cc:333] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.677130  8637 raft_consensus.cc:2243] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.677450  8637 raft_consensus.cc:2272] T d6724b5f4d23403097a81f5e83cf5e0e P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.679147  8637 tablet_replica.cc:333] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a: stopping tablet replica
I20260709 12:30:25.679507  8637 raft_consensus.cc:2243] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:25.679816  8637 raft_consensus.cc:2272] T 5daaf5ff8d2242d2bdfdff37cbbd6146 P cd924581228b49d889b0e1553519722a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.742640  8637 tablet_server.cc:196] TabletServer@127.8.111.68:0 shutdown complete.
I20260709 12:30:25.824935  8637 master.cc:562] Master@127.8.111.126:41553 shutting down...
I20260709 12:30:25.851687  8637 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:25.852231  8637 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:25.852557  8637 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9192e06dae494224a07f6aae9558426a: stopping tablet replica
I20260709 12:30:25.873474  8637 master.cc:584] Master@127.8.111.126:41553 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (49203 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:30:25.963953  8637 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.111.126:44977
I20260709 12:30:25.965019  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:25.970909 18047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:25.971083 18048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:25.972056 18050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:25.972914  8637 server_base.cc:1061] running on GCE node
I20260709 12:30:25.974061  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:25.974272  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:25.974466  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600225974431 us; error 0 us; skew 500 ppm
I20260709 12:30:25.974987  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:25.977262  8637 webserver.cc:533] Webserver started at http://127.8.111.126:44869/ using document root <none> and password file <none>
I20260709 12:30:25.977769  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:25.977963  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:25.978242  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:25.979394  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/master-0-root/instance:
uuid: "1c6a60a5c9e5419aa1e14ff4384f1b32"
format_stamp: "Formatted at 2026-07-09 12:30:25 on dist-test-slave-044g"
I20260709 12:30:25.983696  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:30:25.986914 18055 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:25.987619  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:30:25.987896  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/master-0-root
uuid: "1c6a60a5c9e5419aa1e14ff4384f1b32"
format_stamp: "Formatted at 2026-07-09 12:30:25 on dist-test-slave-044g"
I20260709 12:30:25.988180  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:26.007292  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:26.008628  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:26.048647  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.126:44977
I20260709 12:30:26.048748 18106 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.126:44977 every 8 connection(s)
I20260709 12:30:26.052604 18107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.062479 18107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32: Bootstrap starting.
I20260709 12:30:26.066974 18107 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.071136 18107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32: No bootstrap required, opened a new log
I20260709 12:30:26.073596 18107 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c6a60a5c9e5419aa1e14ff4384f1b32" member_type: VOTER }
I20260709 12:30:26.073998 18107 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.074235 18107 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c6a60a5c9e5419aa1e14ff4384f1b32, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.074926 18107 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c6a60a5c9e5419aa1e14ff4384f1b32" member_type: VOTER }
I20260709 12:30:26.075505 18107 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:30:26.075731 18107 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:30:26.076040 18107 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:26.080943 18107 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c6a60a5c9e5419aa1e14ff4384f1b32" member_type: VOTER }
I20260709 12:30:26.081480 18107 leader_election.cc:304] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c6a60a5c9e5419aa1e14ff4384f1b32; no voters: 
I20260709 12:30:26.082660 18107 leader_election.cc:290] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:30:26.083146 18110 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:26.084610 18110 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32 [term 1 LEADER]: Becoming Leader. State: Replica: 1c6a60a5c9e5419aa1e14ff4384f1b32, State: Running, Role: LEADER
I20260709 12:30:26.085301 18110 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c6a60a5c9e5419aa1e14ff4384f1b32" member_type: VOTER }
I20260709 12:30:26.085548 18107 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:30:26.090102 18112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c6a60a5c9e5419aa1e14ff4384f1b32. Latest consensus state: current_term: 1 leader_uuid: "1c6a60a5c9e5419aa1e14ff4384f1b32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c6a60a5c9e5419aa1e14ff4384f1b32" member_type: VOTER } }
I20260709 12:30:26.091063 18112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32 [sys.catalog]: This master's current role is: LEADER
I20260709 12:30:26.090701 18111 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c6a60a5c9e5419aa1e14ff4384f1b32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c6a60a5c9e5419aa1e14ff4384f1b32" member_type: VOTER } }
I20260709 12:30:26.091943 18111 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32 [sys.catalog]: This master's current role is: LEADER
I20260709 12:30:26.092960 18118 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:30:26.099222 18118 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:30:26.100235  8637 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:30:26.108100 18118 catalog_manager.cc:1383] Generated new cluster ID: bacacac095b14e1daebfd00eafd4bbcd
I20260709 12:30:26.108385 18118 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:30:26.120855 18118 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:30:26.122116 18118 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:30:26.133018 18118 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32: Generated new TSK 0
I20260709 12:30:26.133625 18118 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:30:26.167066  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:26.172654 18128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:26.173784 18129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:26.175244 18131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:26.176275  8637 server_base.cc:1061] running on GCE node
I20260709 12:30:26.177342  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:26.177717  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:26.177858  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600226177841 us; error 0 us; skew 500 ppm
I20260709 12:30:26.178627  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:26.180918  8637 webserver.cc:533] Webserver started at http://127.8.111.65:34155/ using document root <none> and password file <none>
I20260709 12:30:26.181355  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:26.181506  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:26.181710  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:26.182791  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/ts-0-root/instance:
uuid: "b3ad6524ae404f4287e91f045cd49630"
format_stamp: "Formatted at 2026-07-09 12:30:26 on dist-test-slave-044g"
I20260709 12:30:26.186978  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:30:26.190522 18136 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:26.191288  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:30:26.191593  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/ts-0-root
uuid: "b3ad6524ae404f4287e91f045cd49630"
format_stamp: "Formatted at 2026-07-09 12:30:26 on dist-test-slave-044g"
I20260709 12:30:26.191886  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:26.221791  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:26.223079  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:26.224550  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:26.226805  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:30:26.227031  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:26.227272  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:30:26.227468  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:26.267884  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.65:46167
I20260709 12:30:26.268015 18198 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.65:46167 every 8 connection(s)
I20260709 12:30:26.273065  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:26.279882 18203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:26.282188 18204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:26.284706  8637 server_base.cc:1061] running on GCE node
W20260709 12:30:26.284965 18206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:26.286228  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:26.286494  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:26.286682  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600226286652 us; error 0 us; skew 500 ppm
I20260709 12:30:26.287282  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:26.289527 18199 heartbeater.cc:344] Connected to a master server at 127.8.111.126:44977
I20260709 12:30:26.289866 18199 heartbeater.cc:461] Registering TS with master...
I20260709 12:30:26.290385  8637 webserver.cc:533] Webserver started at http://127.8.111.66:37849/ using document root <none> and password file <none>
I20260709 12:30:26.290714 18199 heartbeater.cc:507] Master 127.8.111.126:44977 requested a full tablet report, sending...
I20260709 12:30:26.290933  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:26.291252  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:26.291533  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:26.292857  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/ts-1-root/instance:
uuid: "b4196549c2db465183f36e9703d6d422"
format_stamp: "Formatted at 2026-07-09 12:30:26 on dist-test-slave-044g"
I20260709 12:30:26.292933 18072 ts_manager.cc:194] Registered new tserver with Master: b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167)
I20260709 12:30:26.294872 18072 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44314
I20260709 12:30:26.297818  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:30:26.301254 18211 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:26.301983  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:30:26.302320  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/ts-1-root
uuid: "b4196549c2db465183f36e9703d6d422"
format_stamp: "Formatted at 2026-07-09 12:30:26 on dist-test-slave-044g"
I20260709 12:30:26.302615  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:26.321607  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:26.322888  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:26.324290  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:26.326424  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:30:26.326644  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:26.326877  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:30:26.327044  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:26.365890  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.66:46121
I20260709 12:30:26.366037 18273 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.66:46121 every 8 connection(s)
I20260709 12:30:26.370777  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:26.377636 18277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:26.384047 18278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:26.385763 18274 heartbeater.cc:344] Connected to a master server at 127.8.111.126:44977
I20260709 12:30:26.386358 18274 heartbeater.cc:461] Registering TS with master...
I20260709 12:30:26.386943  8637 server_base.cc:1061] running on GCE node
I20260709 12:30:26.387400 18274 heartbeater.cc:507] Master 127.8.111.126:44977 requested a full tablet report, sending...
W20260709 12:30:26.387471 18280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:26.388646  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:26.388943  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:26.389140  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600226389106 us; error 0 us; skew 500 ppm
I20260709 12:30:26.389818  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:26.389997 18072 ts_manager.cc:194] Registered new tserver with Master: b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121)
I20260709 12:30:26.391877 18072 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44330
I20260709 12:30:26.392581  8637 webserver.cc:533] Webserver started at http://127.8.111.67:40027/ using document root <none> and password file <none>
I20260709 12:30:26.393277  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:26.393510  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:26.393865  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:26.395233  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/ts-2-root/instance:
uuid: "459af2dc183b4890a69a8bafa457dbfd"
format_stamp: "Formatted at 2026-07-09 12:30:26 on dist-test-slave-044g"
I20260709 12:30:26.399360  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:30:26.402380 18285 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:26.403115  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:30:26.403399  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/ts-2-root
uuid: "459af2dc183b4890a69a8bafa457dbfd"
format_stamp: "Formatted at 2026-07-09 12:30:26 on dist-test-slave-044g"
I20260709 12:30:26.403640  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:26.428047  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:26.429226  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:26.430720  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:26.432875  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:30:26.433127  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:26.433396  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:30:26.433586  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:26.472836  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.67:43607
I20260709 12:30:26.472946 18347 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.67:43607 every 8 connection(s)
I20260709 12:30:26.486927 18348 heartbeater.cc:344] Connected to a master server at 127.8.111.126:44977
I20260709 12:30:26.487370 18348 heartbeater.cc:461] Registering TS with master...
I20260709 12:30:26.488139 18348 heartbeater.cc:507] Master 127.8.111.126:44977 requested a full tablet report, sending...
I20260709 12:30:26.490000 18072 ts_manager.cc:194] Registered new tserver with Master: 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:26.490688  8637 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014811069s
I20260709 12:30:26.491729 18072 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44336
I20260709 12:30:26.515513 18072 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44346:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:30:26.518154 18072 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:30:26.585963 18239 tablet_service.cc:1511] Processing CreateTablet for tablet 2a902188d2864995a1bd386dc585c256 (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:30:26.587805 18239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a902188d2864995a1bd386dc585c256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.591943 18238 tablet_service.cc:1511] Processing CreateTablet for tablet dc699d0852fb467faead580ffa7d7c4c (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:30:26.592940 18235 tablet_service.cc:1511] Processing CreateTablet for tablet 6865ba7952554654a4f74f0e78728e4c (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:30:26.593463 18238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc699d0852fb467faead580ffa7d7c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.595353 18237 tablet_service.cc:1511] Processing CreateTablet for tablet 7beb8f7a0b2e4d049f4959b99fcccc03 (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:30:26.596061 18235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6865ba7952554654a4f74f0e78728e4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.596921 18237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7beb8f7a0b2e4d049f4959b99fcccc03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.599452 18236 tablet_service.cc:1511] Processing CreateTablet for tablet dd557e285b7f49d488d1bd1356d41885 (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:30:26.600945 18236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd557e285b7f49d488d1bd1356d41885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.603439 18164 tablet_service.cc:1511] Processing CreateTablet for tablet 2a902188d2864995a1bd386dc585c256 (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:30:26.606021 18164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a902188d2864995a1bd386dc585c256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.606106 18163 tablet_service.cc:1511] Processing CreateTablet for tablet dc699d0852fb467faead580ffa7d7c4c (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:30:26.607534 18163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc699d0852fb467faead580ffa7d7c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.615854 18162 tablet_service.cc:1511] Processing CreateTablet for tablet 7beb8f7a0b2e4d049f4959b99fcccc03 (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:30:26.617362 18162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7beb8f7a0b2e4d049f4959b99fcccc03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.623481 18234 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa56b1764974ae6b0a838890e1e30d6 (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:30:26.625077 18234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa56b1764974ae6b0a838890e1e30d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.628473 18313 tablet_service.cc:1511] Processing CreateTablet for tablet 2a902188d2864995a1bd386dc585c256 (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:30:26.629961 18313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a902188d2864995a1bd386dc585c256. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.631562 18312 tablet_service.cc:1511] Processing CreateTablet for tablet dc699d0852fb467faead580ffa7d7c4c (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:30:26.631846 18161 tablet_service.cc:1511] Processing CreateTablet for tablet dd557e285b7f49d488d1bd1356d41885 (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:30:26.633194 18161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd557e285b7f49d488d1bd1356d41885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.634672 18311 tablet_service.cc:1511] Processing CreateTablet for tablet 7beb8f7a0b2e4d049f4959b99fcccc03 (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:30:26.636183 18311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7beb8f7a0b2e4d049f4959b99fcccc03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.638022 18310 tablet_service.cc:1511] Processing CreateTablet for tablet dd557e285b7f49d488d1bd1356d41885 (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:30:26.638201 18232 tablet_service.cc:1511] Processing CreateTablet for tablet 01ea941634d04818819c1b7270d28dd0 (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:30:26.639503 18232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ea941634d04818819c1b7270d28dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.640470 18309 tablet_service.cc:1511] Processing CreateTablet for tablet 6865ba7952554654a4f74f0e78728e4c (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:30:26.642985 18308 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa56b1764974ae6b0a838890e1e30d6 (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:30:26.644068 18231 tablet_service.cc:1511] Processing CreateTablet for tablet 4412ee203abc432fa25d402110e4d33e (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:30:26.645474 18307 tablet_service.cc:1511] Processing CreateTablet for tablet 4c732cf3421d4b4fa6ebafcfd554414a (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:30:26.647255 18230 tablet_service.cc:1511] Processing CreateTablet for tablet aedae4fe005741258a43c1b4cf924100 (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:30:26.647965 18306 tablet_service.cc:1511] Processing CreateTablet for tablet 01ea941634d04818819c1b7270d28dd0 (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:30:26.650367 18233 tablet_service.cc:1511] Processing CreateTablet for tablet 4c732cf3421d4b4fa6ebafcfd554414a (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:30:26.652117 18160 tablet_service.cc:1511] Processing CreateTablet for tablet 6865ba7952554654a4f74f0e78728e4c (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:30:26.652828 18157 tablet_service.cc:1511] Processing CreateTablet for tablet 01ea941634d04818819c1b7270d28dd0 (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:30:26.653462 18160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6865ba7952554654a4f74f0e78728e4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.654102 18157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ea941634d04818819c1b7270d28dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.654775 18306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01ea941634d04818819c1b7270d28dd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.655537 18312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc699d0852fb467faead580ffa7d7c4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.656280 18310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd557e285b7f49d488d1bd1356d41885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.658594 18305 tablet_service.cc:1511] Processing CreateTablet for tablet 4412ee203abc432fa25d402110e4d33e (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:30:26.660041 18305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4412ee203abc432fa25d402110e4d33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.659752 18159 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa56b1764974ae6b0a838890e1e30d6 (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:30:26.661082 18159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa56b1764974ae6b0a838890e1e30d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.662667 18307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c732cf3421d4b4fa6ebafcfd554414a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.664026 18158 tablet_service.cc:1511] Processing CreateTablet for tablet 4c732cf3421d4b4fa6ebafcfd554414a (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:30:26.665288 18158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c732cf3421d4b4fa6ebafcfd554414a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.667397 18156 tablet_service.cc:1511] Processing CreateTablet for tablet 4412ee203abc432fa25d402110e4d33e (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:30:26.667598 18304 tablet_service.cc:1511] Processing CreateTablet for tablet aedae4fe005741258a43c1b4cf924100 (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:30:26.668720 18156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4412ee203abc432fa25d402110e4d33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.668987 18304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aedae4fe005741258a43c1b4cf924100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.670759 18309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6865ba7952554654a4f74f0e78728e4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.674655 18308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa56b1764974ae6b0a838890e1e30d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.645514 18231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4412ee203abc432fa25d402110e4d33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.678210 18230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aedae4fe005741258a43c1b4cf924100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.679062 18233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c732cf3421d4b4fa6ebafcfd554414a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.680332 18155 tablet_service.cc:1511] Processing CreateTablet for tablet aedae4fe005741258a43c1b4cf924100 (DEFAULT_TABLE table=test-workload [id=6a955abecfa94e9399effc3c3c03a7bf]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:30:26.682071 18155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aedae4fe005741258a43c1b4cf924100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:26.769276 18365 tablet_bootstrap.cc:492] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630: Bootstrap starting.
I20260709 12:30:26.783134 18363 tablet_bootstrap.cc:492] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422: Bootstrap starting.
I20260709 12:30:26.792124 18366 tablet_bootstrap.cc:492] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd: Bootstrap starting.
I20260709 12:30:26.798190 18366 tablet_bootstrap.cc:654] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.806107 18365 tablet_bootstrap.cc:654] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.806571 18363 tablet_bootstrap.cc:654] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.870482 18366 tablet_bootstrap.cc:492] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd: No bootstrap required, opened a new log
I20260709 12:30:26.872139 18366 ts_tablet_manager.cc:1403] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.004s
I20260709 12:30:26.879171 18366 raft_consensus.cc:359] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:26.884229 18366 raft_consensus.cc:385] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.884558 18366 raft_consensus.cc:740] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.887387 18365 tablet_bootstrap.cc:492] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630: No bootstrap required, opened a new log
I20260709 12:30:26.885685 18366 consensus_queue.cc:260] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:26.888345 18363 tablet_bootstrap.cc:492] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422: No bootstrap required, opened a new log
I20260709 12:30:26.888473 18365 ts_tablet_manager.cc:1403] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630: Time spent bootstrapping tablet: real 0.120s	user 0.024s	sys 0.004s
I20260709 12:30:26.889317 18363 ts_tablet_manager.cc:1403] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422: Time spent bootstrapping tablet: real 0.107s	user 0.007s	sys 0.008s
I20260709 12:30:26.890884 18348 heartbeater.cc:499] Master 127.8.111.126:44977 was elected leader, sending a full tablet report...
I20260709 12:30:26.891438 18366 ts_tablet_manager.cc:1434] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd: Time spent starting tablet: real 0.019s	user 0.001s	sys 0.013s
I20260709 12:30:26.893388 18366 tablet_bootstrap.cc:492] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd: Bootstrap starting.
I20260709 12:30:26.894049 18365 raft_consensus.cc:359] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:26.894665 18363 raft_consensus.cc:359] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:26.895598 18365 raft_consensus.cc:385] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.895936 18363 raft_consensus.cc:385] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.896085 18365 raft_consensus.cc:740] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.896457 18363 raft_consensus.cc:740] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4196549c2db465183f36e9703d6d422, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.897429 18365 consensus_queue.cc:260] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:26.897645 18363 consensus_queue.cc:260] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:26.904372 18366 tablet_bootstrap.cc:654] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.904500 18365 ts_tablet_manager.cc:1434] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630: Time spent starting tablet: real 0.015s	user 0.013s	sys 0.003s
I20260709 12:30:26.904577 18199 heartbeater.cc:499] Master 127.8.111.126:44977 was elected leader, sending a full tablet report...
I20260709 12:30:26.909667 18363 ts_tablet_manager.cc:1434] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422: Time spent starting tablet: real 0.020s	user 0.015s	sys 0.001s
I20260709 12:30:26.910835 18274 heartbeater.cc:499] Master 127.8.111.126:44977 was elected leader, sending a full tablet report...
I20260709 12:30:26.919261 18363 tablet_bootstrap.cc:492] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422: Bootstrap starting.
I20260709 12:30:26.927349 18363 tablet_bootstrap.cc:654] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.927922 18365 tablet_bootstrap.cc:492] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630: Bootstrap starting.
I20260709 12:30:26.932574 18363 tablet_bootstrap.cc:492] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422: No bootstrap required, opened a new log
I20260709 12:30:26.933055 18363 ts_tablet_manager.cc:1403] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:30:26.936043 18363 raft_consensus.cc:359] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:26.936815 18363 raft_consensus.cc:385] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.937119 18363 raft_consensus.cc:740] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4196549c2db465183f36e9703d6d422, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.938081 18363 consensus_queue.cc:260] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:26.940582 18363 ts_tablet_manager.cc:1434] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:30:26.941730 18363 tablet_bootstrap.cc:492] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422: Bootstrap starting.
I20260709 12:30:26.944566 18366 tablet_bootstrap.cc:492] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd: No bootstrap required, opened a new log
I20260709 12:30:26.945263 18366 ts_tablet_manager.cc:1403] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd: Time spent bootstrapping tablet: real 0.053s	user 0.021s	sys 0.030s
I20260709 12:30:26.945844 18365 tablet_bootstrap.cc:654] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.949005 18363 tablet_bootstrap.cc:654] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.948630 18366 raft_consensus.cc:359] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:26.949527 18366 raft_consensus.cc:385] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.949903 18366 raft_consensus.cc:740] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.950944 18366 consensus_queue.cc:260] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:26.956696 18366 ts_tablet_manager.cc:1434] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:30:26.957895 18366 tablet_bootstrap.cc:492] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd: Bootstrap starting.
I20260709 12:30:26.958796 18365 tablet_bootstrap.cc:492] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630: No bootstrap required, opened a new log
I20260709 12:30:26.959321 18365 ts_tablet_manager.cc:1403] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.012s
I20260709 12:30:26.962550 18365 raft_consensus.cc:359] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:26.963287 18365 raft_consensus.cc:385] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.963598 18365 raft_consensus.cc:740] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.964213 18363 tablet_bootstrap.cc:492] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422: No bootstrap required, opened a new log
I20260709 12:30:26.964661 18363 ts_tablet_manager.cc:1403] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.003s
I20260709 12:30:26.964802 18366 tablet_bootstrap.cc:654] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.964448 18365 consensus_queue.cc:260] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:26.967051 18365 ts_tablet_manager.cc:1434] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.007s
I20260709 12:30:26.967384 18363 raft_consensus.cc:359] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } } peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } }
I20260709 12:30:26.968127 18363 raft_consensus.cc:385] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.968289 18365 tablet_bootstrap.cc:492] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630: Bootstrap starting.
I20260709 12:30:26.968425 18363 raft_consensus.cc:740] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4196549c2db465183f36e9703d6d422, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.969612 18363 consensus_queue.cc:260] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } } peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } }
W20260709 12:30:26.977036 18349 tablet.cc:2406] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:30:26.978413 18363 ts_tablet_manager.cc:1434] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 12:30:26.980748 18365 tablet_bootstrap.cc:654] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.985807 18363 tablet_bootstrap.cc:492] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422: Bootstrap starting.
I20260709 12:30:26.993638 18363 tablet_bootstrap.cc:654] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:26.994329 18365 tablet_bootstrap.cc:492] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630: No bootstrap required, opened a new log
I20260709 12:30:26.994755 18366 tablet_bootstrap.cc:492] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd: No bootstrap required, opened a new log
I20260709 12:30:26.994845 18365 ts_tablet_manager.cc:1403] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.010s
I20260709 12:30:26.995373 18366 ts_tablet_manager.cc:1403] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.014s
I20260709 12:30:26.998163 18365 raft_consensus.cc:359] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:26.998656 18363 tablet_bootstrap.cc:492] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422: No bootstrap required, opened a new log
I20260709 12:30:26.998425 18366 raft_consensus.cc:359] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:26.998957 18365 raft_consensus.cc:385] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.999183 18366 raft_consensus.cc:385] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:26.999310 18365 raft_consensus.cc:740] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Initialized, Role: FOLLOWER
I20260709 12:30:26.999333 18363 ts_tablet_manager.cc:1403] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.009s
I20260709 12:30:26.999558 18366 raft_consensus.cc:740] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.000281 18365 consensus_queue.cc:260] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.000751 18366 consensus_queue.cc:260] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.002616 18365 ts_tablet_manager.cc:1434] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:30:27.002759 18363 raft_consensus.cc:359] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.003670 18365 tablet_bootstrap.cc:492] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630: Bootstrap starting.
I20260709 12:30:27.003612 18363 raft_consensus.cc:385] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.004133 18363 raft_consensus.cc:740] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4196549c2db465183f36e9703d6d422, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.005116 18366 ts_tablet_manager.cc:1434] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:30:27.005286 18363 consensus_queue.cc:260] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.006515 18366 tablet_bootstrap.cc:492] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd: Bootstrap starting.
I20260709 12:30:27.012202 18365 tablet_bootstrap.cc:654] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:27.014739 18366 tablet_bootstrap.cc:654] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:27.015511 18363 ts_tablet_manager.cc:1434] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.005s
I20260709 12:30:27.022938 18363 tablet_bootstrap.cc:492] T aedae4fe005741258a43c1b4cf924100 P b4196549c2db465183f36e9703d6d422: Bootstrap starting.
I20260709 12:30:27.025163 18365 tablet_bootstrap.cc:492] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630: No bootstrap required, opened a new log
I20260709 12:30:27.025683 18365 ts_tablet_manager.cc:1403] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.005s
I20260709 12:30:27.028414 18365 raft_consensus.cc:359] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.028937 18366 tablet_bootstrap.cc:492] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd: No bootstrap required, opened a new log
I20260709 12:30:27.028962 18365 raft_consensus.cc:385] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.029593 18365 raft_consensus.cc:740] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.029659 18366 ts_tablet_manager.cc:1403] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 12:30:27.030239 18363 tablet_bootstrap.cc:654] T aedae4fe005741258a43c1b4cf924100 P b4196549c2db465183f36e9703d6d422: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:27.030424 18365 consensus_queue.cc:260] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.031340 18372 raft_consensus.cc:493] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:27.031981 18372 raft_consensus.cc:515] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.033461 18366 raft_consensus.cc:359] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } } peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } }
I20260709 12:30:27.034569 18366 raft_consensus.cc:385] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.034974 18366 raft_consensus.cc:740] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.036041 18366 consensus_queue.cc:260] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } } peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } }
I20260709 12:30:27.039212 18366 ts_tablet_manager.cc:1434] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 12:30:27.039747 18365 ts_tablet_manager.cc:1434] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:30:27.042330 18366 tablet_bootstrap.cc:492] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd: Bootstrap starting.
I20260709 12:30:27.046608 18365 tablet_bootstrap.cc:492] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630: Bootstrap starting.
I20260709 12:30:27.051633 18366 tablet_bootstrap.cc:654] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:27.055603 18372 leader_election.cc:290] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:27.056456 18365 tablet_bootstrap.cc:654] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:27.059747 18363 tablet_bootstrap.cc:492] T aedae4fe005741258a43c1b4cf924100 P b4196549c2db465183f36e9703d6d422: No bootstrap required, opened a new log
I20260709 12:30:27.060252 18363 ts_tablet_manager.cc:1403] T aedae4fe005741258a43c1b4cf924100 P b4196549c2db465183f36e9703d6d422: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.018s
I20260709 12:30:27.065687 18363 raft_consensus.cc:359] T aedae4fe005741258a43c1b4cf924100 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.066445 18363 raft_consensus.cc:385] T aedae4fe005741258a43c1b4cf924100 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.066753 18363 raft_consensus.cc:740] T aedae4fe005741258a43c1b4cf924100 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4196549c2db465183f36e9703d6d422, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.068800 18363 consensus_queue.cc:260] T aedae4fe005741258a43c1b4cf924100 P b4196549c2db465183f36e9703d6d422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.071476 18363 ts_tablet_manager.cc:1434] T aedae4fe005741258a43c1b4cf924100 P b4196549c2db465183f36e9703d6d422: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:30:27.072723 18363 tablet_bootstrap.cc:492] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422: Bootstrap starting.
I20260709 12:30:27.077134 18366 tablet_bootstrap.cc:492] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd: No bootstrap required, opened a new log
I20260709 12:30:27.077721 18366 ts_tablet_manager.cc:1403] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.000s
I20260709 12:30:27.079680 18363 tablet_bootstrap.cc:654] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:27.080933 18366 raft_consensus.cc:359] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.081718 18366 raft_consensus.cc:385] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.082026 18366 raft_consensus.cc:740] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.082965 18366 consensus_queue.cc:260] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.089756 18366 ts_tablet_manager.cc:1434] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:30:27.091396 18366 tablet_bootstrap.cc:492] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd: Bootstrap starting.
W20260709 12:30:27.095906 18120 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:27.096685 18371 raft_consensus.cc:493] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:27.097229 18371 raft_consensus.cc:515] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.098824 18366 tablet_bootstrap.cc:654] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:27.102811 18371 leader_election.cc:290] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:27.111053 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd557e285b7f49d488d1bd1356d41885" candidate_uuid: "b3ad6524ae404f4287e91f045cd49630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422" is_pre_election: true
I20260709 12:30:27.112162 18249 raft_consensus.cc:2468] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3ad6524ae404f4287e91f045cd49630 in term 0.
I20260709 12:30:27.113797 18382 raft_consensus.cc:493] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:27.114109 18363 tablet_bootstrap.cc:492] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422: No bootstrap required, opened a new log
I20260709 12:30:27.114674 18363 ts_tablet_manager.cc:1403] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.011s
I20260709 12:30:27.114356 18382 raft_consensus.cc:515] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.116711 18382 leader_election.cc:290] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:27.117803 18365 tablet_bootstrap.cc:492] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630: No bootstrap required, opened a new log
I20260709 12:30:27.118424 18365 ts_tablet_manager.cc:1403] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630: Time spent bootstrapping tablet: real 0.072s	user 0.034s	sys 0.029s
I20260709 12:30:27.118569 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0" candidate_uuid: "b3ad6524ae404f4287e91f045cd49630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422" is_pre_election: true
I20260709 12:30:27.119402 18249 raft_consensus.cc:2468] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3ad6524ae404f4287e91f045cd49630 in term 0.
I20260709 12:30:27.121313 18139 leader_election.cc:304] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:27.121912 18365 raft_consensus.cc:359] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.122460 18370 raft_consensus.cc:493] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:27.122651 18382 raft_consensus.cc:2804] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:27.122812 18365 raft_consensus.cc:385] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.123101 18382 raft_consensus.cc:493] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:27.123026 18370 raft_consensus.cc:515] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.123488 18365 raft_consensus.cc:740] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.123768 18382 raft_consensus.cc:3060] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.124624 18365 consensus_queue.cc:260] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.126017 18370 leader_election.cc:290] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121)
I20260709 12:30:27.122502 18139 leader_election.cc:304] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:27.127909 18372 raft_consensus.cc:2804] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:27.128325 18372 raft_consensus.cc:493] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:27.128736 18372 raft_consensus.cc:3060] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.118129 18363 raft_consensus.cc:359] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.139640 18363 raft_consensus.cc:385] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.139950 18363 raft_consensus.cc:740] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4196549c2db465183f36e9703d6d422, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.142517 18365 ts_tablet_manager.cc:1434] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:30:27.146183 18365 tablet_bootstrap.cc:492] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630: Bootstrap starting.
I20260709 12:30:27.144552 18372 raft_consensus.cc:515] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.148006 18323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd557e285b7f49d488d1bd1356d41885" candidate_uuid: "b3ad6524ae404f4287e91f045cd49630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd" is_pre_election: true
I20260709 12:30:27.149501 18322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0" candidate_uuid: "b3ad6524ae404f4287e91f045cd49630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd" is_pre_election: true
I20260709 12:30:27.143651 18363 consensus_queue.cc:260] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.154706 18322 raft_consensus.cc:2468] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3ad6524ae404f4287e91f045cd49630 in term 0.
I20260709 12:30:27.156091 18366 tablet_bootstrap.cc:492] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd: No bootstrap required, opened a new log
I20260709 12:30:27.156594 18366 ts_tablet_manager.cc:1403] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd: Time spent bootstrapping tablet: real 0.065s	user 0.018s	sys 0.002s
W20260709 12:30:27.156819 18139 leader_election.cc:343] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:27.157608 18372 leader_election.cc:290] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 election: Requested vote from peers b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:27.159104 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0" candidate_uuid: "b3ad6524ae404f4287e91f045cd49630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422"
I20260709 12:30:27.167259 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422" is_pre_election: true
I20260709 12:30:27.167857 18249 raft_consensus.cc:3060] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.170097 18323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beb8f7a0b2e4d049f4959b99fcccc03" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd" is_pre_election: true
I20260709 12:30:27.170735 18323 raft_consensus.cc:2468] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 0.
I20260709 12:30:27.170998 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beb8f7a0b2e4d049f4959b99fcccc03" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3ad6524ae404f4287e91f045cd49630" is_pre_election: true
I20260709 12:30:27.171753 18174 raft_consensus.cc:2468] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 0.
I20260709 12:30:27.171777 18214 leader_election.cc:304] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:27.172719 18371 raft_consensus.cc:2804] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:27.173049 18371 raft_consensus.cc:493] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:27.173336 18371 raft_consensus.cc:3060] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.149798 18382 raft_consensus.cc:515] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.159904 18322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0" candidate_uuid: "b3ad6524ae404f4287e91f045cd49630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
I20260709 12:30:27.174268 18322 raft_consensus.cc:3060] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.175479 18382 leader_election.cc:290] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 election: Requested vote from peers b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:27.176877 18249 raft_consensus.cc:2468] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3ad6524ae404f4287e91f045cd49630 in term 1.
I20260709 12:30:27.163295 18366 raft_consensus.cc:359] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.177980 18366 raft_consensus.cc:385] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.178316 18366 raft_consensus.cc:740] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.179234 18366 consensus_queue.cc:260] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.181818 18366 ts_tablet_manager.cc:1434] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:30:27.181586 18371 raft_consensus.cc:515] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.182919 18366 tablet_bootstrap.cc:492] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd: Bootstrap starting.
I20260709 12:30:27.183759 18371 leader_election.cc:290] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 1 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:27.183753 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd557e285b7f49d488d1bd1356d41885" candidate_uuid: "b3ad6524ae404f4287e91f045cd49630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422"
I20260709 12:30:27.184535 18248 raft_consensus.cc:3060] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.184429 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beb8f7a0b2e4d049f4959b99fcccc03" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:27.185252 18174 raft_consensus.cc:3060] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.187580 18139 leader_election.cc:304] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:27.187906 18323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beb8f7a0b2e4d049f4959b99fcccc03" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
I20260709 12:30:27.188423 18382 raft_consensus.cc:2804] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:27.188498 18323 raft_consensus.cc:3060] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.188961 18382 raft_consensus.cc:697] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 1 LEADER]: Becoming Leader. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Running, Role: LEADER
I20260709 12:30:27.164034 18365 tablet_bootstrap.cc:654] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:27.189909 18382 consensus_queue.cc:237] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.166795 18363 ts_tablet_manager.cc:1434] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.001s
I20260709 12:30:27.194203 18363 tablet_bootstrap.cc:492] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422: Bootstrap starting.
I20260709 12:30:27.194659 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3ad6524ae404f4287e91f045cd49630" is_pre_election: true
I20260709 12:30:27.195482 18321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd557e285b7f49d488d1bd1356d41885" candidate_uuid: "b3ad6524ae404f4287e91f045cd49630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
I20260709 12:30:27.198555 18289 leader_election.cc:304] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd; no voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422
W20260709 12:30:27.198199 18139 leader_election.cc:343] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:27.199762 18174 raft_consensus.cc:2468] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 1.
I20260709 12:30:27.203217 18215 leader_election.cc:304] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:27.200793 18363 tablet_bootstrap.cc:654] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:27.190207 18366 tablet_bootstrap.cc:654] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:27.201393 18322 raft_consensus.cc:2468] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3ad6524ae404f4287e91f045cd49630 in term 1.
I20260709 12:30:27.204205 18371 raft_consensus.cc:2804] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:27.210512 18370 raft_consensus.cc:2749] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:27.216909 18371 raft_consensus.cc:697] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 1 LEADER]: Becoming Leader. State: Replica: b4196549c2db465183f36e9703d6d422, State: Running, Role: LEADER
I20260709 12:30:27.218523 18366 tablet_bootstrap.cc:492] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd: No bootstrap required, opened a new log
I20260709 12:30:27.217940 18371 consensus_queue.cc:237] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.221534 18323 raft_consensus.cc:2468] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 1.
I20260709 12:30:27.219210 18366 ts_tablet_manager.cc:1403] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.004s
I20260709 12:30:27.224376 18363 tablet_bootstrap.cc:492] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422: No bootstrap required, opened a new log
I20260709 12:30:27.224905 18363 ts_tablet_manager.cc:1403] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.008s
I20260709 12:30:27.224619 18248 raft_consensus.cc:2468] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3ad6524ae404f4287e91f045cd49630 in term 1.
I20260709 12:30:27.225559 18366 raft_consensus.cc:359] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.226366 18366 raft_consensus.cc:385] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.226729 18366 raft_consensus.cc:740] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.226431 18139 leader_election.cc:304] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422; no voters: 459af2dc183b4890a69a8bafa457dbfd
I20260709 12:30:27.227556 18372 raft_consensus.cc:2804] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:27.228345 18363 raft_consensus.cc:359] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.229310 18363 raft_consensus.cc:385] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.229626 18363 raft_consensus.cc:740] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4196549c2db465183f36e9703d6d422, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.229830 18366 consensus_queue.cc:260] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.230528 18363 consensus_queue.cc:260] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.231734 18366 ts_tablet_manager.cc:1434] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:30:27.233000 18363 ts_tablet_manager.cc:1434] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:30:27.234071 18363 tablet_bootstrap.cc:492] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422: Bootstrap starting.
I20260709 12:30:27.240689 18366 tablet_bootstrap.cc:492] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd: Bootstrap starting.
I20260709 12:30:27.241061 18363 tablet_bootstrap.cc:654] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:27.241391 18372 raft_consensus.cc:697] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [term 1 LEADER]: Becoming Leader. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Running, Role: LEADER
I20260709 12:30:27.242635 18372 consensus_queue.cc:237] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.246526 18070 catalog_manager.cc:5697] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3ad6524ae404f4287e91f045cd49630 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "b3ad6524ae404f4287e91f045cd49630" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:27.253945 18365 tablet_bootstrap.cc:492] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630: No bootstrap required, opened a new log
I20260709 12:30:27.254613 18365 ts_tablet_manager.cc:1403] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630: Time spent bootstrapping tablet: real 0.109s	user 0.018s	sys 0.006s
I20260709 12:30:27.257699 18071 catalog_manager.cc:5697] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4196549c2db465183f36e9703d6d422 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "b4196549c2db465183f36e9703d6d422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:27.259819 18365 raft_consensus.cc:359] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.254695 18370 raft_consensus.cc:493] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:27.253995 18366 tablet_bootstrap.cc:654] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:27.260979 18370 raft_consensus.cc:515] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.261627 18365 raft_consensus.cc:385] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.262028 18365 raft_consensus.cc:740] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.263304 18370 leader_election.cc:290] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121)
I20260709 12:30:27.263803 18370 raft_consensus.cc:493] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:27.264245 18370 raft_consensus.cc:515] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.264245 18365 consensus_queue.cc:260] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.267665 18365 ts_tablet_manager.cc:1434] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:30:27.268865 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc699d0852fb467faead580ffa7d7c4c" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3ad6524ae404f4287e91f045cd49630" is_pre_election: true
I20260709 12:30:27.269488 18173 raft_consensus.cc:2468] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 0.
I20260709 12:30:27.269716 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc699d0852fb467faead580ffa7d7c4c" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422" is_pre_election: true
I20260709 12:30:27.270220 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedae4fe005741258a43c1b4cf924100" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422" is_pre_election: true
I20260709 12:30:27.270677 18403 raft_consensus.cc:493] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:27.270954 18248 raft_consensus.cc:2468] T aedae4fe005741258a43c1b4cf924100 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 0.
I20260709 12:30:27.271194 18403 raft_consensus.cc:515] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.269661 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedae4fe005741258a43c1b4cf924100" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3ad6524ae404f4287e91f045cd49630" is_pre_election: true
W20260709 12:30:27.271615 18288 leader_election.cc:343] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:27.266196 18370 leader_election.cc:290] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121)
I20260709 12:30:27.273041 18288 leader_election.cc:304] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:27.273373 18403 leader_election.cc:290] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:27.274295 18370 raft_consensus.cc:2804] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:27.274376 18289 leader_election.cc:304] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b3ad6524ae404f4287e91f045cd49630; no voters: b4196549c2db465183f36e9703d6d422
I20260709 12:30:27.274741 18370 raft_consensus.cc:493] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:27.275287 18370 raft_consensus.cc:3060] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.276018 18365 tablet_bootstrap.cc:492] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630: Bootstrap starting.
W20260709 12:30:27.276048 18289 leader_election.cc:343] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:27.279500 18323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4412ee203abc432fa25d402110e4d33e" candidate_uuid: "b3ad6524ae404f4287e91f045cd49630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd" is_pre_election: true
W20260709 12:30:27.281929 18139 leader_election.cc:343] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:27.282976 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4412ee203abc432fa25d402110e4d33e" candidate_uuid: "b3ad6524ae404f4287e91f045cd49630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422" is_pre_election: true
W20260709 12:30:27.284540 18139 leader_election.cc:343] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:27.284904 18363 tablet_bootstrap.cc:492] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422: No bootstrap required, opened a new log
I20260709 12:30:27.285019 18139 leader_election.cc:304] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3ad6524ae404f4287e91f045cd49630; no voters: 459af2dc183b4890a69a8bafa457dbfd, b4196549c2db465183f36e9703d6d422
I20260709 12:30:27.285641 18363 ts_tablet_manager.cc:1403] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.015s
I20260709 12:30:27.286130 18403 raft_consensus.cc:2749] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:27.290453 18365 tablet_bootstrap.cc:654] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:27.289391 18363 raft_consensus.cc:359] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.296344 18363 raft_consensus.cc:385] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.296715 18363 raft_consensus.cc:740] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4196549c2db465183f36e9703d6d422, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.294004 18370 raft_consensus.cc:515] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.292961 18407 raft_consensus.cc:2804] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:27.300427 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedae4fe005741258a43c1b4cf924100" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:27.300729 18363 consensus_queue.cc:260] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.299983 18409 raft_consensus.cc:493] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:27.303030 18365 tablet_bootstrap.cc:492] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630: No bootstrap required, opened a new log
I20260709 12:30:27.303467 18409 raft_consensus.cc:515] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.305174 18366 tablet_bootstrap.cc:492] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd: No bootstrap required, opened a new log
I20260709 12:30:27.305843 18366 ts_tablet_manager.cc:1403] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.008s
I20260709 12:30:27.306556 18365 ts_tablet_manager.cc:1403] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630: Time spent bootstrapping tablet: real 0.031s	user 0.000s	sys 0.014s
I20260709 12:30:27.307780 18363 ts_tablet_manager.cc:1434] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.000s
I20260709 12:30:27.309682 18363 tablet_bootstrap.cc:492] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422: Bootstrap starting.
I20260709 12:30:27.310858 18366 raft_consensus.cc:359] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.311806 18366 raft_consensus.cc:385] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.312135 18366 raft_consensus.cc:740] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.313086 18366 consensus_queue.cc:260] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.318392 18363 tablet_bootstrap.cc:654] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:27.300400 18407 raft_consensus.cc:493] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:27.321767 18409 leader_election.cc:290] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121)
I20260709 12:30:27.321586 18411 raft_consensus.cc:493] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:27.322878 18248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedae4fe005741258a43c1b4cf924100" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422"
I20260709 12:30:27.323108 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd557e285b7f49d488d1bd1356d41885" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422" is_pre_election: true
I20260709 12:30:27.323294 18411 raft_consensus.cc:515] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } } peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } }
I20260709 12:30:27.323777 18248 raft_consensus.cc:3060] T aedae4fe005741258a43c1b4cf924100 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.323992 18249 raft_consensus.cc:2393] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 459af2dc183b4890a69a8bafa457dbfd in current term 1: Already voted for candidate b3ad6524ae404f4287e91f045cd49630 in this term.
I20260709 12:30:27.325531 18411 leader_election.cc:290] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121), b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167)
I20260709 12:30:27.317932 18365 raft_consensus.cc:359] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.326376 18365 raft_consensus.cc:385] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.326493 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a902188d2864995a1bd386dc585c256" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422" is_pre_election: true
I20260709 12:30:27.326709 18365 raft_consensus.cc:740] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.327154 18249 raft_consensus.cc:2468] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 0.
I20260709 12:30:27.327620 18365 consensus_queue.cc:260] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.328382 18288 leader_election.cc:304] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:27.329217 18411 raft_consensus.cc:2804] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:27.329576 18411 raft_consensus.cc:493] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:27.329896 18411 raft_consensus.cc:3060] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.320537 18407 raft_consensus.cc:3060] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.330116 18365 ts_tablet_manager.cc:1434] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.005s
I20260709 12:30:27.319245 18370 leader_election.cc:290] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121)
I20260709 12:30:27.337332 18366 ts_tablet_manager.cc:1434] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.016s
W20260709 12:30:27.321002 18289 leader_election.cc:343] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:27.338380 18366 tablet_bootstrap.cc:492] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd: Bootstrap starting.
I20260709 12:30:27.339047 18365 tablet_bootstrap.cc:492] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630: Bootstrap starting.
I20260709 12:30:27.345803 18366 tablet_bootstrap.cc:654] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:27.341694 18411 raft_consensus.cc:515] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } } peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } }
I20260709 12:30:27.349972 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd557e285b7f49d488d1bd1356d41885" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3ad6524ae404f4287e91f045cd49630" is_pre_election: true
I20260709 12:30:27.352458 18365 tablet_bootstrap.cc:654] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:27.354090 18289 leader_election.cc:304] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd; no voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422
I20260709 12:30:27.354221 18407 raft_consensus.cc:515] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.354749 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a902188d2864995a1bd386dc585c256" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3ad6524ae404f4287e91f045cd49630" is_pre_election: true
I20260709 12:30:27.355348 18370 raft_consensus.cc:3060] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:30:27.356873 18289 leader_election.cc:343] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:27.358839 18363 tablet_bootstrap.cc:492] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422: No bootstrap required, opened a new log
I20260709 12:30:27.359411 18363 ts_tablet_manager.cc:1403] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.007s
I20260709 12:30:27.359727 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a902188d2864995a1bd386dc585c256" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422"
I20260709 12:30:27.360349 18249 raft_consensus.cc:3060] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.362802 18413 raft_consensus.cc:493] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:27.363322 18413 raft_consensus.cc:515] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.365330 18413 leader_election.cc:290] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121)
I20260709 12:30:27.366756 18363 raft_consensus.cc:359] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.367221 18247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c732cf3421d4b4fa6ebafcfd554414a" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422" is_pre_election: true
I20260709 12:30:27.372133 18070 catalog_manager.cc:5697] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3ad6524ae404f4287e91f045cd49630 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "b3ad6524ae404f4287e91f045cd49630" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: UNKNOWN } } }
W20260709 12:30:27.374253 18288 leader_election.cc:343] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:27.368707 18248 raft_consensus.cc:2468] T aedae4fe005741258a43c1b4cf924100 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 1.
I20260709 12:30:27.371960 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc699d0852fb467faead580ffa7d7c4c" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422"
I20260709 12:30:27.375344 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c732cf3421d4b4fa6ebafcfd554414a" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3ad6524ae404f4287e91f045cd49630" is_pre_election: true
I20260709 12:30:27.376398 18288 leader_election.cc:304] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b4196549c2db465183f36e9703d6d422; no voters: b3ad6524ae404f4287e91f045cd49630
I20260709 12:30:27.377534 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc699d0852fb467faead580ffa7d7c4c" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:27.378118 18413 raft_consensus.cc:2804] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:30:27.379163 18289 leader_election.cc:343] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:27.379103 18413 raft_consensus.cc:697] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [term 1 LEADER]: Becoming Leader. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Running, Role: LEADER
I20260709 12:30:27.378224 18174 raft_consensus.cc:3060] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.380885 18413 consensus_queue.cc:237] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.372721 18407 leader_election.cc:290] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121)
I20260709 12:30:27.380503 18363 raft_consensus.cc:385] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.374015 18249 raft_consensus.cc:2468] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 1.
I20260709 12:30:27.385620 18289 leader_election.cc:304] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd; no voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422
I20260709 12:30:27.365340 18370 raft_consensus.cc:2749] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:27.385563 18363 raft_consensus.cc:740] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4196549c2db465183f36e9703d6d422, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.394622 18288 leader_election.cc:304] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:27.386909 18411 leader_election.cc:290] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 election: Requested vote from peers b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121), b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167)
I20260709 12:30:27.396343 18409 raft_consensus.cc:2749] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:27.396415 18407 raft_consensus.cc:2804] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:27.398177 18407 raft_consensus.cc:697] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [term 1 LEADER]: Becoming Leader. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Running, Role: LEADER
I20260709 12:30:27.398645 18174 raft_consensus.cc:2468] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 1.
I20260709 12:30:27.400203 18289 leader_election.cc:304] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b3ad6524ae404f4287e91f045cd49630; no voters: 
I20260709 12:30:27.403793 18411 raft_consensus.cc:2804] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:27.404685 18411 raft_consensus.cc:697] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 1 LEADER]: Becoming Leader. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Running, Role: LEADER
I20260709 12:30:27.400991 18407 consensus_queue.cc:237] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } } peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } }
I20260709 12:30:27.407456 18411 consensus_queue.cc:237] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.405339 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a902188d2864995a1bd386dc585c256" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:27.412801 18371 raft_consensus.cc:493] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:27.413327 18371 raft_consensus.cc:515] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.395426 18363 consensus_queue.cc:260] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.415642 18246 raft_consensus.cc:3060] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.416626 18371 leader_election.cc:290] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:27.426502 18323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4412ee203abc432fa25d402110e4d33e" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd" is_pre_election: true
I20260709 12:30:27.427657 18365 tablet_bootstrap.cc:492] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630: No bootstrap required, opened a new log
I20260709 12:30:27.428231 18365 ts_tablet_manager.cc:1403] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.029s
I20260709 12:30:27.428357 18403 raft_consensus.cc:493] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:30:27.428239 18214 leader_election.cc:343] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:27.428290 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4412ee203abc432fa25d402110e4d33e" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3ad6524ae404f4287e91f045cd49630" is_pre_election: true
I20260709 12:30:27.429121 18403 raft_consensus.cc:515] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.429880 18173 raft_consensus.cc:2468] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 0.
I20260709 12:30:27.431044 18215 leader_election.cc:304] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422; no voters: 459af2dc183b4890a69a8bafa457dbfd
I20260709 12:30:27.431166 18365 raft_consensus.cc:359] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
W20260709 12:30:27.424118 18289 leader_election.cc:343] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:27.431551 18403 leader_election.cc:290] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:27.431839 18365 raft_consensus.cc:385] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.432149 18371 raft_consensus.cc:2804] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:27.432185 18365 raft_consensus.cc:740] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.432689 18371 raft_consensus.cc:493] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:27.433050 18371 raft_consensus.cc:3060] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.433190 18365 consensus_queue.cc:260] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.434000 18323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6865ba7952554654a4f74f0e78728e4c" candidate_uuid: "b3ad6524ae404f4287e91f045cd49630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd" is_pre_election: true
W20260709 12:30:27.435496 18139 leader_election.cc:343] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:27.435600 18246 raft_consensus.cc:2468] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 1.
I20260709 12:30:27.439261 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6865ba7952554654a4f74f0e78728e4c" candidate_uuid: "b3ad6524ae404f4287e91f045cd49630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422" is_pre_election: true
I20260709 12:30:27.440754 18365 ts_tablet_manager.cc:1434] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 12:30:27.440690 18249 raft_consensus.cc:2468] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b3ad6524ae404f4287e91f045cd49630 in term 0.
I20260709 12:30:27.441766 18365 tablet_bootstrap.cc:492] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630: Bootstrap starting.
I20260709 12:30:27.442083 18139 leader_election.cc:304] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422; no voters: 459af2dc183b4890a69a8bafa457dbfd
I20260709 12:30:27.443611 18403 raft_consensus.cc:2804] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:27.444077 18403 raft_consensus.cc:493] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:27.444506 18403 raft_consensus.cc:3060] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.448371 18365 tablet_bootstrap.cc:654] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:27.447855 18070 catalog_manager.cc:5697] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd reported cstate change: term changed from 0 to 1, leader changed from <none> to 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67). New cstate: current_term: 1 leader_uuid: "459af2dc183b4890a69a8bafa457dbfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:27.450199 18366 tablet_bootstrap.cc:492] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd: No bootstrap required, opened a new log
I20260709 12:30:27.451165 18366 ts_tablet_manager.cc:1403] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd: Time spent bootstrapping tablet: real 0.113s	user 0.017s	sys 0.030s
I20260709 12:30:27.460246 18365 tablet_bootstrap.cc:492] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630: No bootstrap required, opened a new log
I20260709 12:30:27.460767 18365 ts_tablet_manager.cc:1403] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630: Time spent bootstrapping tablet: real 0.019s	user 0.003s	sys 0.011s
I20260709 12:30:27.461031 18363 ts_tablet_manager.cc:1434] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422: Time spent starting tablet: real 0.101s	user 0.010s	sys 0.001s
I20260709 12:30:27.462107 18363 tablet_bootstrap.cc:492] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422: Bootstrap starting.
I20260709 12:30:27.462409 18403 raft_consensus.cc:515] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.463531 18365 raft_consensus.cc:359] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.464222 18365 raft_consensus.cc:385] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.464486 18365 raft_consensus.cc:740] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.464592 18403 leader_election.cc:290] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 election: Requested vote from peers b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:27.465271 18365 consensus_queue.cc:260] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.447749 18371 raft_consensus.cc:515] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.466940 18365 ts_tablet_manager.cc:1434] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:30:27.469290 18323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6865ba7952554654a4f74f0e78728e4c" candidate_uuid: "b3ad6524ae404f4287e91f045cd49630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
I20260709 12:30:27.470539 18365 tablet_bootstrap.cc:492] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630: Bootstrap starting.
I20260709 12:30:27.468550 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6865ba7952554654a4f74f0e78728e4c" candidate_uuid: "b3ad6524ae404f4287e91f045cd49630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422"
I20260709 12:30:27.471071 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4412ee203abc432fa25d402110e4d33e" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:27.471323 18249 raft_consensus.cc:3060] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.471661 18173 raft_consensus.cc:3060] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.477568 18365 tablet_bootstrap.cc:654] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:27.479981 18363 tablet_bootstrap.cc:654] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:27.483816 18249 raft_consensus.cc:2468] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3ad6524ae404f4287e91f045cd49630 in term 1.
I20260709 12:30:27.485214 18139 leader_election.cc:304] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:27.486137 18403 raft_consensus.cc:2804] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:27.486685 18403 raft_consensus.cc:697] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 1 LEADER]: Becoming Leader. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Running, Role: LEADER
I20260709 12:30:27.487619 18403 consensus_queue.cc:237] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.488125 18173 raft_consensus.cc:2468] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 1.
I20260709 12:30:27.489673 18215 leader_election.cc:304] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:27.491032 18399 raft_consensus.cc:2804] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:27.493724 18069 catalog_manager.cc:5697] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd reported cstate change: term changed from 0 to 1, leader changed from <none> to 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67). New cstate: current_term: 1 leader_uuid: "459af2dc183b4890a69a8bafa457dbfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:27.497385 18069 catalog_manager.cc:5697] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd reported cstate change: term changed from 0 to 1, leader changed from <none> to 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67). New cstate: current_term: 1 leader_uuid: "459af2dc183b4890a69a8bafa457dbfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:27.467300 18366 raft_consensus.cc:359] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.509160 18322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4412ee203abc432fa25d402110e4d33e" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
I20260709 12:30:27.510118 18371 leader_election.cc:290] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 1 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:27.507964 18423 raft_consensus.cc:493] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:30:27.511881 18214 leader_election.cc:343] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:27.510156 18363 tablet_bootstrap.cc:492] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422: No bootstrap required, opened a new log
I20260709 12:30:27.513818 18423 raft_consensus.cc:515] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.514524 18363 ts_tablet_manager.cc:1403] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.000s
I20260709 12:30:27.509451 18070 catalog_manager.cc:5697] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 reported cstate change: term changed from 0 to 1, leader changed from <none> to b3ad6524ae404f4287e91f045cd49630 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "b3ad6524ae404f4287e91f045cd49630" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:27.517715 18363 raft_consensus.cc:359] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.518464 18363 raft_consensus.cc:385] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.518748 18363 raft_consensus.cc:740] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4196549c2db465183f36e9703d6d422, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.519642 18322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa56b1764974ae6b0a838890e1e30d6" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd" is_pre_election: true
I20260709 12:30:27.519513 18363 consensus_queue.cc:260] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.520285 18322 raft_consensus.cc:2468] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 0.
I20260709 12:30:27.521358 18174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa56b1764974ae6b0a838890e1e30d6" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3ad6524ae404f4287e91f045cd49630" is_pre_election: true
I20260709 12:30:27.521731 18214 leader_election.cc:304] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:27.522028 18174 raft_consensus.cc:2468] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 0.
I20260709 12:30:27.522307 18363 ts_tablet_manager.cc:1434] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:30:27.522843 18371 raft_consensus.cc:2804] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:27.523294 18371 raft_consensus.cc:493] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:27.523633 18371 raft_consensus.cc:3060] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.509553 18366 raft_consensus.cc:385] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.525591 18366 raft_consensus.cc:740] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.526207 18366 consensus_queue.cc:260] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.527275 18323 raft_consensus.cc:3060] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.529117 18366 ts_tablet_manager.cc:1434] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.000s
I20260709 12:30:27.530102 18366 tablet_bootstrap.cc:492] T 4412ee203abc432fa25d402110e4d33e P 459af2dc183b4890a69a8bafa457dbfd: Bootstrap starting.
I20260709 12:30:27.533250 18399 raft_consensus.cc:697] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [term 1 LEADER]: Becoming Leader. State: Replica: b4196549c2db465183f36e9703d6d422, State: Running, Role: LEADER
I20260709 12:30:27.534255 18399 consensus_queue.cc:237] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.536777 18366 tablet_bootstrap.cc:654] T 4412ee203abc432fa25d402110e4d33e P 459af2dc183b4890a69a8bafa457dbfd: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:27.537802 18323 raft_consensus.cc:2468] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b3ad6524ae404f4287e91f045cd49630 in term 1.
I20260709 12:30:27.548795 18366 tablet_bootstrap.cc:492] T 4412ee203abc432fa25d402110e4d33e P 459af2dc183b4890a69a8bafa457dbfd: No bootstrap required, opened a new log
I20260709 12:30:27.549517 18366 ts_tablet_manager.cc:1403] T 4412ee203abc432fa25d402110e4d33e P 459af2dc183b4890a69a8bafa457dbfd: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.003s
I20260709 12:30:27.549628 18072 catalog_manager.cc:5697] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4196549c2db465183f36e9703d6d422 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "b4196549c2db465183f36e9703d6d422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:27.551659 18423 leader_election.cc:290] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:27.553000 18365 tablet_bootstrap.cc:492] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630: No bootstrap required, opened a new log
I20260709 12:30:27.553460 18365 ts_tablet_manager.cc:1403] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630: Time spent bootstrapping tablet: real 0.083s	user 0.034s	sys 0.029s
I20260709 12:30:27.552536 18366 raft_consensus.cc:359] T 4412ee203abc432fa25d402110e4d33e P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.554744 18366 raft_consensus.cc:385] T 4412ee203abc432fa25d402110e4d33e P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.555127 18366 raft_consensus.cc:740] T 4412ee203abc432fa25d402110e4d33e P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.555469 18371 raft_consensus.cc:515] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.556123 18365 raft_consensus.cc:359] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } } peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } }
I20260709 12:30:27.556989 18365 raft_consensus.cc:385] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:27.557278 18365 raft_consensus.cc:740] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Initialized, Role: FOLLOWER
I20260709 12:30:27.557732 18371 leader_election.cc:290] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 1 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:27.557837 18365 consensus_queue.cc:260] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } } peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } }
I20260709 12:30:27.559383 18323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa56b1764974ae6b0a838890e1e30d6" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
I20260709 12:30:27.556056 18366 consensus_queue.cc:260] T 4412ee203abc432fa25d402110e4d33e P 459af2dc183b4890a69a8bafa457dbfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.559985 18323 raft_consensus.cc:3060] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.561829 18366 ts_tablet_manager.cc:1434] T 4412ee203abc432fa25d402110e4d33e P 459af2dc183b4890a69a8bafa457dbfd: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260709 12:30:27.563731 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa56b1764974ae6b0a838890e1e30d6" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:27.564395 18173 raft_consensus.cc:3060] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.567994 18323 raft_consensus.cc:2468] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 1.
I20260709 12:30:27.559995 18365 ts_tablet_manager.cc:1434] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:30:27.570241 18214 leader_election.cc:304] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:27.574468 18371 raft_consensus.cc:2804] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:27.575026 18371 raft_consensus.cc:697] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 1 LEADER]: Becoming Leader. State: Replica: b4196549c2db465183f36e9703d6d422, State: Running, Role: LEADER
I20260709 12:30:27.576071 18173 raft_consensus.cc:2468] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 1.
I20260709 12:30:27.576093 18371 consensus_queue.cc:237] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.583910 18070 catalog_manager.cc:5697] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4196549c2db465183f36e9703d6d422 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "b4196549c2db465183f36e9703d6d422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:27.609165 18371 consensus_queue.cc:1048] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:27.620357 18399 consensus_queue.cc:1048] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:27.628417 18403 consensus_queue.cc:1048] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:27.639897 18403 consensus_queue.cc:1048] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:27.739517 18399 raft_consensus.cc:493] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:27.740137 18399 raft_consensus.cc:515] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.742126 18399 leader_election.cc:290] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:27.742858 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c732cf3421d4b4fa6ebafcfd554414a" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3ad6524ae404f4287e91f045cd49630" is_pre_election: true
I20260709 12:30:27.743183 18322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c732cf3421d4b4fa6ebafcfd554414a" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd" is_pre_election: true
I20260709 12:30:27.743585 18173 raft_consensus.cc:2468] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 0.
I20260709 12:30:27.743791 18322 raft_consensus.cc:2468] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 0.
I20260709 12:30:27.744743 18215 leader_election.cc:304] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:27.745541 18399 raft_consensus.cc:2804] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:27.745947 18399 raft_consensus.cc:493] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:27.746260 18399 raft_consensus.cc:3060] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.751981 18399 raft_consensus.cc:515] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.753921 18399 leader_election.cc:290] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 1 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:27.754976 18173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c732cf3421d4b4fa6ebafcfd554414a" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:27.755358 18322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c732cf3421d4b4fa6ebafcfd554414a" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
I20260709 12:30:27.755638 18173 raft_consensus.cc:3060] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.756112 18322 raft_consensus.cc:3060] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:27.761160 18173 raft_consensus.cc:2468] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 1.
I20260709 12:30:27.761291 18322 raft_consensus.cc:2468] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 1.
I20260709 12:30:27.762398 18215 leader_election.cc:304] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:27.763062 18399 raft_consensus.cc:2804] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:27.763480 18399 raft_consensus.cc:697] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [term 1 LEADER]: Becoming Leader. State: Replica: b4196549c2db465183f36e9703d6d422, State: Running, Role: LEADER
I20260709 12:30:27.764240 18399 consensus_queue.cc:237] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.771667 18069 catalog_manager.cc:5697] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 reported cstate change: term changed from 0 to 1, leader changed from <none> to b4196549c2db465183f36e9703d6d422 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "b4196549c2db465183f36e9703d6d422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:27.786787 18403 consensus_queue.cc:1048] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:27.791638  8637 ts_manager.cc:295] Set tserver state for b3ad6524ae404f4287e91f045cd49630 to MAINTENANCE_MODE
I20260709 12:30:27.792819  8637 tablet_server.cc:179] TabletServer@127.8.111.65:0 shutting down...
I20260709 12:30:27.798982 18372 consensus_queue.cc:1048] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:30:27.811573 18289 consensus_peers.cc:597] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:27.832135 18289 consensus_peers.cc:597] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:27.834558  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:27.836047  8637 tablet_replica.cc:333] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630: stopping tablet replica
I20260709 12:30:27.836839  8637 raft_consensus.cc:2243] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:27.837397  8637 raft_consensus.cc:2272] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:27.840021  8637 tablet_replica.cc:333] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630: stopping tablet replica
I20260709 12:30:27.840615  8637 raft_consensus.cc:2243] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:27.840992  8637 raft_consensus.cc:2272] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:27.843012  8637 tablet_replica.cc:333] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630: stopping tablet replica
I20260709 12:30:27.843559  8637 raft_consensus.cc:2243] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:27.843914  8637 raft_consensus.cc:2272] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:27.845456  8637 tablet_replica.cc:333] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630: stopping tablet replica
I20260709 12:30:27.845966  8637 raft_consensus.cc:2243] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:27.846598  8637 pending_rounds.cc:70] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630: Trying to abort 1 pending ops.
I20260709 12:30:27.846796  8637 pending_rounds.cc:77] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305626531801935872 op_type: NO_OP noop_request { }
I20260709 12:30:27.847163  8637 raft_consensus.cc:2889] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:30:27.847427  8637 raft_consensus.cc:2272] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:27.849267  8637 tablet_replica.cc:333] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630: stopping tablet replica
I20260709 12:30:27.849792  8637 raft_consensus.cc:2243] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:27.850154  8637 raft_consensus.cc:2272] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:27.851852  8637 tablet_replica.cc:333] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630: stopping tablet replica
I20260709 12:30:27.852384  8637 raft_consensus.cc:2243] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:27.853120  8637 raft_consensus.cc:2272] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:27.855472  8637 tablet_replica.cc:333] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630: stopping tablet replica
I20260709 12:30:27.856046  8637 raft_consensus.cc:2243] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:27.856446  8637 raft_consensus.cc:2272] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:27.858115  8637 tablet_replica.cc:333] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630: stopping tablet replica
I20260709 12:30:27.858677  8637 raft_consensus.cc:2243] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:27.859504  8637 raft_consensus.cc:2272] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:27.861686  8637 tablet_replica.cc:333] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630: stopping tablet replica
I20260709 12:30:27.862229  8637 raft_consensus.cc:2243] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:27.862771  8637 raft_consensus.cc:2272] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:27.864442  8637 tablet_replica.cc:333] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630: stopping tablet replica
I20260709 12:30:27.864890  8637 raft_consensus.cc:2243] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:27.865273  8637 raft_consensus.cc:2272] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:27.874881 18407 consensus_queue.cc:1048] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:27.899336 18407 raft_consensus.cc:493] T 4412ee203abc432fa25d402110e4d33e P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:27.899853 18407 raft_consensus.cc:515] T 4412ee203abc432fa25d402110e4d33e P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:27.900274  8637 tablet_server.cc:196] TabletServer@127.8.111.65:0 shutdown complete.
I20260709 12:30:27.901646 18407 leader_election.cc:290] T 4412ee203abc432fa25d402110e4d33e P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121)
I20260709 12:30:27.902943 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4412ee203abc432fa25d402110e4d33e" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422" is_pre_election: true
W20260709 12:30:27.906615 18289 leader_election.cc:336] T 4412ee203abc432fa25d402110e4d33e P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111)
I20260709 12:30:27.907112 18289 leader_election.cc:304] T 4412ee203abc432fa25d402110e4d33e P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd; no voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422
I20260709 12:30:27.907752 18407 raft_consensus.cc:2749] T 4412ee203abc432fa25d402110e4d33e P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:27.930948 18407 consensus_queue.cc:1048] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:30:27.943590 18289 consensus_peers.cc:597] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:27.977823 18215 consensus_peers.cc:597] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:28.012405 18413 consensus_queue.cc:1048] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:28.052569 18322 raft_consensus.cc:3060] T 4412ee203abc432fa25d402110e4d33e P 459af2dc183b4890a69a8bafa457dbfd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:28.059587 18399 consensus_queue.cc:1048] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:30:28.073158 18215 consensus_peers.cc:597] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:28.083314 18215 consensus_peers.cc:597] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:28.097083 18120 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:30:28.180393 18371 consensus_queue.cc:1048] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:30:28.317931 18215 consensus_peers.cc:597] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:28.367360 18371 consensus_queue.cc:1048] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:30:29.098145 18120 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:30:29.138624 18407 raft_consensus.cc:493] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3ad6524ae404f4287e91f045cd49630)
I20260709 12:30:29.139168 18407 raft_consensus.cc:515] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:29.140841 18407 leader_election.cc:290] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121)
I20260709 12:30:29.141964 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd557e285b7f49d488d1bd1356d41885" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422" is_pre_election: true
I20260709 12:30:29.143757 18423 raft_consensus.cc:493] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3ad6524ae404f4287e91f045cd49630)
I20260709 12:30:29.144455 18423 raft_consensus.cc:515] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
W20260709 12:30:29.144887 18289 leader_election.cc:336] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111)
I20260709 12:30:29.145385 18289 leader_election.cc:304] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd; no voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422
I20260709 12:30:29.145999 18407 raft_consensus.cc:2749] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:29.146502 18423 leader_election.cc:290] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:29.147997 18322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd557e285b7f49d488d1bd1356d41885" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd" is_pre_election: true
I20260709 12:30:29.148620 18322 raft_consensus.cc:2468] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 1.
I20260709 12:30:29.149749 18214 leader_election.cc:304] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b4196549c2db465183f36e9703d6d422; no voters: 
W20260709 12:30:29.150204 18215 leader_election.cc:336] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111)
I20260709 12:30:29.150432 18423 raft_consensus.cc:2804] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:29.150821 18423 raft_consensus.cc:493] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3ad6524ae404f4287e91f045cd49630)
I20260709 12:30:29.151176 18423 raft_consensus.cc:3060] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:29.156217 18423 raft_consensus.cc:515] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:29.157883 18423 leader_election.cc:290] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 2 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:29.159008 18322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd557e285b7f49d488d1bd1356d41885" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
I20260709 12:30:29.159547 18322 raft_consensus.cc:3060] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:30:29.161216 18215 leader_election.cc:336] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111)
I20260709 12:30:29.164731 18322 raft_consensus.cc:2468] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 2.
I20260709 12:30:29.165644 18214 leader_election.cc:304] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b4196549c2db465183f36e9703d6d422; no voters: b3ad6524ae404f4287e91f045cd49630
I20260709 12:30:29.166302 18423 raft_consensus.cc:2804] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:29.167383 18423 raft_consensus.cc:697] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [term 2 LEADER]: Becoming Leader. State: Replica: b4196549c2db465183f36e9703d6d422, State: Running, Role: LEADER
I20260709 12:30:29.168226 18423 consensus_queue.cc:237] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:29.174714 18070 catalog_manager.cc:5697] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 reported cstate change: term changed from 1 to 2, leader changed from b3ad6524ae404f4287e91f045cd49630 (127.8.111.65) to b4196549c2db465183f36e9703d6d422 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "b4196549c2db465183f36e9703d6d422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:29.306053 18407 raft_consensus.cc:493] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3ad6524ae404f4287e91f045cd49630)
I20260709 12:30:29.306645 18407 raft_consensus.cc:515] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:29.308617 18407 leader_election.cc:290] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121)
I20260709 12:30:29.308843 18423 raft_consensus.cc:493] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b3ad6524ae404f4287e91f045cd49630)
I20260709 12:30:29.309455 18423 raft_consensus.cc:515] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:29.309819 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422" is_pre_election: true
I20260709 12:30:29.310549 18246 raft_consensus.cc:2468] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 1.
I20260709 12:30:29.312016 18423 leader_election.cc:290] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:29.312178 18288 leader_election.cc:304] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:29.314126 18407 raft_consensus.cc:2804] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:30:29.314756 18407 raft_consensus.cc:493] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Starting leader election (detected failure of leader b3ad6524ae404f4287e91f045cd49630)
I20260709 12:30:29.315361 18407 raft_consensus.cc:3060] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:30:29.318568 18215 leader_election.cc:336] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111)
I20260709 12:30:29.321206 18322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd" is_pre_election: true
W20260709 12:30:29.322595 18289 leader_election.cc:336] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111)
I20260709 12:30:29.324869 18407 raft_consensus.cc:515] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:29.325800 18322 raft_consensus.cc:2393] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b4196549c2db465183f36e9703d6d422 in current term 2: Already voted for candidate 459af2dc183b4890a69a8bafa457dbfd in this term.
I20260709 12:30:29.326695 18407 leader_election.cc:290] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 2 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121)
I20260709 12:30:29.327909 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422"
I20260709 12:30:29.327696 18214 leader_election.cc:304] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b4196549c2db465183f36e9703d6d422; no voters: 459af2dc183b4890a69a8bafa457dbfd, b3ad6524ae404f4287e91f045cd49630
I20260709 12:30:29.328460 18246 raft_consensus.cc:3060] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:30:29.330492 18289 leader_election.cc:336] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111)
I20260709 12:30:29.334265 18246 raft_consensus.cc:2468] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 2.
I20260709 12:30:29.335047 18423 raft_consensus.cc:2749] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:29.335615 18288 leader_election.cc:304] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b4196549c2db465183f36e9703d6d422; no voters: b3ad6524ae404f4287e91f045cd49630
I20260709 12:30:29.336460 18407 raft_consensus.cc:2804] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:29.337589 18407 raft_consensus.cc:697] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 2 LEADER]: Becoming Leader. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Running, Role: LEADER
I20260709 12:30:29.338367 18407 consensus_queue.cc:237] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:29.345258 18070 catalog_manager.cc:5697] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd reported cstate change: term changed from 1 to 2, leader changed from b3ad6524ae404f4287e91f045cd49630 (127.8.111.65) to 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67). New cstate: current_term: 2 leader_uuid: "459af2dc183b4890a69a8bafa457dbfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:29.426776 18423 raft_consensus.cc:493] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:29.427256 18423 raft_consensus.cc:515] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:29.428875 18423 leader_election.cc:290] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:29.429986 18323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6865ba7952554654a4f74f0e78728e4c" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd" is_pre_election: true
W20260709 12:30:29.430161 18215 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111) [suppressed 117 similar messages]
I20260709 12:30:29.430729 18323 raft_consensus.cc:2468] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 1.
I20260709 12:30:29.431805 18214 leader_election.cc:304] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:29.432564 18423 raft_consensus.cc:2804] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:30:29.433054 18215 leader_election.cc:336] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111)
I20260709 12:30:29.433458 18423 raft_consensus.cc:493] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:29.433847 18423 raft_consensus.cc:3060] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:29.439018 18423 raft_consensus.cc:515] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:29.440608 18423 leader_election.cc:290] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 2 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:29.441638 18323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6865ba7952554654a4f74f0e78728e4c" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
I20260709 12:30:29.442253 18323 raft_consensus.cc:3060] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:30:29.443686 18215 leader_election.cc:336] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111)
I20260709 12:30:29.447420 18323 raft_consensus.cc:2468] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 2.
I20260709 12:30:29.448354 18214 leader_election.cc:304] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b4196549c2db465183f36e9703d6d422; no voters: b3ad6524ae404f4287e91f045cd49630
I20260709 12:30:29.448992 18423 raft_consensus.cc:2804] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:29.449373 18423 raft_consensus.cc:697] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 2 LEADER]: Becoming Leader. State: Replica: b4196549c2db465183f36e9703d6d422, State: Running, Role: LEADER
I20260709 12:30:29.449970 18423 consensus_queue.cc:237] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:29.457541 18070 catalog_manager.cc:5697] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 reported cstate change: term changed from 1 to 2, leader changed from b3ad6524ae404f4287e91f045cd49630 (127.8.111.65) to b4196549c2db465183f36e9703d6d422 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "b4196549c2db465183f36e9703d6d422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:29.662617 18323 raft_consensus.cc:1275] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Refusing update from remote peer b4196549c2db465183f36e9703d6d422: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:29.663897 18423 consensus_queue.cc:1048] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:30:29.678159 18215 consensus_peers.cc:597] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:29.744351 18246 raft_consensus.cc:1275] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Refusing update from remote peer 459af2dc183b4890a69a8bafa457dbfd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:29.745501 18407 consensus_queue.cc:1048] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:30:29.758234 18289 consensus_peers.cc:597] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:29.863154 18215 consensus_peers.cc:597] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:29.978137 18323 raft_consensus.cc:1275] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Refusing update from remote peer b4196549c2db465183f36e9703d6d422: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:30:29.979466 18423 consensus_queue.cc:1048] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:30:30.099187 18120 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:30:30.259111 18289 consensus_peers.cc:597] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:30.404357 18215 consensus_peers.cc:597] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:30.419265 18289 consensus_peers.cc:597] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:30.513075 18215 consensus_peers.cc:597] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:30.520795 18215 consensus_peers.cc:597] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:30.587807 18289 consensus_peers.cc:597] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:31.090793 18215 consensus_peers.cc:597] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:31.100292 18120 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:30:32.016376 18215 consensus_peers.cc:597] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:32.101392 18120 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:30:32.242034 18289 consensus_peers.cc:597] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:32.301769 18215 consensus_peers.cc:597] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:30:32.821890 18289 consensus_peers.cc:597] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:30:32.922958  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:32.929778 18466 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:32.929973 18467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:32.931834 18469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:32.938851  8637 server_base.cc:1061] running on GCE node
I20260709 12:30:32.942233  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:32.942550  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:32.942792  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600232942767 us; error 0 us; skew 500 ppm
I20260709 12:30:32.943406  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:32.946674  8637 webserver.cc:533] Webserver started at http://127.8.111.65:34155/ using document root <none> and password file <none>
I20260709 12:30:32.947191  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:32.947423  8637 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:30:32.951238  8637 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:30:32.955097 18474 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:32.955853  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:30:32.956184  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/ts-0-root
uuid: "b3ad6524ae404f4287e91f045cd49630"
format_stamp: "Formatted at 2026-07-09 12:30:26 on dist-test-slave-044g"
I20260709 12:30:32.956583  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599876290468-8637-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:32.970467  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:32.971664  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:32.973172  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:32.977371 18481 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 12:30:33.005570 18289 consensus_peers.cc:597] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:33.012830 18215 consensus_peers.cc:597] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:30:33.014626 18215 consensus_peers.cc:597] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:30:33.032948  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:30:33.033336  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.057s	user 0.004s	sys 0.000s
I20260709 12:30:33.033731  8637 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
W20260709 12:30:33.035597 18215 consensus_peers.cc:597] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:30:33.038818 18481 tablet_bootstrap.cc:492] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630: Bootstrap starting.
I20260709 12:30:33.052153 18481 tablet_bootstrap.cc:492] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:33.053092 18481 tablet_bootstrap.cc:492] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630: Bootstrap complete.
I20260709 12:30:33.053718 18481 ts_tablet_manager.cc:1403] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:30:33.056212 18481 raft_consensus.cc:359] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.056744 18481 raft_consensus.cc:740] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.057425 18481 consensus_queue.cc:260] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.059703 18481 ts_tablet_manager.cc:1434] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.004s
I20260709 12:30:33.060370 18481 tablet_bootstrap.cc:492] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630: Bootstrap starting.
I20260709 12:30:33.069589  8637 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:30:33.069927  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.036s	user 0.033s	sys 0.000s
I20260709 12:30:33.072767 18481 tablet_bootstrap.cc:492] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:33.073560 18481 tablet_bootstrap.cc:492] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630: Bootstrap complete.
I20260709 12:30:33.074116 18481 ts_tablet_manager.cc:1403] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:30:33.076151 18481 raft_consensus.cc:359] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.076679 18481 raft_consensus.cc:740] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.077344 18481 consensus_queue.cc:260] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.079347 18481 ts_tablet_manager.cc:1434] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:30:33.080091 18481 tablet_bootstrap.cc:492] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630: Bootstrap starting.
I20260709 12:30:33.096314 18481 tablet_bootstrap.cc:492] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:33.097285 18481 tablet_bootstrap.cc:492] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630: Bootstrap complete.
I20260709 12:30:33.097976 18481 ts_tablet_manager.cc:1403] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.007s
I20260709 12:30:33.100664 18481 raft_consensus.cc:359] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.101253 18481 raft_consensus.cc:740] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Initialized, Role: FOLLOWER
W20260709 12:30:33.102267 18120 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:30:33.102510 18481 consensus_queue.cc:260] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.104548 18481 ts_tablet_manager.cc:1434] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:30:33.105499 18481 tablet_bootstrap.cc:492] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630: Bootstrap starting.
I20260709 12:30:33.116683 18481 tablet_bootstrap.cc:492] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:33.117353 18481 tablet_bootstrap.cc:492] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630: Bootstrap complete.
I20260709 12:30:33.117951 18481 ts_tablet_manager.cc:1403] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 12:30:33.120415 18481 raft_consensus.cc:359] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.121151 18481 raft_consensus.cc:740] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.121799 18481 consensus_queue.cc:260] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.123749 18481 ts_tablet_manager.cc:1434] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:30:33.124581 18481 tablet_bootstrap.cc:492] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630: Bootstrap starting.
I20260709 12:30:33.133956 18481 tablet_bootstrap.cc:492] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:33.134670 18481 tablet_bootstrap.cc:492] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630: Bootstrap complete.
I20260709 12:30:33.135205 18481 ts_tablet_manager.cc:1403] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:30:33.137205 18481 raft_consensus.cc:359] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } } peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } }
I20260709 12:30:33.137724 18481 raft_consensus.cc:385] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:33.137955 18481 raft_consensus.cc:740] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.138621 18481 consensus_queue.cc:260] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } } peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } }
I20260709 12:30:33.140493 18481 ts_tablet_manager.cc:1434] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:30:33.141227 18481 tablet_bootstrap.cc:492] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630: Bootstrap starting.
I20260709 12:30:33.142210  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.65:46167
I20260709 12:30:33.142375 18543 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.65:46167 every 8 connection(s)
I20260709 12:30:33.147468  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:33.152503 18481 tablet_bootstrap.cc:492] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:30:33.153596 18481 tablet_bootstrap.cc:492] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630: Bootstrap complete.
I20260709 12:30:33.154320 18481 ts_tablet_manager.cc:1403] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.001s
I20260709 12:30:33.156757 18481 raft_consensus.cc:359] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.157578 18481 raft_consensus.cc:740] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.158380 18481 consensus_queue.cc:260] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.160342 18481 ts_tablet_manager.cc:1434] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:30:33.161531 18481 tablet_bootstrap.cc:492] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630: Bootstrap starting.
I20260709 12:30:33.172814 18544 heartbeater.cc:344] Connected to a master server at 127.8.111.126:44977
I20260709 12:30:33.173314 18544 heartbeater.cc:461] Registering TS with master...
I20260709 12:30:33.174196 18481 tablet_bootstrap.cc:492] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:33.174785 18544 heartbeater.cc:507] Master 127.8.111.126:44977 requested a full tablet report, sending...
I20260709 12:30:33.175050 18481 tablet_bootstrap.cc:492] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630: Bootstrap complete.
I20260709 12:30:33.175763 18481 ts_tablet_manager.cc:1403] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:30:33.178223 18481 raft_consensus.cc:359] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.179154 18246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fa56b1764974ae6b0a838890e1e30d6"
dest_uuid: "b4196549c2db465183f36e9703d6d422"
mode: GRACEFUL
new_leader_uuid: "459af2dc183b4890a69a8bafa457dbfd"
 from {username='slave'} at 127.0.0.1:53130
I20260709 12:30:33.179531 18481 raft_consensus.cc:740] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.179868 18246 raft_consensus.cc:606] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 1 LEADER]: Received request to transfer leadership to TS 459af2dc183b4890a69a8bafa457dbfd
I20260709 12:30:33.180272 18481 consensus_queue.cc:260] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.182452 18481 ts_tablet_manager.cc:1434] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:30:33.183445 18481 tablet_bootstrap.cc:492] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630: Bootstrap starting.
I20260709 12:30:33.183857 18246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6865ba7952554654a4f74f0e78728e4c"
dest_uuid: "b4196549c2db465183f36e9703d6d422"
mode: GRACEFUL
new_leader_uuid: "459af2dc183b4890a69a8bafa457dbfd"
 from {username='slave'} at 127.0.0.1:53130
I20260709 12:30:33.184442 18246 raft_consensus.cc:606] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 2 LEADER]: Received request to transfer leadership to TS 459af2dc183b4890a69a8bafa457dbfd
I20260709 12:30:33.185940  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:30:33.186955  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:33.188023  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:33.188560 18069 ts_manager.cc:194] Re-registered known tserver with Master: b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167)
I20260709 12:30:33.203392 18069 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44360
I20260709 12:30:33.205484 18481 tablet_bootstrap.cc:492] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:33.206521 18481 tablet_bootstrap.cc:492] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630: Bootstrap complete.
I20260709 12:30:33.207202 18481 ts_tablet_manager.cc:1403] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.003s
I20260709 12:30:33.207475 18544 heartbeater.cc:499] Master 127.8.111.126:44977 was elected leader, sending a full tablet report...
I20260709 12:30:33.209637 18481 raft_consensus.cc:359] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.210172 18481 raft_consensus.cc:740] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.210937 18481 consensus_queue.cc:260] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.212725 18481 ts_tablet_manager.cc:1434] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:30:33.213580 18481 tablet_bootstrap.cc:492] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630: Bootstrap starting.
I20260709 12:30:33.225795 18481 tablet_bootstrap.cc:492] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:33.226686 18481 tablet_bootstrap.cc:492] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630: Bootstrap complete.
I20260709 12:30:33.227401 18481 ts_tablet_manager.cc:1403] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.002s
I20260709 12:30:33.229923 18481 raft_consensus.cc:359] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.230587 18481 raft_consensus.cc:385] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:33.230849 18481 raft_consensus.cc:740] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.231510 18481 consensus_queue.cc:260] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.233505 18481 ts_tablet_manager.cc:1434] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:30:33.234197 18481 tablet_bootstrap.cc:492] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630: Bootstrap starting.
I20260709 12:30:33.247917 18481 tablet_bootstrap.cc:492] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:30:33.248646 18481 tablet_bootstrap.cc:492] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630: Bootstrap complete.
I20260709 12:30:33.249161 18481 ts_tablet_manager.cc:1403] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:30:33.250919 18481 raft_consensus.cc:359] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.251395 18481 raft_consensus.cc:740] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3ad6524ae404f4287e91f045cd49630, State: Initialized, Role: FOLLOWER
I20260709 12:30:33.252012 18481 consensus_queue.cc:260] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.253310 18481 ts_tablet_manager.cc:1434] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:30:33.256836 18556 raft_consensus.cc:493] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:33.257408 18556 raft_consensus.cc:515] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.260138 18556 leader_election.cc:290] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:33.274531 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedae4fe005741258a43c1b4cf924100" candidate_uuid: "b3ad6524ae404f4287e91f045cd49630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422" is_pre_election: true
I20260709 12:30:33.278376 18323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aedae4fe005741258a43c1b4cf924100" candidate_uuid: "b3ad6524ae404f4287e91f045cd49630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd" is_pre_election: true
I20260709 12:30:33.279654 18477 leader_election.cc:304] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3ad6524ae404f4287e91f045cd49630; no voters: 459af2dc183b4890a69a8bafa457dbfd, b4196549c2db465183f36e9703d6d422
I20260709 12:30:33.281425 18556 raft_consensus.cc:2749] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:33.282267 18517 raft_consensus.cc:3060] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.323781 18517 raft_consensus.cc:3060] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:33.328806 18517 pending_rounds.cc:85] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630: Aborting all ops after (but not including) 0
I20260709 12:30:33.329078 18517 pending_rounds.cc:107] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:30:33.329324 18517 raft_consensus.cc:2889] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:30:33.357738 18556 raft_consensus.cc:493] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:33.358309 18556 raft_consensus.cc:515] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } } peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } }
I20260709 12:30:33.360229 18556 leader_election.cc:290] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:33.361063 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a902188d2864995a1bd386dc585c256" candidate_uuid: "b3ad6524ae404f4287e91f045cd49630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b4196549c2db465183f36e9703d6d422" is_pre_election: true
I20260709 12:30:33.361414 18323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a902188d2864995a1bd386dc585c256" candidate_uuid: "b3ad6524ae404f4287e91f045cd49630" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "459af2dc183b4890a69a8bafa457dbfd" is_pre_election: true
I20260709 12:30:33.362725 18477 leader_election.cc:304] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b3ad6524ae404f4287e91f045cd49630; no voters: 459af2dc183b4890a69a8bafa457dbfd, b4196549c2db465183f36e9703d6d422
I20260709 12:30:33.363327 18556 raft_consensus.cc:2749] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:33.451741 18565 raft_consensus.cc:993] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422: : Instructing follower 459af2dc183b4890a69a8bafa457dbfd to start an election
I20260709 12:30:33.452656 18465 raft_consensus.cc:1081] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 2 LEADER]: Signalling peer 459af2dc183b4890a69a8bafa457dbfd to start an election
I20260709 12:30:33.454527 18323 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6865ba7952554654a4f74f0e78728e4c"
dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
 from {username='slave'} at 127.0.0.1:47386
I20260709 12:30:33.455384 18323 raft_consensus.cc:493] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:33.455819 18323 raft_consensus.cc:3060] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:33.461607 18323 raft_consensus.cc:515] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.463265 18323 leader_election.cc:290] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 3 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121)
I20260709 12:30:33.464133 18517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6865ba7952554654a4f74f0e78728e4c" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:33.464294 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6865ba7952554654a4f74f0e78728e4c" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b4196549c2db465183f36e9703d6d422"
I20260709 12:30:33.464824 18517 raft_consensus.cc:3060] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:33.464877 18246 raft_consensus.cc:3055] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:33.465360 18246 raft_consensus.cc:740] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b4196549c2db465183f36e9703d6d422, State: Running, Role: LEADER
I20260709 12:30:33.466027 18246 consensus_queue.cc:260] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.467052 18246 raft_consensus.cc:3060] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:33.470301 18517 raft_consensus.cc:2468] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 3.
I20260709 12:30:33.471519 18289 leader_election.cc:304] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b3ad6524ae404f4287e91f045cd49630; no voters: 
I20260709 12:30:33.472163 18246 raft_consensus.cc:2468] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 3.
I20260709 12:30:33.472347 18561 raft_consensus.cc:2804] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:33.472962 18561 raft_consensus.cc:697] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [term 3 LEADER]: Becoming Leader. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Running, Role: LEADER
I20260709 12:30:33.473744 18561 consensus_queue.cc:237] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.480719 18069 catalog_manager.cc:5697] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd reported cstate change: term changed from 2 to 3, leader changed from b4196549c2db465183f36e9703d6d422 (127.8.111.66) to 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67). New cstate: current_term: 3 leader_uuid: "459af2dc183b4890a69a8bafa457dbfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:33.517843 18517 raft_consensus.cc:3060] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:33.541039 18517 raft_consensus.cc:3060] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:33.612159 18516 raft_consensus.cc:3060] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:33.701767 18576 raft_consensus.cc:993] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422: : Instructing follower 459af2dc183b4890a69a8bafa457dbfd to start an election
I20260709 12:30:33.702200 18565 raft_consensus.cc:1081] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 1 LEADER]: Signalling peer 459af2dc183b4890a69a8bafa457dbfd to start an election
I20260709 12:30:33.703466 18322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fa56b1764974ae6b0a838890e1e30d6"
dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
 from {username='slave'} at 127.0.0.1:47386
I20260709 12:30:33.703974 18322 raft_consensus.cc:493] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:33.704337 18322 raft_consensus.cc:3060] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:33.709491 18322 raft_consensus.cc:515] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.711050 18322 leader_election.cc:290] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 2 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121)
I20260709 12:30:33.711802 18516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa56b1764974ae6b0a838890e1e30d6" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:33.712090 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa56b1764974ae6b0a838890e1e30d6" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4196549c2db465183f36e9703d6d422"
I20260709 12:30:33.712450 18516 raft_consensus.cc:3060] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:33.712692 18246 raft_consensus.cc:3055] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:33.713045 18246 raft_consensus.cc:740] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b4196549c2db465183f36e9703d6d422, State: Running, Role: LEADER
I20260709 12:30:33.713868 18246 consensus_queue.cc:260] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.715150 18246 raft_consensus.cc:3060] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:33.719504 18516 raft_consensus.cc:2468] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 2.
I20260709 12:30:33.720744 18289 leader_election.cc:304] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b3ad6524ae404f4287e91f045cd49630; no voters: 
I20260709 12:30:33.721444 18561 raft_consensus.cc:2804] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:33.721948 18561 raft_consensus.cc:697] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 2 LEADER]: Becoming Leader. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Running, Role: LEADER
I20260709 12:30:33.721885 18246 raft_consensus.cc:2468] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 2.
I20260709 12:30:33.723033 18561 consensus_queue.cc:237] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:33.729911 18069 catalog_manager.cc:5697] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd reported cstate change: term changed from 1 to 2, leader changed from b4196549c2db465183f36e9703d6d422 (127.8.111.66) to 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67). New cstate: current_term: 2 leader_uuid: "459af2dc183b4890a69a8bafa457dbfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:33.979077 18516 raft_consensus.cc:1275] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 3 FOLLOWER]: Refusing update from remote peer 459af2dc183b4890a69a8bafa457dbfd: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:33.980297 18578 consensus_queue.cc:1048] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:33.990015 18246 raft_consensus.cc:1275] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 3 FOLLOWER]: Refusing update from remote peer 459af2dc183b4890a69a8bafa457dbfd: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:30:33.991823 18578 consensus_queue.cc:1048] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:30:34.103278 18120 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:30:34.167690 18516 raft_consensus.cc:1275] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Refusing update from remote peer 459af2dc183b4890a69a8bafa457dbfd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:34.169015 18582 consensus_queue.cc:1048] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:34.176191 18246 raft_consensus.cc:1275] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Refusing update from remote peer 459af2dc183b4890a69a8bafa457dbfd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:34.177997 18582 consensus_queue.cc:1048] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:34.206437  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:34.225448 18322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0"
dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
mode: GRACEFUL
new_leader_uuid: "b4196549c2db465183f36e9703d6d422"
 from {username='slave'} at 127.0.0.1:47402
I20260709 12:30:34.225994 18322 raft_consensus.cc:606] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 2 LEADER]: Received request to transfer leadership to TS b4196549c2db465183f36e9703d6d422
I20260709 12:30:34.228852 18246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c732cf3421d4b4fa6ebafcfd554414a"
dest_uuid: "b4196549c2db465183f36e9703d6d422"
mode: GRACEFUL
new_leader_uuid: "459af2dc183b4890a69a8bafa457dbfd"
 from {username='slave'} at 127.0.0.1:53130
I20260709 12:30:34.229439 18246 raft_consensus.cc:606] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [term 1 LEADER]: Received request to transfer leadership to TS 459af2dc183b4890a69a8bafa457dbfd
I20260709 12:30:34.232547 18322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc699d0852fb467faead580ffa7d7c4c"
dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
mode: GRACEFUL
new_leader_uuid: "b4196549c2db465183f36e9703d6d422"
 from {username='slave'} at 127.0.0.1:47402
I20260709 12:30:34.233098 18322 raft_consensus.cc:606] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 1 LEADER]: Received request to transfer leadership to TS b4196549c2db465183f36e9703d6d422
I20260709 12:30:34.234503  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:30:34.235409  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:34.236094  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:34.536667 18578 raft_consensus.cc:993] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd: : Instructing follower b4196549c2db465183f36e9703d6d422 to start an election
I20260709 12:30:34.537247 18582 raft_consensus.cc:1081] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 2 LEADER]: Signalling peer b4196549c2db465183f36e9703d6d422 to start an election
I20260709 12:30:34.538708 18246 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0"
dest_uuid: "b4196549c2db465183f36e9703d6d422"
 from {username='slave'} at 127.0.0.1:53114
I20260709 12:30:34.539193 18246 raft_consensus.cc:493] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:34.539496 18246 raft_consensus.cc:3060] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:34.544381 18246 raft_consensus.cc:515] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:34.546025 18246 leader_election.cc:290] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 3 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:34.547222 18322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
I20260709 12:30:34.547015 18516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:34.547899 18322 raft_consensus.cc:3055] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:34.548049 18516 raft_consensus.cc:3060] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:34.548238 18322 raft_consensus.cc:740] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Running, Role: LEADER
I20260709 12:30:34.549387 18322 consensus_queue.cc:260] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:34.550654 18322 raft_consensus.cc:3060] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:34.555787 18516 raft_consensus.cc:2468] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 3.
I20260709 12:30:34.557034 18215 leader_election.cc:304] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:34.557575 18322 raft_consensus.cc:2468] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 3.
I20260709 12:30:34.557713 18576 raft_consensus.cc:2804] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:34.558370 18576 raft_consensus.cc:697] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 3 LEADER]: Becoming Leader. State: Replica: b4196549c2db465183f36e9703d6d422, State: Running, Role: LEADER
I20260709 12:30:34.559134 18576 consensus_queue.cc:237] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:34.566776 18069 catalog_manager.cc:5697] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 reported cstate change: term changed from 2 to 3, leader changed from 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67) to b4196549c2db465183f36e9703d6d422 (127.8.111.66). New cstate: current_term: 3 leader_uuid: "b4196549c2db465183f36e9703d6d422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:34.607501 18561 raft_consensus.cc:993] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd: : Instructing follower b4196549c2db465183f36e9703d6d422 to start an election
I20260709 12:30:34.607998 18578 raft_consensus.cc:1081] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 1 LEADER]: Signalling peer b4196549c2db465183f36e9703d6d422 to start an election
I20260709 12:30:34.609499 18246 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc699d0852fb467faead580ffa7d7c4c"
dest_uuid: "b4196549c2db465183f36e9703d6d422"
 from {username='slave'} at 127.0.0.1:53114
I20260709 12:30:34.610067 18246 raft_consensus.cc:493] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:34.610384 18246 raft_consensus.cc:3060] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:34.616590 18246 raft_consensus.cc:515] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:34.617959 18246 leader_election.cc:290] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 2 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:34.618779 18516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc699d0852fb467faead580ffa7d7c4c" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:34.619050 18322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc699d0852fb467faead580ffa7d7c4c" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
I20260709 12:30:34.619426 18516 raft_consensus.cc:3060] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:34.619617 18322 raft_consensus.cc:3055] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:34.619987 18322 raft_consensus.cc:740] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Running, Role: LEADER
I20260709 12:30:34.620806 18322 consensus_queue.cc:260] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:34.621999 18322 raft_consensus.cc:3060] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:34.626601 18516 raft_consensus.cc:2468] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 2.
I20260709 12:30:34.627818 18215 leader_election.cc:304] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:34.628589 18465 raft_consensus.cc:2804] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:34.629050 18465 raft_consensus.cc:697] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [term 2 LEADER]: Becoming Leader. State: Replica: b4196549c2db465183f36e9703d6d422, State: Running, Role: LEADER
I20260709 12:30:34.629855 18465 consensus_queue.cc:237] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:34.629837 18322 raft_consensus.cc:2468] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 2.
I20260709 12:30:34.637814 18069 catalog_manager.cc:5697] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 reported cstate change: term changed from 1 to 2, leader changed from 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67) to b4196549c2db465183f36e9703d6d422 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "b4196549c2db465183f36e9703d6d422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:34.716830 18565 raft_consensus.cc:993] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422: : Instructing follower 459af2dc183b4890a69a8bafa457dbfd to start an election
I20260709 12:30:34.717306 18465 raft_consensus.cc:1081] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [term 1 LEADER]: Signalling peer 459af2dc183b4890a69a8bafa457dbfd to start an election
I20260709 12:30:34.718761 18322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c732cf3421d4b4fa6ebafcfd554414a"
dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
 from {username='slave'} at 127.0.0.1:47386
I20260709 12:30:34.719233 18322 raft_consensus.cc:493] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:34.719517 18322 raft_consensus.cc:3060] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:34.724401 18322 raft_consensus.cc:515] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:34.726222 18322 leader_election.cc:290] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 2 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121)
I20260709 12:30:34.727015 18516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c732cf3421d4b4fa6ebafcfd554414a" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:34.727123 18246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c732cf3421d4b4fa6ebafcfd554414a" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4196549c2db465183f36e9703d6d422"
I20260709 12:30:34.727604 18516 raft_consensus.cc:3060] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:34.727735 18246 raft_consensus.cc:3055] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:34.728169 18246 raft_consensus.cc:740] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b4196549c2db465183f36e9703d6d422, State: Running, Role: LEADER
I20260709 12:30:34.728797 18246 consensus_queue.cc:260] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:34.729692 18246 raft_consensus.cc:3060] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:34.732767 18516 raft_consensus.cc:2468] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 2.
I20260709 12:30:34.733837 18289 leader_election.cc:304] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b3ad6524ae404f4287e91f045cd49630; no voters: 
I20260709 12:30:34.734215 18246 raft_consensus.cc:2468] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 2.
I20260709 12:30:34.734728 18578 raft_consensus.cc:2804] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:34.735201 18578 raft_consensus.cc:697] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [term 2 LEADER]: Becoming Leader. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Running, Role: LEADER
I20260709 12:30:34.735898 18578 consensus_queue.cc:237] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:34.742650 18069 catalog_manager.cc:5697] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd reported cstate change: term changed from 1 to 2, leader changed from b4196549c2db465183f36e9703d6d422 (127.8.111.66) to 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67). New cstate: current_term: 2 leader_uuid: "459af2dc183b4890a69a8bafa457dbfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:34.983170 18516 raft_consensus.cc:1275] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 3 FOLLOWER]: Refusing update from remote peer b4196549c2db465183f36e9703d6d422: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:34.984333 18465 consensus_queue.cc:1048] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:34.995407 18322 raft_consensus.cc:1275] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 3 FOLLOWER]: Refusing update from remote peer b4196549c2db465183f36e9703d6d422: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:34.996845 18565 consensus_queue.cc:1048] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:35.009841 18516 raft_consensus.cc:1275] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Refusing update from remote peer b4196549c2db465183f36e9703d6d422: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:35.011086 18565 consensus_queue.cc:1048] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:35.019320 18322 raft_consensus.cc:1275] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Refusing update from remote peer b4196549c2db465183f36e9703d6d422: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:35.021176 18576 consensus_queue.cc:1048] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:30:35.104293 18120 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:30:35.241712 18516 raft_consensus.cc:1275] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Refusing update from remote peer 459af2dc183b4890a69a8bafa457dbfd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:35.243100  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:35.243065 18582 consensus_queue.cc:1048] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:35.252446 18246 raft_consensus.cc:1275] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Refusing update from remote peer 459af2dc183b4890a69a8bafa457dbfd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:35.254899 18601 consensus_queue.cc:1048] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:35.257105 18246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0"
dest_uuid: "b4196549c2db465183f36e9703d6d422"
mode: GRACEFUL
new_leader_uuid: "459af2dc183b4890a69a8bafa457dbfd"
 from {username='slave'} at 127.0.0.1:53130
I20260709 12:30:35.257683 18246 raft_consensus.cc:606] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 3 LEADER]: Received request to transfer leadership to TS 459af2dc183b4890a69a8bafa457dbfd
I20260709 12:30:35.264840 18322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fa56b1764974ae6b0a838890e1e30d6"
dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
mode: GRACEFUL
new_leader_uuid: "b4196549c2db465183f36e9703d6d422"
 from {username='slave'} at 127.0.0.1:47402
I20260709 12:30:35.265434 18322 raft_consensus.cc:606] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 2 LEADER]: Received request to transfer leadership to TS b4196549c2db465183f36e9703d6d422
I20260709 12:30:35.267932 18249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7beb8f7a0b2e4d049f4959b99fcccc03"
dest_uuid: "b4196549c2db465183f36e9703d6d422"
mode: GRACEFUL
new_leader_uuid: "459af2dc183b4890a69a8bafa457dbfd"
 from {username='slave'} at 127.0.0.1:53130
I20260709 12:30:35.268486 18249 raft_consensus.cc:606] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 1 LEADER]: Received request to transfer leadership to TS 459af2dc183b4890a69a8bafa457dbfd
I20260709 12:30:35.270501  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:30:35.270998  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:35.271551  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:35.423204 18565 raft_consensus.cc:993] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422: : Instructing follower 459af2dc183b4890a69a8bafa457dbfd to start an election
I20260709 12:30:35.423710 18576 raft_consensus.cc:1081] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 1 LEADER]: Signalling peer 459af2dc183b4890a69a8bafa457dbfd to start an election
I20260709 12:30:35.425212 18322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7beb8f7a0b2e4d049f4959b99fcccc03"
dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
 from {username='slave'} at 127.0.0.1:47386
I20260709 12:30:35.425738 18322 raft_consensus.cc:493] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:35.426060 18322 raft_consensus.cc:3060] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:35.431262 18322 raft_consensus.cc:515] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:35.432826 18322 leader_election.cc:290] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 2 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121)
I20260709 12:30:35.433600 18516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beb8f7a0b2e4d049f4959b99fcccc03" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:35.433776 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beb8f7a0b2e4d049f4959b99fcccc03" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b4196549c2db465183f36e9703d6d422"
I20260709 12:30:35.434175 18516 raft_consensus.cc:3060] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:35.434404 18249 raft_consensus.cc:3055] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:35.434789 18249 raft_consensus.cc:740] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b4196549c2db465183f36e9703d6d422, State: Running, Role: LEADER
I20260709 12:30:35.435484 18249 consensus_queue.cc:260] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:35.436400 18249 raft_consensus.cc:3060] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:35.439227 18516 raft_consensus.cc:2468] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 2.
I20260709 12:30:35.440284 18289 leader_election.cc:304] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b3ad6524ae404f4287e91f045cd49630; no voters: 
I20260709 12:30:35.441102 18602 raft_consensus.cc:2804] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:35.441524 18602 raft_consensus.cc:697] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 2 LEADER]: Becoming Leader. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Running, Role: LEADER
I20260709 12:30:35.441632 18249 raft_consensus.cc:2468] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 2.
I20260709 12:30:35.442394 18602 consensus_queue.cc:237] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:35.449137 18070 catalog_manager.cc:5697] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd reported cstate change: term changed from 1 to 2, leader changed from b4196549c2db465183f36e9703d6d422 (127.8.111.66) to 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67). New cstate: current_term: 2 leader_uuid: "459af2dc183b4890a69a8bafa457dbfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:35.495891 18565 raft_consensus.cc:993] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422: : Instructing follower 459af2dc183b4890a69a8bafa457dbfd to start an election
I20260709 12:30:35.496354 18576 raft_consensus.cc:1081] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 3 LEADER]: Signalling peer 459af2dc183b4890a69a8bafa457dbfd to start an election
I20260709 12:30:35.497882 18322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0"
dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
 from {username='slave'} at 127.0.0.1:47386
I20260709 12:30:35.498360 18322 raft_consensus.cc:493] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:35.498642 18322 raft_consensus.cc:3060] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:35.504004 18322 raft_consensus.cc:515] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:35.505478 18322 leader_election.cc:290] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 4 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121)
I20260709 12:30:35.506227 18516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:35.506454 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b4196549c2db465183f36e9703d6d422"
I20260709 12:30:35.506911 18516 raft_consensus.cc:3060] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:35.506976 18249 raft_consensus.cc:3055] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:30:35.507397 18249 raft_consensus.cc:740] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b4196549c2db465183f36e9703d6d422, State: Running, Role: LEADER
I20260709 12:30:35.508231 18249 consensus_queue.cc:260] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:35.509507 18249 raft_consensus.cc:3060] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:35.514137 18516 raft_consensus.cc:2468] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 4.
I20260709 12:30:35.515372 18289 leader_election.cc:304] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b3ad6524ae404f4287e91f045cd49630; no voters: 
I20260709 12:30:35.516088 18602 raft_consensus.cc:2804] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:30:35.516206 18249 raft_consensus.cc:2468] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 4.
I20260709 12:30:35.516606 18602 raft_consensus.cc:697] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 4 LEADER]: Becoming Leader. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Running, Role: LEADER
I20260709 12:30:35.517426 18602 consensus_queue.cc:237] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:35.523669 18070 catalog_manager.cc:5697] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd reported cstate change: term changed from 3 to 4, leader changed from b4196549c2db465183f36e9703d6d422 (127.8.111.66) to 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67). New cstate: current_term: 4 leader_uuid: "459af2dc183b4890a69a8bafa457dbfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:35.699440 18602 raft_consensus.cc:993] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd: : Instructing follower b4196549c2db465183f36e9703d6d422 to start an election
I20260709 12:30:35.699847 18578 raft_consensus.cc:1081] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 2 LEADER]: Signalling peer b4196549c2db465183f36e9703d6d422 to start an election
I20260709 12:30:35.701049 18249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fa56b1764974ae6b0a838890e1e30d6"
dest_uuid: "b4196549c2db465183f36e9703d6d422"
 from {username='slave'} at 127.0.0.1:53114
I20260709 12:30:35.701552 18249 raft_consensus.cc:493] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:35.701905 18249 raft_consensus.cc:3060] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:35.707990 18249 raft_consensus.cc:515] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:35.709688 18249 leader_election.cc:290] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 3 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:35.710345 18516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa56b1764974ae6b0a838890e1e30d6" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:35.710649 18322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa56b1764974ae6b0a838890e1e30d6" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
I20260709 12:30:35.711110 18516 raft_consensus.cc:3060] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:35.711228 18322 raft_consensus.cc:3055] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:35.711704 18322 raft_consensus.cc:740] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Running, Role: LEADER
I20260709 12:30:35.712462 18322 consensus_queue.cc:260] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:35.713292 18322 raft_consensus.cc:3060] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:35.716295 18516 raft_consensus.cc:2468] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 3.
I20260709 12:30:35.717442 18215 leader_election.cc:304] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:35.717540 18322 raft_consensus.cc:2468] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 3.
I20260709 12:30:35.718205 18576 raft_consensus.cc:2804] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:35.718767 18576 raft_consensus.cc:697] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 3 LEADER]: Becoming Leader. State: Replica: b4196549c2db465183f36e9703d6d422, State: Running, Role: LEADER
I20260709 12:30:35.719549 18576 consensus_queue.cc:237] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:35.726835 18070 catalog_manager.cc:5697] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 reported cstate change: term changed from 2 to 3, leader changed from 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67) to b4196549c2db465183f36e9703d6d422 (127.8.111.66). New cstate: current_term: 3 leader_uuid: "b4196549c2db465183f36e9703d6d422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:35.914515 18516 raft_consensus.cc:1275] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Refusing update from remote peer 459af2dc183b4890a69a8bafa457dbfd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:35.915804 18578 consensus_queue.cc:1048] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:35.918416 18249 raft_consensus.cc:1275] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Refusing update from remote peer 459af2dc183b4890a69a8bafa457dbfd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:35.920523 18578 consensus_queue.cc:1048] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:36.054590 18516 raft_consensus.cc:1275] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 4 FOLLOWER]: Refusing update from remote peer 459af2dc183b4890a69a8bafa457dbfd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:30:36.056169 18582 consensus_queue.cc:1048] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:30:36.058488 18249 raft_consensus.cc:1275] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 4 FOLLOWER]: Refusing update from remote peer 459af2dc183b4890a69a8bafa457dbfd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:30:36.059854 18582 consensus_queue.cc:1048] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:30:36.105386 18120 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:30:36.134884 18516 raft_consensus.cc:1275] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 3 FOLLOWER]: Refusing update from remote peer b4196549c2db465183f36e9703d6d422: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:36.136586 18576 consensus_queue.cc:1048] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:36.145318 18322 raft_consensus.cc:1275] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 3 FOLLOWER]: Refusing update from remote peer b4196549c2db465183f36e9703d6d422: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:36.147008 18576 consensus_queue.cc:1048] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:36.278048  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:36.285465 18322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a902188d2864995a1bd386dc585c256"
dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
mode: GRACEFUL
new_leader_uuid: "b4196549c2db465183f36e9703d6d422"
 from {username='slave'} at 127.0.0.1:47402
I20260709 12:30:36.285970 18322 raft_consensus.cc:606] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [term 1 LEADER]: Received request to transfer leadership to TS b4196549c2db465183f36e9703d6d422
I20260709 12:30:36.288455 18322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7beb8f7a0b2e4d049f4959b99fcccc03"
dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
mode: GRACEFUL
new_leader_uuid: "b4196549c2db465183f36e9703d6d422"
 from {username='slave'} at 127.0.0.1:47402
I20260709 12:30:36.288872 18322 raft_consensus.cc:606] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 2 LEADER]: Received request to transfer leadership to TS b4196549c2db465183f36e9703d6d422
I20260709 12:30:36.291077 18249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc699d0852fb467faead580ffa7d7c4c"
dest_uuid: "b4196549c2db465183f36e9703d6d422"
mode: GRACEFUL
new_leader_uuid: "459af2dc183b4890a69a8bafa457dbfd"
 from {username='slave'} at 127.0.0.1:53130
I20260709 12:30:36.291615 18249 raft_consensus.cc:606] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [term 2 LEADER]: Received request to transfer leadership to TS 459af2dc183b4890a69a8bafa457dbfd
I20260709 12:30:36.292709  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:30:36.293162  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:36.293678  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:36.465457 18602 raft_consensus.cc:993] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd: : Instructing follower b4196549c2db465183f36e9703d6d422 to start an election
I20260709 12:30:36.465935 18578 raft_consensus.cc:1081] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [term 1 LEADER]: Signalling peer b4196549c2db465183f36e9703d6d422 to start an election
I20260709 12:30:36.467257 18249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a902188d2864995a1bd386dc585c256"
dest_uuid: "b4196549c2db465183f36e9703d6d422"
 from {username='slave'} at 127.0.0.1:53114
I20260709 12:30:36.467731 18249 raft_consensus.cc:493] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:36.468048 18249 raft_consensus.cc:3060] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:36.472766 18249 raft_consensus.cc:515] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } } peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } }
I20260709 12:30:36.474287 18249 leader_election.cc:290] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 2 election: Requested vote from peers 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607), b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167)
I20260709 12:30:36.474943 18322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a902188d2864995a1bd386dc585c256" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
I20260709 12:30:36.475224 18516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a902188d2864995a1bd386dc585c256" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:36.475492 18322 raft_consensus.cc:3055] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:36.475755 18516 raft_consensus.cc:3060] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:36.475816 18322 raft_consensus.cc:740] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Running, Role: LEADER
I20260709 12:30:36.476624 18322 consensus_queue.cc:260] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } } peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } }
I20260709 12:30:36.477469 18322 raft_consensus.cc:3060] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:36.480314 18516 raft_consensus.cc:2468] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 2.
I20260709 12:30:36.481202 18215 leader_election.cc:304] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:36.481809 18576 raft_consensus.cc:2804] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:36.482060 18322 raft_consensus.cc:2468] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 2.
I20260709 12:30:36.482326 18576 raft_consensus.cc:697] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422 [term 2 LEADER]: Becoming Leader. State: Replica: b4196549c2db465183f36e9703d6d422, State: Running, Role: LEADER
I20260709 12:30:36.483186 18576 consensus_queue.cc:237] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } } peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } }
I20260709 12:30:36.490357 18070 catalog_manager.cc:5697] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422 reported cstate change: term changed from 1 to 2, leader changed from 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67) to b4196549c2db465183f36e9703d6d422 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "b4196549c2db465183f36e9703d6d422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:36.524171 18618 raft_consensus.cc:993] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422: : Instructing follower 459af2dc183b4890a69a8bafa457dbfd to start an election
I20260709 12:30:36.524664 18576 raft_consensus.cc:1081] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [term 2 LEADER]: Signalling peer 459af2dc183b4890a69a8bafa457dbfd to start an election
I20260709 12:30:36.526078 18322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc699d0852fb467faead580ffa7d7c4c"
dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
 from {username='slave'} at 127.0.0.1:47386
I20260709 12:30:36.526477 18322 raft_consensus.cc:493] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:36.526707 18322 raft_consensus.cc:3060] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:36.530958 18322 raft_consensus.cc:515] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:36.532310 18322 leader_election.cc:290] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 3 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121)
I20260709 12:30:36.533120 18516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc699d0852fb467faead580ffa7d7c4c" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:36.533273 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc699d0852fb467faead580ffa7d7c4c" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b4196549c2db465183f36e9703d6d422"
I20260709 12:30:36.533640 18516 raft_consensus.cc:3060] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:36.533893 18249 raft_consensus.cc:3055] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:36.534232 18249 raft_consensus.cc:740] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b4196549c2db465183f36e9703d6d422, State: Running, Role: LEADER
I20260709 12:30:36.534919 18249 consensus_queue.cc:260] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:36.535899 18249 raft_consensus.cc:3060] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:36.538717 18516 raft_consensus.cc:2468] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 3.
I20260709 12:30:36.539793 18289 leader_election.cc:304] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b3ad6524ae404f4287e91f045cd49630; no voters: 
I20260709 12:30:36.540499 18578 raft_consensus.cc:2804] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:36.541164 18578 raft_consensus.cc:697] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 3 LEADER]: Becoming Leader. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Running, Role: LEADER
I20260709 12:30:36.541750 18249 raft_consensus.cc:2468] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 3.
I20260709 12:30:36.541921 18578 consensus_queue.cc:237] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:36.548627 18070 catalog_manager.cc:5697] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd reported cstate change: term changed from 2 to 3, leader changed from b4196549c2db465183f36e9703d6d422 (127.8.111.66) to 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67). New cstate: current_term: 3 leader_uuid: "459af2dc183b4890a69a8bafa457dbfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:36.563851 18602 raft_consensus.cc:993] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd: : Instructing follower b4196549c2db465183f36e9703d6d422 to start an election
I20260709 12:30:36.564304 18578 raft_consensus.cc:1081] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 2 LEADER]: Signalling peer b4196549c2db465183f36e9703d6d422 to start an election
I20260709 12:30:36.565670 18249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7beb8f7a0b2e4d049f4959b99fcccc03"
dest_uuid: "b4196549c2db465183f36e9703d6d422"
 from {username='slave'} at 127.0.0.1:53114
I20260709 12:30:36.566085 18249 raft_consensus.cc:493] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:36.566406 18249 raft_consensus.cc:3060] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:36.571233 18249 raft_consensus.cc:515] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:36.572809 18249 leader_election.cc:290] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 3 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:36.573426 18516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beb8f7a0b2e4d049f4959b99fcccc03" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:36.573942 18322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beb8f7a0b2e4d049f4959b99fcccc03" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
I20260709 12:30:36.574545 18322 raft_consensus.cc:3055] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:36.574800 18322 raft_consensus.cc:740] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Running, Role: LEADER
I20260709 12:30:36.575446 18322 consensus_queue.cc:260] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:36.576292 18322 raft_consensus.cc:3060] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:36.578476 18516 raft_consensus.cc:3060] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:36.580571 18322 raft_consensus.cc:2468] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 3.
I20260709 12:30:36.581528 18214 leader_election.cc:304] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:36.582239 18576 raft_consensus.cc:2804] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:36.582780 18576 raft_consensus.cc:697] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 3 LEADER]: Becoming Leader. State: Replica: b4196549c2db465183f36e9703d6d422, State: Running, Role: LEADER
I20260709 12:30:36.583127 18516 raft_consensus.cc:2468] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 3.
I20260709 12:30:36.583508 18576 consensus_queue.cc:237] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:36.589639 18070 catalog_manager.cc:5697] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 reported cstate change: term changed from 2 to 3, leader changed from 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67) to b4196549c2db465183f36e9703d6d422 (127.8.111.66). New cstate: current_term: 3 leader_uuid: "b4196549c2db465183f36e9703d6d422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:36.928094 18322 raft_consensus.cc:1275] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Refusing update from remote peer b4196549c2db465183f36e9703d6d422: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:36.930163 18618 consensus_queue.cc:1048] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:36.950590 18516 raft_consensus.cc:1275] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Refusing update from remote peer b4196549c2db465183f36e9703d6d422: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:36.955497 18618 consensus_queue.cc:1048] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:36.997298 18249 raft_consensus.cc:1275] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [term 3 FOLLOWER]: Refusing update from remote peer 459af2dc183b4890a69a8bafa457dbfd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:36.999110 18578 consensus_queue.cc:1048] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:37.011924 18516 raft_consensus.cc:1275] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630 [term 3 FOLLOWER]: Refusing update from remote peer 459af2dc183b4890a69a8bafa457dbfd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:37.014256 18578 consensus_queue.cc:1048] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:37.068346 18516 raft_consensus.cc:1275] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 3 FOLLOWER]: Refusing update from remote peer b4196549c2db465183f36e9703d6d422: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:37.069941 18618 consensus_queue.cc:1048] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:37.081169 18322 raft_consensus.cc:1275] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 3 FOLLOWER]: Refusing update from remote peer b4196549c2db465183f36e9703d6d422: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:37.082825 18618 consensus_queue.cc:1048] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:30:37.106587 18120 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:30:37.300625  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:37.309943 18322 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0"
dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
mode: GRACEFUL
new_leader_uuid: "b4196549c2db465183f36e9703d6d422"
 from {username='slave'} at 127.0.0.1:47402
I20260709 12:30:37.310580 18322 raft_consensus.cc:606] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 4 LEADER]: Received request to transfer leadership to TS b4196549c2db465183f36e9703d6d422
I20260709 12:30:37.313146 18249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fa56b1764974ae6b0a838890e1e30d6"
dest_uuid: "b4196549c2db465183f36e9703d6d422"
mode: GRACEFUL
new_leader_uuid: "459af2dc183b4890a69a8bafa457dbfd"
 from {username='slave'} at 127.0.0.1:53130
I20260709 12:30:37.313628 18249 raft_consensus.cc:606] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 3 LEADER]: Received request to transfer leadership to TS 459af2dc183b4890a69a8bafa457dbfd
I20260709 12:30:37.316165 18249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7beb8f7a0b2e4d049f4959b99fcccc03"
dest_uuid: "b4196549c2db465183f36e9703d6d422"
mode: GRACEFUL
new_leader_uuid: "459af2dc183b4890a69a8bafa457dbfd"
 from {username='slave'} at 127.0.0.1:53130
I20260709 12:30:37.316673 18249 raft_consensus.cc:606] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 3 LEADER]: Received request to transfer leadership to TS 459af2dc183b4890a69a8bafa457dbfd
I20260709 12:30:37.317778  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:30:37.318331  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:37.319043  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:37.470865 18576 raft_consensus.cc:993] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422: : Instructing follower 459af2dc183b4890a69a8bafa457dbfd to start an election
I20260709 12:30:37.471405 18618 raft_consensus.cc:1081] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 3 LEADER]: Signalling peer 459af2dc183b4890a69a8bafa457dbfd to start an election
I20260709 12:30:37.473031 18322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7beb8f7a0b2e4d049f4959b99fcccc03"
dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
 from {username='slave'} at 127.0.0.1:47386
I20260709 12:30:37.473544 18322 raft_consensus.cc:493] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:37.473905 18322 raft_consensus.cc:3060] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:37.480439 18322 raft_consensus.cc:515] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:37.481938 18322 leader_election.cc:290] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 4 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121)
I20260709 12:30:37.482825 18516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beb8f7a0b2e4d049f4959b99fcccc03" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:37.483072 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7beb8f7a0b2e4d049f4959b99fcccc03" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b4196549c2db465183f36e9703d6d422"
I20260709 12:30:37.483474 18516 raft_consensus.cc:3060] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:37.483695 18249 raft_consensus.cc:3055] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:30:37.484050 18249 raft_consensus.cc:740] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b4196549c2db465183f36e9703d6d422, State: Running, Role: LEADER
I20260709 12:30:37.484894 18249 consensus_queue.cc:260] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:37.486145 18249 raft_consensus.cc:3060] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:37.490268 18516 raft_consensus.cc:2468] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 4.
I20260709 12:30:37.491482 18289 leader_election.cc:304] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b3ad6524ae404f4287e91f045cd49630; no voters: 
I20260709 12:30:37.492213 18578 raft_consensus.cc:2804] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:30:37.492683 18578 raft_consensus.cc:697] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 4 LEADER]: Becoming Leader. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Running, Role: LEADER
I20260709 12:30:37.493666 18578 consensus_queue.cc:237] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:37.494136 18249 raft_consensus.cc:2468] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 4.
I20260709 12:30:37.499900 18070 catalog_manager.cc:5697] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd reported cstate change: term changed from 3 to 4, leader changed from b4196549c2db465183f36e9703d6d422 (127.8.111.66) to 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67). New cstate: current_term: 4 leader_uuid: "459af2dc183b4890a69a8bafa457dbfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:37.674547 18641 raft_consensus.cc:993] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd: : Instructing follower b4196549c2db465183f36e9703d6d422 to start an election
I20260709 12:30:37.675096 18602 raft_consensus.cc:1081] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 4 LEADER]: Signalling peer b4196549c2db465183f36e9703d6d422 to start an election
I20260709 12:30:37.676433 18249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0"
dest_uuid: "b4196549c2db465183f36e9703d6d422"
 from {username='slave'} at 127.0.0.1:53114
I20260709 12:30:37.676869 18249 raft_consensus.cc:493] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:37.677155 18249 raft_consensus.cc:3060] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:30:37.681991 18249 raft_consensus.cc:515] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:37.683595 18249 leader_election.cc:290] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 5 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67:43607)
I20260709 12:30:37.684221 18516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:37.684623 18322 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01ea941634d04818819c1b7270d28dd0" candidate_uuid: "b4196549c2db465183f36e9703d6d422" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
I20260709 12:30:37.684852 18516 raft_consensus.cc:3060] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:30:37.685156 18322 raft_consensus.cc:3055] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:30:37.685472 18322 raft_consensus.cc:740] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Running, Role: LEADER
I20260709 12:30:37.686440 18322 consensus_queue.cc:260] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:37.687772 18322 raft_consensus.cc:3060] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:30:37.691442 18516 raft_consensus.cc:2468] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 5.
I20260709 12:30:37.692516 18215 leader_election.cc:304] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b3ad6524ae404f4287e91f045cd49630, b4196549c2db465183f36e9703d6d422; no voters: 
I20260709 12:30:37.693176 18618 raft_consensus.cc:2804] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:30:37.693627 18618 raft_consensus.cc:697] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 5 LEADER]: Becoming Leader. State: Replica: b4196549c2db465183f36e9703d6d422, State: Running, Role: LEADER
I20260709 12:30:37.693909 18322 raft_consensus.cc:2468] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b4196549c2db465183f36e9703d6d422 in term 5.
I20260709 12:30:37.694729 18618 consensus_queue.cc:237] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:37.701890 18070 catalog_manager.cc:5697] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 reported cstate change: term changed from 4 to 5, leader changed from 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67) to b4196549c2db465183f36e9703d6d422 (127.8.111.66). New cstate: current_term: 5 leader_uuid: "b4196549c2db465183f36e9703d6d422" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:37.747750 18576 raft_consensus.cc:993] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422: : Instructing follower 459af2dc183b4890a69a8bafa457dbfd to start an election
I20260709 12:30:37.748220 18618 raft_consensus.cc:1081] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 3 LEADER]: Signalling peer 459af2dc183b4890a69a8bafa457dbfd to start an election
I20260709 12:30:37.749570 18322 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fa56b1764974ae6b0a838890e1e30d6"
dest_uuid: "459af2dc183b4890a69a8bafa457dbfd"
 from {username='slave'} at 127.0.0.1:47386
I20260709 12:30:37.750015 18322 raft_consensus.cc:493] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:37.750310 18322 raft_consensus.cc:3060] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:37.755303 18322 raft_consensus.cc:515] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:37.757027 18322 leader_election.cc:290] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 4 election: Requested vote from peers b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167), b4196549c2db465183f36e9703d6d422 (127.8.111.66:46121)
I20260709 12:30:37.757504 18516 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa56b1764974ae6b0a838890e1e30d6" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b3ad6524ae404f4287e91f045cd49630"
I20260709 12:30:37.757859 18249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa56b1764974ae6b0a838890e1e30d6" candidate_uuid: "459af2dc183b4890a69a8bafa457dbfd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b4196549c2db465183f36e9703d6d422"
I20260709 12:30:37.758314 18516 raft_consensus.cc:3060] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:37.758553 18249 raft_consensus.cc:3055] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:30:37.758870 18249 raft_consensus.cc:740] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b4196549c2db465183f36e9703d6d422, State: Running, Role: LEADER
I20260709 12:30:37.759698 18249 consensus_queue.cc:260] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:37.761023 18249 raft_consensus.cc:3060] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:30:37.765007 18516 raft_consensus.cc:2468] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 4.
I20260709 12:30:37.766053 18289 leader_election.cc:304] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 459af2dc183b4890a69a8bafa457dbfd, b3ad6524ae404f4287e91f045cd49630; no voters: 
I20260709 12:30:37.766832 18602 raft_consensus.cc:2804] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:30:37.767316 18602 raft_consensus.cc:697] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 4 LEADER]: Becoming Leader. State: Replica: 459af2dc183b4890a69a8bafa457dbfd, State: Running, Role: LEADER
I20260709 12:30:37.768244 18249 raft_consensus.cc:2468] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 459af2dc183b4890a69a8bafa457dbfd in term 4.
I20260709 12:30:37.768625 18602 consensus_queue.cc:237] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } }
I20260709 12:30:37.775691 18070 catalog_manager.cc:5697] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd reported cstate change: term changed from 3 to 4, leader changed from b4196549c2db465183f36e9703d6d422 (127.8.111.66) to 459af2dc183b4890a69a8bafa457dbfd (127.8.111.67). New cstate: current_term: 4 leader_uuid: "459af2dc183b4890a69a8bafa457dbfd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:38.092945 18249 raft_consensus.cc:1275] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 4 FOLLOWER]: Refusing update from remote peer 459af2dc183b4890a69a8bafa457dbfd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:30:38.094075 18602 consensus_queue.cc:1048] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:30:38.104087 18516 raft_consensus.cc:1275] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 4 FOLLOWER]: Refusing update from remote peer 459af2dc183b4890a69a8bafa457dbfd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:30:38.105589 18602 consensus_queue.cc:1048] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:30:38.107760 18120 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:30:38.256254 18249 raft_consensus.cc:1275] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 4 FOLLOWER]: Refusing update from remote peer 459af2dc183b4890a69a8bafa457dbfd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:30:38.257529 18602 consensus_queue.cc:1048] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4196549c2db465183f36e9703d6d422" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 46121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:30:38.265575 18516 raft_consensus.cc:1275] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 4 FOLLOWER]: Refusing update from remote peer 459af2dc183b4890a69a8bafa457dbfd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:30:38.266971 18641 consensus_queue.cc:1048] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:30:38.273754 18517 raft_consensus.cc:1275] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 5 FOLLOWER]: Refusing update from remote peer b4196549c2db465183f36e9703d6d422: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:30:38.275450 18618 consensus_queue.cc:1048] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b3ad6524ae404f4287e91f045cd49630" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 46167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:30:38.290342 18322 raft_consensus.cc:1275] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 5 FOLLOWER]: Refusing update from remote peer b4196549c2db465183f36e9703d6d422: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:30:38.292802 18618 consensus_queue.cc:1048] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [LEADER]: Connected to new peer: Peer: permanent_uuid: "459af2dc183b4890a69a8bafa457dbfd" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 43607 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:30:38.325004  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:38.358471  8637 tablet_server.cc:179] TabletServer@127.8.111.65:46167 shutting down...
I20260709 12:30:38.387405  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:38.388154  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:38.388908  8637 raft_consensus.cc:2243] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:38.389453  8637 raft_consensus.cc:2272] T aedae4fe005741258a43c1b4cf924100 P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.392124  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:38.392805  8637 raft_consensus.cc:2243] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:38.393373  8637 raft_consensus.cc:2272] T 6865ba7952554654a4f74f0e78728e4c P b3ad6524ae404f4287e91f045cd49630 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.395900  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:38.396397  8637 raft_consensus.cc:2243] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:38.396829  8637 raft_consensus.cc:2272] T dc699d0852fb467faead580ffa7d7c4c P b3ad6524ae404f4287e91f045cd49630 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.398998  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:38.399570  8637 raft_consensus.cc:2243] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:38.400074  8637 raft_consensus.cc:2272] T 01ea941634d04818819c1b7270d28dd0 P b3ad6524ae404f4287e91f045cd49630 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.403590  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:38.404311  8637 raft_consensus.cc:2243] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:38.404845  8637 raft_consensus.cc:2272] T dd557e285b7f49d488d1bd1356d41885 P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.407387  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:38.407934  8637 raft_consensus.cc:2243] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:38.408388  8637 raft_consensus.cc:2272] T 2a902188d2864995a1bd386dc585c256 P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.410648  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:38.411190  8637 raft_consensus.cc:2243] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:38.411669  8637 raft_consensus.cc:2272] T 4c732cf3421d4b4fa6ebafcfd554414a P b3ad6524ae404f4287e91f045cd49630 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.414191  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:38.414776  8637 raft_consensus.cc:2243] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:38.415282  8637 raft_consensus.cc:2272] T 4412ee203abc432fa25d402110e4d33e P b3ad6524ae404f4287e91f045cd49630 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.417447  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:38.417959  8637 raft_consensus.cc:2243] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:38.418457  8637 raft_consensus.cc:2272] T 4fa56b1764974ae6b0a838890e1e30d6 P b3ad6524ae404f4287e91f045cd49630 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.421103  8637 tablet_replica.cc:333] stopping tablet replica
I20260709 12:30:38.421587  8637 raft_consensus.cc:2243] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:38.422050  8637 raft_consensus.cc:2272] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b3ad6524ae404f4287e91f045cd49630 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.454715  8637 tablet_server.cc:196] TabletServer@127.8.111.65:46167 shutdown complete.
I20260709 12:30:38.483114  8637 tablet_server.cc:179] TabletServer@127.8.111.66:0 shutting down...
I20260709 12:30:38.508793  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:38.509539  8637 tablet_replica.cc:333] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422: stopping tablet replica
I20260709 12:30:38.510246  8637 raft_consensus.cc:2243] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:38.510866  8637 raft_consensus.cc:2272] T 4c732cf3421d4b4fa6ebafcfd554414a P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.513188  8637 tablet_replica.cc:333] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422: stopping tablet replica
I20260709 12:30:38.513742  8637 raft_consensus.cc:2243] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:38.514654  8637 raft_consensus.cc:2272] T 4412ee203abc432fa25d402110e4d33e P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.516929  8637 tablet_replica.cc:333] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422: stopping tablet replica
I20260709 12:30:38.517482  8637 raft_consensus.cc:2243] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:38.517964  8637 raft_consensus.cc:2272] T 6865ba7952554654a4f74f0e78728e4c P b4196549c2db465183f36e9703d6d422 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.520171  8637 tablet_replica.cc:333] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422: stopping tablet replica
I20260709 12:30:38.520735  8637 raft_consensus.cc:2243] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:38.521152  8637 raft_consensus.cc:2272] T dc699d0852fb467faead580ffa7d7c4c P b4196549c2db465183f36e9703d6d422 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.523164  8637 tablet_replica.cc:333] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422: stopping tablet replica
I20260709 12:30:38.523729  8637 raft_consensus.cc:2243] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:30:38.524477  8637 raft_consensus.cc:2272] T 01ea941634d04818819c1b7270d28dd0 P b4196549c2db465183f36e9703d6d422 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.527305  8637 tablet_replica.cc:333] T aedae4fe005741258a43c1b4cf924100 P b4196549c2db465183f36e9703d6d422: stopping tablet replica
I20260709 12:30:38.528051  8637 raft_consensus.cc:2243] T aedae4fe005741258a43c1b4cf924100 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:38.528724  8637 raft_consensus.cc:2272] T aedae4fe005741258a43c1b4cf924100 P b4196549c2db465183f36e9703d6d422 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:38.530055 18289 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111) [suppressed 77 similar messages]
I20260709 12:30:38.531653  8637 tablet_replica.cc:333] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422: stopping tablet replica
I20260709 12:30:38.532408  8637 raft_consensus.cc:2243] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:38.533639  8637 raft_consensus.cc:2272] T dd557e285b7f49d488d1bd1356d41885 P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:38.535210 18289 consensus_peers.cc:597] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd -> Peer b3ad6524ae404f4287e91f045cd49630 (127.8.111.65:46167): Couldn't send request to peer b3ad6524ae404f4287e91f045cd49630. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:46167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:38.536419  8637 tablet_replica.cc:333] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422: stopping tablet replica
I20260709 12:30:38.537070  8637 raft_consensus.cc:2243] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:38.537799  8637 raft_consensus.cc:2272] T 2a902188d2864995a1bd386dc585c256 P b4196549c2db465183f36e9703d6d422 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.539785  8637 tablet_replica.cc:333] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422: stopping tablet replica
I20260709 12:30:38.540321  8637 raft_consensus.cc:2243] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:38.540740  8637 raft_consensus.cc:2272] T 4fa56b1764974ae6b0a838890e1e30d6 P b4196549c2db465183f36e9703d6d422 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.543205  8637 tablet_replica.cc:333] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422: stopping tablet replica
I20260709 12:30:38.543702  8637 raft_consensus.cc:2243] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:38.544095  8637 raft_consensus.cc:2272] T 7beb8f7a0b2e4d049f4959b99fcccc03 P b4196549c2db465183f36e9703d6d422 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.576895  8637 tablet_server.cc:196] TabletServer@127.8.111.66:0 shutdown complete.
I20260709 12:30:38.601434  8637 tablet_server.cc:179] TabletServer@127.8.111.67:0 shutting down...
I20260709 12:30:38.627077  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:38.627803  8637 tablet_replica.cc:333] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd: stopping tablet replica
I20260709 12:30:38.628509  8637 raft_consensus.cc:2243] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:38.629432  8637 raft_consensus.cc:2272] T 6865ba7952554654a4f74f0e78728e4c P 459af2dc183b4890a69a8bafa457dbfd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.631781  8637 tablet_replica.cc:333] T 4412ee203abc432fa25d402110e4d33e P 459af2dc183b4890a69a8bafa457dbfd: stopping tablet replica
I20260709 12:30:38.632341  8637 raft_consensus.cc:2243] T 4412ee203abc432fa25d402110e4d33e P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:38.632869  8637 raft_consensus.cc:2272] T 4412ee203abc432fa25d402110e4d33e P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.635012  8637 tablet_replica.cc:333] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd: stopping tablet replica
I20260709 12:30:38.635550  8637 raft_consensus.cc:2243] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:38.636358  8637 raft_consensus.cc:2272] T 4c732cf3421d4b4fa6ebafcfd554414a P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.638523  8637 tablet_replica.cc:333] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd: stopping tablet replica
I20260709 12:30:38.639093  8637 raft_consensus.cc:2243] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:38.639501  8637 raft_consensus.cc:2272] T 01ea941634d04818819c1b7270d28dd0 P 459af2dc183b4890a69a8bafa457dbfd [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.642011  8637 tablet_replica.cc:333] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd: stopping tablet replica
I20260709 12:30:38.642629  8637 raft_consensus.cc:2243] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:38.643378  8637 raft_consensus.cc:2272] T dc699d0852fb467faead580ffa7d7c4c P 459af2dc183b4890a69a8bafa457dbfd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.645484  8637 tablet_replica.cc:333] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd: stopping tablet replica
I20260709 12:30:38.645979  8637 raft_consensus.cc:2243] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:38.646857  8637 raft_consensus.cc:2272] T aedae4fe005741258a43c1b4cf924100 P 459af2dc183b4890a69a8bafa457dbfd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.648770  8637 tablet_replica.cc:333] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd: stopping tablet replica
I20260709 12:30:38.649274  8637 raft_consensus.cc:2243] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:38.649745  8637 raft_consensus.cc:2272] T dd557e285b7f49d488d1bd1356d41885 P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.651697  8637 tablet_replica.cc:333] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd: stopping tablet replica
I20260709 12:30:38.652186  8637 raft_consensus.cc:2243] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:38.652607  8637 raft_consensus.cc:2272] T 2a902188d2864995a1bd386dc585c256 P 459af2dc183b4890a69a8bafa457dbfd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.654599  8637 tablet_replica.cc:333] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd: stopping tablet replica
I20260709 12:30:38.655094  8637 raft_consensus.cc:2243] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:30:38.655854  8637 raft_consensus.cc:2272] T 4fa56b1764974ae6b0a838890e1e30d6 P 459af2dc183b4890a69a8bafa457dbfd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.658134  8637 tablet_replica.cc:333] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd: stopping tablet replica
I20260709 12:30:38.658645  8637 raft_consensus.cc:2243] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:30:38.659395  8637 raft_consensus.cc:2272] T 7beb8f7a0b2e4d049f4959b99fcccc03 P 459af2dc183b4890a69a8bafa457dbfd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.693550  8637 tablet_server.cc:196] TabletServer@127.8.111.67:0 shutdown complete.
I20260709 12:30:38.718942  8637 master.cc:562] Master@127.8.111.126:44977 shutting down...
I20260709 12:30:38.740293  8637 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:38.740864  8637 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:38.741199  8637 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1c6a60a5c9e5419aa1e14ff4384f1b32: stopping tablet replica
I20260709 12:30:38.761453  8637 master.cc:584] Master@127.8.111.126:44977 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12843 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:30:38.807801  8637 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.111.126:40917
I20260709 12:30:38.809028  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:38.815032 18661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:38.815069 18660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:38.815760 18663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:38.816543  8637 server_base.cc:1061] running on GCE node
I20260709 12:30:38.817471  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:38.817655  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:38.817826  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600238817811 us; error 0 us; skew 500 ppm
I20260709 12:30:38.818441  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:38.820785  8637 webserver.cc:533] Webserver started at http://127.8.111.126:38993/ using document root <none> and password file <none>
I20260709 12:30:38.821297  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:38.821494  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:38.821766  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:38.822953  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599876290468-8637-0/minicluster-data/master-0-root/instance:
uuid: "88b35d7845ca48a3b8fcfcd189b55087"
format_stamp: "Formatted at 2026-07-09 12:30:38 on dist-test-slave-044g"
I20260709 12:30:38.827512  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:30:38.830897 18668 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:38.831710  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:30:38.832024  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599876290468-8637-0/minicluster-data/master-0-root
uuid: "88b35d7845ca48a3b8fcfcd189b55087"
format_stamp: "Formatted at 2026-07-09 12:30:38 on dist-test-slave-044g"
I20260709 12:30:38.832293  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599876290468-8637-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599876290468-8637-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599876290468-8637-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:38.841976  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:38.843197  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:38.880909  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.126:40917
I20260709 12:30:38.881004 18719 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.126:40917 every 8 connection(s)
I20260709 12:30:38.884728 18720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:38.895990 18720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087: Bootstrap starting.
I20260709 12:30:38.900626 18720 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:38.904582 18720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087: No bootstrap required, opened a new log
I20260709 12:30:38.906627 18720 raft_consensus.cc:359] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88b35d7845ca48a3b8fcfcd189b55087" member_type: VOTER }
I20260709 12:30:38.906967 18720 raft_consensus.cc:385] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:38.907153 18720 raft_consensus.cc:740] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88b35d7845ca48a3b8fcfcd189b55087, State: Initialized, Role: FOLLOWER
I20260709 12:30:38.907714 18720 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88b35d7845ca48a3b8fcfcd189b55087" member_type: VOTER }
I20260709 12:30:38.908115 18720 raft_consensus.cc:399] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:30:38.908301 18720 raft_consensus.cc:493] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:30:38.908500 18720 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:38.913185 18720 raft_consensus.cc:515] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88b35d7845ca48a3b8fcfcd189b55087" member_type: VOTER }
I20260709 12:30:38.913633 18720 leader_election.cc:304] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88b35d7845ca48a3b8fcfcd189b55087; no voters: 
I20260709 12:30:38.914609 18720 leader_election.cc:290] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:30:38.914999 18723 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:38.916313 18723 raft_consensus.cc:697] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087 [term 1 LEADER]: Becoming Leader. State: Replica: 88b35d7845ca48a3b8fcfcd189b55087, State: Running, Role: LEADER
I20260709 12:30:38.917006 18723 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88b35d7845ca48a3b8fcfcd189b55087" member_type: VOTER }
I20260709 12:30:38.917577 18720 sys_catalog.cc:565] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:30:38.922147 18725 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88b35d7845ca48a3b8fcfcd189b55087. Latest consensus state: current_term: 1 leader_uuid: "88b35d7845ca48a3b8fcfcd189b55087" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88b35d7845ca48a3b8fcfcd189b55087" member_type: VOTER } }
I20260709 12:30:38.922912 18725 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087 [sys.catalog]: This master's current role is: LEADER
I20260709 12:30:38.924738 18724 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88b35d7845ca48a3b8fcfcd189b55087" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88b35d7845ca48a3b8fcfcd189b55087" member_type: VOTER } }
I20260709 12:30:38.925523 18724 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087 [sys.catalog]: This master's current role is: LEADER
I20260709 12:30:38.928989 18731 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:30:38.934259 18731 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:30:38.935437  8637 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:30:38.942858 18731 catalog_manager.cc:1383] Generated new cluster ID: 4678505fcb1745d6b0d73449d340d94c
I20260709 12:30:38.943156 18731 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:30:38.962913 18731 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:30:38.964361 18731 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:30:38.976166 18731 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087: Generated new TSK 0
I20260709 12:30:38.976761 18731 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:30:39.002665  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:39.009248 18741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:39.010731 18742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:39.016619 18744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:39.016763  8637 server_base.cc:1061] running on GCE node
I20260709 12:30:39.017843  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:39.018075  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:39.018311  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600239018249 us; error 0 us; skew 500 ppm
I20260709 12:30:39.018862  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:39.021481  8637 webserver.cc:533] Webserver started at http://127.8.111.65:40485/ using document root <none> and password file <none>
I20260709 12:30:39.021965  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:39.022161  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:39.022498  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:39.023633  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599876290468-8637-0/minicluster-data/ts-0-root/instance:
uuid: "2d00654e5f6140bb86d525d53fee2d29"
format_stamp: "Formatted at 2026-07-09 12:30:39 on dist-test-slave-044g"
I20260709 12:30:39.028209  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:30:39.031574 18749 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:39.032325  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:30:39.032614  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599876290468-8637-0/minicluster-data/ts-0-root
uuid: "2d00654e5f6140bb86d525d53fee2d29"
format_stamp: "Formatted at 2026-07-09 12:30:39 on dist-test-slave-044g"
I20260709 12:30:39.032910  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599876290468-8637-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599876290468-8637-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599876290468-8637-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:39.063819  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:39.065056  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:39.066593  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:39.068787  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:30:39.069010  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:39.069262  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:30:39.069455  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:39.108566  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.65:37951
I20260709 12:30:39.108683 18811 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.65:37951 every 8 connection(s)
I20260709 12:30:39.113840  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:39.122365 18817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:39.123054 18816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:39.124364  8637 server_base.cc:1061] running on GCE node
W20260709 12:30:39.124958 18819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:39.125859  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:39.126247  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:39.126510  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600239126488 us; error 0 us; skew 500 ppm
I20260709 12:30:39.127149  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:39.127589 18812 heartbeater.cc:344] Connected to a master server at 127.8.111.126:40917
I20260709 12:30:39.127985 18812 heartbeater.cc:461] Registering TS with master...
I20260709 12:30:39.128899 18812 heartbeater.cc:507] Master 127.8.111.126:40917 requested a full tablet report, sending...
I20260709 12:30:39.129859  8637 webserver.cc:533] Webserver started at http://127.8.111.66:45509/ using document root <none> and password file <none>
I20260709 12:30:39.130611  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:39.130860  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:39.131142  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:39.131176 18685 ts_manager.cc:194] Registered new tserver with Master: 2d00654e5f6140bb86d525d53fee2d29 (127.8.111.65:37951)
I20260709 12:30:39.132365  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599876290468-8637-0/minicluster-data/ts-1-root/instance:
uuid: "efae9dacdef849718ea0aa8e278fae38"
format_stamp: "Formatted at 2026-07-09 12:30:39 on dist-test-slave-044g"
I20260709 12:30:39.133069 18685 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55278
I20260709 12:30:39.136986  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:30:39.140357 18824 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:39.141192  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:30:39.141431  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599876290468-8637-0/minicluster-data/ts-1-root
uuid: "efae9dacdef849718ea0aa8e278fae38"
format_stamp: "Formatted at 2026-07-09 12:30:39 on dist-test-slave-044g"
I20260709 12:30:39.141665  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599876290468-8637-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599876290468-8637-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599876290468-8637-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:39.151129  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:39.152150  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:39.153427  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:39.155550  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:30:39.155748  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:39.155993  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:30:39.156152  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:39.193805  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.66:42233
I20260709 12:30:39.193908 18886 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.66:42233 every 8 connection(s)
I20260709 12:30:39.198630  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:39.204905 18890 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:39.205855 18891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:39.209404 18893 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:39.209497  8637 server_base.cc:1061] running on GCE node
I20260709 12:30:39.210556 18887 heartbeater.cc:344] Connected to a master server at 127.8.111.126:40917
I20260709 12:30:39.210950 18887 heartbeater.cc:461] Registering TS with master...
I20260709 12:30:39.211000  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:39.211324  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:39.211508  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600239211489 us; error 0 us; skew 500 ppm
I20260709 12:30:39.211781 18887 heartbeater.cc:507] Master 127.8.111.126:40917 requested a full tablet report, sending...
I20260709 12:30:39.212200  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:39.214007 18685 ts_manager.cc:194] Registered new tserver with Master: efae9dacdef849718ea0aa8e278fae38 (127.8.111.66:42233)
I20260709 12:30:39.215004  8637 webserver.cc:533] Webserver started at http://127.8.111.67:39797/ using document root <none> and password file <none>
I20260709 12:30:39.215664  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:39.215899  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:39.215878 18685 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55294
I20260709 12:30:39.216451  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:39.217809  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599876290468-8637-0/minicluster-data/ts-2-root/instance:
uuid: "ab5691e75a854875a980098d99c779eb"
format_stamp: "Formatted at 2026-07-09 12:30:39 on dist-test-slave-044g"
I20260709 12:30:39.222361  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:30:39.225449 18898 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:39.226172  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:30:39.226509  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599876290468-8637-0/minicluster-data/ts-2-root
uuid: "ab5691e75a854875a980098d99c779eb"
format_stamp: "Formatted at 2026-07-09 12:30:39 on dist-test-slave-044g"
I20260709 12:30:39.226760  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599876290468-8637-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599876290468-8637-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599876290468-8637-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:39.240890  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:39.242017  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:39.243533  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:39.245621  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:30:39.245791  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:39.246065  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:30:39.246222  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:39.284829  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.67:38137
I20260709 12:30:39.284931 18960 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.67:38137 every 8 connection(s)
I20260709 12:30:39.298570 18961 heartbeater.cc:344] Connected to a master server at 127.8.111.126:40917
I20260709 12:30:39.299010 18961 heartbeater.cc:461] Registering TS with master...
I20260709 12:30:39.299685 18961 heartbeater.cc:507] Master 127.8.111.126:40917 requested a full tablet report, sending...
I20260709 12:30:39.301540 18685 ts_manager.cc:194] Registered new tserver with Master: ab5691e75a854875a980098d99c779eb (127.8.111.67:38137)
I20260709 12:30:39.302500  8637 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014548495s
I20260709 12:30:39.303078 18685 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55298
I20260709 12:30:39.329253 18685 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55304:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:30:39.331480 18685 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:30:39.378049 18852 tablet_service.cc:1511] Processing CreateTablet for tablet b7c9a7f430be4b16b3ee76d278a3dfe5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=a4c9340a402046148828a55802ec2d5f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:30:39.379482 18852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7c9a7f430be4b16b3ee76d278a3dfe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:39.379053 18851 tablet_service.cc:1511] Processing CreateTablet for tablet c553c3c1797b42539f148ef28531f5d8 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=a4c9340a402046148828a55802ec2d5f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:30:39.381039 18851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c553c3c1797b42539f148ef28531f5d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:39.384485 18777 tablet_service.cc:1511] Processing CreateTablet for tablet b7c9a7f430be4b16b3ee76d278a3dfe5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=a4c9340a402046148828a55802ec2d5f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:30:39.384728 18776 tablet_service.cc:1511] Processing CreateTablet for tablet c553c3c1797b42539f148ef28531f5d8 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=a4c9340a402046148828a55802ec2d5f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:30:39.385818 18777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7c9a7f430be4b16b3ee76d278a3dfe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:39.386473 18776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c553c3c1797b42539f148ef28531f5d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:39.403707 18975 tablet_bootstrap.cc:492] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38: Bootstrap starting.
I20260709 12:30:39.406117 18926 tablet_service.cc:1511] Processing CreateTablet for tablet b7c9a7f430be4b16b3ee76d278a3dfe5 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=a4c9340a402046148828a55802ec2d5f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:30:39.407565 18926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7c9a7f430be4b16b3ee76d278a3dfe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:39.411455 18925 tablet_service.cc:1511] Processing CreateTablet for tablet c553c3c1797b42539f148ef28531f5d8 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=a4c9340a402046148828a55802ec2d5f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:30:39.412753 18925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c553c3c1797b42539f148ef28531f5d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:39.417922 18975 tablet_bootstrap.cc:654] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:39.447971 18976 tablet_bootstrap.cc:492] T c553c3c1797b42539f148ef28531f5d8 P 2d00654e5f6140bb86d525d53fee2d29: Bootstrap starting.
I20260709 12:30:39.448659 18977 tablet_bootstrap.cc:492] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb: Bootstrap starting.
I20260709 12:30:39.453198 18975 tablet_bootstrap.cc:492] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38: No bootstrap required, opened a new log
I20260709 12:30:39.453732 18975 ts_tablet_manager.cc:1403] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.000s
I20260709 12:30:39.453691 18976 tablet_bootstrap.cc:654] T c553c3c1797b42539f148ef28531f5d8 P 2d00654e5f6140bb86d525d53fee2d29: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:39.455817 18977 tablet_bootstrap.cc:654] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:39.457590 18975 raft_consensus.cc:359] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.458420 18975 raft_consensus.cc:385] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.458552 18976 tablet_bootstrap.cc:492] T c553c3c1797b42539f148ef28531f5d8 P 2d00654e5f6140bb86d525d53fee2d29: No bootstrap required, opened a new log
I20260709 12:30:39.458761 18975 raft_consensus.cc:740] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efae9dacdef849718ea0aa8e278fae38, State: Initialized, Role: FOLLOWER
I20260709 12:30:39.459146 18976 ts_tablet_manager.cc:1403] T c553c3c1797b42539f148ef28531f5d8 P 2d00654e5f6140bb86d525d53fee2d29: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:30:39.461337 18977 tablet_bootstrap.cc:492] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb: No bootstrap required, opened a new log
I20260709 12:30:39.460388 18975 consensus_queue.cc:260] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.461830 18977 ts_tablet_manager.cc:1403] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:30:39.462862 18976 raft_consensus.cc:359] T c553c3c1797b42539f148ef28531f5d8 P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.463629 18976 raft_consensus.cc:385] T c553c3c1797b42539f148ef28531f5d8 P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.463873 18887 heartbeater.cc:499] Master 127.8.111.126:40917 was elected leader, sending a full tablet report...
I20260709 12:30:39.463904 18976 raft_consensus.cc:740] T c553c3c1797b42539f148ef28531f5d8 P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d00654e5f6140bb86d525d53fee2d29, State: Initialized, Role: FOLLOWER
I20260709 12:30:39.464286 18975 ts_tablet_manager.cc:1434] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:30:39.465305 18975 tablet_bootstrap.cc:492] T b7c9a7f430be4b16b3ee76d278a3dfe5 P efae9dacdef849718ea0aa8e278fae38: Bootstrap starting.
I20260709 12:30:39.464968 18976 consensus_queue.cc:260] T c553c3c1797b42539f148ef28531f5d8 P 2d00654e5f6140bb86d525d53fee2d29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.465081 18977 raft_consensus.cc:359] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.465845 18977 raft_consensus.cc:385] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.466133 18977 raft_consensus.cc:740] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab5691e75a854875a980098d99c779eb, State: Initialized, Role: FOLLOWER
I20260709 12:30:39.466923 18977 consensus_queue.cc:260] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.469571 18961 heartbeater.cc:499] Master 127.8.111.126:40917 was elected leader, sending a full tablet report...
I20260709 12:30:39.469895 18977 ts_tablet_manager.cc:1434] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:30:39.470938 18977 tablet_bootstrap.cc:492] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb: Bootstrap starting.
I20260709 12:30:39.477442 18977 tablet_bootstrap.cc:654] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:39.481972 18812 heartbeater.cc:499] Master 127.8.111.126:40917 was elected leader, sending a full tablet report...
I20260709 12:30:39.482914 18976 ts_tablet_manager.cc:1434] T c553c3c1797b42539f148ef28531f5d8 P 2d00654e5f6140bb86d525d53fee2d29: Time spent starting tablet: real 0.023s	user 0.018s	sys 0.003s
I20260709 12:30:39.483973 18976 tablet_bootstrap.cc:492] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29: Bootstrap starting.
I20260709 12:30:39.487144 18975 tablet_bootstrap.cc:654] T b7c9a7f430be4b16b3ee76d278a3dfe5 P efae9dacdef849718ea0aa8e278fae38: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:39.490334 18976 tablet_bootstrap.cc:654] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:39.498054 18977 tablet_bootstrap.cc:492] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb: No bootstrap required, opened a new log
I20260709 12:30:39.498699 18977 ts_tablet_manager.cc:1403] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.018s
I20260709 12:30:39.501585 18975 tablet_bootstrap.cc:492] T b7c9a7f430be4b16b3ee76d278a3dfe5 P efae9dacdef849718ea0aa8e278fae38: No bootstrap required, opened a new log
I20260709 12:30:39.502133 18975 ts_tablet_manager.cc:1403] T b7c9a7f430be4b16b3ee76d278a3dfe5 P efae9dacdef849718ea0aa8e278fae38: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.004s
I20260709 12:30:39.501801 18977 raft_consensus.cc:359] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.502612 18977 raft_consensus.cc:385] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.502931 18977 raft_consensus.cc:740] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab5691e75a854875a980098d99c779eb, State: Initialized, Role: FOLLOWER
I20260709 12:30:39.503783 18977 consensus_queue.cc:260] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.505106 18975 raft_consensus.cc:359] T b7c9a7f430be4b16b3ee76d278a3dfe5 P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.505825 18975 raft_consensus.cc:385] T b7c9a7f430be4b16b3ee76d278a3dfe5 P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.506121 18975 raft_consensus.cc:740] T b7c9a7f430be4b16b3ee76d278a3dfe5 P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efae9dacdef849718ea0aa8e278fae38, State: Initialized, Role: FOLLOWER
I20260709 12:30:39.506857 18975 consensus_queue.cc:260] T b7c9a7f430be4b16b3ee76d278a3dfe5 P efae9dacdef849718ea0aa8e278fae38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.507846 18977 ts_tablet_manager.cc:1434] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:30:39.510689 18975 ts_tablet_manager.cc:1434] T b7c9a7f430be4b16b3ee76d278a3dfe5 P efae9dacdef849718ea0aa8e278fae38: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:30:39.507905 18981 raft_consensus.cc:493] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:39.512667 18981 raft_consensus.cc:515] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.516157 18981 leader_election.cc:290] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d00654e5f6140bb86d525d53fee2d29 (127.8.111.65:37951), ab5691e75a854875a980098d99c779eb (127.8.111.67:38137)
I20260709 12:30:39.537185 18976 tablet_bootstrap.cc:492] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29: No bootstrap required, opened a new log
I20260709 12:30:39.537788 18976 ts_tablet_manager.cc:1403] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.034s
I20260709 12:30:39.539942 18936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c553c3c1797b42539f148ef28531f5d8" candidate_uuid: "efae9dacdef849718ea0aa8e278fae38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab5691e75a854875a980098d99c779eb" is_pre_election: true
I20260709 12:30:39.540405 18787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c553c3c1797b42539f148ef28531f5d8" candidate_uuid: "efae9dacdef849718ea0aa8e278fae38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d00654e5f6140bb86d525d53fee2d29" is_pre_election: true
I20260709 12:30:39.540709 18936 raft_consensus.cc:2468] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efae9dacdef849718ea0aa8e278fae38 in term 0.
I20260709 12:30:39.541056 18787 raft_consensus.cc:2468] T c553c3c1797b42539f148ef28531f5d8 P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efae9dacdef849718ea0aa8e278fae38 in term 0.
I20260709 12:30:39.540925 18976 raft_consensus.cc:359] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.541693 18976 raft_consensus.cc:385] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.542008 18976 raft_consensus.cc:740] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d00654e5f6140bb86d525d53fee2d29, State: Initialized, Role: FOLLOWER
I20260709 12:30:39.542155 18825 leader_election.cc:304] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab5691e75a854875a980098d99c779eb, efae9dacdef849718ea0aa8e278fae38; no voters: 
I20260709 12:30:39.543068 18981 raft_consensus.cc:2804] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:39.542845 18976 consensus_queue.cc:260] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.543455 18981 raft_consensus.cc:493] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:39.543880 18981 raft_consensus.cc:3060] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:39.544942 18976 ts_tablet_manager.cc:1434] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:30:39.550096 18981 raft_consensus.cc:515] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.553282 18981 leader_election.cc:290] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [CANDIDATE]: Term 1 election: Requested vote from peers 2d00654e5f6140bb86d525d53fee2d29 (127.8.111.65:37951), ab5691e75a854875a980098d99c779eb (127.8.111.67:38137)
I20260709 12:30:39.554772 18787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c553c3c1797b42539f148ef28531f5d8" candidate_uuid: "efae9dacdef849718ea0aa8e278fae38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d00654e5f6140bb86d525d53fee2d29"
I20260709 12:30:39.554906 18936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c553c3c1797b42539f148ef28531f5d8" candidate_uuid: "efae9dacdef849718ea0aa8e278fae38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab5691e75a854875a980098d99c779eb"
I20260709 12:30:39.555294 18787 raft_consensus.cc:3060] T c553c3c1797b42539f148ef28531f5d8 P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:39.555521 18936 raft_consensus.cc:3060] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:39.559165 18983 raft_consensus.cc:493] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:39.559684 18983 raft_consensus.cc:515] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.561003 18936 raft_consensus.cc:2468] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efae9dacdef849718ea0aa8e278fae38 in term 1.
I20260709 12:30:39.562162 18787 raft_consensus.cc:2468] T c553c3c1797b42539f148ef28531f5d8 P 2d00654e5f6140bb86d525d53fee2d29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efae9dacdef849718ea0aa8e278fae38 in term 1.
I20260709 12:30:39.562393 18983 leader_election.cc:290] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efae9dacdef849718ea0aa8e278fae38 (127.8.111.66:42233), 2d00654e5f6140bb86d525d53fee2d29 (127.8.111.65:37951)
I20260709 12:30:39.564903 18825 leader_election.cc:304] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d00654e5f6140bb86d525d53fee2d29, efae9dacdef849718ea0aa8e278fae38; no voters: 
I20260709 12:30:39.565719 18981 raft_consensus.cc:2804] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:39.566319 18981 raft_consensus.cc:697] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [term 1 LEADER]: Becoming Leader. State: Replica: efae9dacdef849718ea0aa8e278fae38, State: Running, Role: LEADER
I20260709 12:30:39.567224 18981 consensus_queue.cc:237] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.572932 18862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c9a7f430be4b16b3ee76d278a3dfe5" candidate_uuid: "ab5691e75a854875a980098d99c779eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efae9dacdef849718ea0aa8e278fae38" is_pre_election: true
I20260709 12:30:39.573608 18862 raft_consensus.cc:2468] T b7c9a7f430be4b16b3ee76d278a3dfe5 P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab5691e75a854875a980098d99c779eb in term 0.
I20260709 12:30:39.574872 18899 leader_election.cc:304] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab5691e75a854875a980098d99c779eb, efae9dacdef849718ea0aa8e278fae38; no voters: 
I20260709 12:30:39.575121 18787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c9a7f430be4b16b3ee76d278a3dfe5" candidate_uuid: "ab5691e75a854875a980098d99c779eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d00654e5f6140bb86d525d53fee2d29" is_pre_election: true
I20260709 12:30:39.575630 18983 raft_consensus.cc:2804] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:39.576001 18983 raft_consensus.cc:493] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:39.575845 18787 raft_consensus.cc:2468] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab5691e75a854875a980098d99c779eb in term 0.
I20260709 12:30:39.576397 18983 raft_consensus.cc:3060] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:39.576167 18683 catalog_manager.cc:5697] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 reported cstate change: term changed from 0 to 1, leader changed from <none> to efae9dacdef849718ea0aa8e278fae38 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "efae9dacdef849718ea0aa8e278fae38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:39.582139 18983 raft_consensus.cc:515] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.584509 18983 leader_election.cc:290] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [CANDIDATE]: Term 1 election: Requested vote from peers efae9dacdef849718ea0aa8e278fae38 (127.8.111.66:42233), 2d00654e5f6140bb86d525d53fee2d29 (127.8.111.65:37951)
I20260709 12:30:39.585377 18787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c9a7f430be4b16b3ee76d278a3dfe5" candidate_uuid: "ab5691e75a854875a980098d99c779eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d00654e5f6140bb86d525d53fee2d29"
I20260709 12:30:39.585417 18862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c9a7f430be4b16b3ee76d278a3dfe5" candidate_uuid: "ab5691e75a854875a980098d99c779eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efae9dacdef849718ea0aa8e278fae38"
I20260709 12:30:39.585938 18787 raft_consensus.cc:3060] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:39.586120 18862 raft_consensus.cc:3060] T b7c9a7f430be4b16b3ee76d278a3dfe5 P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:39.590718 18787 raft_consensus.cc:2468] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab5691e75a854875a980098d99c779eb in term 1.
I20260709 12:30:39.591418 18862 raft_consensus.cc:2468] T b7c9a7f430be4b16b3ee76d278a3dfe5 P efae9dacdef849718ea0aa8e278fae38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab5691e75a854875a980098d99c779eb in term 1.
I20260709 12:30:39.591634 18899 leader_election.cc:304] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d00654e5f6140bb86d525d53fee2d29, ab5691e75a854875a980098d99c779eb; no voters: 
I20260709 12:30:39.592402 18983 raft_consensus.cc:2804] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:39.593458 18983 raft_consensus.cc:697] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [term 1 LEADER]: Becoming Leader. State: Replica: ab5691e75a854875a980098d99c779eb, State: Running, Role: LEADER
I20260709 12:30:39.594121 18983 consensus_queue.cc:237] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.600682 18685 catalog_manager.cc:5697] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb reported cstate change: term changed from 0 to 1, leader changed from <none> to ab5691e75a854875a980098d99c779eb (127.8.111.67). New cstate: current_term: 1 leader_uuid: "ab5691e75a854875a980098d99c779eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:39.646095 18685 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55308:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:30:39.648028 18685 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:30:39.670132 18776 tablet_service.cc:1511] Processing CreateTablet for tablet 45d4675c1b13491da65e406c1060762b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5505410889a8475fa7ae685bceb2d78f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:30:39.671495 18776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d4675c1b13491da65e406c1060762b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:39.671525 18852 tablet_service.cc:1511] Processing CreateTablet for tablet 45d4675c1b13491da65e406c1060762b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5505410889a8475fa7ae685bceb2d78f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:30:39.673178 18852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d4675c1b13491da65e406c1060762b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:39.673225 18926 tablet_service.cc:1511] Processing CreateTablet for tablet 45d4675c1b13491da65e406c1060762b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5505410889a8475fa7ae685bceb2d78f]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:30:39.674556 18926 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45d4675c1b13491da65e406c1060762b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:39.676236 18777 tablet_service.cc:1511] Processing CreateTablet for tablet b6ee5191abc840d489a456be1c5b9cf1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5505410889a8475fa7ae685bceb2d78f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:30:39.677404 18777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ee5191abc840d489a456be1c5b9cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:39.677425 18925 tablet_service.cc:1511] Processing CreateTablet for tablet b6ee5191abc840d489a456be1c5b9cf1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5505410889a8475fa7ae685bceb2d78f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:30:39.680732 18925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ee5191abc840d489a456be1c5b9cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:39.687294 18851 tablet_service.cc:1511] Processing CreateTablet for tablet b6ee5191abc840d489a456be1c5b9cf1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=5505410889a8475fa7ae685bceb2d78f]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:30:39.688588 18851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6ee5191abc840d489a456be1c5b9cf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:39.689684 18975 tablet_bootstrap.cc:492] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38: Bootstrap starting.
I20260709 12:30:39.693287 18976 tablet_bootstrap.cc:492] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29: Bootstrap starting.
I20260709 12:30:39.704581 18976 tablet_bootstrap.cc:654] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:39.705098 18975 tablet_bootstrap.cc:654] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:39.705193 18977 tablet_bootstrap.cc:492] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb: Bootstrap starting.
I20260709 12:30:39.714804 18977 tablet_bootstrap.cc:654] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:39.716292 18975 tablet_bootstrap.cc:492] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38: No bootstrap required, opened a new log
I20260709 12:30:39.716586 18976 tablet_bootstrap.cc:492] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29: No bootstrap required, opened a new log
I20260709 12:30:39.716773 18975 ts_tablet_manager.cc:1403] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.007s
I20260709 12:30:39.718328 18976 ts_tablet_manager.cc:1403] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.002s
I20260709 12:30:39.719791 18975 raft_consensus.cc:359] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.720345 18977 tablet_bootstrap.cc:492] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb: No bootstrap required, opened a new log
I20260709 12:30:39.720556 18975 raft_consensus.cc:385] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.720916 18975 raft_consensus.cc:740] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efae9dacdef849718ea0aa8e278fae38, State: Initialized, Role: FOLLOWER
I20260709 12:30:39.721047 18977 ts_tablet_manager.cc:1403] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 12:30:39.721239 18976 raft_consensus.cc:359] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.721979 18976 raft_consensus.cc:385] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.721724 18975 consensus_queue.cc:260] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.722260 18976 raft_consensus.cc:740] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d00654e5f6140bb86d525d53fee2d29, State: Initialized, Role: FOLLOWER
I20260709 12:30:39.724023 18975 ts_tablet_manager.cc:1434] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:30:39.724089 18977 raft_consensus.cc:359] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.724885 18977 raft_consensus.cc:385] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.724447 18976 consensus_queue.cc:260] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.725217 18977 raft_consensus.cc:740] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab5691e75a854875a980098d99c779eb, State: Initialized, Role: FOLLOWER
I20260709 12:30:39.725528 18975 tablet_bootstrap.cc:492] T b6ee5191abc840d489a456be1c5b9cf1 P efae9dacdef849718ea0aa8e278fae38: Bootstrap starting.
I20260709 12:30:39.726152 18977 consensus_queue.cc:260] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.728591 18977 ts_tablet_manager.cc:1434] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:30:39.729646 18977 tablet_bootstrap.cc:492] T 45d4675c1b13491da65e406c1060762b P ab5691e75a854875a980098d99c779eb: Bootstrap starting.
I20260709 12:30:39.733362 18975 tablet_bootstrap.cc:654] T b6ee5191abc840d489a456be1c5b9cf1 P efae9dacdef849718ea0aa8e278fae38: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:39.736158 18977 tablet_bootstrap.cc:654] T 45d4675c1b13491da65e406c1060762b P ab5691e75a854875a980098d99c779eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:39.739807 18976 ts_tablet_manager.cc:1434] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:30:39.740661 18975 tablet_bootstrap.cc:492] T b6ee5191abc840d489a456be1c5b9cf1 P efae9dacdef849718ea0aa8e278fae38: No bootstrap required, opened a new log
I20260709 12:30:39.741217 18975 ts_tablet_manager.cc:1403] T b6ee5191abc840d489a456be1c5b9cf1 P efae9dacdef849718ea0aa8e278fae38: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 12:30:39.741508 18976 tablet_bootstrap.cc:492] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29: Bootstrap starting.
I20260709 12:30:39.744438 18975 raft_consensus.cc:359] T b6ee5191abc840d489a456be1c5b9cf1 P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.745227 18975 raft_consensus.cc:385] T b6ee5191abc840d489a456be1c5b9cf1 P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.745599 18975 raft_consensus.cc:740] T b6ee5191abc840d489a456be1c5b9cf1 P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efae9dacdef849718ea0aa8e278fae38, State: Initialized, Role: FOLLOWER
I20260709 12:30:39.746551 18975 consensus_queue.cc:260] T b6ee5191abc840d489a456be1c5b9cf1 P efae9dacdef849718ea0aa8e278fae38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.749539 18975 ts_tablet_manager.cc:1434] T b6ee5191abc840d489a456be1c5b9cf1 P efae9dacdef849718ea0aa8e278fae38: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:30:39.750058 18976 tablet_bootstrap.cc:654] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:39.754240 18977 tablet_bootstrap.cc:492] T 45d4675c1b13491da65e406c1060762b P ab5691e75a854875a980098d99c779eb: No bootstrap required, opened a new log
I20260709 12:30:39.754729 18977 ts_tablet_manager.cc:1403] T 45d4675c1b13491da65e406c1060762b P ab5691e75a854875a980098d99c779eb: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.007s
I20260709 12:30:39.755964 18976 tablet_bootstrap.cc:492] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29: No bootstrap required, opened a new log
I20260709 12:30:39.756398 18976 ts_tablet_manager.cc:1403] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:30:39.757284 18977 raft_consensus.cc:359] T 45d4675c1b13491da65e406c1060762b P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.758169 18977 raft_consensus.cc:385] T 45d4675c1b13491da65e406c1060762b P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.758486 18977 raft_consensus.cc:740] T 45d4675c1b13491da65e406c1060762b P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab5691e75a854875a980098d99c779eb, State: Initialized, Role: FOLLOWER
I20260709 12:30:39.759114 18977 consensus_queue.cc:260] T 45d4675c1b13491da65e406c1060762b P ab5691e75a854875a980098d99c779eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.759169 18976 raft_consensus.cc:359] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.759719 18976 raft_consensus.cc:385] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:39.760059 18976 raft_consensus.cc:740] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d00654e5f6140bb86d525d53fee2d29, State: Initialized, Role: FOLLOWER
I20260709 12:30:39.760768 18976 consensus_queue.cc:260] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.761144 18977 ts_tablet_manager.cc:1434] T 45d4675c1b13491da65e406c1060762b P ab5691e75a854875a980098d99c779eb: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:30:39.762495 18976 ts_tablet_manager.cc:1434] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:30:39.849996 18982 raft_consensus.cc:493] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:39.850625 18982 raft_consensus.cc:515] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.852837 18982 leader_election.cc:290] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efae9dacdef849718ea0aa8e278fae38 (127.8.111.66:42233), ab5691e75a854875a980098d99c779eb (127.8.111.67:38137)
I20260709 12:30:39.864328 18862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d4675c1b13491da65e406c1060762b" candidate_uuid: "2d00654e5f6140bb86d525d53fee2d29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efae9dacdef849718ea0aa8e278fae38" is_pre_election: true
I20260709 12:30:39.865097 18862 raft_consensus.cc:2468] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d00654e5f6140bb86d525d53fee2d29 in term 0.
I20260709 12:30:39.866128 18750 leader_election.cc:304] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d00654e5f6140bb86d525d53fee2d29, efae9dacdef849718ea0aa8e278fae38; no voters: 
I20260709 12:30:39.866286 18936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d4675c1b13491da65e406c1060762b" candidate_uuid: "2d00654e5f6140bb86d525d53fee2d29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab5691e75a854875a980098d99c779eb" is_pre_election: true
I20260709 12:30:39.866884 18982 raft_consensus.cc:2804] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:39.866905 18936 raft_consensus.cc:2468] T 45d4675c1b13491da65e406c1060762b P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d00654e5f6140bb86d525d53fee2d29 in term 0.
I20260709 12:30:39.867271 18982 raft_consensus.cc:493] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:39.867637 18982 raft_consensus.cc:3060] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:39.872964 18982 raft_consensus.cc:515] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.874642 18982 leader_election.cc:290] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [CANDIDATE]: Term 1 election: Requested vote from peers efae9dacdef849718ea0aa8e278fae38 (127.8.111.66:42233), ab5691e75a854875a980098d99c779eb (127.8.111.67:38137)
I20260709 12:30:39.875361 18862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d4675c1b13491da65e406c1060762b" candidate_uuid: "2d00654e5f6140bb86d525d53fee2d29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efae9dacdef849718ea0aa8e278fae38"
I20260709 12:30:39.875635 18936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d4675c1b13491da65e406c1060762b" candidate_uuid: "2d00654e5f6140bb86d525d53fee2d29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab5691e75a854875a980098d99c779eb"
I20260709 12:30:39.875900 18862 raft_consensus.cc:3060] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:39.876204 18936 raft_consensus.cc:3060] T 45d4675c1b13491da65e406c1060762b P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:39.881121 18862 raft_consensus.cc:2468] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d00654e5f6140bb86d525d53fee2d29 in term 1.
I20260709 12:30:39.881114 18936 raft_consensus.cc:2468] T 45d4675c1b13491da65e406c1060762b P ab5691e75a854875a980098d99c779eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d00654e5f6140bb86d525d53fee2d29 in term 1.
I20260709 12:30:39.882261 18750 leader_election.cc:304] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d00654e5f6140bb86d525d53fee2d29, efae9dacdef849718ea0aa8e278fae38; no voters: 
I20260709 12:30:39.882974 18982 raft_consensus.cc:2804] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:39.883946 18982 raft_consensus.cc:697] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [term 1 LEADER]: Becoming Leader. State: Replica: 2d00654e5f6140bb86d525d53fee2d29, State: Running, Role: LEADER
I20260709 12:30:39.884773 18982 consensus_queue.cc:237] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:39.892035 18682 catalog_manager.cc:5697] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d00654e5f6140bb86d525d53fee2d29 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "2d00654e5f6140bb86d525d53fee2d29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } health_report { overall_health: UNKNOWN } } }
W20260709 12:30:39.930065 18733 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:40.031368 18981 consensus_queue.cc:1048] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:40.044756 19010 consensus_queue.cc:1048] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:40.097363 18983 consensus_queue.cc:1048] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:40.110096 19015 consensus_queue.cc:1048] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:40.176311 19015 raft_consensus.cc:493] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:40.176887 19015 raft_consensus.cc:515] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:40.178911 19015 leader_election.cc:290] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d00654e5f6140bb86d525d53fee2d29 (127.8.111.65:37951), efae9dacdef849718ea0aa8e278fae38 (127.8.111.66:42233)
I20260709 12:30:40.179795 18787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ee5191abc840d489a456be1c5b9cf1" candidate_uuid: "ab5691e75a854875a980098d99c779eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d00654e5f6140bb86d525d53fee2d29" is_pre_election: true
I20260709 12:30:40.179998 18862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ee5191abc840d489a456be1c5b9cf1" candidate_uuid: "ab5691e75a854875a980098d99c779eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efae9dacdef849718ea0aa8e278fae38" is_pre_election: true
I20260709 12:30:40.180401 18787 raft_consensus.cc:2468] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab5691e75a854875a980098d99c779eb in term 0.
I20260709 12:30:40.180751 18862 raft_consensus.cc:2468] T b6ee5191abc840d489a456be1c5b9cf1 P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab5691e75a854875a980098d99c779eb in term 0.
I20260709 12:30:40.181509 18899 leader_election.cc:304] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d00654e5f6140bb86d525d53fee2d29, ab5691e75a854875a980098d99c779eb; no voters: 
I20260709 12:30:40.182318 19015 raft_consensus.cc:2804] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:40.182618 19015 raft_consensus.cc:493] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:40.182889 19015 raft_consensus.cc:3060] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:40.188099 19015 raft_consensus.cc:515] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:40.189627 19015 leader_election.cc:290] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [CANDIDATE]: Term 1 election: Requested vote from peers 2d00654e5f6140bb86d525d53fee2d29 (127.8.111.65:37951), efae9dacdef849718ea0aa8e278fae38 (127.8.111.66:42233)
I20260709 12:30:40.190665 18787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ee5191abc840d489a456be1c5b9cf1" candidate_uuid: "ab5691e75a854875a980098d99c779eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d00654e5f6140bb86d525d53fee2d29"
I20260709 12:30:40.191013 18862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ee5191abc840d489a456be1c5b9cf1" candidate_uuid: "ab5691e75a854875a980098d99c779eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efae9dacdef849718ea0aa8e278fae38"
I20260709 12:30:40.191229 18787 raft_consensus.cc:3060] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:40.191654 18862 raft_consensus.cc:3060] T b6ee5191abc840d489a456be1c5b9cf1 P efae9dacdef849718ea0aa8e278fae38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:40.196568 18787 raft_consensus.cc:2468] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab5691e75a854875a980098d99c779eb in term 1.
I20260709 12:30:40.197365 18862 raft_consensus.cc:2468] T b6ee5191abc840d489a456be1c5b9cf1 P efae9dacdef849718ea0aa8e278fae38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab5691e75a854875a980098d99c779eb in term 1.
I20260709 12:30:40.197952 18899 leader_election.cc:304] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d00654e5f6140bb86d525d53fee2d29, ab5691e75a854875a980098d99c779eb; no voters: 
I20260709 12:30:40.198719 19015 raft_consensus.cc:2804] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:40.199258 19015 raft_consensus.cc:697] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [term 1 LEADER]: Becoming Leader. State: Replica: ab5691e75a854875a980098d99c779eb, State: Running, Role: LEADER
I20260709 12:30:40.200158 19015 consensus_queue.cc:237] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:40.207541 18682 catalog_manager.cc:5697] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb reported cstate change: term changed from 0 to 1, leader changed from <none> to ab5691e75a854875a980098d99c779eb (127.8.111.67). New cstate: current_term: 1 leader_uuid: "ab5691e75a854875a980098d99c779eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:40.287664 18936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7c9a7f430be4b16b3ee76d278a3dfe5"
dest_uuid: "ab5691e75a854875a980098d99c779eb"
mode: GRACEFUL
new_leader_uuid: "2d00654e5f6140bb86d525d53fee2d29"
 from {username='slave'} at 127.0.0.1:50970
I20260709 12:30:40.288206 18936 raft_consensus.cc:606] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [term 1 LEADER]: Received request to transfer leadership to TS 2d00654e5f6140bb86d525d53fee2d29
I20260709 12:30:40.300197 18862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c553c3c1797b42539f148ef28531f5d8"
dest_uuid: "efae9dacdef849718ea0aa8e278fae38"
mode: GRACEFUL
new_leader_uuid: "ab5691e75a854875a980098d99c779eb"
 from {username='slave'} at 127.0.0.1:48020
I20260709 12:30:40.300765 18862 raft_consensus.cc:606] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [term 1 LEADER]: Received request to transfer leadership to TS ab5691e75a854875a980098d99c779eb
I20260709 12:30:40.309295 18936 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6ee5191abc840d489a456be1c5b9cf1"
dest_uuid: "ab5691e75a854875a980098d99c779eb"
mode: GRACEFUL
new_leader_uuid: "2d00654e5f6140bb86d525d53fee2d29"
 from {username='slave'} at 127.0.0.1:50970
I20260709 12:30:40.309820 18936 raft_consensus.cc:606] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [term 1 LEADER]: Received request to transfer leadership to TS 2d00654e5f6140bb86d525d53fee2d29
I20260709 12:30:40.430434 18982 consensus_queue.cc:1048] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:40.446848 18982 consensus_queue.cc:1048] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:40.569274 19010 raft_consensus.cc:993] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38: : Instructing follower ab5691e75a854875a980098d99c779eb to start an election
I20260709 12:30:40.569710 19025 raft_consensus.cc:1081] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [term 1 LEADER]: Signalling peer ab5691e75a854875a980098d99c779eb to start an election
I20260709 12:30:40.571203 18936 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c553c3c1797b42539f148ef28531f5d8"
dest_uuid: "ab5691e75a854875a980098d99c779eb"
 from {username='slave'} at 127.0.0.1:50938
I20260709 12:30:40.571693 18936 raft_consensus.cc:493] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:40.571997 18936 raft_consensus.cc:3060] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:40.576959 18936 raft_consensus.cc:515] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:40.579324 18787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c553c3c1797b42539f148ef28531f5d8" candidate_uuid: "ab5691e75a854875a980098d99c779eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d00654e5f6140bb86d525d53fee2d29"
I20260709 12:30:40.578773 18936 leader_election.cc:290] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb [CANDIDATE]: Term 2 election: Requested vote from peers 2d00654e5f6140bb86d525d53fee2d29 (127.8.111.65:37951), efae9dacdef849718ea0aa8e278fae38 (127.8.111.66:42233)
I20260709 12:30:40.579726 18862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c553c3c1797b42539f148ef28531f5d8" candidate_uuid: "ab5691e75a854875a980098d99c779eb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efae9dacdef849718ea0aa8e278fae38"
I20260709 12:30:40.580009 18787 raft_consensus.cc:3060] T c553c3c1797b42539f148ef28531f5d8 P 2d00654e5f6140bb86d525d53fee2d29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:40.580319 18862 raft_consensus.cc:3055] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:40.580657 18862 raft_consensus.cc:740] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: efae9dacdef849718ea0aa8e278fae38, State: Running, Role: LEADER
I20260709 12:30:40.581466 18862 consensus_queue.cc:260] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:40.582831 18862 raft_consensus.cc:3060] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:40.587023 18787 raft_consensus.cc:2468] T c553c3c1797b42539f148ef28531f5d8 P 2d00654e5f6140bb86d525d53fee2d29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab5691e75a854875a980098d99c779eb in term 2.
I20260709 12:30:40.588281 18899 leader_election.cc:304] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d00654e5f6140bb86d525d53fee2d29, ab5691e75a854875a980098d99c779eb; no voters: 
I20260709 12:30:40.589145 19024 raft_consensus.cc:2804] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:40.589607 19024 raft_consensus.cc:697] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb [term 2 LEADER]: Becoming Leader. State: Replica: ab5691e75a854875a980098d99c779eb, State: Running, Role: LEADER
I20260709 12:30:40.590071 18862 raft_consensus.cc:2468] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab5691e75a854875a980098d99c779eb in term 2.
I20260709 12:30:40.590520 19024 consensus_queue.cc:237] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:40.593632 18983 consensus_queue.cc:1048] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:40.599045 18682 catalog_manager.cc:5697] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb reported cstate change: term changed from 1 to 2, leader changed from efae9dacdef849718ea0aa8e278fae38 (127.8.111.66) to ab5691e75a854875a980098d99c779eb (127.8.111.67). New cstate: current_term: 2 leader_uuid: "ab5691e75a854875a980098d99c779eb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:40.601138 19015 raft_consensus.cc:993] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb: : Instructing follower 2d00654e5f6140bb86d525d53fee2d29 to start an election
I20260709 12:30:40.601591 19015 raft_consensus.cc:1081] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [term 1 LEADER]: Signalling peer 2d00654e5f6140bb86d525d53fee2d29 to start an election
I20260709 12:30:40.604557 18786 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6ee5191abc840d489a456be1c5b9cf1"
dest_uuid: "2d00654e5f6140bb86d525d53fee2d29"
 from {username='slave'} at 127.0.0.1:33308
I20260709 12:30:40.605127 18786 raft_consensus.cc:493] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:40.605494 18786 raft_consensus.cc:3060] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:40.606762 19015 consensus_queue.cc:1048] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:40.612959 18786 raft_consensus.cc:515] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:40.616007 18861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ee5191abc840d489a456be1c5b9cf1" candidate_uuid: "2d00654e5f6140bb86d525d53fee2d29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efae9dacdef849718ea0aa8e278fae38"
I20260709 12:30:40.616541 18786 leader_election.cc:290] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29 [CANDIDATE]: Term 2 election: Requested vote from peers efae9dacdef849718ea0aa8e278fae38 (127.8.111.66:42233), ab5691e75a854875a980098d99c779eb (127.8.111.67:38137)
I20260709 12:30:40.616679 18861 raft_consensus.cc:3060] T b6ee5191abc840d489a456be1c5b9cf1 P efae9dacdef849718ea0aa8e278fae38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:40.616739 18936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6ee5191abc840d489a456be1c5b9cf1" candidate_uuid: "2d00654e5f6140bb86d525d53fee2d29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab5691e75a854875a980098d99c779eb"
I20260709 12:30:40.617993 18936 raft_consensus.cc:3055] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:40.618363 18936 raft_consensus.cc:740] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab5691e75a854875a980098d99c779eb, State: Running, Role: LEADER
I20260709 12:30:40.619210 18936 consensus_queue.cc:260] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:40.620564 18936 raft_consensus.cc:3060] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:40.625391 19024 raft_consensus.cc:993] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb: : Instructing follower 2d00654e5f6140bb86d525d53fee2d29 to start an election
I20260709 12:30:40.625403 18861 raft_consensus.cc:2468] T b6ee5191abc840d489a456be1c5b9cf1 P efae9dacdef849718ea0aa8e278fae38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d00654e5f6140bb86d525d53fee2d29 in term 2.
I20260709 12:30:40.626169 19024 raft_consensus.cc:1081] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [term 1 LEADER]: Signalling peer 2d00654e5f6140bb86d525d53fee2d29 to start an election
I20260709 12:30:40.627017 18750 leader_election.cc:304] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d00654e5f6140bb86d525d53fee2d29, efae9dacdef849718ea0aa8e278fae38; no voters: 
I20260709 12:30:40.627887 18982 raft_consensus.cc:2804] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:40.628398 18982 raft_consensus.cc:697] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29 [term 2 LEADER]: Becoming Leader. State: Replica: 2d00654e5f6140bb86d525d53fee2d29, State: Running, Role: LEADER
I20260709 12:30:40.628661 18786 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7c9a7f430be4b16b3ee76d278a3dfe5"
dest_uuid: "2d00654e5f6140bb86d525d53fee2d29"
 from {username='slave'} at 127.0.0.1:33308
I20260709 12:30:40.629235 18982 consensus_queue.cc:237] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:40.629400 18786 raft_consensus.cc:493] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:40.630368 18786 raft_consensus.cc:3060] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:40.640947 18786 raft_consensus.cc:515] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:40.641520 18936 raft_consensus.cc:2468] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d00654e5f6140bb86d525d53fee2d29 in term 2.
I20260709 12:30:40.640623 18682 catalog_manager.cc:5697] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29 reported cstate change: term changed from 1 to 2, leader changed from ab5691e75a854875a980098d99c779eb (127.8.111.67) to 2d00654e5f6140bb86d525d53fee2d29 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "2d00654e5f6140bb86d525d53fee2d29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:40.645156 18786 leader_election.cc:290] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29 [CANDIDATE]: Term 2 election: Requested vote from peers efae9dacdef849718ea0aa8e278fae38 (127.8.111.66:42233), ab5691e75a854875a980098d99c779eb (127.8.111.67:38137)
I20260709 12:30:40.645704 18936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c9a7f430be4b16b3ee76d278a3dfe5" candidate_uuid: "2d00654e5f6140bb86d525d53fee2d29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab5691e75a854875a980098d99c779eb"
I20260709 12:30:40.646945 18936 raft_consensus.cc:3055] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:40.646839 18861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c9a7f430be4b16b3ee76d278a3dfe5" candidate_uuid: "2d00654e5f6140bb86d525d53fee2d29" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "efae9dacdef849718ea0aa8e278fae38"
I20260709 12:30:40.647445 18936 raft_consensus.cc:740] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ab5691e75a854875a980098d99c779eb, State: Running, Role: LEADER
I20260709 12:30:40.647874 18861 raft_consensus.cc:3060] T b7c9a7f430be4b16b3ee76d278a3dfe5 P efae9dacdef849718ea0aa8e278fae38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:40.648308 18936 consensus_queue.cc:260] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:40.649597 18936 raft_consensus.cc:3060] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:40.656055 18861 raft_consensus.cc:2468] T b7c9a7f430be4b16b3ee76d278a3dfe5 P efae9dacdef849718ea0aa8e278fae38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d00654e5f6140bb86d525d53fee2d29 in term 2.
I20260709 12:30:40.656280 18936 raft_consensus.cc:2468] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d00654e5f6140bb86d525d53fee2d29 in term 2.
I20260709 12:30:40.657534 18750 leader_election.cc:304] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d00654e5f6140bb86d525d53fee2d29, ab5691e75a854875a980098d99c779eb; no voters: 
I20260709 12:30:40.658414 18982 raft_consensus.cc:2804] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:40.658955 18982 raft_consensus.cc:697] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29 [term 2 LEADER]: Becoming Leader. State: Replica: 2d00654e5f6140bb86d525d53fee2d29, State: Running, Role: LEADER
I20260709 12:30:40.659850 18982 consensus_queue.cc:237] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:40.667567 18685 catalog_manager.cc:5697] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29 reported cstate change: term changed from 1 to 2, leader changed from ab5691e75a854875a980098d99c779eb (127.8.111.67) to 2d00654e5f6140bb86d525d53fee2d29 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "2d00654e5f6140bb86d525d53fee2d29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:40.756253  8637 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:30:40.757943  8637 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:30:40.758323  8637 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:30:40.770570 18786 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45d4675c1b13491da65e406c1060762b"
dest_uuid: "2d00654e5f6140bb86d525d53fee2d29"
mode: GRACEFUL
new_leader_uuid: "efae9dacdef849718ea0aa8e278fae38"
 from {username='slave'} at 127.0.0.1:33324
I20260709 12:30:40.771193 18786 raft_consensus.cc:606] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [term 1 LEADER]: Received request to transfer leadership to TS efae9dacdef849718ea0aa8e278fae38
I20260709 12:30:40.772418  8637 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:30:41.034228 18936 raft_consensus.cc:1275] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [term 2 FOLLOWER]: Refusing update from remote peer 2d00654e5f6140bb86d525d53fee2d29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:41.035625 18982 consensus_queue.cc:1048] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:41.044046 18861 raft_consensus.cc:1275] T b6ee5191abc840d489a456be1c5b9cf1 P efae9dacdef849718ea0aa8e278fae38 [term 2 FOLLOWER]: Refusing update from remote peer 2d00654e5f6140bb86d525d53fee2d29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:41.045876 19030 consensus_queue.cc:1048] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:41.048830 18861 raft_consensus.cc:1275] T b7c9a7f430be4b16b3ee76d278a3dfe5 P efae9dacdef849718ea0aa8e278fae38 [term 2 FOLLOWER]: Refusing update from remote peer 2d00654e5f6140bb86d525d53fee2d29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:41.050467 18982 consensus_queue.cc:1048] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:41.059422 18936 raft_consensus.cc:1275] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [term 2 FOLLOWER]: Refusing update from remote peer 2d00654e5f6140bb86d525d53fee2d29: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:41.061203 19031 consensus_queue.cc:1048] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:41.077411 19020 raft_consensus.cc:993] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29: : Instructing follower efae9dacdef849718ea0aa8e278fae38 to start an election
I20260709 12:30:41.077926 19030 raft_consensus.cc:1081] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [term 1 LEADER]: Signalling peer efae9dacdef849718ea0aa8e278fae38 to start an election
I20260709 12:30:41.079789 18861 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45d4675c1b13491da65e406c1060762b"
dest_uuid: "efae9dacdef849718ea0aa8e278fae38"
 from {username='slave'} at 127.0.0.1:48006
I20260709 12:30:41.080835 18861 raft_consensus.cc:493] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:41.081209 18861 raft_consensus.cc:3060] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:41.086457 18861 raft_consensus.cc:515] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:41.088207 18861 leader_election.cc:290] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38 [CANDIDATE]: Term 2 election: Requested vote from peers 2d00654e5f6140bb86d525d53fee2d29 (127.8.111.65:37951), ab5691e75a854875a980098d99c779eb (127.8.111.67:38137)
I20260709 12:30:41.088920 18787 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d4675c1b13491da65e406c1060762b" candidate_uuid: "efae9dacdef849718ea0aa8e278fae38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d00654e5f6140bb86d525d53fee2d29"
I20260709 12:30:41.089159 18786 raft_consensus.cc:1275] T c553c3c1797b42539f148ef28531f5d8 P 2d00654e5f6140bb86d525d53fee2d29 [term 2 FOLLOWER]: Refusing update from remote peer ab5691e75a854875a980098d99c779eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:41.089570 18787 raft_consensus.cc:3055] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:41.089351 18936 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45d4675c1b13491da65e406c1060762b" candidate_uuid: "efae9dacdef849718ea0aa8e278fae38" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ab5691e75a854875a980098d99c779eb"
I20260709 12:30:41.089993 18787 raft_consensus.cc:740] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d00654e5f6140bb86d525d53fee2d29, State: Running, Role: LEADER
I20260709 12:30:41.090539 18936 raft_consensus.cc:3060] T 45d4675c1b13491da65e406c1060762b P ab5691e75a854875a980098d99c779eb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:41.090830 19024 consensus_queue.cc:1048] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:41.090894 18787 consensus_queue.cc:260] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:41.092265 18787 raft_consensus.cc:3060] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:41.098589 18936 raft_consensus.cc:2468] T 45d4675c1b13491da65e406c1060762b P ab5691e75a854875a980098d99c779eb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efae9dacdef849718ea0aa8e278fae38 in term 2.
I20260709 12:30:41.099418 18787 raft_consensus.cc:2468] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efae9dacdef849718ea0aa8e278fae38 in term 2.
I20260709 12:30:41.099952 18825 leader_election.cc:304] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab5691e75a854875a980098d99c779eb, efae9dacdef849718ea0aa8e278fae38; no voters: 
I20260709 12:30:41.101169 19025 raft_consensus.cc:2804] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:41.102079 18861 raft_consensus.cc:1275] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [term 2 FOLLOWER]: Refusing update from remote peer ab5691e75a854875a980098d99c779eb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:41.102622 19025 raft_consensus.cc:697] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38 [term 2 LEADER]: Becoming Leader. State: Replica: efae9dacdef849718ea0aa8e278fae38, State: Running, Role: LEADER
I20260709 12:30:41.103551 19025 consensus_queue.cc:237] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } }
I20260709 12:30:41.106402 19033 consensus_queue.cc:1048] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb [LEADER]: Connected to new peer: Peer: permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:41.111363 18682 catalog_manager.cc:5697] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38 reported cstate change: term changed from 1 to 2, leader changed from 2d00654e5f6140bb86d525d53fee2d29 (127.8.111.65) to efae9dacdef849718ea0aa8e278fae38 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "efae9dacdef849718ea0aa8e278fae38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2d00654e5f6140bb86d525d53fee2d29" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37951 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efae9dacdef849718ea0aa8e278fae38" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 42233 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab5691e75a854875a980098d99c779eb" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 38137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:41.389304  8637 tablet_server.cc:179] TabletServer@127.8.111.65:0 shutting down...
I20260709 12:30:41.409739  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:41.410432  8637 tablet_replica.cc:333] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29: stopping tablet replica
I20260709 12:30:41.410981  8637 raft_consensus.cc:2243] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.411412  8637 raft_consensus.cc:2272] T 45d4675c1b13491da65e406c1060762b P 2d00654e5f6140bb86d525d53fee2d29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.413714  8637 tablet_replica.cc:333] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29: stopping tablet replica
I20260709 12:30:41.414359  8637 raft_consensus.cc:2243] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.415136  8637 raft_consensus.cc:2272] T b7c9a7f430be4b16b3ee76d278a3dfe5 P 2d00654e5f6140bb86d525d53fee2d29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.417263  8637 tablet_replica.cc:333] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29: stopping tablet replica
I20260709 12:30:41.417768  8637 raft_consensus.cc:2243] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.418649  8637 raft_consensus.cc:2272] T b6ee5191abc840d489a456be1c5b9cf1 P 2d00654e5f6140bb86d525d53fee2d29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.420965  8637 tablet_replica.cc:333] T c553c3c1797b42539f148ef28531f5d8 P 2d00654e5f6140bb86d525d53fee2d29: stopping tablet replica
I20260709 12:30:41.421514  8637 raft_consensus.cc:2243] T c553c3c1797b42539f148ef28531f5d8 P 2d00654e5f6140bb86d525d53fee2d29 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.421928  8637 raft_consensus.cc:2272] T c553c3c1797b42539f148ef28531f5d8 P 2d00654e5f6140bb86d525d53fee2d29 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.444865  8637 tablet_server.cc:196] TabletServer@127.8.111.65:0 shutdown complete.
I20260709 12:30:41.456377  8637 tablet_server.cc:179] TabletServer@127.8.111.66:0 shutting down...
I20260709 12:30:41.472767  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:41.473412  8637 tablet_replica.cc:333] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38: stopping tablet replica
I20260709 12:30:41.474010  8637 raft_consensus.cc:2243] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.474665  8637 pending_rounds.cc:70] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38: Trying to abort 1 pending ops.
I20260709 12:30:41.474859  8637 pending_rounds.cc:77] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305626587572019200 op_type: NO_OP noop_request { }
I20260709 12:30:41.475168  8637 raft_consensus.cc:2889] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:30:41.475469  8637 raft_consensus.cc:2272] T 45d4675c1b13491da65e406c1060762b P efae9dacdef849718ea0aa8e278fae38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.477947  8637 tablet_replica.cc:333] T b7c9a7f430be4b16b3ee76d278a3dfe5 P efae9dacdef849718ea0aa8e278fae38: stopping tablet replica
I20260709 12:30:41.478538  8637 raft_consensus.cc:2243] T b7c9a7f430be4b16b3ee76d278a3dfe5 P efae9dacdef849718ea0aa8e278fae38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.478953  8637 raft_consensus.cc:2272] T b7c9a7f430be4b16b3ee76d278a3dfe5 P efae9dacdef849718ea0aa8e278fae38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.481130  8637 tablet_replica.cc:333] T b6ee5191abc840d489a456be1c5b9cf1 P efae9dacdef849718ea0aa8e278fae38: stopping tablet replica
I20260709 12:30:41.481614  8637 raft_consensus.cc:2243] T b6ee5191abc840d489a456be1c5b9cf1 P efae9dacdef849718ea0aa8e278fae38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.482044  8637 raft_consensus.cc:2272] T b6ee5191abc840d489a456be1c5b9cf1 P efae9dacdef849718ea0aa8e278fae38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.484110  8637 tablet_replica.cc:333] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38: stopping tablet replica
I20260709 12:30:41.484576  8637 raft_consensus.cc:2243] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.484982  8637 raft_consensus.cc:2272] T c553c3c1797b42539f148ef28531f5d8 P efae9dacdef849718ea0aa8e278fae38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.506800  8637 tablet_server.cc:196] TabletServer@127.8.111.66:0 shutdown complete.
I20260709 12:30:41.518558  8637 tablet_server.cc:179] TabletServer@127.8.111.67:0 shutting down...
I20260709 12:30:41.536672  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:41.537387  8637 tablet_replica.cc:333] T 45d4675c1b13491da65e406c1060762b P ab5691e75a854875a980098d99c779eb: stopping tablet replica
I20260709 12:30:41.537976  8637 raft_consensus.cc:2243] T 45d4675c1b13491da65e406c1060762b P ab5691e75a854875a980098d99c779eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.538519  8637 raft_consensus.cc:2272] T 45d4675c1b13491da65e406c1060762b P ab5691e75a854875a980098d99c779eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.540480  8637 tablet_replica.cc:333] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb: stopping tablet replica
I20260709 12:30:41.541056  8637 raft_consensus.cc:2243] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.541502  8637 raft_consensus.cc:2272] T b7c9a7f430be4b16b3ee76d278a3dfe5 P ab5691e75a854875a980098d99c779eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.543684  8637 tablet_replica.cc:333] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb: stopping tablet replica
I20260709 12:30:41.544224  8637 raft_consensus.cc:2243] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:41.544672  8637 raft_consensus.cc:2272] T b6ee5191abc840d489a456be1c5b9cf1 P ab5691e75a854875a980098d99c779eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.546965  8637 tablet_replica.cc:333] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb: stopping tablet replica
I20260709 12:30:41.547462  8637 raft_consensus.cc:2243] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.548290  8637 raft_consensus.cc:2272] T c553c3c1797b42539f148ef28531f5d8 P ab5691e75a854875a980098d99c779eb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.571135  8637 tablet_server.cc:196] TabletServer@127.8.111.67:0 shutdown complete.
I20260709 12:30:41.583191  8637 master.cc:562] Master@127.8.111.126:40917 shutting down...
I20260709 12:30:41.600986  8637 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:41.601497  8637 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:41.601897  8637 tablet_replica.cc:333] T 00000000000000000000000000000000 P 88b35d7845ca48a3b8fcfcd189b55087: stopping tablet replica
I20260709 12:30:41.620698  8637 master.cc:584] Master@127.8.111.126:40917 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2842 ms)
[----------] 6 tests from LeaderRebalancerTest (365196 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:30:41.650209  8637 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.111.126:43789
I20260709 12:30:41.651304  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:41.656499 19036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:41.656814 19037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:41.657691 19039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:41.658835  8637 server_base.cc:1061] running on GCE node
I20260709 12:30:41.659685  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:41.659850  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:41.660033  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600241660018 us; error 0 us; skew 500 ppm
I20260709 12:30:41.660624  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:41.663101  8637 webserver.cc:533] Webserver started at http://127.8.111.126:42717/ using document root <none> and password file <none>
I20260709 12:30:41.663575  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:41.663731  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:41.664047  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:41.665135  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599876290468-8637-0/minicluster-data/master-0-root/instance:
uuid: "dd0c029957244c98a6e49d67421d665a"
format_stamp: "Formatted at 2026-07-09 12:30:41 on dist-test-slave-044g"
I20260709 12:30:41.669953  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:30:41.673705 19044 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:41.674638  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:30:41.674868  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599876290468-8637-0/minicluster-data/master-0-root
uuid: "dd0c029957244c98a6e49d67421d665a"
format_stamp: "Formatted at 2026-07-09 12:30:41 on dist-test-slave-044g"
I20260709 12:30:41.675107  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599876290468-8637-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599876290468-8637-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599876290468-8637-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:41.696807  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:41.697737  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:41.732261  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.126:43789
I20260709 12:30:41.732380 19095 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.126:43789 every 8 connection(s)
I20260709 12:30:41.736128 19096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:41.746594 19096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a: Bootstrap starting.
I20260709 12:30:41.750811 19096 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:41.754357 19096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a: No bootstrap required, opened a new log
I20260709 12:30:41.756208 19096 raft_consensus.cc:359] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd0c029957244c98a6e49d67421d665a" member_type: VOTER }
I20260709 12:30:41.756556 19096 raft_consensus.cc:385] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:41.756737 19096 raft_consensus.cc:740] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd0c029957244c98a6e49d67421d665a, State: Initialized, Role: FOLLOWER
I20260709 12:30:41.757284 19096 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd0c029957244c98a6e49d67421d665a" member_type: VOTER }
I20260709 12:30:41.757694 19096 raft_consensus.cc:399] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:30:41.757879 19096 raft_consensus.cc:493] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:30:41.758090 19096 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:41.762434 19096 raft_consensus.cc:515] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd0c029957244c98a6e49d67421d665a" member_type: VOTER }
I20260709 12:30:41.762847 19096 leader_election.cc:304] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd0c029957244c98a6e49d67421d665a; no voters: 
I20260709 12:30:41.763816 19096 leader_election.cc:290] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:30:41.764101 19099 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:41.765414 19099 raft_consensus.cc:697] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a [term 1 LEADER]: Becoming Leader. State: Replica: dd0c029957244c98a6e49d67421d665a, State: Running, Role: LEADER
I20260709 12:30:41.766050 19099 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd0c029957244c98a6e49d67421d665a" member_type: VOTER }
I20260709 12:30:41.766674 19096 sys_catalog.cc:565] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:30:41.768958 19100 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd0c029957244c98a6e49d67421d665a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd0c029957244c98a6e49d67421d665a" member_type: VOTER } }
I20260709 12:30:41.768999 19101 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd0c029957244c98a6e49d67421d665a. Latest consensus state: current_term: 1 leader_uuid: "dd0c029957244c98a6e49d67421d665a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd0c029957244c98a6e49d67421d665a" member_type: VOTER } }
I20260709 12:30:41.769774 19101 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a [sys.catalog]: This master's current role is: LEADER
I20260709 12:30:41.771180 19100 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a [sys.catalog]: This master's current role is: LEADER
I20260709 12:30:41.773217 19105 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:30:41.779204 19105 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:30:41.781149  8637 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:30:41.787634 19105 catalog_manager.cc:1383] Generated new cluster ID: e1897f974bd24e03b4b1dd73f474cbf9
I20260709 12:30:41.787916 19105 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:30:41.814632 19105 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:30:41.815954 19105 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:30:41.830621 19105 catalog_manager.cc:6070] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a: Generated new TSK 0
I20260709 12:30:41.831522 19105 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:30:41.847177  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:41.853447 19118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:41.853641 19117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:41.855258 19120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:41.855765  8637 server_base.cc:1061] running on GCE node
I20260709 12:30:41.856612  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:41.856822  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:41.856997  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600241856978 us; error 0 us; skew 500 ppm
I20260709 12:30:41.857537  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:41.859688  8637 webserver.cc:533] Webserver started at http://127.8.111.65:41965/ using document root <none> and password file <none>
I20260709 12:30:41.860176  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:41.860375  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:41.860656  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:41.861670  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599876290468-8637-0/minicluster-data/ts-0-root/instance:
uuid: "36047ee0e391483f8291472a07246128"
format_stamp: "Formatted at 2026-07-09 12:30:41 on dist-test-slave-044g"
I20260709 12:30:41.865935  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 12:30:41.869148 19125 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:41.869835  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:30:41.870146  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599876290468-8637-0/minicluster-data/ts-0-root
uuid: "36047ee0e391483f8291472a07246128"
format_stamp: "Formatted at 2026-07-09 12:30:41 on dist-test-slave-044g"
I20260709 12:30:41.870482  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599876290468-8637-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599876290468-8637-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599876290468-8637-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:41.910588  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:41.911705  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:41.913125  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:41.915323  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:30:41.915552  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:41.915793  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:30:41.915961  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:41.953691  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.65:37375
I20260709 12:30:41.953814 19187 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.65:37375 every 8 connection(s)
I20260709 12:30:41.958691  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:41.965602 19192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:41.967494 19193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:41.968654 19195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:41.970090  8637 server_base.cc:1061] running on GCE node
I20260709 12:30:41.970989  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:30:41.971256  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:41.971299 19188 heartbeater.cc:344] Connected to a master server at 127.8.111.126:43789
I20260709 12:30:41.971464  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600241971445 us; error 0 us; skew 500 ppm
I20260709 12:30:41.971810 19188 heartbeater.cc:461] Registering TS with master...
I20260709 12:30:41.972216  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:41.972635 19188 heartbeater.cc:507] Master 127.8.111.126:43789 requested a full tablet report, sending...
I20260709 12:30:41.975023  8637 webserver.cc:533] Webserver started at http://127.8.111.66:36757/ using document root <none> and password file <none>
I20260709 12:30:41.975107 19061 ts_manager.cc:194] Registered new tserver with Master: 36047ee0e391483f8291472a07246128 (127.8.111.65:37375)
I20260709 12:30:41.975608  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:41.975894  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:41.976246  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:41.977176 19061 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56682
I20260709 12:30:41.977422  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599876290468-8637-0/minicluster-data/ts-1-root/instance:
uuid: "c47d5c46e83e47808560e697b5819921"
format_stamp: "Formatted at 2026-07-09 12:30:41 on dist-test-slave-044g"
I20260709 12:30:41.982084  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:30:41.985275 19200 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:41.986152  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:30:41.986465  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599876290468-8637-0/minicluster-data/ts-1-root
uuid: "c47d5c46e83e47808560e697b5819921"
format_stamp: "Formatted at 2026-07-09 12:30:41 on dist-test-slave-044g"
I20260709 12:30:41.986747  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599876290468-8637-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599876290468-8637-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599876290468-8637-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:41.996621  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:41.997665  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:41.999050  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:42.001137  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:30:42.001363  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:42.001600  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:30:42.001773  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:42.040091  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.66:41321
I20260709 12:30:42.040192 19262 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.66:41321 every 8 connection(s)
I20260709 12:30:42.044914  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:30:42.051424 19266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:42.052333 19267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:30:42.055666 19270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:30:42.056501 19263 heartbeater.cc:344] Connected to a master server at 127.8.111.126:43789
I20260709 12:30:42.056624  8637 server_base.cc:1061] running on GCE node
I20260709 12:30:42.056973 19263 heartbeater.cc:461] Registering TS with master...
I20260709 12:30:42.057623  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:30:42.057696 19263 heartbeater.cc:507] Master 127.8.111.126:43789 requested a full tablet report, sending...
W20260709 12:30:42.057881  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:30:42.058144  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600242058125 us; error 0 us; skew 500 ppm
I20260709 12:30:42.058756  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:30:42.059810 19061 ts_manager.cc:194] Registered new tserver with Master: c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321)
I20260709 12:30:42.061053 19061 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56692
I20260709 12:30:42.064291  8637 webserver.cc:533] Webserver started at http://127.8.111.67:37091/ using document root <none> and password file <none>
I20260709 12:30:42.064754  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:30:42.064905  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:30:42.065114  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:30:42.066242  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599876290468-8637-0/minicluster-data/ts-2-root/instance:
uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
format_stamp: "Formatted at 2026-07-09 12:30:42 on dist-test-slave-044g"
I20260709 12:30:42.070647  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:30:42.073994 19274 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:42.074837  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:30:42.075095  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599876290468-8637-0/minicluster-data/ts-2-root
uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
format_stamp: "Formatted at 2026-07-09 12:30:42 on dist-test-slave-044g"
I20260709 12:30:42.075330  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599876290468-8637-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599876290468-8637-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599876290468-8637-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:30:42.092427  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:30:42.093464  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:30:42.094878  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:30:42.097115  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:30:42.097332  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:42.097573  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:30:42.097747  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:30:42.134544  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.67:37131
I20260709 12:30:42.134658 19336 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.67:37131 every 8 connection(s)
I20260709 12:30:42.148432 19337 heartbeater.cc:344] Connected to a master server at 127.8.111.126:43789
I20260709 12:30:42.148914 19337 heartbeater.cc:461] Registering TS with master...
I20260709 12:30:42.149636 19337 heartbeater.cc:507] Master 127.8.111.126:43789 requested a full tablet report, sending...
I20260709 12:30:42.151473 19061 ts_manager.cc:194] Registered new tserver with Master: 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:42.152470  8637 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014756523s
I20260709 12:30:42.152803 19061 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56704
I20260709 12:30:42.177239 19061 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56710:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:30:42.179739 19061 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:30:42.245815 19302 tablet_service.cc:1511] Processing CreateTablet for tablet 6c15fe963984464288540f966880e07b (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:30:42.246248 19301 tablet_service.cc:1511] Processing CreateTablet for tablet 2d00fe8097684a3c97dc5004cf9dc49e (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:30:42.248113 19300 tablet_service.cc:1511] Processing CreateTablet for tablet dcad3b84a85f4e678a358c825d53c551 (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:30:42.248950 19299 tablet_service.cc:1511] Processing CreateTablet for tablet 2057b2de3b3c4ae8b0419bb8c846e616 (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:30:42.249558 19302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c15fe963984464288540f966880e07b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.250237 19299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2057b2de3b3c4ae8b0419bb8c846e616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.251370 19300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcad3b84a85f4e678a358c825d53c551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.254024 19301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d00fe8097684a3c97dc5004cf9dc49e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.257764 19228 tablet_service.cc:1511] Processing CreateTablet for tablet 6c15fe963984464288540f966880e07b (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:30:42.259217 19228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c15fe963984464288540f966880e07b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.269012 19298 tablet_service.cc:1511] Processing CreateTablet for tablet 50ca47c357ac4f17a410d0152c51e24c (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:30:42.270504 19298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ca47c357ac4f17a410d0152c51e24c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.274749 19297 tablet_service.cc:1511] Processing CreateTablet for tablet 4ddc5cd2e6bb45778c8ca3c52b0c6c23 (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:30:42.276656 19297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ddc5cd2e6bb45778c8ca3c52b0c6c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.277601 19227 tablet_service.cc:1511] Processing CreateTablet for tablet 2d00fe8097684a3c97dc5004cf9dc49e (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:30:42.278944 19227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d00fe8097684a3c97dc5004cf9dc49e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.290104 19226 tablet_service.cc:1511] Processing CreateTablet for tablet dcad3b84a85f4e678a358c825d53c551 (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:30:42.291481 19226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcad3b84a85f4e678a358c825d53c551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.295459 19225 tablet_service.cc:1511] Processing CreateTablet for tablet 2057b2de3b3c4ae8b0419bb8c846e616 (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:30:42.296795 19225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2057b2de3b3c4ae8b0419bb8c846e616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.301654 19224 tablet_service.cc:1511] Processing CreateTablet for tablet 50ca47c357ac4f17a410d0152c51e24c (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:30:42.303023 19224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ca47c357ac4f17a410d0152c51e24c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.304486 19152 tablet_service.cc:1511] Processing CreateTablet for tablet 2d00fe8097684a3c97dc5004cf9dc49e (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:30:42.305819 19152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d00fe8097684a3c97dc5004cf9dc49e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.305920 19153 tablet_service.cc:1511] Processing CreateTablet for tablet 6c15fe963984464288540f966880e07b (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:30:42.307225 19153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c15fe963984464288540f966880e07b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.307327 19223 tablet_service.cc:1511] Processing CreateTablet for tablet 4ddc5cd2e6bb45778c8ca3c52b0c6c23 (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:30:42.308383 19150 tablet_service.cc:1511] Processing CreateTablet for tablet 2057b2de3b3c4ae8b0419bb8c846e616 (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:30:42.309695 19150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2057b2de3b3c4ae8b0419bb8c846e616. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.307344 19151 tablet_service.cc:1511] Processing CreateTablet for tablet dcad3b84a85f4e678a358c825d53c551 (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:30:42.311344 19151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcad3b84a85f4e678a358c825d53c551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.315372 19149 tablet_service.cc:1511] Processing CreateTablet for tablet 50ca47c357ac4f17a410d0152c51e24c (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:30:42.316148 19300 tablet_service.cc:1511] Processing CreateTablet for tablet a8abbc11e279441aa8cccafbf8df6290 (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:30:42.316764 19149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50ca47c357ac4f17a410d0152c51e24c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.317447 19300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8abbc11e279441aa8cccafbf8df6290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.319201 19148 tablet_service.cc:1511] Processing CreateTablet for tablet 4ddc5cd2e6bb45778c8ca3c52b0c6c23 (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:30:42.319293 19222 tablet_service.cc:1511] Processing CreateTablet for tablet a8abbc11e279441aa8cccafbf8df6290 (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:30:42.320495 19148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ddc5cd2e6bb45778c8ca3c52b0c6c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.321276 19146 tablet_service.cc:1511] Processing CreateTablet for tablet 30901d6e67d24b3499ef3a95deeeab16 (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:30:42.322580 19146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30901d6e67d24b3499ef3a95deeeab16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.323324 19147 tablet_service.cc:1511] Processing CreateTablet for tablet a8abbc11e279441aa8cccafbf8df6290 (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:30:42.324559 19147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8abbc11e279441aa8cccafbf8df6290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.324249 19301 tablet_service.cc:1511] Processing CreateTablet for tablet 30901d6e67d24b3499ef3a95deeeab16 (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:30:42.325533 19301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30901d6e67d24b3499ef3a95deeeab16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.308789 19223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ddc5cd2e6bb45778c8ca3c52b0c6c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.332276 19222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8abbc11e279441aa8cccafbf8df6290. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.341887 19145 tablet_service.cc:1511] Processing CreateTablet for tablet 7bc577d7fc884a9e83176de68badcabc (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:30:42.343250 19145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bc577d7fc884a9e83176de68badcabc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.352052 19352 tablet_bootstrap.cc:492] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c: Bootstrap starting.
I20260709 12:30:42.358183 19352 tablet_bootstrap.cc:654] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.366899 19221 tablet_service.cc:1511] Processing CreateTablet for tablet 7bc577d7fc884a9e83176de68badcabc (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:30:42.368220 19221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bc577d7fc884a9e83176de68badcabc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.323386 19227 tablet_service.cc:1511] Processing CreateTablet for tablet 30901d6e67d24b3499ef3a95deeeab16 (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:30:42.378934 19227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30901d6e67d24b3499ef3a95deeeab16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.408728 19353 tablet_bootstrap.cc:492] T 6c15fe963984464288540f966880e07b P c47d5c46e83e47808560e697b5819921: Bootstrap starting.
I20260709 12:30:42.412600 19301 tablet_service.cc:1511] Processing CreateTablet for tablet 7bc577d7fc884a9e83176de68badcabc (DEFAULT_TABLE table=test-workload [id=83cc20baf08240699a16e566d4d19535]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:30:42.413923 19301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bc577d7fc884a9e83176de68badcabc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:42.415634 19352 tablet_bootstrap.cc:492] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c: No bootstrap required, opened a new log
I20260709 12:30:42.416195 19352 ts_tablet_manager.cc:1403] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.014s
I20260709 12:30:42.419148 19352 raft_consensus.cc:359] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.427016 19352 raft_consensus.cc:385] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.426708 19353 tablet_bootstrap.cc:654] T 6c15fe963984464288540f966880e07b P c47d5c46e83e47808560e697b5819921: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.423305 19354 tablet_bootstrap.cc:492] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128: Bootstrap starting.
I20260709 12:30:42.434394 19352 raft_consensus.cc:740] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.435803 19352 consensus_queue.cc:260] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.445763 19352 ts_tablet_manager.cc:1434] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.003s
I20260709 12:30:42.447067 19353 tablet_bootstrap.cc:492] T 6c15fe963984464288540f966880e07b P c47d5c46e83e47808560e697b5819921: No bootstrap required, opened a new log
I20260709 12:30:42.447608 19353 ts_tablet_manager.cc:1403] T 6c15fe963984464288540f966880e07b P c47d5c46e83e47808560e697b5819921: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.006s
I20260709 12:30:42.448335 19337 heartbeater.cc:499] Master 127.8.111.126:43789 was elected leader, sending a full tablet report...
I20260709 12:30:42.448673 19354 tablet_bootstrap.cc:654] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.452124 19353 raft_consensus.cc:359] T 6c15fe963984464288540f966880e07b P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } }
I20260709 12:30:42.453330 19352 tablet_bootstrap.cc:492] T 2d00fe8097684a3c97dc5004cf9dc49e P 706ce9f0353f4fa0a4744bf07bd4537c: Bootstrap starting.
I20260709 12:30:42.453661 19353 raft_consensus.cc:385] T 6c15fe963984464288540f966880e07b P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.454020 19353 raft_consensus.cc:740] T 6c15fe963984464288540f966880e07b P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.454926 19353 consensus_queue.cc:260] T 6c15fe963984464288540f966880e07b P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } }
I20260709 12:30:42.460247 19263 heartbeater.cc:499] Master 127.8.111.126:43789 was elected leader, sending a full tablet report...
I20260709 12:30:42.461344 19353 ts_tablet_manager.cc:1434] T 6c15fe963984464288540f966880e07b P c47d5c46e83e47808560e697b5819921: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:30:42.462337 19353 tablet_bootstrap.cc:492] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921: Bootstrap starting.
I20260709 12:30:42.469005 19352 tablet_bootstrap.cc:654] T 2d00fe8097684a3c97dc5004cf9dc49e P 706ce9f0353f4fa0a4744bf07bd4537c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.471100 19354 tablet_bootstrap.cc:492] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128: No bootstrap required, opened a new log
I20260709 12:30:42.474941 19353 tablet_bootstrap.cc:654] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.475351 19354 ts_tablet_manager.cc:1403] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.014s
I20260709 12:30:42.479954 19354 raft_consensus.cc:359] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } }
I20260709 12:30:42.481009 19354 raft_consensus.cc:385] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.481451 19354 raft_consensus.cc:740] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.482525 19354 consensus_queue.cc:260] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } }
I20260709 12:30:42.488402 19352 tablet_bootstrap.cc:492] T 2d00fe8097684a3c97dc5004cf9dc49e P 706ce9f0353f4fa0a4744bf07bd4537c: No bootstrap required, opened a new log
I20260709 12:30:42.489027 19352 ts_tablet_manager.cc:1403] T 2d00fe8097684a3c97dc5004cf9dc49e P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.011s
I20260709 12:30:42.491053 19353 tablet_bootstrap.cc:492] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921: No bootstrap required, opened a new log
I20260709 12:30:42.491777 19353 ts_tablet_manager.cc:1403] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.007s
I20260709 12:30:42.491842 19352 raft_consensus.cc:359] T 2d00fe8097684a3c97dc5004cf9dc49e P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.493182 19352 raft_consensus.cc:385] T 2d00fe8097684a3c97dc5004cf9dc49e P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.493429 19352 raft_consensus.cc:740] T 2d00fe8097684a3c97dc5004cf9dc49e P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.494127 19352 consensus_queue.cc:260] T 2d00fe8097684a3c97dc5004cf9dc49e P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.495801 19352 ts_tablet_manager.cc:1434] T 2d00fe8097684a3c97dc5004cf9dc49e P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:30:42.496872 19352 tablet_bootstrap.cc:492] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c: Bootstrap starting.
I20260709 12:30:42.497014 19188 heartbeater.cc:499] Master 127.8.111.126:43789 was elected leader, sending a full tablet report...
I20260709 12:30:42.497721 19354 ts_tablet_manager.cc:1434] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128: Time spent starting tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 12:30:42.498813 19354 tablet_bootstrap.cc:492] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128: Bootstrap starting.
I20260709 12:30:42.503584 19352 tablet_bootstrap.cc:654] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.505398 19354 tablet_bootstrap.cc:654] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.505959 19353 raft_consensus.cc:359] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.506743 19353 raft_consensus.cc:385] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.507059 19353 raft_consensus.cc:740] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.507858 19353 consensus_queue.cc:260] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.511303 19353 ts_tablet_manager.cc:1434] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.003s
I20260709 12:30:42.512342 19353 tablet_bootstrap.cc:492] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921: Bootstrap starting.
I20260709 12:30:42.515256 19352 tablet_bootstrap.cc:492] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c: No bootstrap required, opened a new log
I20260709 12:30:42.515328 19354 tablet_bootstrap.cc:492] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128: No bootstrap required, opened a new log
I20260709 12:30:42.515969 19352 ts_tablet_manager.cc:1403] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:30:42.516160 19354 ts_tablet_manager.cc:1403] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:30:42.518620 19353 tablet_bootstrap.cc:654] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.518910 19352 raft_consensus.cc:359] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.519699 19352 raft_consensus.cc:385] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.519325 19354 raft_consensus.cc:359] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.520016 19352 raft_consensus.cc:740] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.520274 19354 raft_consensus.cc:385] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.520763 19354 raft_consensus.cc:740] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.520957 19352 consensus_queue.cc:260] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.522049 19354 consensus_queue.cc:260] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.524988 19354 ts_tablet_manager.cc:1434] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:30:42.526582 19354 tablet_bootstrap.cc:492] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128: Bootstrap starting.
I20260709 12:30:42.527568 19352 ts_tablet_manager.cc:1434] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:30:42.528607 19352 tablet_bootstrap.cc:492] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c: Bootstrap starting.
I20260709 12:30:42.534403 19352 tablet_bootstrap.cc:654] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.535663 19353 tablet_bootstrap.cc:492] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921: No bootstrap required, opened a new log
I20260709 12:30:42.536176 19353 ts_tablet_manager.cc:1403] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.009s
I20260709 12:30:42.536645 19354 tablet_bootstrap.cc:654] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.539113 19353 raft_consensus.cc:359] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.540102 19353 raft_consensus.cc:385] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.540479 19353 raft_consensus.cc:740] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.541620 19353 consensus_queue.cc:260] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.545171 19354 tablet_bootstrap.cc:492] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128: No bootstrap required, opened a new log
I20260709 12:30:42.545753 19354 ts_tablet_manager.cc:1403] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 12:30:42.548645 19354 raft_consensus.cc:359] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.549741 19354 raft_consensus.cc:385] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.550093 19354 raft_consensus.cc:740] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.551075 19354 consensus_queue.cc:260] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.553086 19353 ts_tablet_manager.cc:1434] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.003s
I20260709 12:30:42.553582 19354 ts_tablet_manager.cc:1434] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:30:42.554970 19353 tablet_bootstrap.cc:492] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921: Bootstrap starting.
I20260709 12:30:42.555078 19352 tablet_bootstrap.cc:492] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c: No bootstrap required, opened a new log
I20260709 12:30:42.556146 19352 ts_tablet_manager.cc:1403] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.010s
I20260709 12:30:42.556731 19354 tablet_bootstrap.cc:492] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128: Bootstrap starting.
I20260709 12:30:42.559056 19352 raft_consensus.cc:359] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } }
I20260709 12:30:42.559789 19352 raft_consensus.cc:385] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.560084 19352 raft_consensus.cc:740] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.560813 19352 consensus_queue.cc:260] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } }
I20260709 12:30:42.563097 19354 tablet_bootstrap.cc:654] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.564481 19353 tablet_bootstrap.cc:654] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.566004 19352 ts_tablet_manager.cc:1434] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:30:42.567137 19352 tablet_bootstrap.cc:492] T 50ca47c357ac4f17a410d0152c51e24c P 706ce9f0353f4fa0a4744bf07bd4537c: Bootstrap starting.
I20260709 12:30:42.575881 19352 tablet_bootstrap.cc:654] T 50ca47c357ac4f17a410d0152c51e24c P 706ce9f0353f4fa0a4744bf07bd4537c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.581497 19353 tablet_bootstrap.cc:492] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921: No bootstrap required, opened a new log
I20260709 12:30:42.582151 19353 ts_tablet_manager.cc:1403] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.005s
I20260709 12:30:42.582659 19354 tablet_bootstrap.cc:492] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128: No bootstrap required, opened a new log
I20260709 12:30:42.583185 19354 ts_tablet_manager.cc:1403] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.011s
I20260709 12:30:42.585363 19357 raft_consensus.cc:493] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:42.585544 19353 raft_consensus.cc:359] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.585851 19354 raft_consensus.cc:359] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.586339 19353 raft_consensus.cc:385] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.585913 19357 raft_consensus.cc:515] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } }
I20260709 12:30:42.586640 19354 raft_consensus.cc:385] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.586683 19353 raft_consensus.cc:740] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.587144 19354 raft_consensus.cc:740] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.587919 19354 consensus_queue.cc:260] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.587778 19353 consensus_queue.cc:260] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.591724 19354 ts_tablet_manager.cc:1434] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:30:42.592824 19354 tablet_bootstrap.cc:492] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 36047ee0e391483f8291472a07246128: Bootstrap starting.
I20260709 12:30:42.594944 19353 ts_tablet_manager.cc:1434] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:30:42.596024 19353 tablet_bootstrap.cc:492] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921: Bootstrap starting.
I20260709 12:30:42.599779 19354 tablet_bootstrap.cc:654] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 36047ee0e391483f8291472a07246128: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.600340 19238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c15fe963984464288540f966880e07b" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921" is_pre_election: true
I20260709 12:30:42.601110 19238 raft_consensus.cc:2468] T 6c15fe963984464288540f966880e07b P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 0.
I20260709 12:30:42.602674 19278 leader_election.cc:304] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 706ce9f0353f4fa0a4744bf07bd4537c, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:42.602972 19353 tablet_bootstrap.cc:654] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.604338 19357 leader_election.cc:290] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 36047ee0e391483f8291472a07246128 (127.8.111.65:37375)
I20260709 12:30:42.604880 19357 raft_consensus.cc:2804] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:42.605257 19357 raft_consensus.cc:493] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:42.605629 19357 raft_consensus.cc:3060] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:42.613819 19359 raft_consensus.cc:493] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:42.614550 19359 raft_consensus.cc:515] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.620510 19352 tablet_bootstrap.cc:492] T 50ca47c357ac4f17a410d0152c51e24c P 706ce9f0353f4fa0a4744bf07bd4537c: No bootstrap required, opened a new log
I20260709 12:30:42.621110 19352 ts_tablet_manager.cc:1403] T 50ca47c357ac4f17a410d0152c51e24c P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent bootstrapping tablet: real 0.054s	user 0.008s	sys 0.007s
I20260709 12:30:42.625612 19359 leader_election.cc:290] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:42.644035 19362 raft_consensus.cc:493] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:42.643499 19352 raft_consensus.cc:359] T 50ca47c357ac4f17a410d0152c51e24c P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.644780 19352 raft_consensus.cc:385] T 50ca47c357ac4f17a410d0152c51e24c P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.644737 19362 raft_consensus.cc:515] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.645478 19352 raft_consensus.cc:740] T 50ca47c357ac4f17a410d0152c51e24c P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.651818 19357 raft_consensus.cc:515] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } }
I20260709 12:30:42.654399 19362 leader_election.cc:290] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:42.658339 19354 tablet_bootstrap.cc:492] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 36047ee0e391483f8291472a07246128: No bootstrap required, opened a new log
I20260709 12:30:42.659065 19354 ts_tablet_manager.cc:1403] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 36047ee0e391483f8291472a07246128: Time spent bootstrapping tablet: real 0.066s	user 0.033s	sys 0.030s
I20260709 12:30:42.662989 19354 raft_consensus.cc:359] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.664045 19354 raft_consensus.cc:385] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.664474 19354 raft_consensus.cc:740] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.665373 19354 consensus_queue.cc:260] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.668253 19354 ts_tablet_manager.cc:1434] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 36047ee0e391483f8291472a07246128: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:30:42.669802 19354 tablet_bootstrap.cc:492] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128: Bootstrap starting.
I20260709 12:30:42.675925 19354 tablet_bootstrap.cc:654] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.678871 19359 raft_consensus.cc:493] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:42.679598 19238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c15fe963984464288540f966880e07b" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:42.679525 19359 raft_consensus.cc:515] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.680536 19238 raft_consensus.cc:3060] T 6c15fe963984464288540f966880e07b P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:42.682866 19359 leader_election.cc:290] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:42.687644 19354 tablet_bootstrap.cc:492] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128: No bootstrap required, opened a new log
I20260709 12:30:42.688236 19354 ts_tablet_manager.cc:1403] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:30:42.691577 19354 raft_consensus.cc:359] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.692554 19354 raft_consensus.cc:385] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.693044 19354 raft_consensus.cc:740] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.694000 19354 consensus_queue.cc:260] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.696697 19354 ts_tablet_manager.cc:1434] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:30:42.691815 19238 raft_consensus.cc:2468] T 6c15fe963984464288540f966880e07b P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 1.
I20260709 12:30:42.698431 19354 tablet_bootstrap.cc:492] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128: Bootstrap starting.
I20260709 12:30:42.698181 19278 leader_election.cc:304] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 706ce9f0353f4fa0a4744bf07bd4537c, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:42.699676 19372 raft_consensus.cc:2804] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:42.705106 19163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c15fe963984464288540f966880e07b" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128" is_pre_election: true
I20260709 12:30:42.705925 19354 tablet_bootstrap.cc:654] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.706166 19163 raft_consensus.cc:2468] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 0.
I20260709 12:30:42.712924 19353 tablet_bootstrap.cc:492] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921: No bootstrap required, opened a new log
I20260709 12:30:42.713562 19353 ts_tablet_manager.cc:1403] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921: Time spent bootstrapping tablet: real 0.118s	user 0.035s	sys 0.072s
I20260709 12:30:42.716656 19163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c15fe963984464288540f966880e07b" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:42.716974 19353 raft_consensus.cc:359] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.717131 19362 raft_consensus.cc:493] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:42.717305 19163 raft_consensus.cc:3060] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:42.717792 19353 raft_consensus.cc:385] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.717991 19362 raft_consensus.cc:515] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.719568 19312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc577d7fc884a9e83176de68badcabc" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" is_pre_election: true
I20260709 12:30:42.722355 19353 raft_consensus.cc:740] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.721819 19161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d00fe8097684a3c97dc5004cf9dc49e" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128" is_pre_election: true
I20260709 12:30:42.726590 19353 consensus_queue.cc:260] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
W20260709 12:30:42.726994 19202 leader_election.cc:343] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:42.724272 19362 leader_election.cc:290] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:42.719985 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d00fe8097684a3c97dc5004cf9dc49e" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" is_pre_election: true
I20260709 12:30:42.727778 19362 raft_consensus.cc:493] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:42.727999 19311 raft_consensus.cc:2468] T 2d00fe8097684a3c97dc5004cf9dc49e P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 0.
I20260709 12:30:42.728288 19362 raft_consensus.cc:515] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.721354 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc577d7fc884a9e83176de68badcabc" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128" is_pre_election: true
I20260709 12:30:42.729872 19162 raft_consensus.cc:2468] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 0.
I20260709 12:30:42.734866 19163 raft_consensus.cc:2468] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 1.
I20260709 12:30:42.734788 19202 leader_election.cc:304] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 706ce9f0353f4fa0a4744bf07bd4537c, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:42.718096 19352 consensus_queue.cc:260] T 50ca47c357ac4f17a410d0152c51e24c P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.736574 19359 raft_consensus.cc:2804] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:42.737068 19359 raft_consensus.cc:493] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:42.735610 19357 leader_election.cc:290] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 election: Requested vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 36047ee0e391483f8291472a07246128 (127.8.111.65:37375)
I20260709 12:30:42.737526 19359 raft_consensus.cc:3060] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:42.739014 19362 leader_election.cc:290] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
W20260709 12:30:42.743470 19204 leader_election.cc:343] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36047ee0e391483f8291472a07246128 (127.8.111.65:37375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:42.724246 19354 tablet_bootstrap.cc:492] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128: No bootstrap required, opened a new log
I20260709 12:30:42.744504 19204 leader_election.cc:304] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36047ee0e391483f8291472a07246128, c47d5c46e83e47808560e697b5819921; no voters: 706ce9f0353f4fa0a4744bf07bd4537c
I20260709 12:30:42.746170 19354 ts_tablet_manager.cc:1403] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.009s
I20260709 12:30:42.744676 19372 raft_consensus.cc:697] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Becoming Leader. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Running, Role: LEADER
I20260709 12:30:42.749091 19372 consensus_queue.cc:237] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } }
I20260709 12:30:42.756541 19238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc577d7fc884a9e83176de68badcabc" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921" is_pre_election: true
I20260709 12:30:42.756290 19353 ts_tablet_manager.cc:1434] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.006s
I20260709 12:30:42.757227 19238 raft_consensus.cc:2468] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 0.
I20260709 12:30:42.751116 19354 raft_consensus.cc:359] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.757863 19354 raft_consensus.cc:385] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.758234 19354 raft_consensus.cc:740] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.758359 19352 ts_tablet_manager.cc:1434] T 50ca47c357ac4f17a410d0152c51e24c P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent starting tablet: real 0.137s	user 0.010s	sys 0.019s
I20260709 12:30:42.758730 19236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca47c357ac4f17a410d0152c51e24c" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921" is_pre_election: true
I20260709 12:30:42.759418 19236 raft_consensus.cc:2468] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 0.
I20260709 12:30:42.759135 19354 consensus_queue.cc:260] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.760001 19352 tablet_bootstrap.cc:492] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 706ce9f0353f4fa0a4744bf07bd4537c: Bootstrap starting.
I20260709 12:30:42.760739 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2057b2de3b3c4ae8b0419bb8c846e616" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921" is_pre_election: true
I20260709 12:30:42.761792 19354 ts_tablet_manager.cc:1434] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:30:42.762526 19129 leader_election.cc:304] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:42.762849 19354 tablet_bootstrap.cc:492] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128: Bootstrap starting.
I20260709 12:30:42.763901 19362 raft_consensus.cc:2804] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:42.764315 19362 raft_consensus.cc:493] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:42.764635 19362 raft_consensus.cc:3060] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:42.763530 19129 leader_election.cc:304] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:42.769774 19352 tablet_bootstrap.cc:654] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 706ce9f0353f4fa0a4744bf07bd4537c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.771790 19354 tablet_bootstrap.cc:654] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.774379 19353 tablet_bootstrap.cc:492] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921: Bootstrap starting.
I20260709 12:30:42.753449 19359 raft_consensus.cc:515] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
W20260709 12:30:42.776284 19129 leader_election.cc:343] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:42.777204 19383 raft_consensus.cc:2804] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:30:42.777312 19109 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:42.777709 19383 raft_consensus.cc:493] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:42.778195 19383 raft_consensus.cc:3060] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:42.779937 19362 raft_consensus.cc:515] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.782011 19359 leader_election.cc:290] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 election: Requested vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:42.783102 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc577d7fc884a9e83176de68badcabc" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:42.790376 19310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2057b2de3b3c4ae8b0419bb8c846e616" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" is_pre_election: true
I20260709 12:30:42.790695 19237 raft_consensus.cc:3060] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:42.790824 19308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc577d7fc884a9e83176de68badcabc" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:42.791122 19310 raft_consensus.cc:2468] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 0.
W20260709 12:30:42.792590 19127 leader_election.cc:343] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:42.792673 19204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:37375, user_credentials={real_user=slave}} blocked reactor thread for 48259.9us
I20260709 12:30:42.793107 19127 leader_election.cc:304] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c; no voters: c47d5c46e83e47808560e697b5819921
I20260709 12:30:42.783380 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d00fe8097684a3c97dc5004cf9dc49e" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:42.794392 19163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d00fe8097684a3c97dc5004cf9dc49e" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:42.794672 19311 raft_consensus.cc:3060] T 2d00fe8097684a3c97dc5004cf9dc49e P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:42.794984 19389 raft_consensus.cc:2804] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:42.785445 19352 tablet_bootstrap.cc:492] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 706ce9f0353f4fa0a4744bf07bd4537c: No bootstrap required, opened a new log
I20260709 12:30:42.788136 19354 tablet_bootstrap.cc:492] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128: No bootstrap required, opened a new log
I20260709 12:30:42.788425 19362 leader_election.cc:290] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Requested vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:42.789336 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca47c357ac4f17a410d0152c51e24c" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" is_pre_election: true
I20260709 12:30:42.796033 19354 ts_tablet_manager.cc:1403] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.005s
I20260709 12:30:42.796429 19309 raft_consensus.cc:2468] T 50ca47c357ac4f17a410d0152c51e24c P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 0.
I20260709 12:30:42.789621 19312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc577d7fc884a9e83176de68badcabc" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" is_pre_election: true
I20260709 12:30:42.795022 19163 raft_consensus.cc:3060] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:30:42.798897 19127 leader_election.cc:343] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:42.799242 19354 raft_consensus.cc:359] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.799897 19354 raft_consensus.cc:385] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.800117 19354 raft_consensus.cc:740] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.800720 19354 consensus_queue.cc:260] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.795933 19352 ts_tablet_manager.cc:1403] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.006s
I20260709 12:30:42.802207 19354 ts_tablet_manager.cc:1434] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 12:30:42.795630 19389 raft_consensus.cc:493] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:42.803354 19389 raft_consensus.cc:3060] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:42.804514 19163 raft_consensus.cc:2468] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 1.
I20260709 12:30:42.805734 19204 leader_election.cc:304] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:42.805780 19352 raft_consensus.cc:359] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.812337 19352 raft_consensus.cc:385] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.812670 19352 raft_consensus.cc:740] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.812003 19237 raft_consensus.cc:2468] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 1.
I20260709 12:30:42.813475 19359 raft_consensus.cc:2804] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:42.814168 19129 leader_election.cc:304] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36047ee0e391483f8291472a07246128, c47d5c46e83e47808560e697b5819921; no voters: 706ce9f0353f4fa0a4744bf07bd4537c
I20260709 12:30:42.814494 19352 consensus_queue.cc:260] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.814165 19060 catalog_manager.cc:5697] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c reported cstate change: term changed from 0 to 1, leader changed from <none> to 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67). New cstate: current_term: 1 leader_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:42.817190 19352 ts_tablet_manager.cc:1434] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:30:42.818189 19352 tablet_bootstrap.cc:492] T 30901d6e67d24b3499ef3a95deeeab16 P 706ce9f0353f4fa0a4744bf07bd4537c: Bootstrap starting.
I20260709 12:30:42.818732 19362 raft_consensus.cc:2804] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:42.807009 19354 tablet_bootstrap.cc:492] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128: Bootstrap starting.
I20260709 12:30:42.818889 19383 raft_consensus.cc:515] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.823099 19385 raft_consensus.cc:2764] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:30:42.823220 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca47c357ac4f17a410d0152c51e24c" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:42.823726 19312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca47c357ac4f17a410d0152c51e24c" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:42.784108 19384 raft_consensus.cc:493] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:42.819535 19353 tablet_bootstrap.cc:654] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.823948 19237 raft_consensus.cc:3060] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:42.824352 19312 raft_consensus.cc:3060] T 50ca47c357ac4f17a410d0152c51e24c P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:42.808817 19311 raft_consensus.cc:2468] T 2d00fe8097684a3c97dc5004cf9dc49e P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 1.
I20260709 12:30:42.824457 19384 raft_consensus.cc:515] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.830464 19384 leader_election.cc:290] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321)
I20260709 12:30:42.833082 19236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad3b84a85f4e678a358c825d53c551" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921" is_pre_election: true
I20260709 12:30:42.833448 19312 raft_consensus.cc:2468] T 50ca47c357ac4f17a410d0152c51e24c P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 1.
W20260709 12:30:42.834563 19278 leader_election.cc:343] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:42.834630 19127 leader_election.cc:304] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c; no voters: 
I20260709 12:30:42.834787 19354 tablet_bootstrap.cc:654] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.823146 19383 leader_election.cc:290] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Requested vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:42.841014 19362 raft_consensus.cc:697] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Becoming Leader. State: Replica: 36047ee0e391483f8291472a07246128, State: Running, Role: LEADER
I20260709 12:30:42.841270 19163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad3b84a85f4e678a358c825d53c551" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128" is_pre_election: true
I20260709 12:30:42.841884 19163 raft_consensus.cc:2468] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 0.
I20260709 12:30:42.841990 19362 consensus_queue.cc:237] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.842828 19237 raft_consensus.cc:2468] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 1.
I20260709 12:30:42.845077 19392 raft_consensus.cc:493] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:42.845575 19392 raft_consensus.cc:515] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.849052 19163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddc5cd2e6bb45778c8ca3c52b0c6c23" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128" is_pre_election: true
I20260709 12:30:42.849663 19163 raft_consensus.cc:2468] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 0.
I20260709 12:30:42.850823 19204 leader_election.cc:304] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:42.811338 19389 raft_consensus.cc:515] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.843032 19278 leader_election.cc:304] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c; no voters: c47d5c46e83e47808560e697b5819921
I20260709 12:30:42.852293 19384 raft_consensus.cc:2804] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:42.842114 19383 raft_consensus.cc:2804] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:42.852939 19384 raft_consensus.cc:493] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:42.851897 19390 raft_consensus.cc:2804] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:42.853897 19390 raft_consensus.cc:493] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:42.854082 19389 leader_election.cc:290] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Requested vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:42.854360 19390 raft_consensus.cc:3060] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:42.854920 19359 raft_consensus.cc:697] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [term 1 LEADER]: Becoming Leader. State: Replica: c47d5c46e83e47808560e697b5819921, State: Running, Role: LEADER
I20260709 12:30:42.853199 19383 raft_consensus.cc:697] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Becoming Leader. State: Replica: 36047ee0e391483f8291472a07246128, State: Running, Role: LEADER
I20260709 12:30:42.855849 19359 consensus_queue.cc:237] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.853421 19384 raft_consensus.cc:3060] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:42.856992 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2057b2de3b3c4ae8b0419bb8c846e616" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921"
W20260709 12:30:42.858357 19129 leader_election.cc:343] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:42.856199 19383 consensus_queue.cc:237] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.852562 19353 tablet_bootstrap.cc:492] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921: No bootstrap required, opened a new log
I20260709 12:30:42.861753 19353 ts_tablet_manager.cc:1403] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.002s
I20260709 12:30:42.865527 19312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2057b2de3b3c4ae8b0419bb8c846e616" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:42.866211 19312 raft_consensus.cc:3060] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:42.867321 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddc5cd2e6bb45778c8ca3c52b0c6c23" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" is_pre_election: true
I20260709 12:30:42.867974 19311 raft_consensus.cc:2468] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 0.
I20260709 12:30:42.869339 19392 leader_election.cc:290] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:42.870091 19352 tablet_bootstrap.cc:654] T 30901d6e67d24b3499ef3a95deeeab16 P 706ce9f0353f4fa0a4744bf07bd4537c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.870229 19353 raft_consensus.cc:359] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.871153 19353 raft_consensus.cc:385] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.872839 19353 raft_consensus.cc:740] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.878041 19353 consensus_queue.cc:260] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.881731 19353 ts_tablet_manager.cc:1434] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.003s
I20260709 12:30:42.883080 19353 tablet_bootstrap.cc:492] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921: Bootstrap starting.
I20260709 12:30:42.883960 19312 raft_consensus.cc:2468] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 1.
I20260709 12:30:42.885565 19352 tablet_bootstrap.cc:492] T 30901d6e67d24b3499ef3a95deeeab16 P 706ce9f0353f4fa0a4744bf07bd4537c: No bootstrap required, opened a new log
I20260709 12:30:42.885134 19390 raft_consensus.cc:515] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.886103 19352 ts_tablet_manager.cc:1403] T 30901d6e67d24b3499ef3a95deeeab16 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.000s
I20260709 12:30:42.886716 19127 leader_election.cc:304] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c; no voters: c47d5c46e83e47808560e697b5819921
I20260709 12:30:42.879674 19354 tablet_bootstrap.cc:492] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128: No bootstrap required, opened a new log
I20260709 12:30:42.888269 19383 raft_consensus.cc:2804] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:42.888695 19354 ts_tablet_manager.cc:1403] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128: Time spent bootstrapping tablet: real 0.082s	user 0.013s	sys 0.000s
I20260709 12:30:42.888799 19383 raft_consensus.cc:697] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Becoming Leader. State: Replica: 36047ee0e391483f8291472a07246128, State: Running, Role: LEADER
I20260709 12:30:42.889633 19352 raft_consensus.cc:359] T 30901d6e67d24b3499ef3a95deeeab16 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.889261 19061 catalog_manager.cc:5697] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36047ee0e391483f8291472a07246128 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "36047ee0e391483f8291472a07246128" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:42.890419 19352 raft_consensus.cc:385] T 30901d6e67d24b3499ef3a95deeeab16 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.890100 19383 consensus_queue.cc:237] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.891826 19354 raft_consensus.cc:359] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.892484 19354 raft_consensus.cc:385] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.892750 19354 raft_consensus.cc:740] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.893461 19354 consensus_queue.cc:260] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.890758 19352 raft_consensus.cc:740] T 30901d6e67d24b3499ef3a95deeeab16 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.895090 19352 consensus_queue.cc:260] T 30901d6e67d24b3499ef3a95deeeab16 P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.895598 19384 raft_consensus.cc:515] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.895465 19058 catalog_manager.cc:5697] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 reported cstate change: term changed from 0 to 1, leader changed from <none> to c47d5c46e83e47808560e697b5819921 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "c47d5c46e83e47808560e697b5819921" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:42.897500 19353 tablet_bootstrap.cc:654] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.898561 19163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad3b84a85f4e678a358c825d53c551" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:42.899139 19163 raft_consensus.cc:3060] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:42.898878 19352 ts_tablet_manager.cc:1434] T 30901d6e67d24b3499ef3a95deeeab16 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 12:30:42.900784 19352 tablet_bootstrap.cc:492] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c: Bootstrap starting.
I20260709 12:30:42.906520 19163 raft_consensus.cc:2468] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 1.
I20260709 12:30:42.907770 19278 leader_election.cc:304] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c; no voters: 
I20260709 12:30:42.908589 19372 raft_consensus.cc:2804] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:42.909058 19372 raft_consensus.cc:697] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Becoming Leader. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Running, Role: LEADER
I20260709 12:30:42.909878 19372 consensus_queue.cc:237] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.914376 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad3b84a85f4e678a358c825d53c551" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:42.915491 19354 ts_tablet_manager.cc:1434] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 12:30:42.916180 19384 leader_election.cc:290] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 election: Requested vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321)
W20260709 12:30:42.916432 19278 leader_election.cc:343] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:42.918684 19163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddc5cd2e6bb45778c8ca3c52b0c6c23" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:42.919278 19163 raft_consensus.cc:3060] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:42.921269 19352 tablet_bootstrap.cc:654] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.928331 19163 raft_consensus.cc:2468] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 1.
I20260709 12:30:42.929570 19204 leader_election.cc:304] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:42.930461 19392 raft_consensus.cc:2804] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:42.930927 19392 raft_consensus.cc:697] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [term 1 LEADER]: Becoming Leader. State: Replica: c47d5c46e83e47808560e697b5819921, State: Running, Role: LEADER
I20260709 12:30:42.931768 19392 consensus_queue.cc:237] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.934131 19352 tablet_bootstrap.cc:492] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c: No bootstrap required, opened a new log
I20260709 12:30:42.936734 19352 ts_tablet_manager.cc:1403] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.004s
I20260709 12:30:42.937980 19390 leader_election.cc:290] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 election: Requested vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:42.938367 19312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ddc5cd2e6bb45778c8ca3c52b0c6c23" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:42.938900 19312 raft_consensus.cc:3060] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:42.942240 19352 raft_consensus.cc:359] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.944106 19352 raft_consensus.cc:385] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.944620 19352 raft_consensus.cc:740] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.945779 19352 consensus_queue.cc:260] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.948544 19352 ts_tablet_manager.cc:1434] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:30:42.949807 19352 tablet_bootstrap.cc:492] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c: Bootstrap starting.
I20260709 12:30:42.952628 19312 raft_consensus.cc:2468] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 1.
I20260709 12:30:42.955143 19060 catalog_manager.cc:5697] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 reported cstate change: term changed from 0 to 1, leader changed from <none> to c47d5c46e83e47808560e697b5819921 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "c47d5c46e83e47808560e697b5819921" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:42.957310 19352 tablet_bootstrap.cc:654] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.962771 19059 catalog_manager.cc:5697] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36047ee0e391483f8291472a07246128 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "36047ee0e391483f8291472a07246128" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:42.965332 19059 catalog_manager.cc:5697] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36047ee0e391483f8291472a07246128 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "36047ee0e391483f8291472a07246128" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:42.968811 19352 tablet_bootstrap.cc:492] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c: No bootstrap required, opened a new log
I20260709 12:30:42.969309 19352 ts_tablet_manager.cc:1403] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 12:30:42.969806 19353 tablet_bootstrap.cc:492] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921: No bootstrap required, opened a new log
I20260709 12:30:42.970343 19353 ts_tablet_manager.cc:1403] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921: Time spent bootstrapping tablet: real 0.087s	user 0.033s	sys 0.036s
I20260709 12:30:42.971745 19383 raft_consensus.cc:493] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:42.971913 19352 raft_consensus.cc:359] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.972275 19383 raft_consensus.cc:515] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.972690 19352 raft_consensus.cc:385] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.972965 19352 raft_consensus.cc:740] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.973317 19353 raft_consensus.cc:359] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.974071 19353 raft_consensus.cc:385] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.973726 19352 consensus_queue.cc:260] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.974365 19383 leader_election.cc:290] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:42.974400 19353 raft_consensus.cc:740] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.975767 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30901d6e67d24b3499ef3a95deeeab16" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921" is_pre_election: true
I20260709 12:30:42.975915 19312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30901d6e67d24b3499ef3a95deeeab16" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" is_pre_election: true
I20260709 12:30:42.976191 19353 consensus_queue.cc:260] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.976603 19312 raft_consensus.cc:2468] T 30901d6e67d24b3499ef3a95deeeab16 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 0.
I20260709 12:30:42.977222 19237 raft_consensus.cc:2468] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 0.
I20260709 12:30:42.977658 19352 ts_tablet_manager.cc:1434] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:30:42.978035 19127 leader_election.cc:304] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c; no voters: 
I20260709 12:30:42.978847 19383 raft_consensus.cc:2804] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:42.979228 19383 raft_consensus.cc:493] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:42.979571 19383 raft_consensus.cc:3060] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:42.980043 19353 ts_tablet_manager.cc:1434] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:30:42.981073 19353 tablet_bootstrap.cc:492] T dcad3b84a85f4e678a358c825d53c551 P c47d5c46e83e47808560e697b5819921: Bootstrap starting.
I20260709 12:30:42.983206 19058 catalog_manager.cc:5697] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c reported cstate change: term changed from 0 to 1, leader changed from <none> to 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67). New cstate: current_term: 1 leader_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:42.987064 19353 tablet_bootstrap.cc:654] T dcad3b84a85f4e678a358c825d53c551 P c47d5c46e83e47808560e697b5819921: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:42.986804 19383 raft_consensus.cc:515] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.989913 19383 leader_election.cc:290] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Requested vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:42.989813 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30901d6e67d24b3499ef3a95deeeab16" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:42.990675 19237 raft_consensus.cc:3060] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:42.992163 19312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30901d6e67d24b3499ef3a95deeeab16" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:42.992728 19312 raft_consensus.cc:3060] T 30901d6e67d24b3499ef3a95deeeab16 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:42.993199 19353 tablet_bootstrap.cc:492] T dcad3b84a85f4e678a358c825d53c551 P c47d5c46e83e47808560e697b5819921: No bootstrap required, opened a new log
I20260709 12:30:42.993607 19353 ts_tablet_manager.cc:1403] T dcad3b84a85f4e678a358c825d53c551 P c47d5c46e83e47808560e697b5819921: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:30:42.995687 19353 raft_consensus.cc:359] T dcad3b84a85f4e678a358c825d53c551 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.996155 19353 raft_consensus.cc:385] T dcad3b84a85f4e678a358c825d53c551 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:42.996368 19353 raft_consensus.cc:740] T dcad3b84a85f4e678a358c825d53c551 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Initialized, Role: FOLLOWER
I20260709 12:30:42.996937 19353 consensus_queue.cc:260] T dcad3b84a85f4e678a358c825d53c551 P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:42.998057 19237 raft_consensus.cc:2468] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 1.
I20260709 12:30:42.998426 19353 ts_tablet_manager.cc:1434] T dcad3b84a85f4e678a358c825d53c551 P c47d5c46e83e47808560e697b5819921: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:30:42.999336 19129 leader_election.cc:304] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:42.999768 19312 raft_consensus.cc:2468] T 30901d6e67d24b3499ef3a95deeeab16 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 1.
I20260709 12:30:42.999359 19353 tablet_bootstrap.cc:492] T 2057b2de3b3c4ae8b0419bb8c846e616 P c47d5c46e83e47808560e697b5819921: Bootstrap starting.
I20260709 12:30:43.000669 19383 raft_consensus.cc:2804] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:43.002497 19383 raft_consensus.cc:697] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Becoming Leader. State: Replica: 36047ee0e391483f8291472a07246128, State: Running, Role: LEADER
I20260709 12:30:43.003322 19383 consensus_queue.cc:237] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.006914 19353 tablet_bootstrap.cc:654] T 2057b2de3b3c4ae8b0419bb8c846e616 P c47d5c46e83e47808560e697b5819921: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:43.016006 19353 tablet_bootstrap.cc:492] T 2057b2de3b3c4ae8b0419bb8c846e616 P c47d5c46e83e47808560e697b5819921: No bootstrap required, opened a new log
I20260709 12:30:43.016475 19353 ts_tablet_manager.cc:1403] T 2057b2de3b3c4ae8b0419bb8c846e616 P c47d5c46e83e47808560e697b5819921: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 12:30:43.016785 19058 catalog_manager.cc:5697] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36047ee0e391483f8291472a07246128 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "36047ee0e391483f8291472a07246128" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:43.019138 19353 raft_consensus.cc:359] T 2057b2de3b3c4ae8b0419bb8c846e616 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.019685 19353 raft_consensus.cc:385] T 2057b2de3b3c4ae8b0419bb8c846e616 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:43.019943 19353 raft_consensus.cc:740] T 2057b2de3b3c4ae8b0419bb8c846e616 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Initialized, Role: FOLLOWER
I20260709 12:30:43.020646 19353 consensus_queue.cc:260] T 2057b2de3b3c4ae8b0419bb8c846e616 P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.022652 19353 ts_tablet_manager.cc:1434] T 2057b2de3b3c4ae8b0419bb8c846e616 P c47d5c46e83e47808560e697b5819921: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:30:43.023732 19372 raft_consensus.cc:493] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:43.024298 19372 raft_consensus.cc:515] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.026432 19372 leader_election.cc:290] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321)
I20260709 12:30:43.027045 19163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc577d7fc884a9e83176de68badcabc" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128" is_pre_election: true
I20260709 12:30:43.027441 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc577d7fc884a9e83176de68badcabc" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921" is_pre_election: true
I20260709 12:30:43.028241 19237 raft_consensus.cc:2393] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 706ce9f0353f4fa0a4744bf07bd4537c in current term 1: Already voted for candidate 36047ee0e391483f8291472a07246128 in this term.
I20260709 12:30:43.029099 19278 leader_election.cc:304] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 706ce9f0353f4fa0a4744bf07bd4537c; no voters: 36047ee0e391483f8291472a07246128, c47d5c46e83e47808560e697b5819921
I20260709 12:30:43.029758 19372 raft_consensus.cc:3060] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:43.036847 19372 raft_consensus.cc:2749] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:43.152298 19383 raft_consensus.cc:493] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:43.152884 19383 raft_consensus.cc:515] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.154747 19383 leader_election.cc:290] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:43.155596 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8abbc11e279441aa8cccafbf8df6290" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921" is_pre_election: true
I20260709 12:30:43.155761 19312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8abbc11e279441aa8cccafbf8df6290" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" is_pre_election: true
I20260709 12:30:43.156229 19237 raft_consensus.cc:2468] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 0.
I20260709 12:30:43.156401 19312 raft_consensus.cc:2468] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 0.
I20260709 12:30:43.157207 19129 leader_election.cc:304] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:43.157958 19383 raft_consensus.cc:2804] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:43.158346 19383 raft_consensus.cc:493] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:43.158635 19383 raft_consensus.cc:3060] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:43.161427 19372 consensus_queue.cc:1048] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:43.164795 19383 raft_consensus.cc:515] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.166801 19383 leader_election.cc:290] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Requested vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:43.167821 19312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8abbc11e279441aa8cccafbf8df6290" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:43.167868 19236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8abbc11e279441aa8cccafbf8df6290" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:43.168592 19312 raft_consensus.cc:3060] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:43.168681 19236 raft_consensus.cc:3060] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:43.175709 19236 raft_consensus.cc:2468] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 1.
I20260709 12:30:43.175762 19312 raft_consensus.cc:2468] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 1.
I20260709 12:30:43.177150 19127 leader_election.cc:304] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c; no voters: 
I20260709 12:30:43.177928 19383 raft_consensus.cc:2804] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:43.179191 19383 raft_consensus.cc:697] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Becoming Leader. State: Replica: 36047ee0e391483f8291472a07246128, State: Running, Role: LEADER
I20260709 12:30:43.179898 19383 consensus_queue.cc:237] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.187883 19381 consensus_queue.cc:1048] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Connected to new peer: Peer: permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:43.192916 19060 catalog_manager.cc:5697] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36047ee0e391483f8291472a07246128 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "36047ee0e391483f8291472a07246128" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:43.262964 19383 consensus_queue.cc:1048] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:43.273777 19396 consensus_queue.cc:1048] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:43.300894 19396 consensus_queue.cc:1048] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:43.311393 19362 consensus_queue.cc:1048] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:43.332077 19390 consensus_queue.cc:1048] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:43.337601 19390 consensus_queue.cc:1048] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:43.342976 19392 consensus_queue.cc:1048] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:43.367218 19237 raft_consensus.cc:3060] T 2057b2de3b3c4ae8b0419bb8c846e616 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:43.369160 19236 raft_consensus.cc:3060] T dcad3b84a85f4e678a358c825d53c551 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:43.369971 19390 consensus_queue.cc:1048] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:43.379297 19381 consensus_queue.cc:1048] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:43.386932 19362 consensus_queue.cc:1048] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:43.389557 19311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c15fe963984464288540f966880e07b"
dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
mode: GRACEFUL
new_leader_uuid: "36047ee0e391483f8291472a07246128"
 from {username='slave'} at 127.0.0.1:42658
I20260709 12:30:43.390214 19311 raft_consensus.cc:606] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Received request to transfer leadership to TS 36047ee0e391483f8291472a07246128
I20260709 12:30:43.394804 19384 consensus_queue.cc:1048] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Connected to new peer: Peer: permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:43.415104 19396 consensus_queue.cc:1048] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:43.422135 19236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d00fe8097684a3c97dc5004cf9dc49e"
dest_uuid: "c47d5c46e83e47808560e697b5819921"
mode: GRACEFUL
new_leader_uuid: "36047ee0e391483f8291472a07246128"
 from {username='slave'} at 127.0.0.1:54950
I20260709 12:30:43.422961 19236 raft_consensus.cc:606] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [term 1 LEADER]: Received request to transfer leadership to TS 36047ee0e391483f8291472a07246128
I20260709 12:30:43.430269 19311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dcad3b84a85f4e678a358c825d53c551"
dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
mode: GRACEFUL
new_leader_uuid: "36047ee0e391483f8291472a07246128"
 from {username='slave'} at 127.0.0.1:42658
I20260709 12:30:43.430924 19311 raft_consensus.cc:606] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Received request to transfer leadership to TS 36047ee0e391483f8291472a07246128
I20260709 12:30:43.447141 19163 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50ca47c357ac4f17a410d0152c51e24c"
dest_uuid: "36047ee0e391483f8291472a07246128"
mode: GRACEFUL
new_leader_uuid: "c47d5c46e83e47808560e697b5819921"
 from {username='slave'} at 127.0.0.1:39230
I20260709 12:30:43.447639 19163 raft_consensus.cc:606] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Received request to transfer leadership to TS c47d5c46e83e47808560e697b5819921
I20260709 12:30:43.454632 19163 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8abbc11e279441aa8cccafbf8df6290"
dest_uuid: "36047ee0e391483f8291472a07246128"
mode: GRACEFUL
new_leader_uuid: "c47d5c46e83e47808560e697b5819921"
 from {username='slave'} at 127.0.0.1:39230
I20260709 12:30:43.455171 19163 raft_consensus.cc:606] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Received request to transfer leadership to TS c47d5c46e83e47808560e697b5819921
I20260709 12:30:43.459566 19163 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30901d6e67d24b3499ef3a95deeeab16"
dest_uuid: "36047ee0e391483f8291472a07246128"
mode: GRACEFUL
new_leader_uuid: "c47d5c46e83e47808560e697b5819921"
 from {username='slave'} at 127.0.0.1:39230
I20260709 12:30:43.460016 19163 raft_consensus.cc:606] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Received request to transfer leadership to TS c47d5c46e83e47808560e697b5819921
I20260709 12:30:43.464229 19163 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bc577d7fc884a9e83176de68badcabc"
dest_uuid: "36047ee0e391483f8291472a07246128"
mode: GRACEFUL
new_leader_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
 from {username='slave'} at 127.0.0.1:39230
I20260709 12:30:43.464664 19163 raft_consensus.cc:606] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Received request to transfer leadership to TS 706ce9f0353f4fa0a4744bf07bd4537c
I20260709 12:30:43.548990 19396 consensus_queue.cc:1048] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:43.555689 19362 raft_consensus.cc:993] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128: : Instructing follower c47d5c46e83e47808560e697b5819921 to start an election
I20260709 12:30:43.556169 19362 raft_consensus.cc:1081] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Signalling peer c47d5c46e83e47808560e697b5819921 to start an election
I20260709 12:30:43.558652 19237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30901d6e67d24b3499ef3a95deeeab16"
dest_uuid: "c47d5c46e83e47808560e697b5819921"
 from {username='slave'} at 127.0.0.1:54946
I20260709 12:30:43.559185 19237 raft_consensus.cc:493] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:43.559562 19237 raft_consensus.cc:3060] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.560876 19396 consensus_queue.cc:1048] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:43.566689 19237 raft_consensus.cc:515] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.567628 19236 raft_consensus.cc:1240] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Rejecting Update request from peer 36047ee0e391483f8291472a07246128 for earlier term 1. Current term is 2. Ops: []
I20260709 12:30:43.569510 19237 leader_election.cc:290] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 2 election: Requested vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:43.570958 19163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30901d6e67d24b3499ef3a95deeeab16" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:43.571607 19163 raft_consensus.cc:3055] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:43.571542 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30901d6e67d24b3499ef3a95deeeab16" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:43.572081 19163 raft_consensus.cc:740] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Running, Role: LEADER
I20260709 12:30:43.572141 19396 consensus_queue.cc:1059] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:43.572497 19311 raft_consensus.cc:3060] T 30901d6e67d24b3499ef3a95deeeab16 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.578140 19163 consensus_queue.cc:260] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.579447 19163 raft_consensus.cc:3060] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.579555 19311 raft_consensus.cc:2468] T 30901d6e67d24b3499ef3a95deeeab16 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 2.
I20260709 12:30:43.582779 19202 leader_election.cc:304] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 706ce9f0353f4fa0a4744bf07bd4537c, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:43.583611 19392 raft_consensus.cc:2804] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:43.584103 19392 raft_consensus.cc:697] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 [term 2 LEADER]: Becoming Leader. State: Replica: c47d5c46e83e47808560e697b5819921, State: Running, Role: LEADER
I20260709 12:30:43.584894 19392 consensus_queue.cc:237] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.586236 19163 raft_consensus.cc:2468] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 2.
I20260709 12:30:43.591970 19061 catalog_manager.cc:5697] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 reported cstate change: term changed from 1 to 2, leader changed from 36047ee0e391483f8291472a07246128 (127.8.111.65) to c47d5c46e83e47808560e697b5819921 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "c47d5c46e83e47808560e697b5819921" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:43.638618 19389 consensus_queue.cc:1048] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:43.644515 19396 raft_consensus.cc:993] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128: : Instructing follower c47d5c46e83e47808560e697b5819921 to start an election
I20260709 12:30:43.644966 19383 raft_consensus.cc:1081] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Signalling peer c47d5c46e83e47808560e697b5819921 to start an election
I20260709 12:30:43.647725 19237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8abbc11e279441aa8cccafbf8df6290"
dest_uuid: "c47d5c46e83e47808560e697b5819921"
 from {username='slave'} at 127.0.0.1:54946
I20260709 12:30:43.648265 19237 raft_consensus.cc:493] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:43.648648 19237 raft_consensus.cc:3060] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.651329 19396 consensus_queue.cc:1048] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:43.655871 19237 raft_consensus.cc:515] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.659559 19237 leader_election.cc:290] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 2 election: Requested vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:43.660109 19312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8abbc11e279441aa8cccafbf8df6290" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:43.660707 19312 raft_consensus.cc:3060] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.660727 19163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8abbc11e279441aa8cccafbf8df6290" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:43.661437 19163 raft_consensus.cc:3055] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:43.661756 19163 raft_consensus.cc:740] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Running, Role: LEADER
I20260709 12:30:43.662672 19163 consensus_queue.cc:260] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.663918 19163 raft_consensus.cc:3060] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.667188 19312 raft_consensus.cc:2468] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 2.
I20260709 12:30:43.668259 19202 leader_election.cc:304] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 706ce9f0353f4fa0a4744bf07bd4537c, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:43.668996 19392 raft_consensus.cc:2804] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:43.669443 19392 raft_consensus.cc:697] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [term 2 LEADER]: Becoming Leader. State: Replica: c47d5c46e83e47808560e697b5819921, State: Running, Role: LEADER
I20260709 12:30:43.669883 19163 raft_consensus.cc:2468] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 2.
I20260709 12:30:43.670215 19392 consensus_queue.cc:237] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.676798 19060 catalog_manager.cc:5697] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 reported cstate change: term changed from 1 to 2, leader changed from 36047ee0e391483f8291472a07246128 (127.8.111.65) to c47d5c46e83e47808560e697b5819921 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "c47d5c46e83e47808560e697b5819921" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:43.803800 19381 raft_consensus.cc:993] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c: : Instructing follower 36047ee0e391483f8291472a07246128 to start an election
I20260709 12:30:43.804278 19384 raft_consensus.cc:1081] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Signalling peer 36047ee0e391483f8291472a07246128 to start an election
I20260709 12:30:43.805665 19163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c15fe963984464288540f966880e07b"
dest_uuid: "36047ee0e391483f8291472a07246128"
 from {username='slave'} at 127.0.0.1:39216
I20260709 12:30:43.806259 19163 raft_consensus.cc:493] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:43.806588 19163 raft_consensus.cc:3060] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.812688 19163 raft_consensus.cc:515] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } }
I20260709 12:30:43.814316 19163 leader_election.cc:290] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 2 election: Requested vote from peers 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131), c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321)
I20260709 12:30:43.815114 19312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c15fe963984464288540f966880e07b" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:43.815397 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c15fe963984464288540f966880e07b" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:43.815788 19312 raft_consensus.cc:3055] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:43.816118 19237 raft_consensus.cc:3060] T 6c15fe963984464288540f966880e07b P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.816165 19312 raft_consensus.cc:740] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Running, Role: LEADER
I20260709 12:30:43.817039 19312 consensus_queue.cc:260] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } }
I20260709 12:30:43.817955 19312 raft_consensus.cc:3060] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.821244 19237 raft_consensus.cc:2468] T 6c15fe963984464288540f966880e07b P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 2.
I20260709 12:30:43.822371 19129 leader_election.cc:304] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:43.822932 19312 raft_consensus.cc:2468] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 2.
I20260709 12:30:43.823211 19383 raft_consensus.cc:2804] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:43.823791 19383 raft_consensus.cc:697] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128 [term 2 LEADER]: Becoming Leader. State: Replica: 36047ee0e391483f8291472a07246128, State: Running, Role: LEADER
I20260709 12:30:43.824537 19383 consensus_queue.cc:237] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } }
I20260709 12:30:43.830569 19060 catalog_manager.cc:5697] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128 reported cstate change: term changed from 1 to 2, leader changed from 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67) to 36047ee0e391483f8291472a07246128 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "36047ee0e391483f8291472a07246128" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:43.841845 19389 raft_consensus.cc:993] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128: : Instructing follower c47d5c46e83e47808560e697b5819921 to start an election
I20260709 12:30:43.842360 19389 raft_consensus.cc:1081] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Signalling peer c47d5c46e83e47808560e697b5819921 to start an election
I20260709 12:30:43.844123 19237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50ca47c357ac4f17a410d0152c51e24c"
dest_uuid: "c47d5c46e83e47808560e697b5819921"
 from {username='slave'} at 127.0.0.1:54946
I20260709 12:30:43.844779 19237 raft_consensus.cc:493] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:43.845148 19237 raft_consensus.cc:3060] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.851342 19237 raft_consensus.cc:515] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.852981 19237 leader_election.cc:290] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 2 election: Requested vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:43.853732 19163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca47c357ac4f17a410d0152c51e24c" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:43.854128 19312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50ca47c357ac4f17a410d0152c51e24c" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:43.854555 19163 raft_consensus.cc:3055] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:43.854761 19312 raft_consensus.cc:3060] T 50ca47c357ac4f17a410d0152c51e24c P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.854925 19163 raft_consensus.cc:740] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Running, Role: LEADER
I20260709 12:30:43.855813 19163 consensus_queue.cc:260] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.857152 19163 raft_consensus.cc:3060] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.862726 19389 raft_consensus.cc:993] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128: : Instructing follower 706ce9f0353f4fa0a4744bf07bd4537c to start an election
I20260709 12:30:43.863209 19389 raft_consensus.cc:1081] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Signalling peer 706ce9f0353f4fa0a4744bf07bd4537c to start an election
I20260709 12:30:43.863996 19312 raft_consensus.cc:2468] T 50ca47c357ac4f17a410d0152c51e24c P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 2.
I20260709 12:30:43.864655 19163 raft_consensus.cc:2468] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 2.
I20260709 12:30:43.864992 19311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bc577d7fc884a9e83176de68badcabc"
dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
 from {username='slave'} at 127.0.0.1:42652
I20260709 12:30:43.865593 19311 raft_consensus.cc:493] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:43.865473 19202 leader_election.cc:304] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 706ce9f0353f4fa0a4744bf07bd4537c, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:43.866030 19311 raft_consensus.cc:3060] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.867045 19392 raft_consensus.cc:2804] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:43.867542 19392 raft_consensus.cc:697] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921 [term 2 LEADER]: Becoming Leader. State: Replica: c47d5c46e83e47808560e697b5819921, State: Running, Role: LEADER
I20260709 12:30:43.868350 19392 consensus_queue.cc:237] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.872661 19311 raft_consensus.cc:515] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.874439 19311 leader_election.cc:290] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 2 election: Requested vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321)
I20260709 12:30:43.875020 19163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc577d7fc884a9e83176de68badcabc" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:43.875468 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bc577d7fc884a9e83176de68badcabc" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:43.875718 19163 raft_consensus.cc:3055] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:43.876147 19237 raft_consensus.cc:3060] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.876171 19163 raft_consensus.cc:740] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Running, Role: LEADER
I20260709 12:30:43.876543 19060 catalog_manager.cc:5697] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921 reported cstate change: term changed from 1 to 2, leader changed from 36047ee0e391483f8291472a07246128 (127.8.111.65) to c47d5c46e83e47808560e697b5819921 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "c47d5c46e83e47808560e697b5819921" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:43.877578 19163 consensus_queue.cc:260] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.878782 19163 raft_consensus.cc:3060] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.882066 19237 raft_consensus.cc:2468] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 2.
I20260709 12:30:43.883104 19278 leader_election.cc:304] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 706ce9f0353f4fa0a4744bf07bd4537c, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:43.883888 19384 raft_consensus.cc:2804] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:43.884270 19163 raft_consensus.cc:2468] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 2.
I20260709 12:30:43.884312 19384 raft_consensus.cc:697] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 LEADER]: Becoming Leader. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Running, Role: LEADER
I20260709 12:30:43.885484 19384 consensus_queue.cc:237] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.893245 19060 catalog_manager.cc:5697] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c reported cstate change: term changed from 1 to 2, leader changed from 36047ee0e391483f8291472a07246128 (127.8.111.65) to 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67). New cstate: current_term: 2 leader_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:43.904307 19384 raft_consensus.cc:993] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c: : Instructing follower 36047ee0e391483f8291472a07246128 to start an election
I20260709 12:30:43.904788 19384 raft_consensus.cc:1081] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Signalling peer 36047ee0e391483f8291472a07246128 to start an election
I20260709 12:30:43.906244 19163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dcad3b84a85f4e678a358c825d53c551"
dest_uuid: "36047ee0e391483f8291472a07246128"
 from {username='slave'} at 127.0.0.1:39216
I20260709 12:30:43.906762 19163 raft_consensus.cc:493] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:43.907107 19163 raft_consensus.cc:3060] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.912590 19163 raft_consensus.cc:515] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.914144 19163 leader_election.cc:290] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 2 election: Requested vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:43.914819 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad3b84a85f4e678a358c825d53c551" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:43.915186 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcad3b84a85f4e678a358c825d53c551" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:43.915410 19237 raft_consensus.cc:3060] T dcad3b84a85f4e678a358c825d53c551 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.915781 19311 raft_consensus.cc:3055] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:43.916100 19311 raft_consensus.cc:740] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Running, Role: LEADER
I20260709 12:30:43.916712 19311 consensus_queue.cc:260] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.917622 19311 raft_consensus.cc:3060] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.920531 19237 raft_consensus.cc:2468] T dcad3b84a85f4e678a358c825d53c551 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 2.
I20260709 12:30:43.921834 19129 leader_election.cc:304] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:43.922613 19383 raft_consensus.cc:2804] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:43.923080 19383 raft_consensus.cc:697] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128 [term 2 LEADER]: Becoming Leader. State: Replica: 36047ee0e391483f8291472a07246128, State: Running, Role: LEADER
I20260709 12:30:43.923501 19392 raft_consensus.cc:993] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921: : Instructing follower 36047ee0e391483f8291472a07246128 to start an election
I20260709 12:30:43.923640 19311 raft_consensus.cc:2468] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 2.
I20260709 12:30:43.923979 19392 raft_consensus.cc:1081] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [term 1 LEADER]: Signalling peer 36047ee0e391483f8291472a07246128 to start an election
I20260709 12:30:43.923883 19383 consensus_queue.cc:237] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.925693 19163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d00fe8097684a3c97dc5004cf9dc49e"
dest_uuid: "36047ee0e391483f8291472a07246128"
 from {username='slave'} at 127.0.0.1:39210
I20260709 12:30:43.926224 19163 raft_consensus.cc:493] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:43.926662 19163 raft_consensus.cc:3060] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.930779 19061 catalog_manager.cc:5697] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128 reported cstate change: term changed from 1 to 2, leader changed from 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67) to 36047ee0e391483f8291472a07246128 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "36047ee0e391483f8291472a07246128" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:43.931432 19163 raft_consensus.cc:515] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.933216 19163 leader_election.cc:290] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 2 election: Requested vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:43.933780 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d00fe8097684a3c97dc5004cf9dc49e" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:43.934212 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d00fe8097684a3c97dc5004cf9dc49e" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:43.934474 19237 raft_consensus.cc:3055] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:43.934810 19237 raft_consensus.cc:740] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Running, Role: LEADER
I20260709 12:30:43.934850 19311 raft_consensus.cc:3060] T 2d00fe8097684a3c97dc5004cf9dc49e P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.935868 19237 consensus_queue.cc:260] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.937191 19237 raft_consensus.cc:3060] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:43.942495 19311 raft_consensus.cc:2468] T 2d00fe8097684a3c97dc5004cf9dc49e P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 2.
I20260709 12:30:43.943612 19127 leader_election.cc:304] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c; no voters: 
I20260709 12:30:43.944358 19383 raft_consensus.cc:2804] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:43.944412 19237 raft_consensus.cc:2468] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 2.
I20260709 12:30:43.944805 19383 raft_consensus.cc:697] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128 [term 2 LEADER]: Becoming Leader. State: Replica: 36047ee0e391483f8291472a07246128, State: Running, Role: LEADER
I20260709 12:30:43.945674 19383 consensus_queue.cc:237] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:43.951929 19061 catalog_manager.cc:5697] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128 reported cstate change: term changed from 1 to 2, leader changed from c47d5c46e83e47808560e697b5819921 (127.8.111.66) to 36047ee0e391483f8291472a07246128 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "36047ee0e391483f8291472a07246128" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:44.032748 19311 raft_consensus.cc:1275] T 30901d6e67d24b3499ef3a95deeeab16 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Refusing update from remote peer c47d5c46e83e47808560e697b5819921: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.034042 19392 consensus_queue.cc:1048] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:44.042810 19163 raft_consensus.cc:1275] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Refusing update from remote peer c47d5c46e83e47808560e697b5819921: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.044440 19390 consensus_queue.cc:1048] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:44.070358 19311 raft_consensus.cc:1275] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Refusing update from remote peer c47d5c46e83e47808560e697b5819921: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.071516 19390 consensus_queue.cc:1048] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:44.079277 19163 raft_consensus.cc:1275] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Refusing update from remote peer c47d5c46e83e47808560e697b5819921: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.080945 19390 consensus_queue.cc:1048] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:44.240774 19237 raft_consensus.cc:1275] T 6c15fe963984464288540f966880e07b P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Refusing update from remote peer 36047ee0e391483f8291472a07246128: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.242113 19383 consensus_queue.cc:1048] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:44.250406 19311 raft_consensus.cc:1275] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Refusing update from remote peer 36047ee0e391483f8291472a07246128: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.252328 19396 consensus_queue.cc:1048] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:44.326629 19237 raft_consensus.cc:1275] T dcad3b84a85f4e678a358c825d53c551 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Refusing update from remote peer 36047ee0e391483f8291472a07246128: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.328069 19396 consensus_queue.cc:1048] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:44.338424 19311 raft_consensus.cc:1275] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Refusing update from remote peer 36047ee0e391483f8291472a07246128: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.339737 19383 consensus_queue.cc:1048] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:44.374675 19162 raft_consensus.cc:1275] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Refusing update from remote peer c47d5c46e83e47808560e697b5819921: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.376129 19390 consensus_queue.cc:1048] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:44.385311 19311 raft_consensus.cc:1275] T 50ca47c357ac4f17a410d0152c51e24c P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Refusing update from remote peer c47d5c46e83e47808560e697b5819921: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.387125 19390 consensus_queue.cc:1048] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:44.413378 19237 raft_consensus.cc:1275] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Refusing update from remote peer 36047ee0e391483f8291472a07246128: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.414520 19383 consensus_queue.cc:1048] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:44.423082 19311 raft_consensus.cc:1275] T 2d00fe8097684a3c97dc5004cf9dc49e P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Refusing update from remote peer 36047ee0e391483f8291472a07246128: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.425102 19389 consensus_queue.cc:1048] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:44.511350 19162 raft_consensus.cc:1275] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Refusing update from remote peer 706ce9f0353f4fa0a4744bf07bd4537c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.512657 19384 consensus_queue.cc:1048] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Connected to new peer: Peer: permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:44.515300 19237 raft_consensus.cc:1275] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Refusing update from remote peer 706ce9f0353f4fa0a4744bf07bd4537c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:44.516785 19384 consensus_queue.cc:1048] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:46.490451 19060 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46910:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:30:46.492575 19060 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:30:46.537657 19147 tablet_service.cc:1511] Processing CreateTablet for tablet 39d21c988f5c4d0ab2a5368979a3c235 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:30:46.538642 19225 tablet_service.cc:1511] Processing CreateTablet for tablet 39d21c988f5c4d0ab2a5368979a3c235 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:30:46.539024 19147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39d21c988f5c4d0ab2a5368979a3c235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.539940 19225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39d21c988f5c4d0ab2a5368979a3c235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.540402 19301 tablet_service.cc:1511] Processing CreateTablet for tablet 39d21c988f5c4d0ab2a5368979a3c235 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:30:46.541604 19301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39d21c988f5c4d0ab2a5368979a3c235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.544267 19151 tablet_service.cc:1511] Processing CreateTablet for tablet a321ae86ba164e9988812718f254188f (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:30:46.545485 19151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a321ae86ba164e9988812718f254188f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.560719 19464 tablet_bootstrap.cc:492] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c: Bootstrap starting.
I20260709 12:30:46.563881 19463 tablet_bootstrap.cc:492] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128: Bootstrap starting.
I20260709 12:30:46.567118 19224 tablet_service.cc:1511] Processing CreateTablet for tablet a321ae86ba164e9988812718f254188f (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:30:46.568516 19224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a321ae86ba164e9988812718f254188f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.569808 19301 tablet_service.cc:1511] Processing CreateTablet for tablet a321ae86ba164e9988812718f254188f (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:30:46.571084 19301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a321ae86ba164e9988812718f254188f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.573246 19464 tablet_bootstrap.cc:654] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:46.577003 19463 tablet_bootstrap.cc:654] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:46.584704 19465 tablet_bootstrap.cc:492] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921: Bootstrap starting.
I20260709 12:30:46.584969 19300 tablet_service.cc:1511] Processing CreateTablet for tablet 8e970dba149d4c968a07dbb59f75cae7 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:30:46.585814 19226 tablet_service.cc:1511] Processing CreateTablet for tablet 8e970dba149d4c968a07dbb59f75cae7 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:30:46.588317 19300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e970dba149d4c968a07dbb59f75cae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.588389 19226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e970dba149d4c968a07dbb59f75cae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.594339 19299 tablet_service.cc:1511] Processing CreateTablet for tablet 77cf31428b5c44d1ada255bdffff39f1 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:30:46.595856 19299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cf31428b5c44d1ada255bdffff39f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.595639 19225 tablet_service.cc:1511] Processing CreateTablet for tablet 77cf31428b5c44d1ada255bdffff39f1 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:30:46.596994 19225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cf31428b5c44d1ada255bdffff39f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.587589 19147 tablet_service.cc:1511] Processing CreateTablet for tablet 8e970dba149d4c968a07dbb59f75cae7 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:30:46.603858 19147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e970dba149d4c968a07dbb59f75cae7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.605669 19465 tablet_bootstrap.cc:654] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:46.616089 19151 tablet_service.cc:1511] Processing CreateTablet for tablet 77cf31428b5c44d1ada255bdffff39f1 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:30:46.617501 19151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cf31428b5c44d1ada255bdffff39f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.630740 19152 tablet_service.cc:1511] Processing CreateTablet for tablet fc6bddf00974464a9da634f3e8107d07 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:30:46.632644 19152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc6bddf00974464a9da634f3e8107d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.632349 19227 tablet_service.cc:1511] Processing CreateTablet for tablet fc6bddf00974464a9da634f3e8107d07 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:30:46.636099 19301 tablet_service.cc:1511] Processing CreateTablet for tablet fc6bddf00974464a9da634f3e8107d07 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:30:46.637382 19301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc6bddf00974464a9da634f3e8107d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.637171 19149 tablet_service.cc:1511] Processing CreateTablet for tablet 652ae6381b194eb0a5f781edf5377772 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:30:46.638482 19149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 652ae6381b194eb0a5f781edf5377772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.639948 19227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc6bddf00974464a9da634f3e8107d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.645370 19225 tablet_service.cc:1511] Processing CreateTablet for tablet 652ae6381b194eb0a5f781edf5377772 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:30:46.647280 19225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 652ae6381b194eb0a5f781edf5377772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.653712 19465 tablet_bootstrap.cc:492] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921: No bootstrap required, opened a new log
I20260709 12:30:46.654541 19465 ts_tablet_manager.cc:1403] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.006s
I20260709 12:30:46.655646 19299 tablet_service.cc:1511] Processing CreateTablet for tablet 652ae6381b194eb0a5f781edf5377772 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:30:46.656953 19299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 652ae6381b194eb0a5f781edf5377772. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.662261 19153 tablet_service.cc:1511] Processing CreateTablet for tablet b3ce768dc4f84e8aade6196d75698a24 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:30:46.657640 19465 raft_consensus.cc:359] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.663561 19153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ce768dc4f84e8aade6196d75698a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.666702 19300 tablet_service.cc:1511] Processing CreateTablet for tablet b3ce768dc4f84e8aade6196d75698a24 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:30:46.667977 19300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ce768dc4f84e8aade6196d75698a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.675319 19464 tablet_bootstrap.cc:492] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c: No bootstrap required, opened a new log
I20260709 12:30:46.675890 19464 ts_tablet_manager.cc:1403] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent bootstrapping tablet: real 0.115s	user 0.016s	sys 0.014s
I20260709 12:30:46.679111 19464 raft_consensus.cc:359] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.679836 19464 raft_consensus.cc:385] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:46.680182 19464 raft_consensus.cc:740] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.681035 19464 consensus_queue.cc:260] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.683511 19226 tablet_service.cc:1511] Processing CreateTablet for tablet b3ce768dc4f84e8aade6196d75698a24 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:30:46.685300 19226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ce768dc4f84e8aade6196d75698a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.685015 19149 tablet_service.cc:1511] Processing CreateTablet for tablet fc9428376e4f4593b7b7aaf5a17b5624 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:30:46.687014 19149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc9428376e4f4593b7b7aaf5a17b5624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.689378 19463 tablet_bootstrap.cc:492] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128: No bootstrap required, opened a new log
I20260709 12:30:46.689872 19463 ts_tablet_manager.cc:1403] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128: Time spent bootstrapping tablet: real 0.126s	user 0.018s	sys 0.023s
I20260709 12:30:46.690838 19222 tablet_service.cc:1511] Processing CreateTablet for tablet fc9428376e4f4593b7b7aaf5a17b5624 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:30:46.692075 19222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc9428376e4f4593b7b7aaf5a17b5624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.692826 19463 raft_consensus.cc:359] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.693550 19463 raft_consensus.cc:385] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:46.693825 19463 raft_consensus.cc:740] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.695937 19463 consensus_queue.cc:260] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.700435 19463 ts_tablet_manager.cc:1434] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:30:46.701274 19148 tablet_service.cc:1511] Processing CreateTablet for tablet fa3785a9f62342c2aec12bd7d092e5ff (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:30:46.708973 19148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa3785a9f62342c2aec12bd7d092e5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.664119 19465 raft_consensus.cc:385] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:46.710616 19465 raft_consensus.cc:740] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.711635 19465 consensus_queue.cc:260] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.702203 19464 ts_tablet_manager.cc:1434] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 12:30:46.704279 19224 tablet_service.cc:1511] Processing CreateTablet for tablet fa3785a9f62342c2aec12bd7d092e5ff (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:30:46.723461 19224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa3785a9f62342c2aec12bd7d092e5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.723690 19299 tablet_service.cc:1511] Processing CreateTablet for tablet fc9428376e4f4593b7b7aaf5a17b5624 (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:30:46.725482 19299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc9428376e4f4593b7b7aaf5a17b5624. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.707685 19297 tablet_service.cc:1511] Processing CreateTablet for tablet fa3785a9f62342c2aec12bd7d092e5ff (DEFAULT_TABLE table=soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:30:46.727025 19297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa3785a9f62342c2aec12bd7d092e5ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:46.734695 19465 ts_tablet_manager.cc:1434] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.000s
I20260709 12:30:46.735793 19465 tablet_bootstrap.cc:492] T 77cf31428b5c44d1ada255bdffff39f1 P c47d5c46e83e47808560e697b5819921: Bootstrap starting.
I20260709 12:30:46.739081 19464 tablet_bootstrap.cc:492] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c: Bootstrap starting.
I20260709 12:30:46.742939 19463 tablet_bootstrap.cc:492] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128: Bootstrap starting.
I20260709 12:30:46.761998 19465 tablet_bootstrap.cc:654] T 77cf31428b5c44d1ada255bdffff39f1 P c47d5c46e83e47808560e697b5819921: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:46.768682 19464 tablet_bootstrap.cc:654] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:46.770413 19463 tablet_bootstrap.cc:654] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:46.781816 19464 tablet_bootstrap.cc:492] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c: No bootstrap required, opened a new log
I20260709 12:30:46.782620 19464 ts_tablet_manager.cc:1403] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.003s
I20260709 12:30:46.786772 19464 raft_consensus.cc:359] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.788718 19464 raft_consensus.cc:385] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:46.789070 19464 raft_consensus.cc:740] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.789870 19464 consensus_queue.cc:260] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.790858 19463 tablet_bootstrap.cc:492] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128: No bootstrap required, opened a new log
I20260709 12:30:46.791011 19465 tablet_bootstrap.cc:492] T 77cf31428b5c44d1ada255bdffff39f1 P c47d5c46e83e47808560e697b5819921: No bootstrap required, opened a new log
I20260709 12:30:46.791488 19463 ts_tablet_manager.cc:1403] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.016s
I20260709 12:30:46.791638 19465 ts_tablet_manager.cc:1403] T 77cf31428b5c44d1ada255bdffff39f1 P c47d5c46e83e47808560e697b5819921: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.016s
I20260709 12:30:46.792325 19464 ts_tablet_manager.cc:1434] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:30:46.794255 19464 tablet_bootstrap.cc:492] T 77cf31428b5c44d1ada255bdffff39f1 P 706ce9f0353f4fa0a4744bf07bd4537c: Bootstrap starting.
I20260709 12:30:46.794529 19463 raft_consensus.cc:359] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.794880 19465 raft_consensus.cc:359] T 77cf31428b5c44d1ada255bdffff39f1 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.795310 19463 raft_consensus.cc:385] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:46.795683 19465 raft_consensus.cc:385] T 77cf31428b5c44d1ada255bdffff39f1 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:46.795810 19463 raft_consensus.cc:740] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.796105 19465 raft_consensus.cc:740] T 77cf31428b5c44d1ada255bdffff39f1 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.796693 19463 consensus_queue.cc:260] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.796996 19465 consensus_queue.cc:260] T 77cf31428b5c44d1ada255bdffff39f1 P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.799373 19463 ts_tablet_manager.cc:1434] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:30:46.800335 19463 tablet_bootstrap.cc:492] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128: Bootstrap starting.
I20260709 12:30:46.801693 19465 ts_tablet_manager.cc:1434] T 77cf31428b5c44d1ada255bdffff39f1 P c47d5c46e83e47808560e697b5819921: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:30:46.802757 19465 tablet_bootstrap.cc:492] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921: Bootstrap starting.
I20260709 12:30:46.804778 19464 tablet_bootstrap.cc:654] T 77cf31428b5c44d1ada255bdffff39f1 P 706ce9f0353f4fa0a4744bf07bd4537c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:46.807197 19463 tablet_bootstrap.cc:654] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:46.810004 19465 tablet_bootstrap.cc:654] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921: Neither blocks nor log segments found. Creating new log.
W20260709 12:30:46.813393 19109 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:46.817245 19464 tablet_bootstrap.cc:492] T 77cf31428b5c44d1ada255bdffff39f1 P 706ce9f0353f4fa0a4744bf07bd4537c: No bootstrap required, opened a new log
I20260709 12:30:46.817862 19464 ts_tablet_manager.cc:1403] T 77cf31428b5c44d1ada255bdffff39f1 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.010s
I20260709 12:30:46.820962 19464 raft_consensus.cc:359] T 77cf31428b5c44d1ada255bdffff39f1 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.821739 19464 raft_consensus.cc:385] T 77cf31428b5c44d1ada255bdffff39f1 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:46.822080 19464 raft_consensus.cc:740] T 77cf31428b5c44d1ada255bdffff39f1 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.823280 19465 tablet_bootstrap.cc:492] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921: No bootstrap required, opened a new log
I20260709 12:30:46.822990 19464 consensus_queue.cc:260] T 77cf31428b5c44d1ada255bdffff39f1 P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.823805 19465 ts_tablet_manager.cc:1403] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.002s
I20260709 12:30:46.825754 19464 ts_tablet_manager.cc:1434] T 77cf31428b5c44d1ada255bdffff39f1 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:30:46.826772 19465 raft_consensus.cc:359] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.827344 19465 raft_consensus.cc:385] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:46.827651 19465 raft_consensus.cc:740] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.828336 19465 consensus_queue.cc:260] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.829301 19464 tablet_bootstrap.cc:492] T 8e970dba149d4c968a07dbb59f75cae7 P 706ce9f0353f4fa0a4744bf07bd4537c: Bootstrap starting.
I20260709 12:30:46.830911 19465 ts_tablet_manager.cc:1434] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.006s
I20260709 12:30:46.836426 19464 tablet_bootstrap.cc:654] T 8e970dba149d4c968a07dbb59f75cae7 P 706ce9f0353f4fa0a4744bf07bd4537c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:46.837781 19465 tablet_bootstrap.cc:492] T a321ae86ba164e9988812718f254188f P c47d5c46e83e47808560e697b5819921: Bootstrap starting.
I20260709 12:30:46.847325 19465 tablet_bootstrap.cc:654] T a321ae86ba164e9988812718f254188f P c47d5c46e83e47808560e697b5819921: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:46.850538 19463 tablet_bootstrap.cc:492] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128: No bootstrap required, opened a new log
I20260709 12:30:46.851245 19463 ts_tablet_manager.cc:1403] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128: Time spent bootstrapping tablet: real 0.051s	user 0.023s	sys 0.027s
I20260709 12:30:46.855254 19463 raft_consensus.cc:359] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.856318 19463 raft_consensus.cc:385] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:46.856787 19463 raft_consensus.cc:740] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.857914 19463 consensus_queue.cc:260] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.859881 19464 tablet_bootstrap.cc:492] T 8e970dba149d4c968a07dbb59f75cae7 P 706ce9f0353f4fa0a4744bf07bd4537c: No bootstrap required, opened a new log
I20260709 12:30:46.859965 19465 tablet_bootstrap.cc:492] T a321ae86ba164e9988812718f254188f P c47d5c46e83e47808560e697b5819921: No bootstrap required, opened a new log
I20260709 12:30:46.860647 19464 ts_tablet_manager.cc:1403] T 8e970dba149d4c968a07dbb59f75cae7 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.005s
I20260709 12:30:46.860766 19465 ts_tablet_manager.cc:1403] T a321ae86ba164e9988812718f254188f P c47d5c46e83e47808560e697b5819921: Time spent bootstrapping tablet: real 0.023s	user 0.022s	sys 0.000s
I20260709 12:30:46.861860 19463 ts_tablet_manager.cc:1434] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:30:46.862989 19463 tablet_bootstrap.cc:492] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128: Bootstrap starting.
I20260709 12:30:46.863891 19464 raft_consensus.cc:359] T 8e970dba149d4c968a07dbb59f75cae7 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.864641 19464 raft_consensus.cc:385] T 8e970dba149d4c968a07dbb59f75cae7 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:46.864924 19464 raft_consensus.cc:740] T 8e970dba149d4c968a07dbb59f75cae7 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.865690 19464 consensus_queue.cc:260] T 8e970dba149d4c968a07dbb59f75cae7 P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.867394 19465 raft_consensus.cc:359] T a321ae86ba164e9988812718f254188f P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.868253 19465 raft_consensus.cc:385] T a321ae86ba164e9988812718f254188f P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:46.868608 19465 raft_consensus.cc:740] T a321ae86ba164e9988812718f254188f P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.869081 19463 tablet_bootstrap.cc:654] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:46.869437 19465 consensus_queue.cc:260] T a321ae86ba164e9988812718f254188f P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.875375 19465 ts_tablet_manager.cc:1434] T a321ae86ba164e9988812718f254188f P c47d5c46e83e47808560e697b5819921: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:30:46.875698 19464 ts_tablet_manager.cc:1434] T 8e970dba149d4c968a07dbb59f75cae7 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 12:30:46.875968 19463 tablet_bootstrap.cc:492] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128: No bootstrap required, opened a new log
I20260709 12:30:46.876480 19463 ts_tablet_manager.cc:1403] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:30:46.876612 19465 tablet_bootstrap.cc:492] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921: Bootstrap starting.
I20260709 12:30:46.880028 19463 raft_consensus.cc:359] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.880826 19463 raft_consensus.cc:385] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:46.881156 19463 raft_consensus.cc:740] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.881639 19464 tablet_bootstrap.cc:492] T 652ae6381b194eb0a5f781edf5377772 P 706ce9f0353f4fa0a4744bf07bd4537c: Bootstrap starting.
I20260709 12:30:46.881906 19463 consensus_queue.cc:260] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.883909 19465 tablet_bootstrap.cc:654] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:46.886868 19463 ts_tablet_manager.cc:1434] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:30:46.887926 19463 tablet_bootstrap.cc:492] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128: Bootstrap starting.
I20260709 12:30:46.888854 19464 tablet_bootstrap.cc:654] T 652ae6381b194eb0a5f781edf5377772 P 706ce9f0353f4fa0a4744bf07bd4537c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:46.892933 19465 tablet_bootstrap.cc:492] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921: No bootstrap required, opened a new log
I20260709 12:30:46.893471 19465 ts_tablet_manager.cc:1403] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:30:46.895495 19463 tablet_bootstrap.cc:654] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:46.896529 19465 raft_consensus.cc:359] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.897331 19465 raft_consensus.cc:385] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:46.897660 19465 raft_consensus.cc:740] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.898478 19465 consensus_queue.cc:260] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.905246 19465 ts_tablet_manager.cc:1434] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:30:46.906376 19465 tablet_bootstrap.cc:492] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921: Bootstrap starting.
I20260709 12:30:46.907071 19469 raft_consensus.cc:493] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:46.907915 19464 tablet_bootstrap.cc:492] T 652ae6381b194eb0a5f781edf5377772 P 706ce9f0353f4fa0a4744bf07bd4537c: No bootstrap required, opened a new log
I20260709 12:30:46.907826 19469 raft_consensus.cc:515] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.908766 19464 ts_tablet_manager.cc:1403] T 652ae6381b194eb0a5f781edf5377772 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.003s
I20260709 12:30:46.910194 19469 leader_election.cc:290] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:46.912930 19465 tablet_bootstrap.cc:654] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:46.913487 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e970dba149d4c968a07dbb59f75cae7" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" is_pre_election: true
I20260709 12:30:46.913048 19464 raft_consensus.cc:359] T 652ae6381b194eb0a5f781edf5377772 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.914194 19311 raft_consensus.cc:2468] T 8e970dba149d4c968a07dbb59f75cae7 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 0.
I20260709 12:30:46.914247 19464 raft_consensus.cc:385] T 652ae6381b194eb0a5f781edf5377772 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:46.914805 19464 raft_consensus.cc:740] T 652ae6381b194eb0a5f781edf5377772 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.915731 19202 leader_election.cc:304] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 706ce9f0353f4fa0a4744bf07bd4537c, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:46.916841 19469 raft_consensus.cc:2804] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:46.916069 19464 consensus_queue.cc:260] T 652ae6381b194eb0a5f781edf5377772 P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.917244 19469 raft_consensus.cc:493] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:46.917635 19469 raft_consensus.cc:3060] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:46.912894 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e970dba149d4c968a07dbb59f75cae7" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128" is_pre_election: true
W20260709 12:30:46.926214 19204 leader_election.cc:343] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36047ee0e391483f8291472a07246128 (127.8.111.65:37375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:46.928074 19464 ts_tablet_manager.cc:1434] T 652ae6381b194eb0a5f781edf5377772 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:30:46.938794 19464 tablet_bootstrap.cc:492] T fc6bddf00974464a9da634f3e8107d07 P 706ce9f0353f4fa0a4744bf07bd4537c: Bootstrap starting.
I20260709 12:30:46.945439 19464 tablet_bootstrap.cc:654] T fc6bddf00974464a9da634f3e8107d07 P 706ce9f0353f4fa0a4744bf07bd4537c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:46.946784 19463 tablet_bootstrap.cc:492] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128: No bootstrap required, opened a new log
I20260709 12:30:46.947382 19463 ts_tablet_manager.cc:1403] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128: Time spent bootstrapping tablet: real 0.060s	user 0.023s	sys 0.027s
I20260709 12:30:46.951731 19469 raft_consensus.cc:515] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.953409 19463 raft_consensus.cc:359] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.955015 19463 raft_consensus.cc:385] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:46.955310 19463 raft_consensus.cc:740] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Initialized, Role: FOLLOWER
I20260709 12:30:46.954479 19469 leader_election.cc:290] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 election: Requested vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:46.987922 19445 raft_consensus.cc:493] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:46.990495 19450 raft_consensus.cc:493] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:46.956295 19465 tablet_bootstrap.cc:492] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921: No bootstrap required, opened a new log
I20260709 12:30:46.989799 19485 raft_consensus.cc:493] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:46.991778 19450 raft_consensus.cc:515] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.992933 19465 ts_tablet_manager.cc:1403] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.016s
I20260709 12:30:46.993422 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e970dba149d4c968a07dbb59f75cae7" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:46.995487 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e970dba149d4c968a07dbb59f75cae7" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:46.996516 19311 raft_consensus.cc:3060] T 8e970dba149d4c968a07dbb59f75cae7 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:46.999750 19450 leader_election.cc:290] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321)
I20260709 12:30:46.956275 19463 consensus_queue.cc:260] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:46.989863 19445 raft_consensus.cc:515] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.001437 19465 raft_consensus.cc:359] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.002756 19465 raft_consensus.cc:385] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:47.003247 19465 raft_consensus.cc:740] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Initialized, Role: FOLLOWER
I20260709 12:30:47.003320 19236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a321ae86ba164e9988812718f254188f" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921" is_pre_election: true
I20260709 12:30:47.004385 19236 raft_consensus.cc:2468] T a321ae86ba164e9988812718f254188f P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 0.
I20260709 12:30:47.004487 19465 consensus_queue.cc:260] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.006096 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ae6381b194eb0a5f781edf5377772" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921" is_pre_election: true
W20260709 12:30:47.008577 19129 leader_election.cc:343] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:47.009864 19465 ts_tablet_manager.cc:1434] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.006s
I20260709 12:30:46.992918 19485 raft_consensus.cc:515] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.014741 19312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ae6381b194eb0a5f781edf5377772" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" is_pre_election: true
I20260709 12:30:47.015702 19465 tablet_bootstrap.cc:492] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921: Bootstrap starting.
I20260709 12:30:47.011473 19445 leader_election.cc:290] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:47.017349 19278 leader_election.cc:304] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 706ce9f0353f4fa0a4744bf07bd4537c, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:47.018661 19450 raft_consensus.cc:2804] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:47.019126 19450 raft_consensus.cc:493] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:47.019578 19450 raft_consensus.cc:3060] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.021562 19464 tablet_bootstrap.cc:492] T fc6bddf00974464a9da634f3e8107d07 P 706ce9f0353f4fa0a4744bf07bd4537c: No bootstrap required, opened a new log
I20260709 12:30:47.017400 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d21c988f5c4d0ab2a5368979a3c235" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921" is_pre_election: true
I20260709 12:30:47.024484 19469 raft_consensus.cc:493] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:47.024978 19485 leader_election.cc:290] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:47.025210 19445 raft_consensus.cc:493] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:47.025439 19469 raft_consensus.cc:515] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.026083 19445 raft_consensus.cc:515] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.028626 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d21c988f5c4d0ab2a5368979a3c235" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" is_pre_election: true
I20260709 12:30:47.033300 19464 ts_tablet_manager.cc:1403] T fc6bddf00974464a9da634f3e8107d07 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent bootstrapping tablet: real 0.095s	user 0.003s	sys 0.019s
I20260709 12:30:47.033944 19309 raft_consensus.cc:2468] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 0.
I20260709 12:30:47.034694 19310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9428376e4f4593b7b7aaf5a17b5624" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" is_pre_election: true
I20260709 12:30:47.028887 19237 raft_consensus.cc:2468] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 0.
I20260709 12:30:47.015775 19312 raft_consensus.cc:2468] T 652ae6381b194eb0a5f781edf5377772 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 0.
I20260709 12:30:47.042176 19127 leader_election.cc:304] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c; no voters: 
W20260709 12:30:47.042441 19204 leader_election.cc:343] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 36047ee0e391483f8291472a07246128 (127.8.111.65:37375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:47.036696 19445 leader_election.cc:290] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:47.050443 19311 raft_consensus.cc:2468] T 8e970dba149d4c968a07dbb59f75cae7 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 1.
I20260709 12:30:47.051849 19463 ts_tablet_manager.cc:1434] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128: Time spent starting tablet: real 0.104s	user 0.014s	sys 0.000s
I20260709 12:30:47.051690 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d21c988f5c4d0ab2a5368979a3c235" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128" is_pre_election: true
I20260709 12:30:47.052572 19162 raft_consensus.cc:2468] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 0.
I20260709 12:30:47.053771 19469 leader_election.cc:290] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:47.053985 19463 tablet_bootstrap.cc:492] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128: Bootstrap starting.
I20260709 12:30:47.056892 19464 raft_consensus.cc:359] T fc6bddf00974464a9da634f3e8107d07 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.058377 19464 raft_consensus.cc:385] T fc6bddf00974464a9da634f3e8107d07 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:47.058851 19464 raft_consensus.cc:740] T fc6bddf00974464a9da634f3e8107d07 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Initialized, Role: FOLLOWER
I20260709 12:30:47.050484 19465 tablet_bootstrap.cc:654] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:47.054920 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a321ae86ba164e9988812718f254188f" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128" is_pre_election: true
I20260709 12:30:47.055751 19204 leader_election.cc:304] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:47.060547 19162 raft_consensus.cc:2468] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 0.
W20260709 12:30:47.061848 19127 leader_election.cc:343] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:47.062631 19127 leader_election.cc:304] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c; no voters: c47d5c46e83e47808560e697b5819921
I20260709 12:30:47.063316 19445 raft_consensus.cc:2804] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:47.063766 19445 raft_consensus.cc:493] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:47.064129 19445 raft_consensus.cc:3060] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.064472 19485 raft_consensus.cc:2804] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:47.064875 19485 raft_consensus.cc:493] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:47.065200 19485 raft_consensus.cc:3060] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.066470 19310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d21c988f5c4d0ab2a5368979a3c235" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" is_pre_election: true
I20260709 12:30:47.067047 19202 leader_election.cc:304] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 706ce9f0353f4fa0a4744bf07bd4537c, c47d5c46e83e47808560e697b5819921; no voters: 36047ee0e391483f8291472a07246128
I20260709 12:30:47.067190 19310 raft_consensus.cc:2468] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 0.
I20260709 12:30:47.068675 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9428376e4f4593b7b7aaf5a17b5624" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921" is_pre_election: true
I20260709 12:30:47.068790 19390 raft_consensus.cc:2804] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:47.069307 19390 raft_consensus.cc:493] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:47.069736 19390 raft_consensus.cc:3060] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:30:47.071159 19129 leader_election.cc:343] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:47.071735 19129 leader_election.cc:304] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36047ee0e391483f8291472a07246128; no voters: 706ce9f0353f4fa0a4744bf07bd4537c, c47d5c46e83e47808560e697b5819921
I20260709 12:30:47.072229 19469 raft_consensus.cc:2804] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:47.072806 19469 raft_consensus.cc:697] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [term 1 LEADER]: Becoming Leader. State: Replica: c47d5c46e83e47808560e697b5819921, State: Running, Role: LEADER
I20260709 12:30:47.074476 19487 raft_consensus.cc:493] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:47.078611 19488 raft_consensus.cc:2749] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:47.083351 19469 consensus_queue.cc:237] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.090516 19487 raft_consensus.cc:515] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.092864 19487 leader_election.cc:290] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:47.084343 19450 raft_consensus.cc:515] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.094412 19310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cf31428b5c44d1ada255bdffff39f1" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" is_pre_election: true
I20260709 12:30:47.095829 19310 raft_consensus.cc:2468] T 77cf31428b5c44d1ada255bdffff39f1 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 0.
I20260709 12:30:47.096583 19450 leader_election.cc:290] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 election: Requested vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321)
I20260709 12:30:47.097679 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a321ae86ba164e9988812718f254188f" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:47.098963 19237 raft_consensus.cc:3060] T a321ae86ba164e9988812718f254188f P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.106866 19127 leader_election.cc:304] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c; no voters: 
I20260709 12:30:47.109288 19463 tablet_bootstrap.cc:654] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:47.110908 19486 raft_consensus.cc:2804] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:47.111325 19486 raft_consensus.cc:493] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:47.111657 19486 raft_consensus.cc:3060] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.062647 19464 consensus_queue.cc:260] T fc6bddf00974464a9da634f3e8107d07 P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.115132 19445 raft_consensus.cc:515] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.119850 19464 ts_tablet_manager.cc:1434] T fc6bddf00974464a9da634f3e8107d07 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent starting tablet: real 0.086s	user 0.005s	sys 0.005s
I20260709 12:30:47.123481 19464 tablet_bootstrap.cc:492] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c: Bootstrap starting.
I20260709 12:30:47.122917 19485 raft_consensus.cc:515] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.130478 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a321ae86ba164e9988812718f254188f" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:47.131292 19162 raft_consensus.cc:3060] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.130509 19236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cf31428b5c44d1ada255bdffff39f1" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921" is_pre_election: true
I20260709 12:30:47.134855 19236 raft_consensus.cc:2468] T 77cf31428b5c44d1ada255bdffff39f1 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 0.
I20260709 12:30:47.135304 19238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ae6381b194eb0a5f781edf5377772" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:47.136242 19235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d21c988f5c4d0ab2a5368979a3c235" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:47.137331 19390 raft_consensus.cc:515] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.140007 19390 leader_election.cc:290] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 election: Requested vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:47.142315 19235 raft_consensus.cc:2393] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 36047ee0e391483f8291472a07246128 in current term 1: Already voted for candidate c47d5c46e83e47808560e697b5819921 in this term.
I20260709 12:30:47.143018 19445 leader_election.cc:290] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Requested vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:47.144673 19311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d21c988f5c4d0ab2a5368979a3c235" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:47.145141 19163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d21c988f5c4d0ab2a5368979a3c235" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:47.145483 19311 raft_consensus.cc:3060] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.146073 19163 raft_consensus.cc:2393] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c47d5c46e83e47808560e697b5819921 in current term 1: Already voted for candidate 36047ee0e391483f8291472a07246128 in this term.
I20260709 12:30:47.148808 19486 raft_consensus.cc:515] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.153198 19310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cf31428b5c44d1ada255bdffff39f1" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:47.156847 19310 raft_consensus.cc:3060] T 77cf31428b5c44d1ada255bdffff39f1 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.158669 19463 tablet_bootstrap.cc:492] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128: No bootstrap required, opened a new log
I20260709 12:30:47.159255 19463 ts_tablet_manager.cc:1403] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128: Time spent bootstrapping tablet: real 0.106s	user 0.010s	sys 0.019s
I20260709 12:30:47.160988 19237 raft_consensus.cc:2468] T a321ae86ba164e9988812718f254188f P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 1.
I20260709 12:30:47.160672 19312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ae6381b194eb0a5f781edf5377772" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
W20260709 12:30:47.162236 19129 leader_election.cc:343] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:47.162537 19312 raft_consensus.cc:3060] T 652ae6381b194eb0a5f781edf5377772 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.164912 19235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cf31428b5c44d1ada255bdffff39f1" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:47.165547 19235 raft_consensus.cc:3060] T 77cf31428b5c44d1ada255bdffff39f1 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.166420 19463 raft_consensus.cc:359] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.166756 19309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d21c988f5c4d0ab2a5368979a3c235" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:47.167209 19463 raft_consensus.cc:385] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:47.167598 19463 raft_consensus.cc:740] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Initialized, Role: FOLLOWER
I20260709 12:30:47.168572 19463 consensus_queue.cc:260] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.169312 19202 leader_election.cc:304] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c47d5c46e83e47808560e697b5819921; no voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c
I20260709 12:30:47.170521 19390 raft_consensus.cc:2749] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:30:47.161736 19485 leader_election.cc:290] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Requested vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:47.152814 19486 leader_election.cc:290] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Requested vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:47.173267 19278 leader_election.cc:304] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 706ce9f0353f4fa0a4744bf07bd4537c, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:47.177917 19450 raft_consensus.cc:2804] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:47.180042 19235 raft_consensus.cc:2468] T 77cf31428b5c44d1ada255bdffff39f1 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 1.
I20260709 12:30:47.184652 19129 leader_election.cc:304] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:47.186328 19485 raft_consensus.cc:2804] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:47.185575 19060 catalog_manager.cc:5697] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 reported cstate change: term changed from 0 to 1, leader changed from <none> to c47d5c46e83e47808560e697b5819921 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "c47d5c46e83e47808560e697b5819921" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:47.187247 19464 tablet_bootstrap.cc:654] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:47.186857 19485 raft_consensus.cc:697] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Becoming Leader. State: Replica: 36047ee0e391483f8291472a07246128, State: Running, Role: LEADER
I20260709 12:30:47.175208 19311 raft_consensus.cc:2468] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 1.
I20260709 12:30:47.188969 19485 consensus_queue.cc:237] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.189668 19127 leader_election.cc:304] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c; no voters: c47d5c46e83e47808560e697b5819921
I20260709 12:30:47.190955 19486 raft_consensus.cc:2804] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:47.191689 19486 raft_consensus.cc:697] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Becoming Leader. State: Replica: 36047ee0e391483f8291472a07246128, State: Running, Role: LEADER
I20260709 12:30:47.192859 19162 raft_consensus.cc:2468] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 1.
I20260709 12:30:47.192780 19486 consensus_queue.cc:237] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.193517 19463 ts_tablet_manager.cc:1434] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.002s
I20260709 12:30:47.195729 19450 raft_consensus.cc:697] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Becoming Leader. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Running, Role: LEADER
I20260709 12:30:47.197508 19463 tablet_bootstrap.cc:492] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128: Bootstrap starting.
I20260709 12:30:47.198331 19310 raft_consensus.cc:2468] T 77cf31428b5c44d1ada255bdffff39f1 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 1.
I20260709 12:30:47.197552 19465 tablet_bootstrap.cc:492] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921: No bootstrap required, opened a new log
I20260709 12:30:47.192866 19312 raft_consensus.cc:2468] T 652ae6381b194eb0a5f781edf5377772 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 1.
I20260709 12:30:47.205626 19465 ts_tablet_manager.cc:1403] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921: Time spent bootstrapping tablet: real 0.191s	user 0.019s	sys 0.032s
I20260709 12:30:47.208513 19450 consensus_queue.cc:237] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.209218 19127 leader_election.cc:304] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c; no voters: c47d5c46e83e47808560e697b5819921
I20260709 12:30:47.210088 19465 raft_consensus.cc:359] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.211329 19465 raft_consensus.cc:385] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:47.210788 19445 raft_consensus.cc:2804] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:47.214519 19465 raft_consensus.cc:740] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Initialized, Role: FOLLOWER
I20260709 12:30:47.216423 19465 consensus_queue.cc:260] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.218662 19445 raft_consensus.cc:697] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Becoming Leader. State: Replica: 36047ee0e391483f8291472a07246128, State: Running, Role: LEADER
I20260709 12:30:47.219372 19463 tablet_bootstrap.cc:654] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:47.219794 19445 consensus_queue.cc:237] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.220271 19465 ts_tablet_manager.cc:1434] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.002s
I20260709 12:30:47.229985 19465 tablet_bootstrap.cc:492] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921: Bootstrap starting.
I20260709 12:30:47.250878 19061 catalog_manager.cc:5697] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36047ee0e391483f8291472a07246128 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "36047ee0e391483f8291472a07246128" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:47.256125 19059 catalog_manager.cc:5697] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c reported cstate change: term changed from 0 to 1, leader changed from <none> to 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67). New cstate: current_term: 1 leader_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:47.258677 19390 raft_consensus.cc:493] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:47.259301 19390 raft_consensus.cc:515] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.260445 19464 tablet_bootstrap.cc:492] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c: No bootstrap required, opened a new log
I20260709 12:30:47.261104 19464 ts_tablet_manager.cc:1403] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent bootstrapping tablet: real 0.138s	user 0.015s	sys 0.006s
I20260709 12:30:47.261530 19390 leader_election.cc:290] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:47.262385 19485 raft_consensus.cc:493] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:47.262902 19485 raft_consensus.cc:515] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.265247 19312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6bddf00974464a9da634f3e8107d07" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" is_pre_election: true
I20260709 12:30:47.266198 19312 raft_consensus.cc:2468] T fc6bddf00974464a9da634f3e8107d07 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 0.
I20260709 12:30:47.266665 19310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6bddf00974464a9da634f3e8107d07" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" is_pre_election: true
I20260709 12:30:47.267513 19310 raft_consensus.cc:2468] T fc6bddf00974464a9da634f3e8107d07 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 0.
I20260709 12:30:47.268033 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6bddf00974464a9da634f3e8107d07" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128" is_pre_election: true
I20260709 12:30:47.268472 19235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6bddf00974464a9da634f3e8107d07" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921" is_pre_election: true
I20260709 12:30:47.268733 19162 raft_consensus.cc:2468] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 0.
I20260709 12:30:47.269089 19235 raft_consensus.cc:2468] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 0.
I20260709 12:30:47.270135 19204 leader_election.cc:304] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:47.271132 19129 leader_election.cc:304] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:47.272256 19445 raft_consensus.cc:2804] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:47.272627 19445 raft_consensus.cc:493] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:47.272642 19489 raft_consensus.cc:2804] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:47.272998 19445 raft_consensus.cc:3060] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.273129 19489 raft_consensus.cc:493] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:47.266430 19485 leader_election.cc:290] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:47.273679 19489 raft_consensus.cc:3060] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.274503 19465 tablet_bootstrap.cc:654] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:47.266119 19464 raft_consensus.cc:359] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.277061 19464 raft_consensus.cc:385] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:47.277456 19464 raft_consensus.cc:740] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Initialized, Role: FOLLOWER
I20260709 12:30:47.278290 19464 consensus_queue.cc:260] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.280972 19390 raft_consensus.cc:493] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:47.281453 19464 ts_tablet_manager.cc:1434] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:30:47.281553 19390 raft_consensus.cc:515] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.282862 19464 tablet_bootstrap.cc:492] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c: Bootstrap starting.
I20260709 12:30:47.283888 19390 leader_election.cc:290] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:47.285059 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3785a9f62342c2aec12bd7d092e5ff" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128" is_pre_election: true
I20260709 12:30:47.285480 19310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3785a9f62342c2aec12bd7d092e5ff" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" is_pre_election: true
W20260709 12:30:47.286949 19202 leader_election.cc:343] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:47.287570 19204 leader_election.cc:343] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36047ee0e391483f8291472a07246128 (127.8.111.65:37375): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:47.288018 19204 leader_election.cc:304] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c47d5c46e83e47808560e697b5819921; no voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c
I20260709 12:30:47.289440 19390 raft_consensus.cc:2749] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:47.291254 19489 raft_consensus.cc:515] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.292527 19445 raft_consensus.cc:515] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.294154 19489 leader_election.cc:290] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 election: Requested vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:47.294551 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6bddf00974464a9da634f3e8107d07" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:47.295789 19162 raft_consensus.cc:2393] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c47d5c46e83e47808560e697b5819921 in current term 1: Already voted for candidate 36047ee0e391483f8291472a07246128 in this term.
I20260709 12:30:47.297796 19310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6bddf00974464a9da634f3e8107d07" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:47.297966 19235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6bddf00974464a9da634f3e8107d07" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:47.298393 19310 raft_consensus.cc:3060] T fc6bddf00974464a9da634f3e8107d07 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.299010 19445 leader_election.cc:290] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Requested vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:47.299096 19312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6bddf00974464a9da634f3e8107d07" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:47.305778 19465 tablet_bootstrap.cc:492] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921: No bootstrap required, opened a new log
I20260709 12:30:47.298985 19235 raft_consensus.cc:2393] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 36047ee0e391483f8291472a07246128 in current term 1: Already voted for candidate c47d5c46e83e47808560e697b5819921 in this term.
I20260709 12:30:47.306322 19465 ts_tablet_manager.cc:1403] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921: Time spent bootstrapping tablet: real 0.077s	user 0.015s	sys 0.005s
I20260709 12:30:47.307366 19310 raft_consensus.cc:2468] T fc6bddf00974464a9da634f3e8107d07 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 1.
I20260709 12:30:47.310189 19463 tablet_bootstrap.cc:492] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128: No bootstrap required, opened a new log
I20260709 12:30:47.310125 19465 raft_consensus.cc:359] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.310789 19463 ts_tablet_manager.cc:1403] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128: Time spent bootstrapping tablet: real 0.114s	user 0.013s	sys 0.008s
I20260709 12:30:47.310992 19465 raft_consensus.cc:385] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:47.311307 19465 raft_consensus.cc:740] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Initialized, Role: FOLLOWER
I20260709 12:30:47.311098 19202 leader_election.cc:304] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 706ce9f0353f4fa0a4744bf07bd4537c, c47d5c46e83e47808560e697b5819921; no voters: 36047ee0e391483f8291472a07246128
I20260709 12:30:47.313444 19390 raft_consensus.cc:2804] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:47.313915 19390 raft_consensus.cc:697] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [term 1 LEADER]: Becoming Leader. State: Replica: c47d5c46e83e47808560e697b5819921, State: Running, Role: LEADER
I20260709 12:30:47.313985 19463 raft_consensus.cc:359] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.314914 19463 raft_consensus.cc:385] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:47.314831 19390 consensus_queue.cc:237] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.315322 19463 raft_consensus.cc:740] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Initialized, Role: FOLLOWER
I20260709 12:30:47.316804 19463 consensus_queue.cc:260] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.318656 19463 ts_tablet_manager.cc:1434] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:30:47.319891 19463 tablet_bootstrap.cc:492] T fa3785a9f62342c2aec12bd7d092e5ff P 36047ee0e391483f8291472a07246128: Bootstrap starting.
I20260709 12:30:47.294665 19464 tablet_bootstrap.cc:654] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:47.317022 19129 leader_election.cc:304] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 36047ee0e391483f8291472a07246128; no voters: 706ce9f0353f4fa0a4744bf07bd4537c, c47d5c46e83e47808560e697b5819921
I20260709 12:30:47.323836 19485 raft_consensus.cc:2749] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:30:47.332705 19463 tablet_bootstrap.cc:654] T fa3785a9f62342c2aec12bd7d092e5ff P 36047ee0e391483f8291472a07246128: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:47.333454 19465 consensus_queue.cc:260] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.337311 19465 ts_tablet_manager.cc:1434] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:30:47.338626 19465 tablet_bootstrap.cc:492] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921: Bootstrap starting.
I20260709 12:30:47.339497 19464 tablet_bootstrap.cc:492] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c: No bootstrap required, opened a new log
I20260709 12:30:47.340216 19464 ts_tablet_manager.cc:1403] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.008s
I20260709 12:30:47.342435 19463 tablet_bootstrap.cc:492] T fa3785a9f62342c2aec12bd7d092e5ff P 36047ee0e391483f8291472a07246128: No bootstrap required, opened a new log
I20260709 12:30:47.342979 19463 ts_tablet_manager.cc:1403] T fa3785a9f62342c2aec12bd7d092e5ff P 36047ee0e391483f8291472a07246128: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.003s
I20260709 12:30:47.344314 19464 raft_consensus.cc:359] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.345400 19464 raft_consensus.cc:385] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:47.345790 19464 raft_consensus.cc:740] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Initialized, Role: FOLLOWER
I20260709 12:30:47.346035 19463 raft_consensus.cc:359] T fa3785a9f62342c2aec12bd7d092e5ff P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.347008 19463 raft_consensus.cc:385] T fa3785a9f62342c2aec12bd7d092e5ff P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:47.347384 19463 raft_consensus.cc:740] T fa3785a9f62342c2aec12bd7d092e5ff P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Initialized, Role: FOLLOWER
I20260709 12:30:47.347036 19464 consensus_queue.cc:260] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.348671 19463 consensus_queue.cc:260] T fa3785a9f62342c2aec12bd7d092e5ff P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.350492 19465 tablet_bootstrap.cc:654] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:47.351370 19463 ts_tablet_manager.cc:1434] T fa3785a9f62342c2aec12bd7d092e5ff P 36047ee0e391483f8291472a07246128: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:30:47.352675 19463 tablet_bootstrap.cc:492] T b3ce768dc4f84e8aade6196d75698a24 P 36047ee0e391483f8291472a07246128: Bootstrap starting.
I20260709 12:30:47.355883 19465 tablet_bootstrap.cc:492] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921: No bootstrap required, opened a new log
I20260709 12:30:47.356401 19465 ts_tablet_manager.cc:1403] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921: Time spent bootstrapping tablet: real 0.018s	user 0.002s	sys 0.008s
I20260709 12:30:47.353763 19060 catalog_manager.cc:5697] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36047ee0e391483f8291472a07246128 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "36047ee0e391483f8291472a07246128" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:47.359134 19463 tablet_bootstrap.cc:654] T b3ce768dc4f84e8aade6196d75698a24 P 36047ee0e391483f8291472a07246128: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:47.359665 19465 raft_consensus.cc:359] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.360309 19465 raft_consensus.cc:385] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:47.358762 19060 catalog_manager.cc:5697] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 reported cstate change: term changed from 0 to 1, leader changed from <none> to 36047ee0e391483f8291472a07246128 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "36047ee0e391483f8291472a07246128" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:47.360549 19465 raft_consensus.cc:740] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Initialized, Role: FOLLOWER
I20260709 12:30:47.361265 19465 consensus_queue.cc:260] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.362900 19464 ts_tablet_manager.cc:1434] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.001s
I20260709 12:30:47.363646 19465 ts_tablet_manager.cc:1434] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:30:47.364107 19464 tablet_bootstrap.cc:492] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c: Bootstrap starting.
I20260709 12:30:47.370402 19464 tablet_bootstrap.cc:654] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:47.378485 19450 raft_consensus.cc:493] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:47.379092 19450 raft_consensus.cc:515] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.381286 19450 leader_election.cc:290] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321)
I20260709 12:30:47.383422 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3785a9f62342c2aec12bd7d092e5ff" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128" is_pre_election: true
I20260709 12:30:47.383249 19058 catalog_manager.cc:5697] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 reported cstate change: term changed from 0 to 1, leader changed from <none> to c47d5c46e83e47808560e697b5819921 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "c47d5c46e83e47808560e697b5819921" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:47.384325 19162 raft_consensus.cc:2468] T fa3785a9f62342c2aec12bd7d092e5ff P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 0.
I20260709 12:30:47.386245 19235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3785a9f62342c2aec12bd7d092e5ff" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921" is_pre_election: true
I20260709 12:30:47.386673 19278 leader_election.cc:304] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c; no voters: 
I20260709 12:30:47.387017 19235 raft_consensus.cc:2468] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 0.
I20260709 12:30:47.388880 19495 raft_consensus.cc:2804] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:47.389351 19495 raft_consensus.cc:493] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:47.389755 19495 raft_consensus.cc:3060] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.393790 19463 tablet_bootstrap.cc:492] T b3ce768dc4f84e8aade6196d75698a24 P 36047ee0e391483f8291472a07246128: No bootstrap required, opened a new log
I20260709 12:30:47.393966 19464 tablet_bootstrap.cc:492] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c: No bootstrap required, opened a new log
I20260709 12:30:47.394315 19463 ts_tablet_manager.cc:1403] T b3ce768dc4f84e8aade6196d75698a24 P 36047ee0e391483f8291472a07246128: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.018s
I20260709 12:30:47.394527 19464 ts_tablet_manager.cc:1403] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.001s
I20260709 12:30:47.397281 19463 raft_consensus.cc:359] T b3ce768dc4f84e8aade6196d75698a24 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.397993 19463 raft_consensus.cc:385] T b3ce768dc4f84e8aade6196d75698a24 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:47.397701 19464 raft_consensus.cc:359] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.398325 19463 raft_consensus.cc:740] T b3ce768dc4f84e8aade6196d75698a24 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Initialized, Role: FOLLOWER
I20260709 12:30:47.398470 19464 raft_consensus.cc:385] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:47.402166 19464 raft_consensus.cc:740] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Initialized, Role: FOLLOWER
I20260709 12:30:47.403015 19464 consensus_queue.cc:260] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.403226 19495 raft_consensus.cc:515] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.405023 19464 ts_tablet_manager.cc:1434] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:30:47.405251 19495 leader_election.cc:290] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 election: Requested vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321)
I20260709 12:30:47.399111 19463 consensus_queue.cc:260] T b3ce768dc4f84e8aade6196d75698a24 P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.407778 19463 ts_tablet_manager.cc:1434] T b3ce768dc4f84e8aade6196d75698a24 P 36047ee0e391483f8291472a07246128: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:30:47.409834 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3785a9f62342c2aec12bd7d092e5ff" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:47.410353 19162 raft_consensus.cc:3060] T fa3785a9f62342c2aec12bd7d092e5ff P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.410594 19235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa3785a9f62342c2aec12bd7d092e5ff" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:47.411252 19235 raft_consensus.cc:3060] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.417606 19162 raft_consensus.cc:2468] T fa3785a9f62342c2aec12bd7d092e5ff P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 1.
I20260709 12:30:47.419042 19235 raft_consensus.cc:2468] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 1.
I20260709 12:30:47.420168 19278 leader_election.cc:304] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 706ce9f0353f4fa0a4744bf07bd4537c, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:47.422523 19450 raft_consensus.cc:2804] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:47.422993 19450 raft_consensus.cc:697] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Becoming Leader. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Running, Role: LEADER
I20260709 12:30:47.423774 19450 consensus_queue.cc:237] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.432521 19059 catalog_manager.cc:5697] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c reported cstate change: term changed from 0 to 1, leader changed from <none> to 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67). New cstate: current_term: 1 leader_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:47.492903 19162 raft_consensus.cc:3060] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.499930 19390 consensus_queue.cc:1048] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:47.512126 19489 consensus_queue.cc:1048] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:47.523772 19450 raft_consensus.cc:493] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:47.524173 19450 raft_consensus.cc:515] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.526345 19450 leader_election.cc:290] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321)
I20260709 12:30:47.527051 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ce768dc4f84e8aade6196d75698a24" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128" is_pre_election: true
I20260709 12:30:47.527398 19235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ce768dc4f84e8aade6196d75698a24" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921" is_pre_election: true
I20260709 12:30:47.527787 19162 raft_consensus.cc:2468] T b3ce768dc4f84e8aade6196d75698a24 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 0.
I20260709 12:30:47.528041 19235 raft_consensus.cc:2468] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 0.
I20260709 12:30:47.529006 19278 leader_election.cc:304] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 706ce9f0353f4fa0a4744bf07bd4537c, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:47.529651 19450 raft_consensus.cc:2804] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:47.530018 19450 raft_consensus.cc:493] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:47.530380 19450 raft_consensus.cc:3060] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.532454 19490 raft_consensus.cc:493] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:47.532985 19490 raft_consensus.cc:515] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.534705 19490 leader_election.cc:290] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:47.535732 19310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9428376e4f4593b7b7aaf5a17b5624" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" is_pre_election: true
I20260709 12:30:47.536056 19163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9428376e4f4593b7b7aaf5a17b5624" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128" is_pre_election: true
I20260709 12:30:47.536448 19310 raft_consensus.cc:2468] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 0.
I20260709 12:30:47.536692 19163 raft_consensus.cc:2468] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 0.
I20260709 12:30:47.537413 19450 raft_consensus.cc:515] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.537415 19202 leader_election.cc:304] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 706ce9f0353f4fa0a4744bf07bd4537c, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:47.538718 19490 raft_consensus.cc:2804] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:47.539033 19490 raft_consensus.cc:493] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:47.539328 19490 raft_consensus.cc:3060] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.539506 19450 leader_election.cc:290] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 election: Requested vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321)
I20260709 12:30:47.540148 19163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ce768dc4f84e8aade6196d75698a24" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:47.540654 19163 raft_consensus.cc:3060] T b3ce768dc4f84e8aade6196d75698a24 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.540619 19235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ce768dc4f84e8aade6196d75698a24" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:47.541370 19235 raft_consensus.cc:3060] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.545867 19163 raft_consensus.cc:2468] T b3ce768dc4f84e8aade6196d75698a24 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 1.
I20260709 12:30:47.546821 19278 leader_election.cc:304] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c; no voters: 
I20260709 12:30:47.546846 19490 raft_consensus.cc:515] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.547572 19450 raft_consensus.cc:2804] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:47.548063 19450 raft_consensus.cc:697] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Becoming Leader. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Running, Role: LEADER
I20260709 12:30:47.548985 19235 raft_consensus.cc:2468] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 1.
I20260709 12:30:47.548942 19450 consensus_queue.cc:237] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.549518 19163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9428376e4f4593b7b7aaf5a17b5624" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:47.550129 19490 leader_election.cc:290] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 election: Requested vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:47.550433 19310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9428376e4f4593b7b7aaf5a17b5624" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:47.550670 19163 raft_consensus.cc:3060] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.551045 19310 raft_consensus.cc:3060] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.557049 19310 raft_consensus.cc:2468] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 1.
I20260709 12:30:47.557981 19163 raft_consensus.cc:2468] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 1.
I20260709 12:30:47.558627 19202 leader_election.cc:304] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 706ce9f0353f4fa0a4744bf07bd4537c, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:47.559459 19490 raft_consensus.cc:2804] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:47.559056 19059 catalog_manager.cc:5697] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c reported cstate change: term changed from 0 to 1, leader changed from <none> to 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67). New cstate: current_term: 1 leader_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:47.559933 19490 raft_consensus.cc:697] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [term 1 LEADER]: Becoming Leader. State: Replica: c47d5c46e83e47808560e697b5819921, State: Running, Role: LEADER
I20260709 12:30:47.560794 19490 consensus_queue.cc:237] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.569296 19060 catalog_manager.cc:5697] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 reported cstate change: term changed from 0 to 1, leader changed from <none> to c47d5c46e83e47808560e697b5819921 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "c47d5c46e83e47808560e697b5819921" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:47.596966 19445 consensus_queue.cc:1048] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:47.608773 19485 consensus_queue.cc:1048] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:47.617868 19237 raft_consensus.cc:3060] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:47.624308 19445 consensus_queue.cc:1048] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:47.638600 19486 consensus_queue.cc:1048] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:47.652941 19486 consensus_queue.cc:1048] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:47.666874 19485 consensus_queue.cc:1048] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:47.673136 19310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a321ae86ba164e9988812718f254188f"
dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
mode: GRACEFUL
new_leader_uuid: "36047ee0e391483f8291472a07246128"
 from {username='slave'} at 127.0.0.1:42658
I20260709 12:30:47.673903 19310 raft_consensus.cc:606] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Received request to transfer leadership to TS 36047ee0e391483f8291472a07246128
I20260709 12:30:47.683864 19235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e970dba149d4c968a07dbb59f75cae7"
dest_uuid: "c47d5c46e83e47808560e697b5819921"
mode: GRACEFUL
new_leader_uuid: "36047ee0e391483f8291472a07246128"
 from {username='slave'} at 127.0.0.1:54950
I20260709 12:30:47.684360 19235 raft_consensus.cc:606] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [term 1 LEADER]: Received request to transfer leadership to TS 36047ee0e391483f8291472a07246128
I20260709 12:30:47.695721 19162 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "652ae6381b194eb0a5f781edf5377772"
dest_uuid: "36047ee0e391483f8291472a07246128"
mode: GRACEFUL
new_leader_uuid: "c47d5c46e83e47808560e697b5819921"
 from {username='slave'} at 127.0.0.1:39230
I20260709 12:30:47.696290 19162 raft_consensus.cc:606] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Received request to transfer leadership to TS c47d5c46e83e47808560e697b5819921
I20260709 12:30:47.696486 19450 consensus_queue.cc:1048] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Connected to new peer: Peer: permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:47.701545 19312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3ce768dc4f84e8aade6196d75698a24"
dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
mode: GRACEFUL
new_leader_uuid: "c47d5c46e83e47808560e697b5819921"
 from {username='slave'} at 127.0.0.1:42658
I20260709 12:30:47.702131 19312 raft_consensus.cc:606] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Received request to transfer leadership to TS c47d5c46e83e47808560e697b5819921
I20260709 12:30:47.703961 19495 raft_consensus.cc:993] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c: : Instructing follower 36047ee0e391483f8291472a07246128 to start an election
I20260709 12:30:47.704697 19450 raft_consensus.cc:1081] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Signalling peer 36047ee0e391483f8291472a07246128 to start an election
I20260709 12:30:47.709852 19162 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a321ae86ba164e9988812718f254188f"
dest_uuid: "36047ee0e391483f8291472a07246128"
 from {username='slave'} at 127.0.0.1:39216
I20260709 12:30:47.710739 19162 raft_consensus.cc:493] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:47.711815 19162 raft_consensus.cc:3060] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:47.722543 19530 consensus_queue.cc:1048] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:47.723591 19162 raft_consensus.cc:515] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.725703 19162 leader_election.cc:290] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 2 election: Requested vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:47.727804 19237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a321ae86ba164e9988812718f254188f" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:47.729244 19312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a321ae86ba164e9988812718f254188f" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:47.729794 19312 raft_consensus.cc:3055] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:47.730108 19312 raft_consensus.cc:740] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Running, Role: LEADER
I20260709 12:30:47.730945 19312 consensus_queue.cc:260] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.732015 19312 raft_consensus.cc:3060] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:47.738775 19312 raft_consensus.cc:2468] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 2.
I20260709 12:30:47.739794 19127 leader_election.cc:304] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c; no voters: c47d5c46e83e47808560e697b5819921
I20260709 12:30:47.740499 19485 raft_consensus.cc:2804] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:47.741006 19485 raft_consensus.cc:697] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128 [term 2 LEADER]: Becoming Leader. State: Replica: 36047ee0e391483f8291472a07246128, State: Running, Role: LEADER
I20260709 12:30:47.741736 19485 consensus_queue.cc:237] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:47.748730 19061 catalog_manager.cc:5697] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128 reported cstate change: term changed from 1 to 2, leader changed from 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67) to 36047ee0e391483f8291472a07246128 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "36047ee0e391483f8291472a07246128" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:47.785348 19490 consensus_queue.cc:1048] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:47.795970 19490 consensus_queue.cc:1048] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:47.819901 19530 consensus_queue.cc:1048] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:47.837836 19495 consensus_queue.cc:1048] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Connected to new peer: Peer: permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:47.989516 19450 consensus_queue.cc:1048] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:47.991816 19450 consensus_queue.cc:1048] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Connected to new peer: Peer: permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:47.996891 19530 raft_consensus.cc:993] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c: : Instructing follower c47d5c46e83e47808560e697b5819921 to start an election
I20260709 12:30:47.997363 19530 raft_consensus.cc:1081] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Signalling peer c47d5c46e83e47808560e697b5819921 to start an election
I20260709 12:30:48.000188 19235 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3ce768dc4f84e8aade6196d75698a24"
dest_uuid: "c47d5c46e83e47808560e697b5819921"
 from {username='slave'} at 127.0.0.1:54934
I20260709 12:30:48.001518 19235 raft_consensus.cc:493] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:48.003014 19235 raft_consensus.cc:3060] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:48.015980 19235 raft_consensus.cc:515] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:48.017937 19235 leader_election.cc:290] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 2 election: Requested vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:48.018882 19312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ce768dc4f84e8aade6196d75698a24" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:48.019371 19162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ce768dc4f84e8aade6196d75698a24" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:48.019544 19312 raft_consensus.cc:3055] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:48.019917 19312 raft_consensus.cc:740] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Running, Role: LEADER
I20260709 12:30:48.020902 19312 consensus_queue.cc:260] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:48.022146 19312 raft_consensus.cc:3060] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:48.019969 19162 raft_consensus.cc:3060] T b3ce768dc4f84e8aade6196d75698a24 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:48.029492 19312 raft_consensus.cc:2468] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 2.
I20260709 12:30:48.030701 19202 leader_election.cc:304] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 706ce9f0353f4fa0a4744bf07bd4537c, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:48.030992 19162 raft_consensus.cc:2468] T b3ce768dc4f84e8aade6196d75698a24 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 2.
I20260709 12:30:48.031536 19489 raft_consensus.cc:2804] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:48.032065 19489 raft_consensus.cc:697] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921 [term 2 LEADER]: Becoming Leader. State: Replica: c47d5c46e83e47808560e697b5819921, State: Running, Role: LEADER
I20260709 12:30:48.032801 19489 consensus_queue.cc:237] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:48.039727 19058 catalog_manager.cc:5697] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921 reported cstate change: term changed from 1 to 2, leader changed from 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67) to c47d5c46e83e47808560e697b5819921 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "c47d5c46e83e47808560e697b5819921" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:48.054795 19489 consensus_queue.cc:1048] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:48.064633 19390 consensus_queue.cc:1048] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:48.108985 19390 raft_consensus.cc:993] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921: : Instructing follower 36047ee0e391483f8291472a07246128 to start an election
I20260709 12:30:48.109649 19390 raft_consensus.cc:1081] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [term 1 LEADER]: Signalling peer 36047ee0e391483f8291472a07246128 to start an election
I20260709 12:30:48.111716 19163 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e970dba149d4c968a07dbb59f75cae7"
dest_uuid: "36047ee0e391483f8291472a07246128"
 from {username='slave'} at 127.0.0.1:39210
I20260709 12:30:48.112174 19163 raft_consensus.cc:493] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:48.112402 19163 raft_consensus.cc:3060] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:48.117352 19163 raft_consensus.cc:515] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:48.118811 19163 leader_election.cc:290] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 2 election: Requested vote from peers c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:48.119732 19235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e970dba149d4c968a07dbb59f75cae7" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:48.119884 19312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e970dba149d4c968a07dbb59f75cae7" candidate_uuid: "36047ee0e391483f8291472a07246128" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:48.120349 19235 raft_consensus.cc:3055] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:48.120425 19312 raft_consensus.cc:3060] T 8e970dba149d4c968a07dbb59f75cae7 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:48.120675 19235 raft_consensus.cc:740] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Running, Role: LEADER
I20260709 12:30:48.121491 19235 consensus_queue.cc:260] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:48.122553 19235 raft_consensus.cc:3060] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:48.125496 19312 raft_consensus.cc:2468] T 8e970dba149d4c968a07dbb59f75cae7 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 2.
I20260709 12:30:48.126606 19127 leader_election.cc:304] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c; no voters: 
I20260709 12:30:48.127290 19486 raft_consensus.cc:2804] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:48.127408 19235 raft_consensus.cc:2468] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36047ee0e391483f8291472a07246128 in term 2.
I20260709 12:30:48.127732 19486 raft_consensus.cc:697] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128 [term 2 LEADER]: Becoming Leader. State: Replica: 36047ee0e391483f8291472a07246128, State: Running, Role: LEADER
I20260709 12:30:48.128793 19486 consensus_queue.cc:237] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:48.135588 19061 catalog_manager.cc:5697] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128 reported cstate change: term changed from 1 to 2, leader changed from c47d5c46e83e47808560e697b5819921 (127.8.111.66) to 36047ee0e391483f8291472a07246128 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "36047ee0e391483f8291472a07246128" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:48.190821 19491 raft_consensus.cc:993] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128: : Instructing follower c47d5c46e83e47808560e697b5819921 to start an election
I20260709 12:30:48.191299 19486 raft_consensus.cc:1081] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Signalling peer c47d5c46e83e47808560e697b5819921 to start an election
I20260709 12:30:48.192734 19235 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "652ae6381b194eb0a5f781edf5377772"
dest_uuid: "c47d5c46e83e47808560e697b5819921"
 from {username='slave'} at 127.0.0.1:54946
I20260709 12:30:48.193224 19235 raft_consensus.cc:493] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:48.193521 19235 raft_consensus.cc:3060] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:48.198398 19235 raft_consensus.cc:515] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:48.200057 19235 leader_election.cc:290] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 2 election: Requested vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67:37131)
I20260709 12:30:48.200738 19163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ae6381b194eb0a5f781edf5377772" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:48.201095 19312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "652ae6381b194eb0a5f781edf5377772" candidate_uuid: "c47d5c46e83e47808560e697b5819921" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
I20260709 12:30:48.201418 19163 raft_consensus.cc:3055] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:48.201792 19163 raft_consensus.cc:740] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Running, Role: LEADER
I20260709 12:30:48.201819 19312 raft_consensus.cc:3060] T 652ae6381b194eb0a5f781edf5377772 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:48.202688 19235 raft_consensus.cc:3060] T a321ae86ba164e9988812718f254188f P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:48.202642 19163 consensus_queue.cc:260] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:48.203577 19163 raft_consensus.cc:3060] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:48.207894 19163 raft_consensus.cc:2468] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 2.
I20260709 12:30:48.208591 19312 raft_consensus.cc:2468] T 652ae6381b194eb0a5f781edf5377772 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c47d5c46e83e47808560e697b5819921 in term 2.
I20260709 12:30:48.208937 19204 leader_election.cc:304] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:48.209451 19235 raft_consensus.cc:1275] T a321ae86ba164e9988812718f254188f P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Refusing update from remote peer 36047ee0e391483f8291472a07246128: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:48.209807 19390 raft_consensus.cc:2804] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:48.210309 19390 raft_consensus.cc:697] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921 [term 2 LEADER]: Becoming Leader. State: Replica: c47d5c46e83e47808560e697b5819921, State: Running, Role: LEADER
I20260709 12:30:48.210810 19486 consensus_queue.cc:1048] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:48.211099 19390 consensus_queue.cc:237] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:48.217839 19312 raft_consensus.cc:1275] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Refusing update from remote peer 36047ee0e391483f8291472a07246128: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:48.219084 19485 consensus_queue.cc:1048] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:48.219816 19061 catalog_manager.cc:5697] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921 reported cstate change: term changed from 1 to 2, leader changed from 36047ee0e391483f8291472a07246128 (127.8.111.65) to c47d5c46e83e47808560e697b5819921 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "c47d5c46e83e47808560e697b5819921" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:48.513447 19312 raft_consensus.cc:1275] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Refusing update from remote peer c47d5c46e83e47808560e697b5819921: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:48.514950 19390 consensus_queue.cc:1048] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:48.527767 19162 raft_consensus.cc:1275] T b3ce768dc4f84e8aade6196d75698a24 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Refusing update from remote peer c47d5c46e83e47808560e697b5819921: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:48.528985 19489 consensus_queue.cc:1048] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:48.599948 19312 raft_consensus.cc:1275] T 8e970dba149d4c968a07dbb59f75cae7 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Refusing update from remote peer 36047ee0e391483f8291472a07246128: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:48.601222 19491 consensus_queue.cc:1048] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:48.611114 19235 raft_consensus.cc:1275] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Refusing update from remote peer 36047ee0e391483f8291472a07246128: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:48.612571 19486 consensus_queue.cc:1048] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:48.619576 19310 raft_consensus.cc:1275] T 652ae6381b194eb0a5f781edf5377772 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Refusing update from remote peer c47d5c46e83e47808560e697b5819921: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:48.622579 19390 consensus_queue.cc:1048] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:48.634626 19162 raft_consensus.cc:1275] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Refusing update from remote peer c47d5c46e83e47808560e697b5819921: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:48.636027 19489 consensus_queue.cc:1048] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921 [LEADER]: Connected to new peer: Peer: permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:50.738551 19061 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46910:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:30:50.765198 19061 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46910:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:30:50.868882  8637 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:30:50.993912 19592 tablet.cc:1724] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:51.006297 19581 tablet.cc:1724] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:30:51.139659 19127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:37131, user_credentials={real_user=slave}} blocked reactor thread for 134190us
I20260709 12:30:50.963636 19589 tablet.cc:1724] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:30:51.140105 19278 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:41321, user_credentials={real_user=slave}} blocked reactor thread for 134824us
I20260709 12:30:51.183104 19598 tablet.cc:1724] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:51.190632 19596 tablet.cc:1724] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:51.196870 19590 tablet.cc:1724] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:51.207389 19603 tablet.cc:1724] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:51.166411 19593 tablet.cc:1724] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:30:51.210896 19595 log.cc:927] Time spent T 77cf31428b5c44d1ada255bdffff39f1 P c47d5c46e83e47808560e697b5819921: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 12:30:51.238191 19189 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:39d21c988f5c4d0ab2a5368979a3c235)
W20260709 12:30:51.260355 19189 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:39d21c988f5c4d0ab2a5368979a3c235)
W20260709 12:30:51.262610 19587 log.cc:927] Time spent T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:30:51.270200 19608 tablet.cc:1724] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:30:51.289881 19571 log.cc:927] Time spent T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921: Append to log took a long time: real 0.138s	user 0.001s	sys 0.002s
W20260709 12:30:51.290568 19338 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:39d21c988f5c4d0ab2a5368979a3c235)
I20260709 12:30:51.301561 19605 tablet.cc:1724] T fc6bddf00974464a9da634f3e8107d07 P 706ce9f0353f4fa0a4744bf07bd4537c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:51.304788 19581 tablet.cc:1724] T 77cf31428b5c44d1ada255bdffff39f1 P c47d5c46e83e47808560e697b5819921: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:51.279663 19607 tablet.cc:1724] T 77cf31428b5c44d1ada255bdffff39f1 P 706ce9f0353f4fa0a4744bf07bd4537c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:30:51.322925 19579 log.cc:927] Time spent T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c: Append to log took a long time: real 0.171s	user 0.003s	sys 0.000s
I20260709 12:30:51.257997 19601 tablet.cc:1724] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:51.366837 19590 tablet.cc:1724] T 652ae6381b194eb0a5f781edf5377772 P 706ce9f0353f4fa0a4744bf07bd4537c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:51.369879 19589 tablet.cc:1724] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:51.370903 19592 tablet.cc:1724] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:51.376222 19596 tablet.cc:1724] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:51.377440 19598 tablet.cc:1724] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:51.382222 19156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39d21c988f5c4d0ab2a5368979a3c235"
dest_uuid: "36047ee0e391483f8291472a07246128"
mode: GRACEFUL
new_leader_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
 from {username='slave'} at 127.0.0.1:53022
I20260709 12:30:51.392158 19156 raft_consensus.cc:606] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Received request to transfer leadership to TS 706ce9f0353f4fa0a4744bf07bd4537c
I20260709 12:30:51.382084 19593 tablet.cc:1724] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:51.400655 19608 tablet.cc:1724] T fa3785a9f62342c2aec12bd7d092e5ff P 36047ee0e391483f8291472a07246128: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:30:51.403119 19092 debug-util.cc:398] Leaking SignalData structure 0x7b0800008600 after lost signal to thread 8640
W20260709 12:30:51.404249 19092 debug-util.cc:398] Leaking SignalData structure 0x7b08000354c0 after lost signal to thread 19095
I20260709 12:30:51.407919 19589 tablet.cc:1724] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:30:51.410135 19092 debug-util.cc:398] Leaking SignalData structure 0x7b08003dcea0 after lost signal to thread 19262
I20260709 12:30:51.383787 19601 tablet.cc:1724] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:30:51.426265 19092 debug-util.cc:398] Leaking SignalData structure 0x7b0800238360 after lost signal to thread 19336
I20260709 12:30:51.426395 19590 tablet.cc:1724] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:51.432405 19593 tablet.cc:1724] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:51.424520 19598 tablet.cc:1724] T a321ae86ba164e9988812718f254188f P c47d5c46e83e47808560e697b5819921: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:51.441462 19608 tablet.cc:1724] T b3ce768dc4f84e8aade6196d75698a24 P 36047ee0e391483f8291472a07246128: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:51.460489 19593 tablet.cc:1724] T 8e970dba149d4c968a07dbb59f75cae7 P 706ce9f0353f4fa0a4744bf07bd4537c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:51.496752 19546 raft_consensus.cc:993] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128: : Instructing follower 706ce9f0353f4fa0a4744bf07bd4537c to start an election
I20260709 12:30:51.497269 19546 raft_consensus.cc:1081] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Signalling peer 706ce9f0353f4fa0a4744bf07bd4537c to start an election
I20260709 12:30:51.499218 19308 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39d21c988f5c4d0ab2a5368979a3c235"
dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
 from {username='slave'} at 127.0.0.1:42652
I20260709 12:30:51.499770 19308 raft_consensus.cc:493] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:51.500147 19308 raft_consensus.cc:3060] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:51.505321 19234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc9428376e4f4593b7b7aaf5a17b5624"
dest_uuid: "c47d5c46e83e47808560e697b5819921"
mode: GRACEFUL
new_leader_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
 from {username='slave'} at 127.0.0.1:51990
I20260709 12:30:51.505970 19234 raft_consensus.cc:606] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [term 1 LEADER]: Received request to transfer leadership to TS 706ce9f0353f4fa0a4744bf07bd4537c
I20260709 12:30:51.507280  8637 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:30:51.508036  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:51.527182 19308 raft_consensus.cc:515] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:51.531000 19156 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2057b2de3b3c4ae8b0419bb8c846e616"
dest_uuid: "36047ee0e391483f8291472a07246128"
mode: GRACEFUL
new_leader_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
 from {username='slave'} at 127.0.0.1:53022
I20260709 12:30:51.531373 19159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d21c988f5c4d0ab2a5368979a3c235" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:51.531651 19156 raft_consensus.cc:606] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Received request to transfer leadership to TS 706ce9f0353f4fa0a4744bf07bd4537c
I20260709 12:30:51.532063 19159 raft_consensus.cc:3055] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:51.532409 19159 raft_consensus.cc:740] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Running, Role: LEADER
I20260709 12:30:51.533176 19159 consensus_queue.cc:260] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:51.534842 19159 raft_consensus.cc:3060] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:51.542896 19308 leader_election.cc:290] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 2 election: Requested vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321)
I20260709 12:30:51.547168 19159 raft_consensus.cc:2468] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 2.
I20260709 12:30:51.548695 19278 leader_election.cc:304] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c; no voters: 
I20260709 12:30:51.549384 19234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39d21c988f5c4d0ab2a5368979a3c235" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:51.549993 19234 raft_consensus.cc:3060] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:51.550022 19550 raft_consensus.cc:2804] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:51.550726 19550 raft_consensus.cc:697] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 LEADER]: Becoming Leader. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Running, Role: LEADER
I20260709 12:30:51.551635 19550 consensus_queue.cc:237] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:51.555538 19238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8abbc11e279441aa8cccafbf8df6290"
dest_uuid: "c47d5c46e83e47808560e697b5819921"
mode: GRACEFUL
new_leader_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
 from {username='slave'} at 127.0.0.1:51990
I20260709 12:30:51.556169 19238 raft_consensus.cc:606] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [term 2 LEADER]: Received request to transfer leadership to TS 706ce9f0353f4fa0a4744bf07bd4537c
I20260709 12:30:51.560350  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:30:51.561007  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:51.528784 19058 catalog_manager.cc:6242] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a: soft_deleted_table [id=89aa7cf4d4de4fc5b660724b3efbf2e5] alter complete (version 1)
I20260709 12:30:51.598449 19234 raft_consensus.cc:2468] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 2.
I20260709 12:30:51.600211 19061 catalog_manager.cc:5697] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c reported cstate change: term changed from 1 to 2, leader changed from 36047ee0e391483f8291472a07246128 (127.8.111.65) to 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67). New cstate: current_term: 2 leader_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:51.792747 19489 raft_consensus.cc:993] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921: : Instructing follower 706ce9f0353f4fa0a4744bf07bd4537c to start an election
I20260709 12:30:51.793220 19545 raft_consensus.cc:1081] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [term 1 LEADER]: Signalling peer 706ce9f0353f4fa0a4744bf07bd4537c to start an election
I20260709 12:30:51.794914 19308 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc9428376e4f4593b7b7aaf5a17b5624"
dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
 from {username='slave'} at 127.0.0.1:42648
I20260709 12:30:51.795400 19308 raft_consensus.cc:493] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:51.795717 19308 raft_consensus.cc:3060] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:51.800661 19308 raft_consensus.cc:515] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:51.803295 19159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9428376e4f4593b7b7aaf5a17b5624" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:51.803853 19159 raft_consensus.cc:3060] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:51.804358 19308 leader_election.cc:290] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 2 election: Requested vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321)
I20260709 12:30:51.807366 19238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc9428376e4f4593b7b7aaf5a17b5624" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:51.807977 19238 raft_consensus.cc:3055] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:51.808292 19238 raft_consensus.cc:740] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Running, Role: LEADER
I20260709 12:30:51.809074 19238 consensus_queue.cc:260] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:51.810425 19238 raft_consensus.cc:3060] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:51.812376 19159 raft_consensus.cc:2468] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 2.
I20260709 12:30:51.813735 19278 leader_election.cc:304] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c; no voters: 
I20260709 12:30:51.814702 19550 raft_consensus.cc:2804] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:51.815186 19550 raft_consensus.cc:697] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 LEADER]: Becoming Leader. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Running, Role: LEADER
I20260709 12:30:51.816071 19550 consensus_queue.cc:237] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:51.818439 19238 raft_consensus.cc:2468] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 2.
I20260709 12:30:51.824664 19061 catalog_manager.cc:5697] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c reported cstate change: term changed from 1 to 2, leader changed from c47d5c46e83e47808560e697b5819921 (127.8.111.66) to 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67). New cstate: current_term: 2 leader_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:51.945417 19238 raft_consensus.cc:1275] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Refusing update from remote peer 706ce9f0353f4fa0a4744bf07bd4537c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:30:51.947036 19550 consensus_queue.cc:1048] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:51.948215 19613 raft_consensus.cc:993] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128: : Instructing follower 706ce9f0353f4fa0a4744bf07bd4537c to start an election
I20260709 12:30:51.948742 19613 raft_consensus.cc:1081] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Signalling peer 706ce9f0353f4fa0a4744bf07bd4537c to start an election
I20260709 12:30:51.951129 19308 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2057b2de3b3c4ae8b0419bb8c846e616"
dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
 from {username='slave'} at 127.0.0.1:42652
I20260709 12:30:51.951851 19308 raft_consensus.cc:493] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:51.952219 19308 raft_consensus.cc:3060] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:51.956758 19159 raft_consensus.cc:1275] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Refusing update from remote peer 706ce9f0353f4fa0a4744bf07bd4537c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:30:51.958446 19548 consensus_queue.cc:1048] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Connected to new peer: Peer: permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:51.961408 19308 raft_consensus.cc:515] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:51.963593 19308 leader_election.cc:290] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 2 election: Requested vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321)
I20260709 12:30:51.966109 19156 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2057b2de3b3c4ae8b0419bb8c846e616" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:51.969388 19156 raft_consensus.cc:3055] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:51.969709 19156 raft_consensus.cc:740] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36047ee0e391483f8291472a07246128, State: Running, Role: LEADER
I20260709 12:30:51.970552 19156 consensus_queue.cc:260] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:51.972345 19238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2057b2de3b3c4ae8b0419bb8c846e616" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:51.972995 19238 raft_consensus.cc:3060] T 2057b2de3b3c4ae8b0419bb8c846e616 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:51.971967 19156 raft_consensus.cc:3060] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:51.979528 19545 raft_consensus.cc:993] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921: : Instructing follower 706ce9f0353f4fa0a4744bf07bd4537c to start an election
I20260709 12:30:51.980141 19606 raft_consensus.cc:1081] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [term 2 LEADER]: Signalling peer 706ce9f0353f4fa0a4744bf07bd4537c to start an election
I20260709 12:30:51.984426 19310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8abbc11e279441aa8cccafbf8df6290"
dest_uuid: "706ce9f0353f4fa0a4744bf07bd4537c"
 from {username='slave'} at 127.0.0.1:42648
I20260709 12:30:51.984963 19310 raft_consensus.cc:493] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:51.985306 19310 raft_consensus.cc:3060] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:51.992269 19238 raft_consensus.cc:2468] T 2057b2de3b3c4ae8b0419bb8c846e616 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 2.
I20260709 12:30:51.993412 19278 leader_election.cc:304] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 706ce9f0353f4fa0a4744bf07bd4537c, c47d5c46e83e47808560e697b5819921; no voters: 
I20260709 12:30:51.994343 19550 raft_consensus.cc:2804] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:51.994805 19550 raft_consensus.cc:697] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 LEADER]: Becoming Leader. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Running, Role: LEADER
I20260709 12:30:51.995705 19550 consensus_queue.cc:237] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:51.998154 19310 raft_consensus.cc:515] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:52.001246 19159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8abbc11e279441aa8cccafbf8df6290" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36047ee0e391483f8291472a07246128"
I20260709 12:30:52.002009 19159 raft_consensus.cc:3060] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:52.012009 19159 raft_consensus.cc:2468] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 3.
I20260709 12:30:52.013091 19278 leader_election.cc:304] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 36047ee0e391483f8291472a07246128, 706ce9f0353f4fa0a4744bf07bd4537c; no voters: 
I20260709 12:30:52.015139 19061 catalog_manager.cc:5697] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c reported cstate change: term changed from 1 to 2, leader changed from 36047ee0e391483f8291472a07246128 (127.8.111.65) to 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67). New cstate: current_term: 2 leader_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:52.016808 19156 raft_consensus.cc:2468] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 2.
I20260709 12:30:52.017884 19495 raft_consensus.cc:2804] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:52.018496 19495 raft_consensus.cc:697] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [term 3 LEADER]: Becoming Leader. State: Replica: 706ce9f0353f4fa0a4744bf07bd4537c, State: Running, Role: LEADER
I20260709 12:30:52.019390 19495 consensus_queue.cc:237] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:52.020038 19238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8abbc11e279441aa8cccafbf8df6290" candidate_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c47d5c46e83e47808560e697b5819921"
I20260709 12:30:52.020627 19238 raft_consensus.cc:3055] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:52.020949 19238 raft_consensus.cc:740] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c47d5c46e83e47808560e697b5819921, State: Running, Role: LEADER
I20260709 12:30:52.021780 19238 consensus_queue.cc:260] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } }
I20260709 12:30:52.022964 19238 raft_consensus.cc:3060] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:52.030831 19238 raft_consensus.cc:2468] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 706ce9f0353f4fa0a4744bf07bd4537c in term 3.
I20260709 12:30:52.031999 19310 leader_election.cc:290] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [CANDIDATE]: Term 3 election: Requested vote from peers 36047ee0e391483f8291472a07246128 (127.8.111.65:37375), c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321)
I20260709 12:30:52.041229 19061 catalog_manager.cc:5697] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c reported cstate change: term changed from 2 to 3, leader changed from c47d5c46e83e47808560e697b5819921 (127.8.111.66) to 706ce9f0353f4fa0a4744bf07bd4537c (127.8.111.67). New cstate: current_term: 3 leader_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "706ce9f0353f4fa0a4744bf07bd4537c" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 37131 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:52.281244 19234 raft_consensus.cc:1275] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Refusing update from remote peer 706ce9f0353f4fa0a4744bf07bd4537c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:30:52.282714 19495 consensus_queue.cc:1048] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:52.293231 19156 raft_consensus.cc:1275] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Refusing update from remote peer 706ce9f0353f4fa0a4744bf07bd4537c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:30:52.295326 19548 consensus_queue.cc:1048] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Connected to new peer: Peer: permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:30:52.422699 19156 raft_consensus.cc:1275] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Refusing update from remote peer 706ce9f0353f4fa0a4744bf07bd4537c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:52.423921 19623 consensus_queue.cc:1048] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Connected to new peer: Peer: permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:52.439055 19234 raft_consensus.cc:1275] T 2057b2de3b3c4ae8b0419bb8c846e616 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Refusing update from remote peer 706ce9f0353f4fa0a4744bf07bd4537c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:52.441012 19495 consensus_queue.cc:1048] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:52.562173  8637 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:30:52.567327  8637 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:30:52.567764  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:52.574717  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:52.575181  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:52.631369 19156 raft_consensus.cc:1275] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 3 FOLLOWER]: Refusing update from remote peer 706ce9f0353f4fa0a4744bf07bd4537c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:52.632683 19495 consensus_queue.cc:1048] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Connected to new peer: Peer: permanent_uuid: "36047ee0e391483f8291472a07246128" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 37375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:52.644124 19234 raft_consensus.cc:1275] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [term 3 FOLLOWER]: Refusing update from remote peer 706ce9f0353f4fa0a4744bf07bd4537c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:52.646142 19548 consensus_queue.cc:1048] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c47d5c46e83e47808560e697b5819921" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:53.576073  8637 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:30:53.581944  8637 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:30:53.582428  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:53.588305  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:53.588699  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:54.589761  8637 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:30:54.596203  8637 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:30:54.596647  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:54.601660  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:54.602068  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:55.603250  8637 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:30:55.608862  8637 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:30:55.609268  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:55.614662  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:55.615027  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:56.616014  8637 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:30:56.623044  8637 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:30:56.623469  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:56.627996  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:56.628371  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:57.784544  8637 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:30:57.792296  8637 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:30:57.792783  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:57.800890  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:57.801501  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:30:58.336473 19333 debug-util.cc:398] Leaking SignalData structure 0x7b080041a560 after lost signal to thread 8640
W20260709 12:30:58.337507 19333 debug-util.cc:398] Leaking SignalData structure 0x7b08003e05e0 after lost signal to thread 19095
W20260709 12:30:58.338564 19333 debug-util.cc:398] Leaking SignalData structure 0x7b080041c300 after lost signal to thread 19187
W20260709 12:30:58.339473 19333 debug-util.cc:398] Leaking SignalData structure 0x7b080022abe0 after lost signal to thread 19262
W20260709 12:30:58.340363 19333 debug-util.cc:398] Leaking SignalData structure 0x7b08001ca920 after lost signal to thread 19336
I20260709 12:30:58.802850  8637 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:30:58.808109  8637 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:30:58.808496  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:58.813171  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:58.813568  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:59.814640  8637 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:30:59.820135  8637 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:30:59.820603  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:59.825321  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:59.825708  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:00.826853  8637 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:31:00.835453  8637 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:31:00.836107  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:00.845096  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:00.845721  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:01.906673  8637 tablet_server.cc:179] TabletServer@127.8.111.65:0 shutting down...
I20260709 12:31:01.946810  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:31:01.947582  8637 tablet_replica.cc:333] T b3ce768dc4f84e8aade6196d75698a24 P 36047ee0e391483f8291472a07246128: stopping tablet replica
I20260709 12:31:01.948413  8637 raft_consensus.cc:2243] T b3ce768dc4f84e8aade6196d75698a24 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:01.949038  8637 raft_consensus.cc:2272] T b3ce768dc4f84e8aade6196d75698a24 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:01.952232  8637 tablet_replica.cc:333] T fa3785a9f62342c2aec12bd7d092e5ff P 36047ee0e391483f8291472a07246128: stopping tablet replica
W20260709 12:31:01.952574 19204 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:31:01.953197  8637 raft_consensus.cc:2243] T fa3785a9f62342c2aec12bd7d092e5ff P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:01.954331  8637 raft_consensus.cc:2272] T fa3785a9f62342c2aec12bd7d092e5ff P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:01.956112 19204 consensus_peers.cc:597] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 -> Peer 36047ee0e391483f8291472a07246128 (127.8.111.65:37375): Couldn't send request to peer 36047ee0e391483f8291472a07246128. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:01.957507  8637 tablet_replica.cc:333] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128: stopping tablet replica
I20260709 12:31:01.958091  8637 raft_consensus.cc:2243] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:01.958858  8637 raft_consensus.cc:2272] T fc6bddf00974464a9da634f3e8107d07 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:01.962155  8637 tablet_replica.cc:333] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128: stopping tablet replica
I20260709 12:31:01.962790  8637 raft_consensus.cc:2243] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:01.963218  8637 raft_consensus.cc:2272] T fc9428376e4f4593b7b7aaf5a17b5624 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:01.965510  8637 tablet_replica.cc:333] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128: stopping tablet replica
I20260709 12:31:01.966207  8637 raft_consensus.cc:2243] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:01.967232  8637 raft_consensus.cc:2272] T 77cf31428b5c44d1ada255bdffff39f1 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:01.969595  8637 tablet_replica.cc:333] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128: stopping tablet replica
I20260709 12:31:01.970224  8637 raft_consensus.cc:2243] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:01.970777  8637 raft_consensus.cc:2272] T 39d21c988f5c4d0ab2a5368979a3c235 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:01.972968  8637 tablet_replica.cc:333] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128: stopping tablet replica
I20260709 12:31:01.973657  8637 raft_consensus.cc:2243] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:01.974174  8637 raft_consensus.cc:2272] T a8abbc11e279441aa8cccafbf8df6290 P 36047ee0e391483f8291472a07246128 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:01.976747  8637 tablet_replica.cc:333] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128: stopping tablet replica
I20260709 12:31:01.977396  8637 raft_consensus.cc:2243] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:01.978379  8637 raft_consensus.cc:2272] T 2d00fe8097684a3c97dc5004cf9dc49e P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:01.980500  8637 tablet_replica.cc:333] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128: stopping tablet replica
I20260709 12:31:01.981019  8637 raft_consensus.cc:2243] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:01.981446  8637 raft_consensus.cc:2272] T 50ca47c357ac4f17a410d0152c51e24c P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:01.983654  8637 tablet_replica.cc:333] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128: stopping tablet replica
I20260709 12:31:01.984179  8637 raft_consensus.cc:2243] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:01.984617  8637 raft_consensus.cc:2272] T 2057b2de3b3c4ae8b0419bb8c846e616 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:01.988149  8637 tablet_replica.cc:333] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128: stopping tablet replica
I20260709 12:31:01.988870  8637 raft_consensus.cc:2243] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:01.990147  8637 raft_consensus.cc:2272] T dcad3b84a85f4e678a358c825d53c551 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:01.990209 19278 consensus_peers.cc:597] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c -> Peer 36047ee0e391483f8291472a07246128 (127.8.111.65:37375): Couldn't send request to peer 36047ee0e391483f8291472a07246128. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:01.992892  8637 tablet_replica.cc:333] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128: stopping tablet replica
I20260709 12:31:01.993471  8637 raft_consensus.cc:2243] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:01.993945  8637 raft_consensus.cc:2272] T 652ae6381b194eb0a5f781edf5377772 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:01.996132  8637 tablet_replica.cc:333] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 36047ee0e391483f8291472a07246128: stopping tablet replica
I20260709 12:31:01.996652  8637 raft_consensus.cc:2243] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:01.997071  8637 raft_consensus.cc:2272] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 36047ee0e391483f8291472a07246128 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:01.999214  8637 tablet_replica.cc:333] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128: stopping tablet replica
I20260709 12:31:01.999668  8637 raft_consensus.cc:2243] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.000126  8637 raft_consensus.cc:2272] T 30901d6e67d24b3499ef3a95deeeab16 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.002615  8637 tablet_replica.cc:333] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128: stopping tablet replica
I20260709 12:31:02.003178  8637 raft_consensus.cc:2243] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:02.004168  8637 raft_consensus.cc:2272] T 8e970dba149d4c968a07dbb59f75cae7 P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.006873  8637 tablet_replica.cc:333] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128: stopping tablet replica
I20260709 12:31:02.007433  8637 raft_consensus.cc:2243] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:02.008319  8637 raft_consensus.cc:2272] T a321ae86ba164e9988812718f254188f P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.010538  8637 tablet_replica.cc:333] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128: stopping tablet replica
I20260709 12:31:02.011015  8637 raft_consensus.cc:2243] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.011487  8637 raft_consensus.cc:2272] T 7bc577d7fc884a9e83176de68badcabc P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.013748  8637 tablet_replica.cc:333] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128: stopping tablet replica
I20260709 12:31:02.014231  8637 raft_consensus.cc:2243] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:02.015077  8637 raft_consensus.cc:2272] T 6c15fe963984464288540f966880e07b P 36047ee0e391483f8291472a07246128 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:02.020753 19204 consensus_peers.cc:597] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 -> Peer 36047ee0e391483f8291472a07246128 (127.8.111.65:37375): Couldn't send request to peer 36047ee0e391483f8291472a07246128. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:02.061286  8637 tablet_server.cc:196] TabletServer@127.8.111.65:0 shutdown complete.
I20260709 12:31:02.104944  8637 tablet_server.cc:179] TabletServer@127.8.111.66:0 shutting down...
W20260709 12:31:02.135560 19204 consensus_peers.cc:597] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921 -> Peer 36047ee0e391483f8291472a07246128 (127.8.111.65:37375): Couldn't send request to peer 36047ee0e391483f8291472a07246128. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:37375: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:02.136818  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:31:02.137559  8637 tablet_replica.cc:333] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921: stopping tablet replica
I20260709 12:31:02.138443  8637 raft_consensus.cc:2243] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:02.139490  8637 raft_consensus.cc:2272] T b3ce768dc4f84e8aade6196d75698a24 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.141850  8637 tablet_replica.cc:333] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921: stopping tablet replica
I20260709 12:31:02.142529  8637 raft_consensus.cc:2243] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:02.143388  8637 raft_consensus.cc:2272] T fc6bddf00974464a9da634f3e8107d07 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.145419  8637 tablet_replica.cc:333] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921: stopping tablet replica
I20260709 12:31:02.145926  8637 raft_consensus.cc:2243] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.146552  8637 raft_consensus.cc:2272] T fa3785a9f62342c2aec12bd7d092e5ff P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.148845  8637 tablet_replica.cc:333] T a321ae86ba164e9988812718f254188f P c47d5c46e83e47808560e697b5819921: stopping tablet replica
I20260709 12:31:02.149435  8637 raft_consensus.cc:2243] T a321ae86ba164e9988812718f254188f P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.150008  8637 raft_consensus.cc:2272] T a321ae86ba164e9988812718f254188f P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.152267  8637 tablet_replica.cc:333] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921: stopping tablet replica
I20260709 12:31:02.152834  8637 raft_consensus.cc:2243] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.153389  8637 raft_consensus.cc:2272] T 8e970dba149d4c968a07dbb59f75cae7 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.155901  8637 tablet_replica.cc:333] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921: stopping tablet replica
I20260709 12:31:02.156595  8637 raft_consensus.cc:2243] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.157160  8637 raft_consensus.cc:2272] T 39d21c988f5c4d0ab2a5368979a3c235 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.159600  8637 tablet_replica.cc:333] T dcad3b84a85f4e678a358c825d53c551 P c47d5c46e83e47808560e697b5819921: stopping tablet replica
I20260709 12:31:02.160110  8637 raft_consensus.cc:2243] T dcad3b84a85f4e678a358c825d53c551 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.160632  8637 raft_consensus.cc:2272] T dcad3b84a85f4e678a358c825d53c551 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.164788  8637 tablet_replica.cc:333] T 2057b2de3b3c4ae8b0419bb8c846e616 P c47d5c46e83e47808560e697b5819921: stopping tablet replica
I20260709 12:31:02.165777  8637 raft_consensus.cc:2243] T 2057b2de3b3c4ae8b0419bb8c846e616 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.166546  8637 raft_consensus.cc:2272] T 2057b2de3b3c4ae8b0419bb8c846e616 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:02.166708 19278 consensus_peers.cc:597] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c -> Peer c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321): Couldn't send request to peer c47d5c46e83e47808560e697b5819921. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:02.169221  8637 tablet_replica.cc:333] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921: stopping tablet replica
I20260709 12:31:02.169829  8637 raft_consensus.cc:2243] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.170352  8637 raft_consensus.cc:2272] T fc9428376e4f4593b7b7aaf5a17b5624 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.172533  8637 tablet_replica.cc:333] T 77cf31428b5c44d1ada255bdffff39f1 P c47d5c46e83e47808560e697b5819921: stopping tablet replica
I20260709 12:31:02.173094  8637 raft_consensus.cc:2243] T 77cf31428b5c44d1ada255bdffff39f1 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.173594  8637 raft_consensus.cc:2272] T 77cf31428b5c44d1ada255bdffff39f1 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.175717  8637 tablet_replica.cc:333] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921: stopping tablet replica
I20260709 12:31:02.176249  8637 raft_consensus.cc:2243] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:02.177234  8637 raft_consensus.cc:2272] T 652ae6381b194eb0a5f781edf5377772 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.180068  8637 tablet_replica.cc:333] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921: stopping tablet replica
I20260709 12:31:02.180917  8637 raft_consensus.cc:2243] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:02.182189  8637 raft_consensus.cc:2272] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P c47d5c46e83e47808560e697b5819921 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.185477  8637 tablet_replica.cc:333] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921: stopping tablet replica
I20260709 12:31:02.186264  8637 raft_consensus.cc:2243] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:31:02.186343 19278 consensus_peers.cc:597] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c -> Peer c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321): Couldn't send request to peer c47d5c46e83e47808560e697b5819921. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:31:02.187055 19278 consensus_peers.cc:597] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c -> Peer 36047ee0e391483f8291472a07246128 (127.8.111.65:37375): Couldn't send request to peer 36047ee0e391483f8291472a07246128. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:37375: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:02.187458  8637 raft_consensus.cc:2272] T 30901d6e67d24b3499ef3a95deeeab16 P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.189694  8637 tablet_replica.cc:333] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921: stopping tablet replica
I20260709 12:31:02.190203  8637 raft_consensus.cc:2243] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.190685  8637 raft_consensus.cc:2272] T a8abbc11e279441aa8cccafbf8df6290 P c47d5c46e83e47808560e697b5819921 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.192708  8637 tablet_replica.cc:333] T 6c15fe963984464288540f966880e07b P c47d5c46e83e47808560e697b5819921: stopping tablet replica
I20260709 12:31:02.193176  8637 raft_consensus.cc:2243] T 6c15fe963984464288540f966880e07b P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.193591  8637 raft_consensus.cc:2272] T 6c15fe963984464288540f966880e07b P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.195713  8637 tablet_replica.cc:333] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921: stopping tablet replica
I20260709 12:31:02.196177  8637 raft_consensus.cc:2243] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.196560  8637 raft_consensus.cc:2272] T 7bc577d7fc884a9e83176de68badcabc P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.198621  8637 tablet_replica.cc:333] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921: stopping tablet replica
I20260709 12:31:02.199054  8637 raft_consensus.cc:2243] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.199452  8637 raft_consensus.cc:2272] T 2d00fe8097684a3c97dc5004cf9dc49e P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.201439  8637 tablet_replica.cc:333] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921: stopping tablet replica
I20260709 12:31:02.201848  8637 raft_consensus.cc:2243] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:02.202669  8637 raft_consensus.cc:2272] T 50ca47c357ac4f17a410d0152c51e24c P c47d5c46e83e47808560e697b5819921 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:02.209864 19278 consensus_peers.cc:597] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c -> Peer c47d5c46e83e47808560e697b5819921 (127.8.111.66:41321): Couldn't send request to peer c47d5c46e83e47808560e697b5819921. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:02.246053  8637 tablet_server.cc:196] TabletServer@127.8.111.66:0 shutdown complete.
I20260709 12:31:02.285756  8637 tablet_server.cc:179] TabletServer@127.8.111.67:0 shutting down...
I20260709 12:31:02.313772  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:31:02.314569  8637 tablet_replica.cc:333] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c: stopping tablet replica
I20260709 12:31:02.315287  8637 raft_consensus.cc:2243] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.315963  8637 raft_consensus.cc:2272] T b3ce768dc4f84e8aade6196d75698a24 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.318385  8637 tablet_replica.cc:333] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c: stopping tablet replica
I20260709 12:31:02.319128  8637 raft_consensus.cc:2243] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:02.320143  8637 raft_consensus.cc:2272] T fa3785a9f62342c2aec12bd7d092e5ff P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.322371  8637 tablet_replica.cc:333] T fc6bddf00974464a9da634f3e8107d07 P 706ce9f0353f4fa0a4744bf07bd4537c: stopping tablet replica
I20260709 12:31:02.322885  8637 raft_consensus.cc:2243] T fc6bddf00974464a9da634f3e8107d07 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.323347  8637 raft_consensus.cc:2272] T fc6bddf00974464a9da634f3e8107d07 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.325264  8637 tablet_replica.cc:333] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c: stopping tablet replica
I20260709 12:31:02.325748  8637 raft_consensus.cc:2243] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:02.326598  8637 raft_consensus.cc:2272] T fc9428376e4f4593b7b7aaf5a17b5624 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.328481  8637 tablet_replica.cc:333] T 77cf31428b5c44d1ada255bdffff39f1 P 706ce9f0353f4fa0a4744bf07bd4537c: stopping tablet replica
I20260709 12:31:02.329042  8637 raft_consensus.cc:2243] T 77cf31428b5c44d1ada255bdffff39f1 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.329497  8637 raft_consensus.cc:2272] T 77cf31428b5c44d1ada255bdffff39f1 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.331499  8637 tablet_replica.cc:333] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c: stopping tablet replica
I20260709 12:31:02.331991  8637 raft_consensus.cc:2243] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:02.332763  8637 raft_consensus.cc:2272] T 39d21c988f5c4d0ab2a5368979a3c235 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.334715  8637 tablet_replica.cc:333] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c: stopping tablet replica
I20260709 12:31:02.335290  8637 raft_consensus.cc:2243] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.335723  8637 raft_consensus.cc:2272] T 6c15fe963984464288540f966880e07b P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.337652  8637 tablet_replica.cc:333] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c: stopping tablet replica
I20260709 12:31:02.338099  8637 raft_consensus.cc:2243] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:02.338909  8637 raft_consensus.cc:2272] T 7bc577d7fc884a9e83176de68badcabc P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.340931  8637 tablet_replica.cc:333] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c: stopping tablet replica
I20260709 12:31:02.341455  8637 raft_consensus.cc:2243] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:31:02.342175  8637 raft_consensus.cc:2272] T a8abbc11e279441aa8cccafbf8df6290 P 706ce9f0353f4fa0a4744bf07bd4537c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.344036  8637 tablet_replica.cc:333] T 8e970dba149d4c968a07dbb59f75cae7 P 706ce9f0353f4fa0a4744bf07bd4537c: stopping tablet replica
I20260709 12:31:02.344493  8637 raft_consensus.cc:2243] T 8e970dba149d4c968a07dbb59f75cae7 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.344916  8637 raft_consensus.cc:2272] T 8e970dba149d4c968a07dbb59f75cae7 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.346741  8637 tablet_replica.cc:333] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c: stopping tablet replica
I20260709 12:31:02.347193  8637 raft_consensus.cc:2243] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.347606  8637 raft_consensus.cc:2272] T a321ae86ba164e9988812718f254188f P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.349567  8637 tablet_replica.cc:333] T 652ae6381b194eb0a5f781edf5377772 P 706ce9f0353f4fa0a4744bf07bd4537c: stopping tablet replica
I20260709 12:31:02.350060  8637 raft_consensus.cc:2243] T 652ae6381b194eb0a5f781edf5377772 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.350556  8637 raft_consensus.cc:2272] T 652ae6381b194eb0a5f781edf5377772 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.352438  8637 tablet_replica.cc:333] T 30901d6e67d24b3499ef3a95deeeab16 P 706ce9f0353f4fa0a4744bf07bd4537c: stopping tablet replica
I20260709 12:31:02.352907  8637 raft_consensus.cc:2243] T 30901d6e67d24b3499ef3a95deeeab16 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.353303  8637 raft_consensus.cc:2272] T 30901d6e67d24b3499ef3a95deeeab16 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.355304  8637 tablet_replica.cc:333] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 706ce9f0353f4fa0a4744bf07bd4537c: stopping tablet replica
I20260709 12:31:02.355732  8637 raft_consensus.cc:2243] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.356130  8637 raft_consensus.cc:2272] T 4ddc5cd2e6bb45778c8ca3c52b0c6c23 P 706ce9f0353f4fa0a4744bf07bd4537c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.357990  8637 tablet_replica.cc:333] T 50ca47c357ac4f17a410d0152c51e24c P 706ce9f0353f4fa0a4744bf07bd4537c: stopping tablet replica
I20260709 12:31:02.358521  8637 raft_consensus.cc:2243] T 50ca47c357ac4f17a410d0152c51e24c P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.358976  8637 raft_consensus.cc:2272] T 50ca47c357ac4f17a410d0152c51e24c P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.361002  8637 tablet_replica.cc:333] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c: stopping tablet replica
I20260709 12:31:02.361454  8637 raft_consensus.cc:2243] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:02.362227  8637 raft_consensus.cc:2272] T 2057b2de3b3c4ae8b0419bb8c846e616 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.364317  8637 tablet_replica.cc:333] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c: stopping tablet replica
I20260709 12:31:02.364758  8637 raft_consensus.cc:2243] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.365180  8637 raft_consensus.cc:2272] T dcad3b84a85f4e678a358c825d53c551 P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.367276  8637 tablet_replica.cc:333] T 2d00fe8097684a3c97dc5004cf9dc49e P 706ce9f0353f4fa0a4744bf07bd4537c: stopping tablet replica
I20260709 12:31:02.367769  8637 raft_consensus.cc:2243] T 2d00fe8097684a3c97dc5004cf9dc49e P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:02.368304  8637 raft_consensus.cc:2272] T 2d00fe8097684a3c97dc5004cf9dc49e P 706ce9f0353f4fa0a4744bf07bd4537c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.427902  8637 tablet_server.cc:196] TabletServer@127.8.111.67:0 shutdown complete.
I20260709 12:31:02.467530  8637 master.cc:562] Master@127.8.111.126:43789 shutting down...
I20260709 12:31:02.494513  8637 raft_consensus.cc:2243] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:02.495143  8637 raft_consensus.cc:2272] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:02.495484  8637 tablet_replica.cc:333] T 00000000000000000000000000000000 P dd0c029957244c98a6e49d67421d665a: stopping tablet replica
I20260709 12:31:02.534798  8637 master.cc:584] Master@127.8.111.126:43789 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (20938 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:31:02.589183  8637 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.8.111.126:38517
I20260709 12:31:02.590329  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:31:02.596410 19659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:02.596765 19660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:02.597258 19662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:02.597718  8637 server_base.cc:1061] running on GCE node
I20260709 12:31:02.598755  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:31:02.598989  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:31:02.599169  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600262599127 us; error 0 us; skew 500 ppm
I20260709 12:31:02.599740  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:31:02.602192  8637 webserver.cc:533] Webserver started at http://127.8.111.126:36855/ using document root <none> and password file <none>
I20260709 12:31:02.602768  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:31:02.602983  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:31:02.603274  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:31:02.604532  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599876290468-8637-0/minicluster-data/master-0-root/instance:
uuid: "c8b1a28a177141e6bef39772ff663734"
format_stamp: "Formatted at 2026-07-09 12:31:02 on dist-test-slave-044g"
I20260709 12:31:02.609282  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:31:02.612802 19667 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:02.613584  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:31:02.613903  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599876290468-8637-0/minicluster-data/master-0-root
uuid: "c8b1a28a177141e6bef39772ff663734"
format_stamp: "Formatted at 2026-07-09 12:31:02 on dist-test-slave-044g"
I20260709 12:31:02.614254  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599876290468-8637-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599876290468-8637-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599876290468-8637-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:31:02.630446  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:31:02.631698  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:31:02.669195  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.126:38517
I20260709 12:31:02.669327 19718 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.126:38517 every 8 connection(s)
I20260709 12:31:02.673161 19719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:02.684485 19719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734: Bootstrap starting.
I20260709 12:31:02.689342 19719 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:02.693360 19719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734: No bootstrap required, opened a new log
I20260709 12:31:02.695613 19719 raft_consensus.cc:359] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8b1a28a177141e6bef39772ff663734" member_type: VOTER }
I20260709 12:31:02.696060 19719 raft_consensus.cc:385] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:02.696295 19719 raft_consensus.cc:740] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8b1a28a177141e6bef39772ff663734, State: Initialized, Role: FOLLOWER
I20260709 12:31:02.696924 19719 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8b1a28a177141e6bef39772ff663734" member_type: VOTER }
I20260709 12:31:02.697407 19719 raft_consensus.cc:399] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:31:02.697629 19719 raft_consensus.cc:493] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:31:02.697916 19719 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:02.702486 19719 raft_consensus.cc:515] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8b1a28a177141e6bef39772ff663734" member_type: VOTER }
I20260709 12:31:02.702987 19719 leader_election.cc:304] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c8b1a28a177141e6bef39772ff663734; no voters: 
I20260709 12:31:02.704061 19719 leader_election.cc:290] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:31:02.704478 19722 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:02.705821 19722 raft_consensus.cc:697] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734 [term 1 LEADER]: Becoming Leader. State: Replica: c8b1a28a177141e6bef39772ff663734, State: Running, Role: LEADER
I20260709 12:31:02.706580 19722 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8b1a28a177141e6bef39772ff663734" member_type: VOTER }
I20260709 12:31:02.706962 19719 sys_catalog.cc:565] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:31:02.711225 19724 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8b1a28a177141e6bef39772ff663734. Latest consensus state: current_term: 1 leader_uuid: "c8b1a28a177141e6bef39772ff663734" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8b1a28a177141e6bef39772ff663734" member_type: VOTER } }
I20260709 12:31:02.711843 19724 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734 [sys.catalog]: This master's current role is: LEADER
I20260709 12:31:02.716236 19723 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c8b1a28a177141e6bef39772ff663734" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8b1a28a177141e6bef39772ff663734" member_type: VOTER } }
I20260709 12:31:02.716810 19723 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734 [sys.catalog]: This master's current role is: LEADER
I20260709 12:31:02.718364 19730 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:31:02.725973 19730 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:31:02.726971  8637 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:31:02.735124 19730 catalog_manager.cc:1383] Generated new cluster ID: 13de623c38b6487b869baea4e60a23b0
I20260709 12:31:02.735414 19730 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:31:02.772950 19730 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:31:02.774247 19730 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:31:02.786201 19730 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734: Generated new TSK 0
I20260709 12:31:02.786808 19730 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:31:02.793860  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:31:02.799957 19740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:02.801187 19741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:02.804417  8637 server_base.cc:1061] running on GCE node
W20260709 12:31:02.805343 19743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:02.806449  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:31:02.806665  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:31:02.806861  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600262806841 us; error 0 us; skew 500 ppm
I20260709 12:31:02.807389  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:31:02.809904  8637 webserver.cc:533] Webserver started at http://127.8.111.65:42567/ using document root <none> and password file <none>
I20260709 12:31:02.810457  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:31:02.810658  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:31:02.810950  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:31:02.812124  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599876290468-8637-0/minicluster-data/ts-0-root/instance:
uuid: "f7d3855f4244492987f0d3cd83c4a348"
format_stamp: "Formatted at 2026-07-09 12:31:02 on dist-test-slave-044g"
I20260709 12:31:02.816812  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:31:02.820176 19748 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:02.821069  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:31:02.821424  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599876290468-8637-0/minicluster-data/ts-0-root
uuid: "f7d3855f4244492987f0d3cd83c4a348"
format_stamp: "Formatted at 2026-07-09 12:31:02 on dist-test-slave-044g"
I20260709 12:31:02.821729  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599876290468-8637-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599876290468-8637-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599876290468-8637-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:31:02.845655  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:31:02.847028  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:31:02.848616  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:31:02.851118  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:31:02.851374  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:02.851691  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:31:02.851863  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:02.894379  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.65:36403
I20260709 12:31:02.894477 19810 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.65:36403 every 8 connection(s)
I20260709 12:31:02.899477  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:31:02.907286 19815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:02.908762 19816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:02.911908  8637 server_base.cc:1061] running on GCE node
W20260709 12:31:02.911932 19818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:02.913615  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:31:02.913869  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:31:02.914079  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600262914061 us; error 0 us; skew 500 ppm
I20260709 12:31:02.914565 19811 heartbeater.cc:344] Connected to a master server at 127.8.111.126:38517
I20260709 12:31:02.914752  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:31:02.914966 19811 heartbeater.cc:461] Registering TS with master...
I20260709 12:31:02.915895 19811 heartbeater.cc:507] Master 127.8.111.126:38517 requested a full tablet report, sending...
I20260709 12:31:02.918098 19684 ts_manager.cc:194] Registered new tserver with Master: f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403)
I20260709 12:31:02.918658  8637 webserver.cc:533] Webserver started at http://127.8.111.66:36025/ using document root <none> and password file <none>
I20260709 12:31:02.919306  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:31:02.919516  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:31:02.919817  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:31:02.920183 19684 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46184
I20260709 12:31:02.921096  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599876290468-8637-0/minicluster-data/ts-1-root/instance:
uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
format_stamp: "Formatted at 2026-07-09 12:31:02 on dist-test-slave-044g"
I20260709 12:31:02.926424  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 12:31:02.929876 19823 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:02.930701  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:31:02.931031  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599876290468-8637-0/minicluster-data/ts-1-root
uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
format_stamp: "Formatted at 2026-07-09 12:31:02 on dist-test-slave-044g"
I20260709 12:31:02.931310  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599876290468-8637-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599876290468-8637-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599876290468-8637-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:31:02.942945  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:31:02.944157  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:31:02.945571  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:31:02.947798  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:31:02.948040  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:02.948287  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:31:02.948462  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:02.989002  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.66:41479
I20260709 12:31:02.989091 19885 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.66:41479 every 8 connection(s)
I20260709 12:31:02.994094  8637 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:31:03.001307 19889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:03.003010 19890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:31:03.005802 19892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:31:03.006531 19886 heartbeater.cc:344] Connected to a master server at 127.8.111.126:38517
I20260709 12:31:03.007009  8637 server_base.cc:1061] running on GCE node
I20260709 12:31:03.007046 19886 heartbeater.cc:461] Registering TS with master...
I20260709 12:31:03.008038 19886 heartbeater.cc:507] Master 127.8.111.126:38517 requested a full tablet report, sending...
I20260709 12:31:03.008080  8637 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:31:03.008540  8637 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:31:03.008752  8637 hybrid_clock.cc:648] HybridClock initialized: now 1783600263008717 us; error 0 us; skew 500 ppm
I20260709 12:31:03.009516  8637 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:31:03.010229 19684 ts_manager.cc:194] Registered new tserver with Master: d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:03.011689 19684 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46198
I20260709 12:31:03.012548  8637 webserver.cc:533] Webserver started at http://127.8.111.67:43641/ using document root <none> and password file <none>
I20260709 12:31:03.013168  8637 fs_manager.cc:362] Metadata directory not provided
I20260709 12:31:03.013377  8637 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:31:03.013682  8637 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:31:03.014905  8637 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599876290468-8637-0/minicluster-data/ts-2-root/instance:
uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
format_stamp: "Formatted at 2026-07-09 12:31:03 on dist-test-slave-044g"
I20260709 12:31:03.019323  8637 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:31:03.022696 19897 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:03.023525  8637 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:31:03.023821  8637 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599876290468-8637-0/minicluster-data/ts-2-root
uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
format_stamp: "Formatted at 2026-07-09 12:31:03 on dist-test-slave-044g"
I20260709 12:31:03.024135  8637 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599876290468-8637-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599876290468-8637-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskT5kX3d/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599876290468-8637-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:31:03.046905  8637 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:31:03.048069  8637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:31:03.049489  8637 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:31:03.051741  8637 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:31:03.051982  8637 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:03.052233  8637 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:31:03.052412  8637 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:31:03.094595  8637 rpc_server.cc:307] RPC server started. Bound to: 127.8.111.67:34465
I20260709 12:31:03.094744 19959 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.111.67:34465 every 8 connection(s)
I20260709 12:31:03.108652 19960 heartbeater.cc:344] Connected to a master server at 127.8.111.126:38517
I20260709 12:31:03.109176 19960 heartbeater.cc:461] Registering TS with master...
I20260709 12:31:03.109896 19960 heartbeater.cc:507] Master 127.8.111.126:38517 requested a full tablet report, sending...
I20260709 12:31:03.111963 19684 ts_manager.cc:194] Registered new tserver with Master: bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:03.112823  8637 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014766796s
I20260709 12:31:03.113540 19684 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46202
I20260709 12:31:03.138630 19684 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46204:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:31:03.141399 19684 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:31:03.214102 19776 tablet_service.cc:1511] Processing CreateTablet for tablet 6cbdd9c7dcc14dfbb34eaa87c9c726c7 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:31:03.215442 19775 tablet_service.cc:1511] Processing CreateTablet for tablet ce4bc28a0a8d473698323f80cd969094 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:31:03.215713 19776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cbdd9c7dcc14dfbb34eaa87c9c726c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.217639 19774 tablet_service.cc:1511] Processing CreateTablet for tablet 71185e64eb2744ffaf2f069c035505a4 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:31:03.219246 19774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71185e64eb2744ffaf2f069c035505a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.219962 19773 tablet_service.cc:1511] Processing CreateTablet for tablet 57bb268f539c448cabdf9058d7567b80 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:31:03.220804 19775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce4bc28a0a8d473698323f80cd969094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.222935 19925 tablet_service.cc:1511] Processing CreateTablet for tablet 6cbdd9c7dcc14dfbb34eaa87c9c726c7 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:31:03.223754 19924 tablet_service.cc:1511] Processing CreateTablet for tablet ce4bc28a0a8d473698323f80cd969094 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:31:03.224321 19925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cbdd9c7dcc14dfbb34eaa87c9c726c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.225138 19924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce4bc28a0a8d473698323f80cd969094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.227478 19923 tablet_service.cc:1511] Processing CreateTablet for tablet 71185e64eb2744ffaf2f069c035505a4 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:31:03.229090 19773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57bb268f539c448cabdf9058d7567b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.237377 19851 tablet_service.cc:1511] Processing CreateTablet for tablet 6cbdd9c7dcc14dfbb34eaa87c9c726c7 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:31:03.238646 19923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71185e64eb2744ffaf2f069c035505a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.238807 19851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cbdd9c7dcc14dfbb34eaa87c9c726c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.239427 19849 tablet_service.cc:1511] Processing CreateTablet for tablet 71185e64eb2744ffaf2f069c035505a4 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:31:03.240765 19849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71185e64eb2744ffaf2f069c035505a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.238186 19850 tablet_service.cc:1511] Processing CreateTablet for tablet ce4bc28a0a8d473698323f80cd969094 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:31:03.244328 19850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce4bc28a0a8d473698323f80cd969094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.255867 19848 tablet_service.cc:1511] Processing CreateTablet for tablet 57bb268f539c448cabdf9058d7567b80 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:31:03.257457 19848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57bb268f539c448cabdf9058d7567b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.270766 19922 tablet_service.cc:1511] Processing CreateTablet for tablet 57bb268f539c448cabdf9058d7567b80 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:31:03.272419 19922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57bb268f539c448cabdf9058d7567b80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.278362 19772 tablet_service.cc:1511] Processing CreateTablet for tablet 6de140a555174689bc2a03d802a477e5 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:31:03.279807 19772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de140a555174689bc2a03d802a477e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.292622 19977 tablet_bootstrap.cc:492] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9: Bootstrap starting.
I20260709 12:31:03.293519 19851 tablet_service.cc:1511] Processing CreateTablet for tablet 6de140a555174689bc2a03d802a477e5 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:31:03.297678 19851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de140a555174689bc2a03d802a477e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.298655 19975 tablet_bootstrap.cc:492] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348: Bootstrap starting.
I20260709 12:31:03.305840 19975 tablet_bootstrap.cc:654] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.307375 19773 tablet_service.cc:1511] Processing CreateTablet for tablet 17775893872142bb88fbe22bedd96b11 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:31:03.306690 19977 tablet_bootstrap.cc:654] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.308841 19773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17775893872142bb88fbe22bedd96b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.309902 19976 tablet_bootstrap.cc:492] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4: Bootstrap starting.
I20260709 12:31:03.316938 19922 tablet_service.cc:1511] Processing CreateTablet for tablet 6de140a555174689bc2a03d802a477e5 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:31:03.320801 19922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6de140a555174689bc2a03d802a477e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.326016 19975 tablet_bootstrap.cc:492] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348: No bootstrap required, opened a new log
I20260709 12:31:03.326632 19975 ts_tablet_manager.cc:1403] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.008s
I20260709 12:31:03.327247 19976 tablet_bootstrap.cc:654] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.329619 19975 raft_consensus.cc:359] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.324451 19848 tablet_service.cc:1511] Processing CreateTablet for tablet 17775893872142bb88fbe22bedd96b11 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:31:03.324568 19924 tablet_service.cc:1511] Processing CreateTablet for tablet 17775893872142bb88fbe22bedd96b11 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:31:03.331202 19924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17775893872142bb88fbe22bedd96b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.323091 19977 tablet_bootstrap.cc:492] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9: No bootstrap required, opened a new log
I20260709 12:31:03.331919 19977 ts_tablet_manager.cc:1403] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.008s
I20260709 12:31:03.332679 19976 tablet_bootstrap.cc:492] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4: No bootstrap required, opened a new log
I20260709 12:31:03.333163 19976 ts_tablet_manager.cc:1403] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 12:31:03.331241 19848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17775893872142bb88fbe22bedd96b11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.335292 19977 raft_consensus.cc:359] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } }
I20260709 12:31:03.336011 19977 raft_consensus.cc:385] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.336015 19976 raft_consensus.cc:359] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } }
I20260709 12:31:03.336575 19977 raft_consensus.cc:740] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.336822 19976 raft_consensus.cc:385] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.337164 19976 raft_consensus.cc:740] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.337399 19977 consensus_queue.cc:260] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } }
I20260709 12:31:03.336098 19975 raft_consensus.cc:385] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.339190 19976 consensus_queue.cc:260] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } }
I20260709 12:31:03.338824 19772 tablet_service.cc:1511] Processing CreateTablet for tablet ecbfa438576e4052957cc88dc495f4d2 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:31:03.341881 19772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecbfa438576e4052957cc88dc495f4d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.341868 19925 tablet_service.cc:1511] Processing CreateTablet for tablet ecbfa438576e4052957cc88dc495f4d2 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:31:03.343214 19776 tablet_service.cc:1511] Processing CreateTablet for tablet cd117ec76ec24b74988cfdccf3bcb28c (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:31:03.344498 19776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd117ec76ec24b74988cfdccf3bcb28c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.343290 19925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecbfa438576e4052957cc88dc495f4d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.339203 19975 raft_consensus.cc:740] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.339429 19849 tablet_service.cc:1511] Processing CreateTablet for tablet ecbfa438576e4052957cc88dc495f4d2 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:31:03.354818 19975 consensus_queue.cc:260] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.366714 19849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecbfa438576e4052957cc88dc495f4d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.368938 19811 heartbeater.cc:499] Master 127.8.111.126:38517 was elected leader, sending a full tablet report...
I20260709 12:31:03.373382 19851 tablet_service.cc:1511] Processing CreateTablet for tablet cd117ec76ec24b74988cfdccf3bcb28c (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:31:03.374339 19923 tablet_service.cc:1511] Processing CreateTablet for tablet cd117ec76ec24b74988cfdccf3bcb28c (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:31:03.374764 19851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd117ec76ec24b74988cfdccf3bcb28c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.375591 19923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd117ec76ec24b74988cfdccf3bcb28c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.388098 19850 tablet_service.cc:1511] Processing CreateTablet for tablet f9874751d7e14ddaa2cf2f9e29c3e5b4 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:31:03.389076 19772 tablet_service.cc:1511] Processing CreateTablet for tablet f9874751d7e14ddaa2cf2f9e29c3e5b4 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:31:03.389479 19850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9874751d7e14ddaa2cf2f9e29c3e5b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.390292 19772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9874751d7e14ddaa2cf2f9e29c3e5b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.395408 19921 tablet_service.cc:1511] Processing CreateTablet for tablet f9874751d7e14ddaa2cf2f9e29c3e5b4 (DEFAULT_TABLE table=test-workload [id=520cf2086e484e1fa4a1576557787ae5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:31:03.398074 19921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9874751d7e14ddaa2cf2f9e29c3e5b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:03.388149 19984 raft_consensus.cc:493] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:03.403131 19984 raft_consensus.cc:515] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.418625 19960 heartbeater.cc:499] Master 127.8.111.126:38517 was elected leader, sending a full tablet report...
I20260709 12:31:03.424081 19975 ts_tablet_manager.cc:1434] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348: Time spent starting tablet: real 0.097s	user 0.008s	sys 0.000s
I20260709 12:31:03.425858 19977 ts_tablet_manager.cc:1434] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent starting tablet: real 0.094s	user 0.012s	sys 0.019s
I20260709 12:31:03.426692 19886 heartbeater.cc:499] Master 127.8.111.126:38517 was elected leader, sending a full tablet report...
I20260709 12:31:03.426986 19975 tablet_bootstrap.cc:492] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348: Bootstrap starting.
I20260709 12:31:03.427057 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71185e64eb2744ffaf2f069c035505a4" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" is_pre_election: true
W20260709 12:31:03.428838 19749 leader_election.cc:343] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:03.431141 19981 raft_consensus.cc:493] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:03.431644 19981 raft_consensus.cc:515] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } }
I20260709 12:31:03.418655 19976 ts_tablet_manager.cc:1434] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent starting tablet: real 0.085s	user 0.034s	sys 0.032s
I20260709 12:31:03.434536 19976 tablet_bootstrap.cc:492] T ce4bc28a0a8d473698323f80cd969094 P bc9e314a6d804f6a895a924cc11d3ec4: Bootstrap starting.
I20260709 12:31:03.437183 19984 leader_election.cc:290] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:03.438095 19977 tablet_bootstrap.cc:492] T ce4bc28a0a8d473698323f80cd969094 P d44fdddd21fe44c09069dd1e3f98b8a9: Bootstrap starting.
I20260709 12:31:03.448378 19981 leader_election.cc:290] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:03.454481 19976 tablet_bootstrap.cc:654] T ce4bc28a0a8d473698323f80cd969094 P bc9e314a6d804f6a895a924cc11d3ec4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.456451 19977 tablet_bootstrap.cc:654] T ce4bc28a0a8d473698323f80cd969094 P d44fdddd21fe44c09069dd1e3f98b8a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.463995 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71185e64eb2744ffaf2f069c035505a4" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" is_pre_election: true
I20260709 12:31:03.473939 19975 tablet_bootstrap.cc:654] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348: Neither blocks nor log segments found. Creating new log.
W20260709 12:31:03.475291 19752 leader_election.cc:343] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:03.475835 19752 leader_election.cc:304] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7d3855f4244492987f0d3cd83c4a348; no voters: bc9e314a6d804f6a895a924cc11d3ec4, d44fdddd21fe44c09069dd1e3f98b8a9
I20260709 12:31:03.476969 19984 raft_consensus.cc:2749] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:03.465651 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cbdd9c7dcc14dfbb34eaa87c9c726c7" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348" is_pre_election: true
W20260709 12:31:03.479000 19825 leader_election.cc:343] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:31:03.494796 19887 tablet.cc:2406] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:31:03.504758 19976 tablet_bootstrap.cc:492] T ce4bc28a0a8d473698323f80cd969094 P bc9e314a6d804f6a895a924cc11d3ec4: No bootstrap required, opened a new log
I20260709 12:31:03.505158 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cbdd9c7dcc14dfbb34eaa87c9c726c7" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" is_pre_election: true
I20260709 12:31:03.505781 19935 raft_consensus.cc:2468] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 0.
I20260709 12:31:03.505324 19976 ts_tablet_manager.cc:1403] T ce4bc28a0a8d473698323f80cd969094 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent bootstrapping tablet: real 0.071s	user 0.025s	sys 0.011s
I20260709 12:31:03.506959 19827 leader_election.cc:304] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, d44fdddd21fe44c09069dd1e3f98b8a9; no voters: f7d3855f4244492987f0d3cd83c4a348
I20260709 12:31:03.508181 19981 raft_consensus.cc:2804] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:03.508528 19981 raft_consensus.cc:493] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:03.508853 19981 raft_consensus.cc:3060] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:03.512427 19976 raft_consensus.cc:359] T ce4bc28a0a8d473698323f80cd969094 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.513190 19976 raft_consensus.cc:385] T ce4bc28a0a8d473698323f80cd969094 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.513468 19976 raft_consensus.cc:740] T ce4bc28a0a8d473698323f80cd969094 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.514235 19976 consensus_queue.cc:260] T ce4bc28a0a8d473698323f80cd969094 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.516815 19976 ts_tablet_manager.cc:1434] T ce4bc28a0a8d473698323f80cd969094 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:31:03.517030 19977 tablet_bootstrap.cc:492] T ce4bc28a0a8d473698323f80cd969094 P d44fdddd21fe44c09069dd1e3f98b8a9: No bootstrap required, opened a new log
I20260709 12:31:03.517737 19977 ts_tablet_manager.cc:1403] T ce4bc28a0a8d473698323f80cd969094 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent bootstrapping tablet: real 0.080s	user 0.018s	sys 0.016s
I20260709 12:31:03.517810 19976 tablet_bootstrap.cc:492] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4: Bootstrap starting.
I20260709 12:31:03.521806 19977 raft_consensus.cc:359] T ce4bc28a0a8d473698323f80cd969094 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.525326 19976 tablet_bootstrap.cc:654] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.527604 19977 raft_consensus.cc:385] T ce4bc28a0a8d473698323f80cd969094 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.528003 19977 raft_consensus.cc:740] T ce4bc28a0a8d473698323f80cd969094 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.528939 19975 tablet_bootstrap.cc:492] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348: No bootstrap required, opened a new log
I20260709 12:31:03.528884 19977 consensus_queue.cc:260] T ce4bc28a0a8d473698323f80cd969094 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.529210 19981 raft_consensus.cc:515] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } }
I20260709 12:31:03.531131 19977 ts_tablet_manager.cc:1434] T ce4bc28a0a8d473698323f80cd969094 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:31:03.532130 19977 tablet_bootstrap.cc:492] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9: Bootstrap starting.
I20260709 12:31:03.529583 19975 ts_tablet_manager.cc:1403] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348: Time spent bootstrapping tablet: real 0.103s	user 0.014s	sys 0.021s
I20260709 12:31:03.532987 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cbdd9c7dcc14dfbb34eaa87c9c726c7" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
W20260709 12:31:03.535071 19825 leader_election.cc:343] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:03.535303 19975 raft_consensus.cc:359] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.536552 19975 raft_consensus.cc:385] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.536897 19975 raft_consensus.cc:740] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.537811 19975 consensus_queue.cc:260] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.541210 19977 tablet_bootstrap.cc:654] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.547366 19975 ts_tablet_manager.cc:1434] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:31:03.551764 19975 tablet_bootstrap.cc:492] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348: Bootstrap starting.
I20260709 12:31:03.552645 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cbdd9c7dcc14dfbb34eaa87c9c726c7" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:03.553504 19935 raft_consensus.cc:3060] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:03.561343 19976 tablet_bootstrap.cc:492] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4: No bootstrap required, opened a new log
I20260709 12:31:03.561826 19975 tablet_bootstrap.cc:654] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.561969 19976 ts_tablet_manager.cc:1403] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent bootstrapping tablet: real 0.044s	user 0.020s	sys 0.021s
I20260709 12:31:03.562419 19977 tablet_bootstrap.cc:492] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9: No bootstrap required, opened a new log
I20260709 12:31:03.563000 19977 ts_tablet_manager.cc:1403] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.012s
I20260709 12:31:03.565291 19976 raft_consensus.cc:359] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.566212 19976 raft_consensus.cc:385] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.566463 19981 leader_election.cc:290] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:03.566612 19976 raft_consensus.cc:740] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.566625 19977 raft_consensus.cc:359] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.567497 19935 raft_consensus.cc:2468] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 1.
I20260709 12:31:03.567948 19977 raft_consensus.cc:385] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.567763 19976 consensus_queue.cc:260] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.568545 19977 raft_consensus.cc:740] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.568754 19827 leader_election.cc:304] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, d44fdddd21fe44c09069dd1e3f98b8a9; no voters: f7d3855f4244492987f0d3cd83c4a348
I20260709 12:31:03.570094 19981 raft_consensus.cc:2804] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:03.569885 19977 consensus_queue.cc:260] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.571512 19981 raft_consensus.cc:697] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Becoming Leader. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Running, Role: LEADER
I20260709 12:31:03.572888 19976 ts_tablet_manager.cc:1434] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:31:03.575515 19976 tablet_bootstrap.cc:492] T 71185e64eb2744ffaf2f069c035505a4 P bc9e314a6d804f6a895a924cc11d3ec4: Bootstrap starting.
I20260709 12:31:03.575162 19981 consensus_queue.cc:237] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } }
I20260709 12:31:03.573391 19977 ts_tablet_manager.cc:1434] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:31:03.581525 19977 tablet_bootstrap.cc:492] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9: Bootstrap starting.
I20260709 12:31:03.582988 19975 tablet_bootstrap.cc:492] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348: No bootstrap required, opened a new log
I20260709 12:31:03.583578 19975 ts_tablet_manager.cc:1403] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.013s
I20260709 12:31:03.585749 19976 tablet_bootstrap.cc:654] T 71185e64eb2744ffaf2f069c035505a4 P bc9e314a6d804f6a895a924cc11d3ec4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.586762 19975 raft_consensus.cc:359] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } }
I20260709 12:31:03.587605 19975 raft_consensus.cc:385] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.587963 19975 raft_consensus.cc:740] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.588277 19977 tablet_bootstrap.cc:654] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.588846 19975 consensus_queue.cc:260] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } }
I20260709 12:31:03.592417 19975 ts_tablet_manager.cc:1434] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:31:03.593833 19975 tablet_bootstrap.cc:492] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348: Bootstrap starting.
I20260709 12:31:03.594663 19981 raft_consensus.cc:493] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:03.595340 19981 raft_consensus.cc:515] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.599884 19977 tablet_bootstrap.cc:492] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9: No bootstrap required, opened a new log
I20260709 12:31:03.599711 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de140a555174689bc2a03d802a477e5" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" is_pre_election: true
I20260709 12:31:03.600822 19981 leader_election.cc:290] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
W20260709 12:31:03.601364 19827 leader_election.cc:343] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:03.601843 19984 raft_consensus.cc:493] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:03.602061 19982 raft_consensus.cc:493] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:03.604127 19984 raft_consensus.cc:515] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } }
I20260709 12:31:03.603924 19681 catalog_manager.cc:5697] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:03.602636 19977 ts_tablet_manager.cc:1403] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.009s
I20260709 12:31:03.606371 19984 leader_election.cc:290] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:03.608095 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cbdd9c7dcc14dfbb34eaa87c9c726c7" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" is_pre_election: true
I20260709 12:31:03.609000 19977 raft_consensus.cc:359] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.609815 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cbdd9c7dcc14dfbb34eaa87c9c726c7" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" is_pre_election: true
I20260709 12:31:03.610052 19977 raft_consensus.cc:385] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.610633 19935 raft_consensus.cc:2393] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f7d3855f4244492987f0d3cd83c4a348 in current term 1: Already voted for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in this term.
I20260709 12:31:03.604287 19982 raft_consensus.cc:515] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.612438 19752 leader_election.cc:304] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7d3855f4244492987f0d3cd83c4a348; no voters: bc9e314a6d804f6a895a924cc11d3ec4, d44fdddd21fe44c09069dd1e3f98b8a9
I20260709 12:31:03.613688 19982 leader_election.cc:290] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:03.614830 19984 raft_consensus.cc:3060] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:03.602540 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de140a555174689bc2a03d802a477e5" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348" is_pre_election: true
W20260709 12:31:03.616909 19825 leader_election.cc:343] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:03.617515 19825 leader_election.cc:304] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9; no voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348
I20260709 12:31:03.619115 19981 raft_consensus.cc:2749] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:03.610524 19977 raft_consensus.cc:740] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.627449 19977 consensus_queue.cc:260] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.629865 19977 ts_tablet_manager.cc:1434] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:31:03.603659 19975 tablet_bootstrap.cc:654] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.631922 19977 tablet_bootstrap.cc:492] T 57bb268f539c448cabdf9058d7567b80 P d44fdddd21fe44c09069dd1e3f98b8a9: Bootstrap starting.
I20260709 12:31:03.636976 19984 raft_consensus.cc:2749] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:03.640614 19976 tablet_bootstrap.cc:492] T 71185e64eb2744ffaf2f069c035505a4 P bc9e314a6d804f6a895a924cc11d3ec4: No bootstrap required, opened a new log
I20260709 12:31:03.647725 19976 ts_tablet_manager.cc:1403] T 71185e64eb2744ffaf2f069c035505a4 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent bootstrapping tablet: real 0.072s	user 0.025s	sys 0.030s
I20260709 12:31:03.650071 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bb268f539c448cabdf9058d7567b80" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348" is_pre_election: true
W20260709 12:31:03.651717 19899 leader_election.cc:343] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:03.652334 19976 raft_consensus.cc:359] T 71185e64eb2744ffaf2f069c035505a4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.652968 19976 raft_consensus.cc:385] T 71185e64eb2744ffaf2f069c035505a4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.653290 19976 raft_consensus.cc:740] T 71185e64eb2744ffaf2f069c035505a4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.653381 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bb268f539c448cabdf9058d7567b80" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" is_pre_election: true
I20260709 12:31:03.654075 19976 consensus_queue.cc:260] T 71185e64eb2744ffaf2f069c035505a4 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
W20260709 12:31:03.655131 19898 leader_election.cc:343] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:03.655790 19898 leader_election.cc:304] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4; no voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348
I20260709 12:31:03.656311 19976 ts_tablet_manager.cc:1434] T 71185e64eb2744ffaf2f069c035505a4 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:31:03.657296 19976 tablet_bootstrap.cc:492] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4: Bootstrap starting.
I20260709 12:31:03.657869 19982 raft_consensus.cc:2749] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:03.642526 19977 tablet_bootstrap.cc:654] T 57bb268f539c448cabdf9058d7567b80 P d44fdddd21fe44c09069dd1e3f98b8a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.663731 19976 tablet_bootstrap.cc:654] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.669342 19977 tablet_bootstrap.cc:492] T 57bb268f539c448cabdf9058d7567b80 P d44fdddd21fe44c09069dd1e3f98b8a9: No bootstrap required, opened a new log
I20260709 12:31:03.670001 19977 ts_tablet_manager.cc:1403] T 57bb268f539c448cabdf9058d7567b80 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.001s
I20260709 12:31:03.674199 19977 raft_consensus.cc:359] T 57bb268f539c448cabdf9058d7567b80 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.676445 19977 raft_consensus.cc:385] T 57bb268f539c448cabdf9058d7567b80 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.676792 19977 raft_consensus.cc:740] T 57bb268f539c448cabdf9058d7567b80 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.677145 19975 tablet_bootstrap.cc:492] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348: No bootstrap required, opened a new log
I20260709 12:31:03.677731 19975 ts_tablet_manager.cc:1403] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348: Time spent bootstrapping tablet: real 0.084s	user 0.032s	sys 0.021s
I20260709 12:31:03.677556 19977 consensus_queue.cc:260] T 57bb268f539c448cabdf9058d7567b80 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.678889 19976 tablet_bootstrap.cc:492] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4: No bootstrap required, opened a new log
I20260709 12:31:03.679528 19976 ts_tablet_manager.cc:1403] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.010s
I20260709 12:31:03.680270 19977 ts_tablet_manager.cc:1434] T 57bb268f539c448cabdf9058d7567b80 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:31:03.680893 19975 raft_consensus.cc:359] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.681696 19975 raft_consensus.cc:385] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.682052 19975 raft_consensus.cc:740] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.681350 19977 tablet_bootstrap.cc:492] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9: Bootstrap starting.
I20260709 12:31:03.682839 19976 raft_consensus.cc:359] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.682884 19975 consensus_queue.cc:260] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.683758 19976 raft_consensus.cc:385] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.685444 19976 raft_consensus.cc:740] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.685909 19975 ts_tablet_manager.cc:1434] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:31:03.686344 19976 consensus_queue.cc:260] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.687086 19975 tablet_bootstrap.cc:492] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348: Bootstrap starting.
I20260709 12:31:03.690001 19977 tablet_bootstrap.cc:654] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.694420 19975 tablet_bootstrap.cc:654] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.695490 19976 ts_tablet_manager.cc:1434] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 12:31:03.696746 19976 tablet_bootstrap.cc:492] T cd117ec76ec24b74988cfdccf3bcb28c P bc9e314a6d804f6a895a924cc11d3ec4: Bootstrap starting.
I20260709 12:31:03.703792 19976 tablet_bootstrap.cc:654] T cd117ec76ec24b74988cfdccf3bcb28c P bc9e314a6d804f6a895a924cc11d3ec4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.707530 19975 tablet_bootstrap.cc:492] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348: No bootstrap required, opened a new log
I20260709 12:31:03.708272 19975 ts_tablet_manager.cc:1403] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348: Time spent bootstrapping tablet: real 0.021s	user 0.020s	sys 0.000s
I20260709 12:31:03.712889 19977 tablet_bootstrap.cc:492] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9: No bootstrap required, opened a new log
I20260709 12:31:03.712602 19975 raft_consensus.cc:359] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.713486 19977 ts_tablet_manager.cc:1403] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.017s
I20260709 12:31:03.713658 19975 raft_consensus.cc:385] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.714215 19975 raft_consensus.cc:740] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.715013 19975 consensus_queue.cc:260] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.717466 19975 ts_tablet_manager.cc:1434] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
W20260709 12:31:03.717679 19732 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:31:03.718516 19975 tablet_bootstrap.cc:492] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348: Bootstrap starting.
I20260709 12:31:03.718312 19977 raft_consensus.cc:359] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.718918 19976 tablet_bootstrap.cc:492] T cd117ec76ec24b74988cfdccf3bcb28c P bc9e314a6d804f6a895a924cc11d3ec4: No bootstrap required, opened a new log
I20260709 12:31:03.719312 19977 raft_consensus.cc:385] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.719633 19976 ts_tablet_manager.cc:1403] T cd117ec76ec24b74988cfdccf3bcb28c P bc9e314a6d804f6a895a924cc11d3ec4: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.001s
I20260709 12:31:03.719774 19977 raft_consensus.cc:740] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.721014 19977 consensus_queue.cc:260] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.722992 19976 raft_consensus.cc:359] T cd117ec76ec24b74988cfdccf3bcb28c P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.723886 19976 raft_consensus.cc:385] T cd117ec76ec24b74988cfdccf3bcb28c P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.724215 19976 raft_consensus.cc:740] T cd117ec76ec24b74988cfdccf3bcb28c P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.724373 19977 ts_tablet_manager.cc:1434] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:31:03.725502 19975 tablet_bootstrap.cc:654] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.725162 19976 consensus_queue.cc:260] T cd117ec76ec24b74988cfdccf3bcb28c P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.725682 19977 tablet_bootstrap.cc:492] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9: Bootstrap starting.
I20260709 12:31:03.728051 19976 ts_tablet_manager.cc:1434] T cd117ec76ec24b74988cfdccf3bcb28c P bc9e314a6d804f6a895a924cc11d3ec4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:31:03.729372 19976 tablet_bootstrap.cc:492] T 6de140a555174689bc2a03d802a477e5 P bc9e314a6d804f6a895a924cc11d3ec4: Bootstrap starting.
I20260709 12:31:03.733911 19977 tablet_bootstrap.cc:654] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.737186 19976 tablet_bootstrap.cc:654] T 6de140a555174689bc2a03d802a477e5 P bc9e314a6d804f6a895a924cc11d3ec4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.737607 19975 tablet_bootstrap.cc:492] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348: No bootstrap required, opened a new log
I20260709 12:31:03.738216 19975 ts_tablet_manager.cc:1403] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 12:31:03.741724 19975 raft_consensus.cc:359] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.742859 19975 raft_consensus.cc:385] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.743316 19975 raft_consensus.cc:740] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.744444 19975 consensus_queue.cc:260] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.747172 19975 ts_tablet_manager.cc:1434] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:31:03.748279 19975 tablet_bootstrap.cc:492] T cd117ec76ec24b74988cfdccf3bcb28c P f7d3855f4244492987f0d3cd83c4a348: Bootstrap starting.
I20260709 12:31:03.745694 19977 tablet_bootstrap.cc:492] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9: No bootstrap required, opened a new log
I20260709 12:31:03.748821 19976 tablet_bootstrap.cc:492] T 6de140a555174689bc2a03d802a477e5 P bc9e314a6d804f6a895a924cc11d3ec4: No bootstrap required, opened a new log
I20260709 12:31:03.749222 19977 ts_tablet_manager.cc:1403] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.013s
I20260709 12:31:03.749454 19976 ts_tablet_manager.cc:1403] T 6de140a555174689bc2a03d802a477e5 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.011s
I20260709 12:31:03.752678 19976 raft_consensus.cc:359] T 6de140a555174689bc2a03d802a477e5 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.754437 19977 raft_consensus.cc:359] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.754981 19976 raft_consensus.cc:385] T 6de140a555174689bc2a03d802a477e5 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.755267 19977 raft_consensus.cc:385] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.755373 19976 raft_consensus.cc:740] T 6de140a555174689bc2a03d802a477e5 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.755692 19977 raft_consensus.cc:740] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.756219 19976 consensus_queue.cc:260] T 6de140a555174689bc2a03d802a477e5 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.758558 19976 ts_tablet_manager.cc:1434] T 6de140a555174689bc2a03d802a477e5 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:31:03.756650 19977 consensus_queue.cc:260] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.759505 19976 tablet_bootstrap.cc:492] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4: Bootstrap starting.
I20260709 12:31:03.754644 19975 tablet_bootstrap.cc:654] T cd117ec76ec24b74988cfdccf3bcb28c P f7d3855f4244492987f0d3cd83c4a348: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.761500 19977 ts_tablet_manager.cc:1434] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.006s
I20260709 12:31:03.762588 19977 tablet_bootstrap.cc:492] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9: Bootstrap starting.
I20260709 12:31:03.765528 19984 raft_consensus.cc:493] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:03.766124 19984 raft_consensus.cc:515] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.768644 19975 tablet_bootstrap.cc:492] T cd117ec76ec24b74988cfdccf3bcb28c P f7d3855f4244492987f0d3cd83c4a348: No bootstrap required, opened a new log
I20260709 12:31:03.769223 19975 ts_tablet_manager.cc:1403] T cd117ec76ec24b74988cfdccf3bcb28c P f7d3855f4244492987f0d3cd83c4a348: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.002s
I20260709 12:31:03.769404 19976 tablet_bootstrap.cc:654] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.769404 19977 tablet_bootstrap.cc:654] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.771571 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17775893872142bb88fbe22bedd96b11" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" is_pre_election: true
I20260709 12:31:03.772291 19861 raft_consensus.cc:2468] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 0.
I20260709 12:31:03.772522 19975 raft_consensus.cc:359] T cd117ec76ec24b74988cfdccf3bcb28c P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.773346 19975 raft_consensus.cc:385] T cd117ec76ec24b74988cfdccf3bcb28c P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.773684 19975 raft_consensus.cc:740] T cd117ec76ec24b74988cfdccf3bcb28c P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.773876 19749 leader_election.cc:304] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:03.774562 19975 consensus_queue.cc:260] T cd117ec76ec24b74988cfdccf3bcb28c P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.775113 19983 raft_consensus.cc:2804] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:03.775576 19983 raft_consensus.cc:493] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:03.775964 19983 raft_consensus.cc:3060] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:03.777864 19981 raft_consensus.cc:493] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:03.769834 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17775893872142bb88fbe22bedd96b11" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" is_pre_election: true
I20260709 12:31:03.778520 19981 raft_consensus.cc:515] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
W20260709 12:31:03.780329 19752 leader_election.cc:343] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:03.781296 19984 leader_election.cc:290] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:03.783289 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd117ec76ec24b74988cfdccf3bcb28c" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" is_pre_election: true
I20260709 12:31:03.784859 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd117ec76ec24b74988cfdccf3bcb28c" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348" is_pre_election: true
I20260709 12:31:03.785490 19981 leader_election.cc:290] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:03.787711 19935 raft_consensus.cc:2468] T cd117ec76ec24b74988cfdccf3bcb28c P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 0.
I20260709 12:31:03.791203 19827 leader_election.cc:304] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, d44fdddd21fe44c09069dd1e3f98b8a9; no voters: 
I20260709 12:31:03.789414 19786 raft_consensus.cc:2468] T cd117ec76ec24b74988cfdccf3bcb28c P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 0.
I20260709 12:31:03.793980 19981 raft_consensus.cc:2804] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:03.794488 19981 raft_consensus.cc:493] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:03.794929 19981 raft_consensus.cc:3060] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:03.803401 19985 raft_consensus.cc:493] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:03.804190 19985 raft_consensus.cc:515] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.807096 19985 leader_election.cc:290] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:03.810097 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71185e64eb2744ffaf2f069c035505a4" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348" is_pre_election: true
I20260709 12:31:03.811095 19786 raft_consensus.cc:2468] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 0.
I20260709 12:31:03.812748 19825 leader_election.cc:304] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:03.814129 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71185e64eb2744ffaf2f069c035505a4" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" is_pre_election: true
I20260709 12:31:03.815382 19985 raft_consensus.cc:2804] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:03.815085 19935 raft_consensus.cc:2468] T 71185e64eb2744ffaf2f069c035505a4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 0.
I20260709 12:31:03.815905 19985 raft_consensus.cc:493] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:03.818987 19985 raft_consensus.cc:3060] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:03.824185 19983 raft_consensus.cc:515] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.845155 19975 ts_tablet_manager.cc:1434] T cd117ec76ec24b74988cfdccf3bcb28c P f7d3855f4244492987f0d3cd83c4a348: Time spent starting tablet: real 0.076s	user 0.025s	sys 0.048s
I20260709 12:31:03.845348 19983 leader_election.cc:290] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 election: Requested vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:03.846628 19975 tablet_bootstrap.cc:492] T ecbfa438576e4052957cc88dc495f4d2 P f7d3855f4244492987f0d3cd83c4a348: Bootstrap starting.
I20260709 12:31:03.847529 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17775893872142bb88fbe22bedd96b11" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
W20260709 12:31:03.849056 19752 leader_election.cc:343] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:03.849370 19981 raft_consensus.cc:515] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.852320 19983 raft_consensus.cc:493] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:03.852865 19983 raft_consensus.cc:515] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.853322 19981 leader_election.cc:290] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:03.853924 19981 raft_consensus.cc:493] T ce4bc28a0a8d473698323f80cd969094 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:03.854388 19981 raft_consensus.cc:515] T ce4bc28a0a8d473698323f80cd969094 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.856024 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd117ec76ec24b74988cfdccf3bcb28c" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:03.856232 19934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4bc28a0a8d473698323f80cd969094" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" is_pre_election: true
I20260709 12:31:03.856675 19786 raft_consensus.cc:3060] T cd117ec76ec24b74988cfdccf3bcb28c P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:03.857072 19975 tablet_bootstrap.cc:654] T ecbfa438576e4052957cc88dc495f4d2 P f7d3855f4244492987f0d3cd83c4a348: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.857658 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd117ec76ec24b74988cfdccf3bcb28c" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:03.858098 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4bc28a0a8d473698323f80cd969094" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" is_pre_election: true
I20260709 12:31:03.858302 19935 raft_consensus.cc:3060] T cd117ec76ec24b74988cfdccf3bcb28c P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:03.859963 19981 leader_election.cc:290] T ce4bc28a0a8d473698323f80cd969094 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:03.856972 19934 raft_consensus.cc:2468] T ce4bc28a0a8d473698323f80cd969094 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 0.
I20260709 12:31:03.863405 19752 leader_election.cc:304] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:03.858711 19983 leader_election.cc:290] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:03.864676 19984 raft_consensus.cc:2804] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:03.865042 19984 raft_consensus.cc:493] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:03.865669 19984 raft_consensus.cc:3060] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:03.865789 19786 raft_consensus.cc:2468] T cd117ec76ec24b74988cfdccf3bcb28c P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 1.
I20260709 12:31:03.867165 19825 leader_election.cc:304] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:03.868081 20012 raft_consensus.cc:2804] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:03.868248 19976 tablet_bootstrap.cc:492] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4: No bootstrap required, opened a new log
I20260709 12:31:03.868651 20012 raft_consensus.cc:697] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Becoming Leader. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Running, Role: LEADER
I20260709 12:31:03.868479 19985 raft_consensus.cc:515] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.863293 19785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4bc28a0a8d473698323f80cd969094" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348" is_pre_election: true
I20260709 12:31:03.869618 20012 consensus_queue.cc:237] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.870842 19982 raft_consensus.cc:493] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:03.868809 19976 ts_tablet_manager.cc:1403] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent bootstrapping tablet: real 0.110s	user 0.008s	sys 0.073s
I20260709 12:31:03.871382 19982 raft_consensus.cc:515] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.871721 19985 leader_election.cc:290] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:03.872829 19934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71185e64eb2744ffaf2f069c035505a4" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:03.873486 19982 leader_election.cc:290] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:03.875833 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbfa438576e4052957cc88dc495f4d2" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" is_pre_election: true
I20260709 12:31:03.876565 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17775893872142bb88fbe22bedd96b11" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:03.877226 19860 raft_consensus.cc:3060] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:31:03.877499 19898 leader_election.cc:343] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:03.873512 19934 raft_consensus.cc:3060] T 71185e64eb2744ffaf2f069c035505a4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:03.881498 19975 tablet_bootstrap.cc:492] T ecbfa438576e4052957cc88dc495f4d2 P f7d3855f4244492987f0d3cd83c4a348: No bootstrap required, opened a new log
I20260709 12:31:03.882113 19975 ts_tablet_manager.cc:1403] T ecbfa438576e4052957cc88dc495f4d2 P f7d3855f4244492987f0d3cd83c4a348: Time spent bootstrapping tablet: real 0.036s	user 0.003s	sys 0.014s
I20260709 12:31:03.885367 19860 raft_consensus.cc:2468] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 1.
I20260709 12:31:03.886440 19975 raft_consensus.cc:359] T ecbfa438576e4052957cc88dc495f4d2 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.886750 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4bc28a0a8d473698323f80cd969094" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" is_pre_election: true
I20260709 12:31:03.887251 19975 raft_consensus.cc:385] T ecbfa438576e4052957cc88dc495f4d2 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.887451 19861 raft_consensus.cc:2468] T ce4bc28a0a8d473698323f80cd969094 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 0.
I20260709 12:31:03.885546 19784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbfa438576e4052957cc88dc495f4d2" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348" is_pre_election: true
I20260709 12:31:03.887769 19984 raft_consensus.cc:515] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.887678 19975 raft_consensus.cc:740] T ecbfa438576e4052957cc88dc495f4d2 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.888769 19977 tablet_bootstrap.cc:492] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9: No bootstrap required, opened a new log
I20260709 12:31:03.889010 19785 raft_consensus.cc:2393] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d44fdddd21fe44c09069dd1e3f98b8a9 in current term 1: Already voted for candidate f7d3855f4244492987f0d3cd83c4a348 in this term.
I20260709 12:31:03.885639 19976 raft_consensus.cc:359] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.889474 19976 raft_consensus.cc:385] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.889972 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71185e64eb2744ffaf2f069c035505a4" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:03.889781 19975 consensus_queue.cc:260] T ecbfa438576e4052957cc88dc495f4d2 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.891031 19784 raft_consensus.cc:2468] T ecbfa438576e4052957cc88dc495f4d2 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 0.
I20260709 12:31:03.891083 19749 leader_election.cc:304] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: bc9e314a6d804f6a895a924cc11d3ec4
I20260709 12:31:03.892341 19975 ts_tablet_manager.cc:1434] T ecbfa438576e4052957cc88dc495f4d2 P f7d3855f4244492987f0d3cd83c4a348: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:31:03.892598 19825 leader_election.cc:304] T ce4bc28a0a8d473698323f80cd969094 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9; no voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348
I20260709 12:31:03.892974 20011 raft_consensus.cc:2804] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:03.893441 19985 raft_consensus.cc:3060] T ce4bc28a0a8d473698323f80cd969094 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:03.893579 19975 tablet_bootstrap.cc:492] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348: Bootstrap starting.
I20260709 12:31:03.894622 19934 raft_consensus.cc:2468] T 71185e64eb2744ffaf2f069c035505a4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 1.
I20260709 12:31:03.893025 19899 leader_election.cc:304] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348; no voters: d44fdddd21fe44c09069dd1e3f98b8a9
I20260709 12:31:03.893635 20011 raft_consensus.cc:697] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Becoming Leader. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Running, Role: LEADER
I20260709 12:31:03.896018 19982 raft_consensus.cc:2804] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:03.896449 19982 raft_consensus.cc:493] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:03.896798 19982 raft_consensus.cc:3060] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:03.896988 19977 ts_tablet_manager.cc:1403] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent bootstrapping tablet: real 0.135s	user 0.009s	sys 0.021s
I20260709 12:31:03.895952 20011 consensus_queue.cc:237] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.900035 19977 raft_consensus.cc:359] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.900722 19977 raft_consensus.cc:385] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:03.900990 19977 raft_consensus.cc:740] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.889794 19976 raft_consensus.cc:740] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Initialized, Role: FOLLOWER
I20260709 12:31:03.901808 19985 raft_consensus.cc:2749] T ce4bc28a0a8d473698323f80cd969094 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:03.901890 19977 consensus_queue.cc:260] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.901927 19976 consensus_queue.cc:260] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.904054 19977 ts_tablet_manager.cc:1434] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:31:03.904496 19975 tablet_bootstrap.cc:654] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.904695 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4bc28a0a8d473698323f80cd969094" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:03.904975 19977 tablet_bootstrap.cc:492] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9: Bootstrap starting.
I20260709 12:31:03.911712 19977 tablet_bootstrap.cc:654] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:03.915534 19860 raft_consensus.cc:2468] T ce4bc28a0a8d473698323f80cd969094 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 1.
I20260709 12:31:03.890628 19786 raft_consensus.cc:3060] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:03.919924 19982 raft_consensus.cc:515] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.881938 19935 raft_consensus.cc:2468] T cd117ec76ec24b74988cfdccf3bcb28c P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 1.
I20260709 12:31:03.924039 19784 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbfa438576e4052957cc88dc495f4d2" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:03.924840 19784 raft_consensus.cc:3060] T ecbfa438576e4052957cc88dc495f4d2 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:03.925323 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce4bc28a0a8d473698323f80cd969094" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:03.926215 19933 raft_consensus.cc:3060] T ce4bc28a0a8d473698323f80cd969094 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:03.927040 19827 leader_election.cc:304] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, d44fdddd21fe44c09069dd1e3f98b8a9; no voters: 
I20260709 12:31:03.927989 19985 raft_consensus.cc:2804] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:03.928524 19985 raft_consensus.cc:697] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Becoming Leader. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Running, Role: LEADER
I20260709 12:31:03.929358 19985 consensus_queue.cc:237] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.936800 19983 raft_consensus.cc:493] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:03.937330 19983 raft_consensus.cc:515] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.938683 19981 raft_consensus.cc:493] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:03.940070 19981 raft_consensus.cc:515] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.940768 19983 leader_election.cc:290] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:03.940510 19749 leader_election.cc:304] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:03.942546 19981 leader_election.cc:290] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:03.944128 19933 raft_consensus.cc:2468] T ce4bc28a0a8d473698323f80cd969094 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 1.
I20260709 12:31:03.944670 19784 raft_consensus.cc:2468] T ecbfa438576e4052957cc88dc495f4d2 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 1.
I20260709 12:31:03.945012 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de140a555174689bc2a03d802a477e5" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" is_pre_election: true
I20260709 12:31:03.946799 19899 leader_election.cc:304] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:03.938246 19984 leader_election.cc:290] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 election: Requested vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:03.947480 19861 raft_consensus.cc:2468] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 0.
I20260709 12:31:03.954753 19976 ts_tablet_manager.cc:1434] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent starting tablet: real 0.083s	user 0.017s	sys 0.000s
I20260709 12:31:03.955315 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de140a555174689bc2a03d802a477e5" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" is_pre_election: true
I20260709 12:31:03.948864 19983 raft_consensus.cc:2804] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:03.956981 19976 tablet_bootstrap.cc:492] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4: Bootstrap starting.
I20260709 12:31:03.954072 19785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9874751d7e14ddaa2cf2f9e29c3e5b4" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348" is_pre_election: true
I20260709 12:31:03.964062 19749 leader_election.cc:304] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:03.959692 19983 raft_consensus.cc:697] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Becoming Leader. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Running, Role: LEADER
I20260709 12:31:03.960242 19982 leader_election.cc:290] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:03.958886 19935 raft_consensus.cc:2468] T 6de140a555174689bc2a03d802a477e5 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 0.
I20260709 12:31:03.969393 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9874751d7e14ddaa2cf2f9e29c3e5b4" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" is_pre_election: true
W20260709 12:31:03.971007 19827 leader_election.cc:343] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:03.971292 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbfa438576e4052957cc88dc495f4d2" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
W20260709 12:31:03.975622 19898 leader_election.cc:343] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:03.973879 19984 raft_consensus.cc:2804] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:03.977150 19984 raft_consensus.cc:493] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:03.977578 19984 raft_consensus.cc:3060] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:03.978353 20012 consensus_queue.cc:1048] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:31:03.983409 19825 leader_election.cc:343] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:03.984067 19825 leader_election.cc:304] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9; no voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348
I20260709 12:31:03.985054 20012 raft_consensus.cc:2749] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:03.985841 19983 consensus_queue.cc:237] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:03.989822 19683 catalog_manager.cc:5697] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "f7d3855f4244492987f0d3cd83c4a348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:03.990823 19786 raft_consensus.cc:2468] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 1.
I20260709 12:31:03.994035 19681 catalog_manager.cc:5697] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:03.974643 19982 raft_consensus.cc:2804] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:04.000042 19975 tablet_bootstrap.cc:492] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348: No bootstrap required, opened a new log
I20260709 12:31:04.000640 19975 ts_tablet_manager.cc:1403] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348: Time spent bootstrapping tablet: real 0.107s	user 0.025s	sys 0.029s
I20260709 12:31:04.006901 19977 tablet_bootstrap.cc:492] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9: No bootstrap required, opened a new log
I20260709 12:31:04.007592 19977 ts_tablet_manager.cc:1403] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent bootstrapping tablet: real 0.103s	user 0.028s	sys 0.006s
I20260709 12:31:04.009028 19975 raft_consensus.cc:359] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.010080 19975 raft_consensus.cc:385] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:04.010434 19975 raft_consensus.cc:740] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Initialized, Role: FOLLOWER
I20260709 12:31:04.011201 19975 consensus_queue.cc:260] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.013653 19975 ts_tablet_manager.cc:1434] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:31:04.015057 19976 tablet_bootstrap.cc:654] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:04.018885 19984 raft_consensus.cc:515] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.023402 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de140a555174689bc2a03d802a477e5" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:04.028041 19977 raft_consensus.cc:359] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.028774 19977 raft_consensus.cc:385] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:04.029161 19977 raft_consensus.cc:740] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Initialized, Role: FOLLOWER
I20260709 12:31:04.025163 19982 raft_consensus.cc:697] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Becoming Leader. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Running, Role: LEADER
I20260709 12:31:04.027938 20011 raft_consensus.cc:493] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:04.033350 19976 tablet_bootstrap.cc:492] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4: No bootstrap required, opened a new log
I20260709 12:31:04.048996 19976 ts_tablet_manager.cc:1403] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent bootstrapping tablet: real 0.093s	user 0.027s	sys 0.005s
I20260709 12:31:04.031019 20011 raft_consensus.cc:515] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.045329 19977 consensus_queue.cc:260] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.052016 19976 raft_consensus.cc:359] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.052686 20012 raft_consensus.cc:493] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:04.052800 19976 raft_consensus.cc:385] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:04.052977 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bb268f539c448cabdf9058d7567b80" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" is_pre_election: true
I20260709 12:31:04.053275 19976 raft_consensus.cc:740] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Initialized, Role: FOLLOWER
I20260709 12:31:04.053720 19860 raft_consensus.cc:2468] T 57bb268f539c448cabdf9058d7567b80 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 0.
I20260709 12:31:04.053325 20012 raft_consensus.cc:515] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.054092 19976 consensus_queue.cc:260] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.055789 19749 leader_election.cc:304] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:04.056555 19976 ts_tablet_manager.cc:1434] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:31:04.036859 19982 consensus_queue.cc:237] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.059007 20012 leader_election.cc:290] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:04.059252 19934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbfa438576e4052957cc88dc495f4d2" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" is_pre_election: true
I20260709 12:31:04.059432 19785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbfa438576e4052957cc88dc495f4d2" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348" is_pre_election: true
I20260709 12:31:04.030854 19984 leader_election.cc:290] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 election: Requested vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:04.060335 19785 raft_consensus.cc:2393] T ecbfa438576e4052957cc88dc495f4d2 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d44fdddd21fe44c09069dd1e3f98b8a9 in current term 1: Already voted for candidate bc9e314a6d804f6a895a924cc11d3ec4 in this term.
I20260709 12:31:04.061669 20012 consensus_queue.cc:1048] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:04.061774 19827 leader_election.cc:304] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9; no voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348
I20260709 12:31:04.063230 19981 raft_consensus.cc:3060] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:04.042042 19682 catalog_manager.cc:5697] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "f7d3855f4244492987f0d3cd83c4a348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:04.032297 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de140a555174689bc2a03d802a477e5" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:04.069247 19935 raft_consensus.cc:3060] T 6de140a555174689bc2a03d802a477e5 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:04.073580 19981 raft_consensus.cc:2749] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:04.060323 19984 raft_consensus.cc:2804] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:04.074735 19984 raft_consensus.cc:493] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:04.075184 19984 raft_consensus.cc:3060] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:04.083413 19935 raft_consensus.cc:2468] T 6de140a555174689bc2a03d802a477e5 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 1.
I20260709 12:31:04.085390 19752 leader_election.cc:304] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:04.086499 19983 raft_consensus.cc:2804] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:04.089493 19934 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bb268f539c448cabdf9058d7567b80" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" is_pre_election: true
I20260709 12:31:04.088690 19681 catalog_manager.cc:5697] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:04.090410 19934 raft_consensus.cc:2468] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 0.
I20260709 12:31:04.028338 19861 raft_consensus.cc:3060] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:04.095731 20011 leader_election.cc:290] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:04.101482 19977 ts_tablet_manager.cc:1434] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent starting tablet: real 0.094s	user 0.009s	sys 0.000s
I20260709 12:31:04.105536 19861 raft_consensus.cc:2468] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 1.
I20260709 12:31:04.108127 19984 raft_consensus.cc:515] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.115379 19983 raft_consensus.cc:697] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Becoming Leader. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Running, Role: LEADER
I20260709 12:31:04.122465 19983 consensus_queue.cc:237] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.125695 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bb268f539c448cabdf9058d7567b80" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:04.126447 19861 raft_consensus.cc:3060] T 57bb268f539c448cabdf9058d7567b80 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:04.133219 19984 leader_election.cc:290] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 election: Requested vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:04.136571 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57bb268f539c448cabdf9058d7567b80" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:04.137496 19933 raft_consensus.cc:3060] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:04.139081 19682 catalog_manager.cc:5697] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:04.143337 19861 raft_consensus.cc:2468] T 57bb268f539c448cabdf9058d7567b80 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 1.
I20260709 12:31:04.144383 19749 leader_election.cc:304] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:04.145064 19983 raft_consensus.cc:2804] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:04.145533 19983 raft_consensus.cc:697] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Becoming Leader. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Running, Role: LEADER
I20260709 12:31:04.147933 19933 raft_consensus.cc:2468] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 1.
I20260709 12:31:04.146351 19983 consensus_queue.cc:237] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.162985 19683 catalog_manager.cc:5697] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "f7d3855f4244492987f0d3cd83c4a348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:04.164290 19683 catalog_manager.cc:5697] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "f7d3855f4244492987f0d3cd83c4a348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:04.219862 19983 raft_consensus.cc:493] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:04.220471 19983 raft_consensus.cc:515] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.222430 19983 leader_election.cc:290] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:04.222725 19982 raft_consensus.cc:493] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:04.223271 19982 raft_consensus.cc:515] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.223389 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9874751d7e14ddaa2cf2f9e29c3e5b4" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" is_pre_election: true
I20260709 12:31:04.223467 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9874751d7e14ddaa2cf2f9e29c3e5b4" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" is_pre_election: true
I20260709 12:31:04.224184 19861 raft_consensus.cc:2468] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 0.
I20260709 12:31:04.224337 19933 raft_consensus.cc:2468] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 0.
I20260709 12:31:04.225601 19752 leader_election.cc:304] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:04.225865 19982 leader_election.cc:290] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:04.226486 19983 raft_consensus.cc:2804] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:04.226511 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9874751d7e14ddaa2cf2f9e29c3e5b4" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" is_pre_election: true
I20260709 12:31:04.227020 19983 raft_consensus.cc:493] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:04.227068 19785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9874751d7e14ddaa2cf2f9e29c3e5b4" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348" is_pre_election: true
I20260709 12:31:04.227259 19861 raft_consensus.cc:2468] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 0.
I20260709 12:31:04.227502 19983 raft_consensus.cc:3060] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:04.228332 19898 leader_election.cc:304] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, d44fdddd21fe44c09069dd1e3f98b8a9; no voters: 
I20260709 12:31:04.229018 19982 raft_consensus.cc:2804] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:04.229398 19982 raft_consensus.cc:493] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:04.229730 19982 raft_consensus.cc:3060] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:04.235102 19983 raft_consensus.cc:515] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.236311 19785 raft_consensus.cc:2393] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc9e314a6d804f6a895a924cc11d3ec4 in current term 1: Already voted for candidate f7d3855f4244492987f0d3cd83c4a348 in this term.
I20260709 12:31:04.236977 19982 raft_consensus.cc:515] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.237342 19983 leader_election.cc:290] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 election: Requested vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:04.238344 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9874751d7e14ddaa2cf2f9e29c3e5b4" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:04.239001 19861 raft_consensus.cc:3060] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:04.239104 19982 leader_election.cc:290] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:04.239578 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9874751d7e14ddaa2cf2f9e29c3e5b4" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:04.240036 19785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9874751d7e14ddaa2cf2f9e29c3e5b4" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:04.240537 19933 raft_consensus.cc:2393] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f7d3855f4244492987f0d3cd83c4a348 in current term 1: Already voted for candidate bc9e314a6d804f6a895a924cc11d3ec4 in this term.
I20260709 12:31:04.240634 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9874751d7e14ddaa2cf2f9e29c3e5b4" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:04.240916 19785 raft_consensus.cc:2393] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bc9e314a6d804f6a895a924cc11d3ec4 in current term 1: Already voted for candidate f7d3855f4244492987f0d3cd83c4a348 in this term.
I20260709 12:31:04.242208 19899 leader_election.cc:304] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4; no voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348
I20260709 12:31:04.243006 19982 raft_consensus.cc:2749] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:31:04.245780 19861 raft_consensus.cc:2468] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 1.
I20260709 12:31:04.246757 19749 leader_election.cc:304] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: bc9e314a6d804f6a895a924cc11d3ec4
I20260709 12:31:04.247375 19983 raft_consensus.cc:2804] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:04.247784 19983 raft_consensus.cc:697] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Becoming Leader. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Running, Role: LEADER
I20260709 12:31:04.248407 19983 consensus_queue.cc:237] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.255824 19683 catalog_manager.cc:5697] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "f7d3855f4244492987f0d3cd83c4a348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:04.300755 19933 raft_consensus.cc:3060] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:04.306823 19983 consensus_queue.cc:1048] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:04.316124 19981 consensus_queue.cc:1048] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:04.321167 19983 consensus_queue.cc:1048] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:04.330629 20012 consensus_queue.cc:1048] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:04.377440 19861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cbdd9c7dcc14dfbb34eaa87c9c726c7"
dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
mode: GRACEFUL
new_leader_uuid: "f7d3855f4244492987f0d3cd83c4a348"
 from {username='slave'} at 127.0.0.1:58784
I20260709 12:31:04.377955 19861 raft_consensus.cc:606] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Received request to transfer leadership to TS f7d3855f4244492987f0d3cd83c4a348
I20260709 12:31:04.385382 19861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71185e64eb2744ffaf2f069c035505a4"
dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
mode: GRACEFUL
new_leader_uuid: "f7d3855f4244492987f0d3cd83c4a348"
 from {username='slave'} at 127.0.0.1:58784
I20260709 12:31:04.385813 19861 raft_consensus.cc:606] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Received request to transfer leadership to TS f7d3855f4244492987f0d3cd83c4a348
I20260709 12:31:04.397718 19983 consensus_queue.cc:1048] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:04.401852 19785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6de140a555174689bc2a03d802a477e5"
dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
mode: GRACEFUL
new_leader_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
 from {username='slave'} at 127.0.0.1:35046
I20260709 12:31:04.402496 19785 raft_consensus.cc:606] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Received request to transfer leadership to TS d44fdddd21fe44c09069dd1e3f98b8a9
I20260709 12:31:04.409454 20011 consensus_queue.cc:1048] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:04.414227 19785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17775893872142bb88fbe22bedd96b11"
dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
mode: GRACEFUL
new_leader_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
 from {username='slave'} at 127.0.0.1:35046
I20260709 12:31:04.414916 19785 raft_consensus.cc:606] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Received request to transfer leadership to TS d44fdddd21fe44c09069dd1e3f98b8a9
I20260709 12:31:04.422464 20012 consensus_queue.cc:1048] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:04.434914 19933 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecbfa438576e4052957cc88dc495f4d2"
dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
mode: GRACEFUL
new_leader_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
 from {username='slave'} at 127.0.0.1:52350
I20260709 12:31:04.435506 19933 raft_consensus.cc:606] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Received request to transfer leadership to TS d44fdddd21fe44c09069dd1e3f98b8a9
I20260709 12:31:04.440703 19985 consensus_queue.cc:1048] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:04.446388 19785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9874751d7e14ddaa2cf2f9e29c3e5b4"
dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
mode: GRACEFUL
new_leader_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
 from {username='slave'} at 127.0.0.1:35046
I20260709 12:31:04.447062 19785 raft_consensus.cc:606] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Received request to transfer leadership to TS bc9e314a6d804f6a895a924cc11d3ec4
I20260709 12:31:04.515283 20011 consensus_queue.cc:1048] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:04.521456 20030 raft_consensus.cc:993] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348: : Instructing follower d44fdddd21fe44c09069dd1e3f98b8a9 to start an election
I20260709 12:31:04.521937 19984 raft_consensus.cc:1081] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Signalling peer d44fdddd21fe44c09069dd1e3f98b8a9 to start an election
I20260709 12:31:04.525719 19861 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6de140a555174689bc2a03d802a477e5"
dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
 from {username='slave'} at 127.0.0.1:58758
I20260709 12:31:04.526427 19861 raft_consensus.cc:493] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:04.526800 19861 raft_consensus.cc:3060] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:04.526878 19983 consensus_queue.cc:1048] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:04.534830 19861 raft_consensus.cc:515] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.536633 19861 leader_election.cc:290] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 2 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:04.537266 19785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de140a555174689bc2a03d802a477e5" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:04.537798 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6de140a555174689bc2a03d802a477e5" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:04.538004 19785 raft_consensus.cc:3055] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:04.538496 19933 raft_consensus.cc:3060] T 6de140a555174689bc2a03d802a477e5 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:04.538524 19785 raft_consensus.cc:740] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Running, Role: LEADER
I20260709 12:31:04.540625 19785 consensus_queue.cc:260] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.541967 19785 raft_consensus.cc:3060] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:04.543165 19982 consensus_queue.cc:1048] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:04.549392 19983 consensus_queue.cc:1048] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:04.550902 19982 raft_consensus.cc:993] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4: : Instructing follower d44fdddd21fe44c09069dd1e3f98b8a9 to start an election
I20260709 12:31:04.551815 19933 raft_consensus.cc:2468] T 6de140a555174689bc2a03d802a477e5 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 2.
I20260709 12:31:04.552538 20023 raft_consensus.cc:1081] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Signalling peer d44fdddd21fe44c09069dd1e3f98b8a9 to start an election
I20260709 12:31:04.549408 19785 raft_consensus.cc:2468] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 2.
I20260709 12:31:04.554195 19825 leader_election.cc:304] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:04.555313 20012 raft_consensus.cc:2804] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:04.555799 20012 raft_consensus.cc:697] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 LEADER]: Becoming Leader. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Running, Role: LEADER
I20260709 12:31:04.556660 20012 consensus_queue.cc:237] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.557184 19860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecbfa438576e4052957cc88dc495f4d2"
dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
 from {username='slave'} at 127.0.0.1:58768
I20260709 12:31:04.557847 19860 raft_consensus.cc:493] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:04.558200 19860 raft_consensus.cc:3060] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:04.560364 20023 consensus_queue.cc:1048] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:31:04.566072 19860 raft_consensus.cc:515] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.567227 19861 raft_consensus.cc:1240] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Rejecting Update request from peer bc9e314a6d804f6a895a924cc11d3ec4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:31:04.568447 19683 catalog_manager.cc:5697] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 reported cstate change: term changed from 1 to 2, leader changed from f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65) to d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:04.570456 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbfa438576e4052957cc88dc495f4d2" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:04.572510 19982 consensus_queue.cc:1059] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:04.577816 20049 raft_consensus.cc:3055] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:04.578166 20049 raft_consensus.cc:740] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Running, Role: LEADER
I20260709 12:31:04.578517 20011 consensus_queue.cc:1048] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:04.578989 20049 consensus_queue.cc:260] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.580057 20049 raft_consensus.cc:3060] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:04.585881 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecbfa438576e4052957cc88dc495f4d2" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:04.587057 19860 leader_election.cc:290] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 2 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:04.597216 19985 raft_consensus.cc:993] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9: : Instructing follower f7d3855f4244492987f0d3cd83c4a348 to start an election
I20260709 12:31:04.597683 19985 raft_consensus.cc:1081] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Signalling peer f7d3855f4244492987f0d3cd83c4a348 to start an election
I20260709 12:31:04.601869 19935 raft_consensus.cc:2468] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 2.
I20260709 12:31:04.603802 19827 leader_election.cc:304] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, d44fdddd21fe44c09069dd1e3f98b8a9; no voters: f7d3855f4244492987f0d3cd83c4a348
I20260709 12:31:04.604509 19785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cbdd9c7dcc14dfbb34eaa87c9c726c7"
dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
 from {username='slave'} at 127.0.0.1:35036
I20260709 12:31:04.605167 19785 raft_consensus.cc:493] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:04.605268 20012 raft_consensus.cc:2804] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:04.605616 19785 raft_consensus.cc:3060] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:04.605820 20012 raft_consensus.cc:697] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 LEADER]: Becoming Leader. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Running, Role: LEADER
I20260709 12:31:04.606760 20012 consensus_queue.cc:237] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.613474 19785 raft_consensus.cc:515] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } }
I20260709 12:31:04.616003 19785 leader_election.cc:290] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 2 election: Requested vote from peers bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:04.617192 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cbdd9c7dcc14dfbb34eaa87c9c726c7" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:04.617606 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cbdd9c7dcc14dfbb34eaa87c9c726c7" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:04.617797 19861 raft_consensus.cc:3055] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:04.618197 19935 raft_consensus.cc:3060] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:04.618216 19861 raft_consensus.cc:740] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Running, Role: LEADER
I20260709 12:31:04.619383 19861 consensus_queue.cc:260] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } }
I20260709 12:31:04.620759 19861 raft_consensus.cc:3060] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:04.620442 19682 catalog_manager.cc:5697] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 reported cstate change: term changed from 1 to 2, leader changed from bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67) to d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:04.624069 19935 raft_consensus.cc:2468] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 2.
I20260709 12:31:04.625191 19752 leader_election.cc:304] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:04.625922 19983 raft_consensus.cc:2804] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:04.626477 19983 raft_consensus.cc:697] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 2 LEADER]: Becoming Leader. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Running, Role: LEADER
I20260709 12:31:04.627283 19983 consensus_queue.cc:237] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } }
I20260709 12:31:04.627874 19861 raft_consensus.cc:2468] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 2.
I20260709 12:31:04.634022 19682 catalog_manager.cc:5697] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 reported cstate change: term changed from 1 to 2, leader changed from d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66) to f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "f7d3855f4244492987f0d3cd83c4a348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:04.649161 19983 consensus_queue.cc:1048] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:04.659570 20030 consensus_queue.cc:1048] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:04.668555 19983 raft_consensus.cc:993] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348: : Instructing follower bc9e314a6d804f6a895a924cc11d3ec4 to start an election
I20260709 12:31:04.669077 20030 raft_consensus.cc:1081] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Signalling peer bc9e314a6d804f6a895a924cc11d3ec4 to start an election
I20260709 12:31:04.670655 19935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9874751d7e14ddaa2cf2f9e29c3e5b4"
dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
 from {username='slave'} at 127.0.0.1:52324
I20260709 12:31:04.671299 19935 raft_consensus.cc:493] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:04.671638 19935 raft_consensus.cc:3060] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:04.676614 19935 raft_consensus.cc:515] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.678292 19935 leader_election.cc:290] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 2 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:04.679312 19785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9874751d7e14ddaa2cf2f9e29c3e5b4" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:04.679436 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9874751d7e14ddaa2cf2f9e29c3e5b4" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:04.680099 19785 raft_consensus.cc:3055] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:04.680166 19861 raft_consensus.cc:3060] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:04.680429 19785 raft_consensus.cc:740] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Running, Role: LEADER
I20260709 12:31:04.681299 19785 consensus_queue.cc:260] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.682253 19785 raft_consensus.cc:3060] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:04.685891 19861 raft_consensus.cc:2468] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 2.
I20260709 12:31:04.687013 19898 leader_election.cc:304] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, d44fdddd21fe44c09069dd1e3f98b8a9; no voters: 
I20260709 12:31:04.687453 19785 raft_consensus.cc:2468] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 2.
I20260709 12:31:04.687707 20049 raft_consensus.cc:2804] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:04.688287 20049 raft_consensus.cc:697] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 LEADER]: Becoming Leader. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Running, Role: LEADER
I20260709 12:31:04.689010 20049 consensus_queue.cc:237] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.694757 19683 catalog_manager.cc:5697] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 reported cstate change: term changed from 1 to 2, leader changed from f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65) to bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67). New cstate: current_term: 2 leader_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:04.731666 19983 raft_consensus.cc:993] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348: : Instructing follower d44fdddd21fe44c09069dd1e3f98b8a9 to start an election
I20260709 12:31:04.732139 20030 raft_consensus.cc:1081] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Signalling peer d44fdddd21fe44c09069dd1e3f98b8a9 to start an election
I20260709 12:31:04.733672 19861 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17775893872142bb88fbe22bedd96b11"
dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
 from {username='slave'} at 127.0.0.1:58758
I20260709 12:31:04.734259 19861 raft_consensus.cc:493] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:04.734658 19861 raft_consensus.cc:3060] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:04.740020 19861 raft_consensus.cc:515] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.741593 19861 leader_election.cc:290] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 2 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:04.742436 19785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17775893872142bb88fbe22bedd96b11" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:04.742656 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17775893872142bb88fbe22bedd96b11" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:04.743165 19785 raft_consensus.cc:3055] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:04.743191 19935 raft_consensus.cc:3060] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:04.743710 19785 raft_consensus.cc:740] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Running, Role: LEADER
I20260709 12:31:04.744597 19785 consensus_queue.cc:260] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.745869 19785 raft_consensus.cc:3060] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:04.750519 19935 raft_consensus.cc:2468] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 2.
I20260709 12:31:04.751638 19827 leader_election.cc:304] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, d44fdddd21fe44c09069dd1e3f98b8a9; no voters: 
I20260709 12:31:04.752426 20012 raft_consensus.cc:2804] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:04.752900 20012 raft_consensus.cc:697] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 LEADER]: Becoming Leader. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Running, Role: LEADER
I20260709 12:31:04.753530 20012 consensus_queue.cc:237] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.753911 19785 raft_consensus.cc:2468] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 2.
I20260709 12:31:04.760043 19683 catalog_manager.cc:5697] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 reported cstate change: term changed from 1 to 2, leader changed from f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65) to d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:04.865520 19985 raft_consensus.cc:993] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9: : Instructing follower f7d3855f4244492987f0d3cd83c4a348 to start an election
I20260709 12:31:04.865979 20012 raft_consensus.cc:1081] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Signalling peer f7d3855f4244492987f0d3cd83c4a348 to start an election
I20260709 12:31:04.867636 19785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71185e64eb2744ffaf2f069c035505a4"
dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
 from {username='slave'} at 127.0.0.1:35036
I20260709 12:31:04.868165 19785 raft_consensus.cc:493] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:04.868468 19785 raft_consensus.cc:3060] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:04.874115 19785 raft_consensus.cc:515] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.875707 19785 leader_election.cc:290] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 2 election: Requested vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:04.876539 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71185e64eb2744ffaf2f069c035505a4" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:04.876842 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71185e64eb2744ffaf2f069c035505a4" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:04.877266 19861 raft_consensus.cc:3055] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:04.877532 19935 raft_consensus.cc:3060] T 71185e64eb2744ffaf2f069c035505a4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:04.877686 19861 raft_consensus.cc:740] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Running, Role: LEADER
I20260709 12:31:04.878535 19861 consensus_queue.cc:260] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.879472 19861 raft_consensus.cc:3060] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:04.883134 19935 raft_consensus.cc:2468] T 71185e64eb2744ffaf2f069c035505a4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 2.
I20260709 12:31:04.884299 19752 leader_election.cc:304] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:04.884799 19861 raft_consensus.cc:2468] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 2.
I20260709 12:31:04.885053 20030 raft_consensus.cc:2804] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:04.885613 20030 raft_consensus.cc:697] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [term 2 LEADER]: Becoming Leader. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Running, Role: LEADER
I20260709 12:31:04.886449 20030 consensus_queue.cc:237] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:04.893337 19683 catalog_manager.cc:5697] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 reported cstate change: term changed from 1 to 2, leader changed from d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66) to f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "f7d3855f4244492987f0d3cd83c4a348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:05.027973 19935 raft_consensus.cc:1275] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Refusing update from remote peer d44fdddd21fe44c09069dd1e3f98b8a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:05.029438 20012 consensus_queue.cc:1048] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:05.037283 19785 raft_consensus.cc:3060] T ecbfa438576e4052957cc88dc495f4d2 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:05.047305 19785 raft_consensus.cc:1275] T ecbfa438576e4052957cc88dc495f4d2 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Refusing update from remote peer d44fdddd21fe44c09069dd1e3f98b8a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:05.048637 19981 consensus_queue.cc:1048] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:05.058192 19935 raft_consensus.cc:1275] T 6de140a555174689bc2a03d802a477e5 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Refusing update from remote peer d44fdddd21fe44c09069dd1e3f98b8a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:05.059623 20055 consensus_queue.cc:1048] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:05.070777 19785 raft_consensus.cc:1275] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Refusing update from remote peer d44fdddd21fe44c09069dd1e3f98b8a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:05.072317 19981 consensus_queue.cc:1048] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:05.088315 19935 raft_consensus.cc:1275] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Refusing update from remote peer f7d3855f4244492987f0d3cd83c4a348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:05.089079 19861 raft_consensus.cc:1275] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Refusing update from remote peer f7d3855f4244492987f0d3cd83c4a348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:05.089782 20030 consensus_queue.cc:1048] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:05.090492 19983 consensus_queue.cc:1048] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:05.191365 19861 raft_consensus.cc:1275] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Refusing update from remote peer bc9e314a6d804f6a895a924cc11d3ec4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:05.192659 20049 consensus_queue.cc:1048] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:05.195724 19785 raft_consensus.cc:1275] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Refusing update from remote peer d44fdddd21fe44c09069dd1e3f98b8a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:05.197045 19981 consensus_queue.cc:1048] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:05.202153 19786 raft_consensus.cc:1275] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Refusing update from remote peer bc9e314a6d804f6a895a924cc11d3ec4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:05.203915 20057 consensus_queue.cc:1048] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:05.213375 19935 raft_consensus.cc:1275] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Refusing update from remote peer d44fdddd21fe44c09069dd1e3f98b8a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:05.215155 20012 consensus_queue.cc:1048] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:05.274943 19935 raft_consensus.cc:1275] T 71185e64eb2744ffaf2f069c035505a4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Refusing update from remote peer f7d3855f4244492987f0d3cd83c4a348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:05.276134 20030 consensus_queue.cc:1048] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:05.283838 19861 raft_consensus.cc:1275] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Refusing update from remote peer f7d3855f4244492987f0d3cd83c4a348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:05.285426 20030 consensus_queue.cc:1048] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:07.490957 19681 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40800:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:31:07.493924 19681 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:31:07.552650 19772 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0b5a815b844529bc04dbfd6b4881a1 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:31:07.553721 19849 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0b5a815b844529bc04dbfd6b4881a1 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:31:07.554872 19772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0b5a815b844529bc04dbfd6b4881a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.555619 19849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0b5a815b844529bc04dbfd6b4881a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.557559 19921 tablet_service.cc:1511] Processing CreateTablet for tablet 3d0b5a815b844529bc04dbfd6b4881a1 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:31:07.559271 19921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d0b5a815b844529bc04dbfd6b4881a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.559981 19776 tablet_service.cc:1511] Processing CreateTablet for tablet 5df454fac23d4cf6a9c10ffa0ef263b4 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:31:07.561482 19776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df454fac23d4cf6a9c10ffa0ef263b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.561496 19850 tablet_service.cc:1511] Processing CreateTablet for tablet 5df454fac23d4cf6a9c10ffa0ef263b4 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:31:07.563122 19850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df454fac23d4cf6a9c10ffa0ef263b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.562767 19924 tablet_service.cc:1511] Processing CreateTablet for tablet 5df454fac23d4cf6a9c10ffa0ef263b4 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:31:07.564193 19924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5df454fac23d4cf6a9c10ffa0ef263b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.565258 19773 tablet_service.cc:1511] Processing CreateTablet for tablet 24bbaeea725746cbbe1519c39ebeca50 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:31:07.566738 19773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24bbaeea725746cbbe1519c39ebeca50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.571848 19851 tablet_service.cc:1511] Processing CreateTablet for tablet 24bbaeea725746cbbe1519c39ebeca50 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:31:07.573316 19851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24bbaeea725746cbbe1519c39ebeca50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.573523 19922 tablet_service.cc:1511] Processing CreateTablet for tablet 24bbaeea725746cbbe1519c39ebeca50 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:31:07.574983 19922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24bbaeea725746cbbe1519c39ebeca50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.590858 19774 tablet_service.cc:1511] Processing CreateTablet for tablet 4f7bc6b062e34c94a171a37dbec21045 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:31:07.592491 19774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7bc6b062e34c94a171a37dbec21045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.602793 19923 tablet_service.cc:1511] Processing CreateTablet for tablet 4f7bc6b062e34c94a171a37dbec21045 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:31:07.604249 19923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7bc6b062e34c94a171a37dbec21045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.605891 19848 tablet_service.cc:1511] Processing CreateTablet for tablet 4f7bc6b062e34c94a171a37dbec21045 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:31:07.607314 19848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f7bc6b062e34c94a171a37dbec21045. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.629065 19772 tablet_service.cc:1511] Processing CreateTablet for tablet d29f26ef85584432b3f88fa1b72595b1 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:31:07.630569 19772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d29f26ef85584432b3f88fa1b72595b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.631846 19847 tablet_service.cc:1511] Processing CreateTablet for tablet d29f26ef85584432b3f88fa1b72595b1 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:31:07.633250 19847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d29f26ef85584432b3f88fa1b72595b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.643553 20073 tablet_bootstrap.cc:492] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348: Bootstrap starting.
I20260709 12:31:07.649494 19924 tablet_service.cc:1511] Processing CreateTablet for tablet d29f26ef85584432b3f88fa1b72595b1 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:31:07.650928 19924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d29f26ef85584432b3f88fa1b72595b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.651677 19776 tablet_service.cc:1511] Processing CreateTablet for tablet 90f9b3b3645a4a8ca2406580f1775ed3 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:31:07.653040 19776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f9b3b3645a4a8ca2406580f1775ed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.653160 19846 tablet_service.cc:1511] Processing CreateTablet for tablet 90f9b3b3645a4a8ca2406580f1775ed3 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:31:07.654484 19846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f9b3b3645a4a8ca2406580f1775ed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.656977 19775 tablet_service.cc:1511] Processing CreateTablet for tablet 05311105c0bc48bab5cd036c37ccef25 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:31:07.658293 19775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05311105c0bc48bab5cd036c37ccef25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.658613 19921 tablet_service.cc:1511] Processing CreateTablet for tablet 90f9b3b3645a4a8ca2406580f1775ed3 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:31:07.659879 19921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90f9b3b3645a4a8ca2406580f1775ed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.679054 19925 tablet_service.cc:1511] Processing CreateTablet for tablet 05311105c0bc48bab5cd036c37ccef25 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:31:07.680488 19925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05311105c0bc48bab5cd036c37ccef25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.681672 19850 tablet_service.cc:1511] Processing CreateTablet for tablet 05311105c0bc48bab5cd036c37ccef25 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:31:07.683280 19850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05311105c0bc48bab5cd036c37ccef25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.682879 19776 tablet_service.cc:1511] Processing CreateTablet for tablet 6c15b658c218435e81ff92455aa619db (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:31:07.684473 19776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c15b658c218435e81ff92455aa619db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.687506 20075 tablet_bootstrap.cc:492] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4: Bootstrap starting.
I20260709 12:31:07.691466 20074 tablet_bootstrap.cc:492] T 24bbaeea725746cbbe1519c39ebeca50 P d44fdddd21fe44c09069dd1e3f98b8a9: Bootstrap starting.
I20260709 12:31:07.696874 20073 tablet_bootstrap.cc:654] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:07.707762 19921 tablet_service.cc:1511] Processing CreateTablet for tablet 6c15b658c218435e81ff92455aa619db (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:31:07.709265 19921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c15b658c218435e81ff92455aa619db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.710974 20074 tablet_bootstrap.cc:654] T 24bbaeea725746cbbe1519c39ebeca50 P d44fdddd21fe44c09069dd1e3f98b8a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:07.716878 19776 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff8ef1253964c75aab3da58f7e9a417 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:31:07.708240 20073 tablet_bootstrap.cc:492] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348: No bootstrap required, opened a new log
I20260709 12:31:07.718194 19776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff8ef1253964c75aab3da58f7e9a417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.718263 20073 ts_tablet_manager.cc:1403] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348: Time spent bootstrapping tablet: real 0.075s	user 0.005s	sys 0.011s
I20260709 12:31:07.724833 19847 tablet_service.cc:1511] Processing CreateTablet for tablet 6c15b658c218435e81ff92455aa619db (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:31:07.727847 20074 tablet_bootstrap.cc:492] T 24bbaeea725746cbbe1519c39ebeca50 P d44fdddd21fe44c09069dd1e3f98b8a9: No bootstrap required, opened a new log
I20260709 12:31:07.728502 20074 ts_tablet_manager.cc:1403] T 24bbaeea725746cbbe1519c39ebeca50 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.003s
I20260709 12:31:07.731156 20075 tablet_bootstrap.cc:654] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:07.731808 20074 raft_consensus.cc:359] T 24bbaeea725746cbbe1519c39ebeca50 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.732990 20074 raft_consensus.cc:385] T 24bbaeea725746cbbe1519c39ebeca50 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:07.733374 20074 raft_consensus.cc:740] T 24bbaeea725746cbbe1519c39ebeca50 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Initialized, Role: FOLLOWER
I20260709 12:31:07.734342 20074 consensus_queue.cc:260] T 24bbaeea725746cbbe1519c39ebeca50 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.738560 19924 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff8ef1253964c75aab3da58f7e9a417 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:31:07.739856 19924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff8ef1253964c75aab3da58f7e9a417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.739535 19850 tablet_service.cc:1511] Processing CreateTablet for tablet 0ff8ef1253964c75aab3da58f7e9a417 (DEFAULT_TABLE table=soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:31:07.742940 19847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c15b658c218435e81ff92455aa619db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.743345 20074 ts_tablet_manager.cc:1434] T 24bbaeea725746cbbe1519c39ebeca50 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 12:31:07.744513 20074 tablet_bootstrap.cc:492] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9: Bootstrap starting.
I20260709 12:31:07.746631 19850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ff8ef1253964c75aab3da58f7e9a417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:31:07.750459 20073 raft_consensus.cc:359] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.751260 20073 raft_consensus.cc:385] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:07.751463 20074 tablet_bootstrap.cc:654] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:07.751552 20073 raft_consensus.cc:740] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Initialized, Role: FOLLOWER
W20260709 12:31:07.757449 19732 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:31:07.758392 20075 tablet_bootstrap.cc:492] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4: No bootstrap required, opened a new log
I20260709 12:31:07.758311 20073 consensus_queue.cc:260] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.762557 20073 ts_tablet_manager.cc:1434] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.004s
I20260709 12:31:07.763633 20073 tablet_bootstrap.cc:492] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348: Bootstrap starting.
I20260709 12:31:07.759037 20075 ts_tablet_manager.cc:1403] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.006s
I20260709 12:31:07.766796 20075 raft_consensus.cc:359] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.767534 20075 raft_consensus.cc:385] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:07.770372 20075 raft_consensus.cc:740] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Initialized, Role: FOLLOWER
I20260709 12:31:07.771216 20075 consensus_queue.cc:260] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.773908 20075 ts_tablet_manager.cc:1434] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 12:31:07.774690 20074 tablet_bootstrap.cc:492] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9: No bootstrap required, opened a new log
I20260709 12:31:07.774916 20075 tablet_bootstrap.cc:492] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4: Bootstrap starting.
I20260709 12:31:07.775290 20074 ts_tablet_manager.cc:1403] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.004s
I20260709 12:31:07.778453 20074 raft_consensus.cc:359] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.779157 20074 raft_consensus.cc:385] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:07.779500 20074 raft_consensus.cc:740] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Initialized, Role: FOLLOWER
I20260709 12:31:07.780256 20074 consensus_queue.cc:260] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.782603 20074 ts_tablet_manager.cc:1434] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:31:07.783582 20074 tablet_bootstrap.cc:492] T 3d0b5a815b844529bc04dbfd6b4881a1 P d44fdddd21fe44c09069dd1e3f98b8a9: Bootstrap starting.
I20260709 12:31:07.790184 20074 tablet_bootstrap.cc:654] T 3d0b5a815b844529bc04dbfd6b4881a1 P d44fdddd21fe44c09069dd1e3f98b8a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:07.794296 20075 tablet_bootstrap.cc:654] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:07.795331 20073 tablet_bootstrap.cc:654] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:07.797340 20074 tablet_bootstrap.cc:492] T 3d0b5a815b844529bc04dbfd6b4881a1 P d44fdddd21fe44c09069dd1e3f98b8a9: No bootstrap required, opened a new log
I20260709 12:31:07.797916 20074 ts_tablet_manager.cc:1403] T 3d0b5a815b844529bc04dbfd6b4881a1 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.001s
I20260709 12:31:07.800251 20075 tablet_bootstrap.cc:492] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4: No bootstrap required, opened a new log
I20260709 12:31:07.800838 20075 ts_tablet_manager.cc:1403] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.001s
I20260709 12:31:07.800998 20074 raft_consensus.cc:359] T 3d0b5a815b844529bc04dbfd6b4881a1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.801800 20074 raft_consensus.cc:385] T 3d0b5a815b844529bc04dbfd6b4881a1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:07.801903 20073 tablet_bootstrap.cc:492] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348: No bootstrap required, opened a new log
I20260709 12:31:07.802173 20074 raft_consensus.cc:740] T 3d0b5a815b844529bc04dbfd6b4881a1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Initialized, Role: FOLLOWER
I20260709 12:31:07.802584 20073 ts_tablet_manager.cc:1403] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.003s
I20260709 12:31:07.803053 20074 consensus_queue.cc:260] T 3d0b5a815b844529bc04dbfd6b4881a1 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.804046 20075 raft_consensus.cc:359] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.804872 20075 raft_consensus.cc:385] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:07.805212 20075 raft_consensus.cc:740] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Initialized, Role: FOLLOWER
I20260709 12:31:07.805274 20074 ts_tablet_manager.cc:1434] T 3d0b5a815b844529bc04dbfd6b4881a1 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:31:07.806133 20075 consensus_queue.cc:260] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.807004 20074 tablet_bootstrap.cc:492] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9: Bootstrap starting.
I20260709 12:31:07.808647 20075 ts_tablet_manager.cc:1434] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:31:07.809645 20075 tablet_bootstrap.cc:492] T 5df454fac23d4cf6a9c10ffa0ef263b4 P bc9e314a6d804f6a895a924cc11d3ec4: Bootstrap starting.
I20260709 12:31:07.806082 20073 raft_consensus.cc:359] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.813113 20073 raft_consensus.cc:385] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:07.813529 20073 raft_consensus.cc:740] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Initialized, Role: FOLLOWER
I20260709 12:31:07.814489 20073 consensus_queue.cc:260] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.812799 20074 tablet_bootstrap.cc:654] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:07.816449 20075 tablet_bootstrap.cc:654] T 5df454fac23d4cf6a9c10ffa0ef263b4 P bc9e314a6d804f6a895a924cc11d3ec4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:07.817627 20055 raft_consensus.cc:493] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:07.818365 20055 raft_consensus.cc:515] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.821758 20055 leader_election.cc:290] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:07.824965 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df454fac23d4cf6a9c10ffa0ef263b4" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348" is_pre_election: true
I20260709 12:31:07.826002 19786 raft_consensus.cc:2468] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 0.
I20260709 12:31:07.828055 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df454fac23d4cf6a9c10ffa0ef263b4" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" is_pre_election: true
I20260709 12:31:07.828403 20075 tablet_bootstrap.cc:492] T 5df454fac23d4cf6a9c10ffa0ef263b4 P bc9e314a6d804f6a895a924cc11d3ec4: No bootstrap required, opened a new log
I20260709 12:31:07.828920 20075 ts_tablet_manager.cc:1403] T 5df454fac23d4cf6a9c10ffa0ef263b4 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
W20260709 12:31:07.831287 19827 leader_election.cc:343] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:07.831964 20075 raft_consensus.cc:359] T 5df454fac23d4cf6a9c10ffa0ef263b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.832837 20075 raft_consensus.cc:385] T 5df454fac23d4cf6a9c10ffa0ef263b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:07.833194 20075 raft_consensus.cc:740] T 5df454fac23d4cf6a9c10ffa0ef263b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Initialized, Role: FOLLOWER
I20260709 12:31:07.833510 19825 leader_election.cc:304] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: bc9e314a6d804f6a895a924cc11d3ec4
I20260709 12:31:07.836478 20055 raft_consensus.cc:2804] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:07.837146 20055 raft_consensus.cc:493] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:07.839249 20055 raft_consensus.cc:3060] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:07.834558 20075 consensus_queue.cc:260] T 5df454fac23d4cf6a9c10ffa0ef263b4 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.841627 20075 ts_tablet_manager.cc:1434] T 5df454fac23d4cf6a9c10ffa0ef263b4 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:31:07.843319 20075 tablet_bootstrap.cc:492] T 4f7bc6b062e34c94a171a37dbec21045 P bc9e314a6d804f6a895a924cc11d3ec4: Bootstrap starting.
I20260709 12:31:07.850442 20073 ts_tablet_manager.cc:1434] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348: Time spent starting tablet: real 0.047s	user 0.003s	sys 0.005s
I20260709 12:31:07.860117 20075 tablet_bootstrap.cc:654] T 4f7bc6b062e34c94a171a37dbec21045 P bc9e314a6d804f6a895a924cc11d3ec4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:07.862474 20073 tablet_bootstrap.cc:492] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348: Bootstrap starting.
I20260709 12:31:07.872260 20055 raft_consensus.cc:515] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.873183 20073 tablet_bootstrap.cc:654] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:07.873998 20074 tablet_bootstrap.cc:492] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9: No bootstrap required, opened a new log
I20260709 12:31:07.874591 20074 ts_tablet_manager.cc:1403] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent bootstrapping tablet: real 0.068s	user 0.026s	sys 0.039s
I20260709 12:31:07.875459 20075 tablet_bootstrap.cc:492] T 4f7bc6b062e34c94a171a37dbec21045 P bc9e314a6d804f6a895a924cc11d3ec4: No bootstrap required, opened a new log
I20260709 12:31:07.875623 19785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df454fac23d4cf6a9c10ffa0ef263b4" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:07.876039 20075 ts_tablet_manager.cc:1403] T 4f7bc6b062e34c94a171a37dbec21045 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.004s
I20260709 12:31:07.876341 19785 raft_consensus.cc:3060] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:07.877781 20074 raft_consensus.cc:359] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.878593 20074 raft_consensus.cc:385] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:07.878929 20074 raft_consensus.cc:740] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Initialized, Role: FOLLOWER
I20260709 12:31:07.879488 20075 raft_consensus.cc:359] T 4f7bc6b062e34c94a171a37dbec21045 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.879706 20060 raft_consensus.cc:493] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:07.880285 20075 raft_consensus.cc:385] T 4f7bc6b062e34c94a171a37dbec21045 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:07.880771 20075 raft_consensus.cc:740] T 4f7bc6b062e34c94a171a37dbec21045 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Initialized, Role: FOLLOWER
I20260709 12:31:07.880559 20060 raft_consensus.cc:515] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.881739 20075 consensus_queue.cc:260] T 4f7bc6b062e34c94a171a37dbec21045 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.884357 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b5a815b844529bc04dbfd6b4881a1" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348" is_pre_election: true
I20260709 12:31:07.885138 20073 tablet_bootstrap.cc:492] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348: No bootstrap required, opened a new log
I20260709 12:31:07.885659 20073 ts_tablet_manager.cc:1403] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.008s
I20260709 12:31:07.879804 20074 consensus_queue.cc:260] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.885041 19786 raft_consensus.cc:2468] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 0.
I20260709 12:31:07.890703 19899 leader_election.cc:304] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:07.891088 20060 leader_election.cc:290] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:07.891911 20060 raft_consensus.cc:2804] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:07.892246 20060 raft_consensus.cc:493] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:07.892539 20060 raft_consensus.cc:3060] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:07.893324 20074 ts_tablet_manager.cc:1434] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 12:31:07.894766 20074 tablet_bootstrap.cc:492] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9: Bootstrap starting.
I20260709 12:31:07.898842 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b5a815b844529bc04dbfd6b4881a1" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" is_pre_election: true
I20260709 12:31:07.889006 20073 raft_consensus.cc:359] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.899436 20073 raft_consensus.cc:385] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:07.900507 20073 raft_consensus.cc:740] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Initialized, Role: FOLLOWER
I20260709 12:31:07.901481 20073 consensus_queue.cc:260] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.902186 19785 raft_consensus.cc:2468] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 1.
I20260709 12:31:07.903905 19825 leader_election.cc:304] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:07.904910 20085 raft_consensus.cc:2804] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:07.905402 20085 raft_consensus.cc:697] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Becoming Leader. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Running, Role: LEADER
I20260709 12:31:07.905710 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df454fac23d4cf6a9c10ffa0ef263b4" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:07.906697 19933 raft_consensus.cc:3060] T 5df454fac23d4cf6a9c10ffa0ef263b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:07.906293 20085 consensus_queue.cc:237] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.911149 20073 ts_tablet_manager.cc:1434] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:31:07.899533 19861 raft_consensus.cc:2468] T 3d0b5a815b844529bc04dbfd6b4881a1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 0.
I20260709 12:31:07.915194 20073 tablet_bootstrap.cc:492] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348: Bootstrap starting.
I20260709 12:31:07.916297 20055 leader_election.cc:290] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:07.913305 20060 raft_consensus.cc:515] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.919656 19933 raft_consensus.cc:2468] T 5df454fac23d4cf6a9c10ffa0ef263b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 1.
I20260709 12:31:07.923748 20060 leader_election.cc:290] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:07.925014 20060 raft_consensus.cc:493] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:07.925173 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b5a815b844529bc04dbfd6b4881a1" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:07.926573 20060 raft_consensus.cc:515] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.929759 20060 leader_election.cc:290] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:07.927213 19861 raft_consensus.cc:3060] T 3d0b5a815b844529bc04dbfd6b4881a1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:07.927332 20074 tablet_bootstrap.cc:654] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:07.933748 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bbaeea725746cbbe1519c39ebeca50" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" is_pre_election: true
I20260709 12:31:07.934743 19860 raft_consensus.cc:2468] T 24bbaeea725746cbbe1519c39ebeca50 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 0.
I20260709 12:31:07.940070 19898 leader_election.cc:304] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, d44fdddd21fe44c09069dd1e3f98b8a9; no voters: 
I20260709 12:31:07.941372 20060 raft_consensus.cc:2804] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:07.941977 20060 raft_consensus.cc:493] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:07.942538 20060 raft_consensus.cc:3060] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:07.944566 20075 ts_tablet_manager.cc:1434] T 4f7bc6b062e34c94a171a37dbec21045 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent starting tablet: real 0.068s	user 0.032s	sys 0.019s
I20260709 12:31:07.945749 20075 tablet_bootstrap.cc:492] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4: Bootstrap starting.
I20260709 12:31:07.953523 20073 tablet_bootstrap.cc:654] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:07.961145 20060 raft_consensus.cc:515] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.964978 20075 tablet_bootstrap.cc:654] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:07.968436 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bbaeea725746cbbe1519c39ebeca50" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:07.968971 19861 raft_consensus.cc:2468] T 3d0b5a815b844529bc04dbfd6b4881a1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 1.
I20260709 12:31:07.969348 19860 raft_consensus.cc:3060] T 24bbaeea725746cbbe1519c39ebeca50 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:07.970635 19898 leader_election.cc:304] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, d44fdddd21fe44c09069dd1e3f98b8a9; no voters: 
I20260709 12:31:07.974031 20090 raft_consensus.cc:2804] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:07.974767 20090 raft_consensus.cc:697] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Becoming Leader. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Running, Role: LEADER
I20260709 12:31:07.975983 20090 consensus_queue.cc:237] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:07.977264 19860 raft_consensus.cc:2468] T 24bbaeea725746cbbe1519c39ebeca50 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 1.
W20260709 12:31:07.978621 19899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.65:36403, user_credentials={real_user=slave}} blocked reactor thread for 88115.1us
I20260709 12:31:07.979882 19898 leader_election.cc:304] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, d44fdddd21fe44c09069dd1e3f98b8a9; no voters: 
I20260709 12:31:07.981158 19785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b5a815b844529bc04dbfd6b4881a1" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:07.982764 20089 raft_consensus.cc:2804] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:07.982105 19785 raft_consensus.cc:3060] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:07.989727 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bbaeea725746cbbe1519c39ebeca50" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348" is_pre_election: true
I20260709 12:31:07.992475 20074 tablet_bootstrap.cc:492] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9: No bootstrap required, opened a new log
I20260709 12:31:07.993001 20074 ts_tablet_manager.cc:1403] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent bootstrapping tablet: real 0.099s	user 0.021s	sys 0.009s
I20260709 12:31:07.993310 19681 catalog_manager.cc:5697] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
W20260709 12:31:07.995257 19899 leader_election.cc:343] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:07.995651 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bbaeea725746cbbe1519c39ebeca50" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
W20260709 12:31:07.997364 19899 leader_election.cc:343] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:07.999214 20060 leader_election.cc:290] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:08.005122 20074 raft_consensus.cc:359] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.007930 20089 raft_consensus.cc:697] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Becoming Leader. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Running, Role: LEADER
I20260709 12:31:08.008934 20089 consensus_queue.cc:237] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.010425 19785 raft_consensus.cc:2468] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 1.
I20260709 12:31:08.011233 20074 raft_consensus.cc:385] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:08.011559 20074 raft_consensus.cc:740] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Initialized, Role: FOLLOWER
I20260709 12:31:08.012367 20074 consensus_queue.cc:260] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.019002 20073 tablet_bootstrap.cc:492] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348: No bootstrap required, opened a new log
I20260709 12:31:08.019121 20074 ts_tablet_manager.cc:1434] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 12:31:08.019644 20073 ts_tablet_manager.cc:1403] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348: Time spent bootstrapping tablet: real 0.105s	user 0.027s	sys 0.007s
I20260709 12:31:08.020291 20074 tablet_bootstrap.cc:492] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9: Bootstrap starting.
I20260709 12:31:08.019761 19681 catalog_manager.cc:5697] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:08.022805 20073 raft_consensus.cc:359] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.023648 20073 raft_consensus.cc:385] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:08.023983 20073 raft_consensus.cc:740] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Initialized, Role: FOLLOWER
I20260709 12:31:08.024827 20073 consensus_queue.cc:260] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.027505 20073 ts_tablet_manager.cc:1434] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:31:08.028506 20073 tablet_bootstrap.cc:492] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348: Bootstrap starting.
I20260709 12:31:08.028923 20074 tablet_bootstrap.cc:654] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:08.034540 20073 tablet_bootstrap.cc:654] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:08.038874 20075 tablet_bootstrap.cc:492] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4: No bootstrap required, opened a new log
I20260709 12:31:08.050055 20075 ts_tablet_manager.cc:1403] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent bootstrapping tablet: real 0.105s	user 0.011s	sys 0.006s
I20260709 12:31:08.054478 20075 raft_consensus.cc:359] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.055538 20075 raft_consensus.cc:385] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:08.055917 20075 raft_consensus.cc:740] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Initialized, Role: FOLLOWER
I20260709 12:31:08.056869 20075 consensus_queue.cc:260] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.060379 20075 ts_tablet_manager.cc:1434] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:31:08.061790 20075 tablet_bootstrap.cc:492] T d29f26ef85584432b3f88fa1b72595b1 P bc9e314a6d804f6a895a924cc11d3ec4: Bootstrap starting.
I20260709 12:31:08.062501 19682 catalog_manager.cc:5697] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:08.070863 20075 tablet_bootstrap.cc:654] T d29f26ef85584432b3f88fa1b72595b1 P bc9e314a6d804f6a895a924cc11d3ec4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:08.072299 20074 tablet_bootstrap.cc:492] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9: No bootstrap required, opened a new log
I20260709 12:31:08.073582 20074 ts_tablet_manager.cc:1403] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent bootstrapping tablet: real 0.053s	user 0.021s	sys 0.027s
I20260709 12:31:08.075127 20073 tablet_bootstrap.cc:492] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348: No bootstrap required, opened a new log
I20260709 12:31:08.075904 20073 ts_tablet_manager.cc:1403] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.023s
I20260709 12:31:08.076661 20074 raft_consensus.cc:359] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.077400 20074 raft_consensus.cc:385] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:08.077704 20074 raft_consensus.cc:740] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Initialized, Role: FOLLOWER
I20260709 12:31:08.078478 20074 consensus_queue.cc:260] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.079869 20073 raft_consensus.cc:359] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.080610 20073 raft_consensus.cc:385] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:08.080924 20074 ts_tablet_manager.cc:1434] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:31:08.080943 20073 raft_consensus.cc:740] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Initialized, Role: FOLLOWER
I20260709 12:31:08.082039 20074 tablet_bootstrap.cc:492] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9: Bootstrap starting.
I20260709 12:31:08.082331 20073 consensus_queue.cc:260] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.088253 20075 tablet_bootstrap.cc:492] T d29f26ef85584432b3f88fa1b72595b1 P bc9e314a6d804f6a895a924cc11d3ec4: No bootstrap required, opened a new log
I20260709 12:31:08.088833 20075 ts_tablet_manager.cc:1403] T d29f26ef85584432b3f88fa1b72595b1 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.004s
I20260709 12:31:08.089110 20074 tablet_bootstrap.cc:654] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:08.091959 20075 raft_consensus.cc:359] T d29f26ef85584432b3f88fa1b72595b1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.093026 20075 raft_consensus.cc:385] T d29f26ef85584432b3f88fa1b72595b1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:08.093331 20075 raft_consensus.cc:740] T d29f26ef85584432b3f88fa1b72595b1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Initialized, Role: FOLLOWER
I20260709 12:31:08.093739 20073 ts_tablet_manager.cc:1434] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:31:08.094101 20075 consensus_queue.cc:260] T d29f26ef85584432b3f88fa1b72595b1 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.095175 20074 tablet_bootstrap.cc:492] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9: No bootstrap required, opened a new log
I20260709 12:31:08.097935 20074 ts_tablet_manager.cc:1403] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:31:08.096778 20075 ts_tablet_manager.cc:1434] T d29f26ef85584432b3f88fa1b72595b1 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:31:08.097424 20073 tablet_bootstrap.cc:492] T 90f9b3b3645a4a8ca2406580f1775ed3 P f7d3855f4244492987f0d3cd83c4a348: Bootstrap starting.
I20260709 12:31:08.101092 20075 tablet_bootstrap.cc:492] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4: Bootstrap starting.
I20260709 12:31:08.100984 20074 raft_consensus.cc:359] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.101831 20074 raft_consensus.cc:385] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:08.102169 20074 raft_consensus.cc:740] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Initialized, Role: FOLLOWER
I20260709 12:31:08.103012 20074 consensus_queue.cc:260] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.105274 20074 ts_tablet_manager.cc:1434] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:31:08.106268 20074 tablet_bootstrap.cc:492] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9: Bootstrap starting.
I20260709 12:31:08.108630 20075 tablet_bootstrap.cc:654] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:08.112414 20074 tablet_bootstrap.cc:654] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:08.119390 20085 raft_consensus.cc:493] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:08.120391 20075 tablet_bootstrap.cc:492] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4: No bootstrap required, opened a new log
I20260709 12:31:08.120113 20085 raft_consensus.cc:515] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.120949 20075 ts_tablet_manager.cc:1403] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:31:08.124151 20075 raft_consensus.cc:359] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.124868 20075 raft_consensus.cc:385] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:08.125161 20075 raft_consensus.cc:740] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Initialized, Role: FOLLOWER
I20260709 12:31:08.125905 20075 consensus_queue.cc:260] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.128149 19785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7bc6b062e34c94a171a37dbec21045" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348" is_pre_election: true
I20260709 12:31:08.128587 20085 leader_election.cc:290] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:08.128839 19785 raft_consensus.cc:2468] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 0.
I20260709 12:31:08.129604 20075 ts_tablet_manager.cc:1434] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:31:08.130717 20075 tablet_bootstrap.cc:492] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4: Bootstrap starting.
I20260709 12:31:08.131381 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7bc6b062e34c94a171a37dbec21045" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" is_pre_election: true
I20260709 12:31:08.132094 19933 raft_consensus.cc:2468] T 4f7bc6b062e34c94a171a37dbec21045 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 0.
I20260709 12:31:08.133008 20074 tablet_bootstrap.cc:492] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9: No bootstrap required, opened a new log
I20260709 12:31:08.130551 19825 leader_election.cc:304] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:08.133641 20074 ts_tablet_manager.cc:1403] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.012s
I20260709 12:31:08.133886 20055 raft_consensus.cc:2804] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:08.130577 20073 tablet_bootstrap.cc:654] T 90f9b3b3645a4a8ca2406580f1775ed3 P f7d3855f4244492987f0d3cd83c4a348: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:08.136860 20055 raft_consensus.cc:493] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:08.137312 20074 raft_consensus.cc:359] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.138039 20074 raft_consensus.cc:385] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:08.138398 20074 raft_consensus.cc:740] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Initialized, Role: FOLLOWER
I20260709 12:31:08.137332 20055 raft_consensus.cc:3060] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:08.139369 20074 consensus_queue.cc:260] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.143365 20073 tablet_bootstrap.cc:492] T 90f9b3b3645a4a8ca2406580f1775ed3 P f7d3855f4244492987f0d3cd83c4a348: No bootstrap required, opened a new log
I20260709 12:31:08.143615 20074 ts_tablet_manager.cc:1434] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 12:31:08.143913 20073 ts_tablet_manager.cc:1403] T 90f9b3b3645a4a8ca2406580f1775ed3 P f7d3855f4244492987f0d3cd83c4a348: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.004s
I20260709 12:31:08.144790 20074 tablet_bootstrap.cc:492] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9: Bootstrap starting.
I20260709 12:31:08.138417 20075 tablet_bootstrap.cc:654] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:08.146503 20055 raft_consensus.cc:515] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.147075 20073 raft_consensus.cc:359] T 90f9b3b3645a4a8ca2406580f1775ed3 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.147858 20073 raft_consensus.cc:385] T 90f9b3b3645a4a8ca2406580f1775ed3 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:08.148141 20073 raft_consensus.cc:740] T 90f9b3b3645a4a8ca2406580f1775ed3 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Initialized, Role: FOLLOWER
I20260709 12:31:08.149042 20073 consensus_queue.cc:260] T 90f9b3b3645a4a8ca2406580f1775ed3 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.149459 19785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7bc6b062e34c94a171a37dbec21045" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:08.150079 19785 raft_consensus.cc:3060] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:08.157320 20074 tablet_bootstrap.cc:654] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:08.158394 20073 ts_tablet_manager.cc:1434] T 90f9b3b3645a4a8ca2406580f1775ed3 P f7d3855f4244492987f0d3cd83c4a348: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 12:31:08.159795 20073 tablet_bootstrap.cc:492] T 6c15b658c218435e81ff92455aa619db P f7d3855f4244492987f0d3cd83c4a348: Bootstrap starting.
I20260709 12:31:08.168550 20073 tablet_bootstrap.cc:654] T 6c15b658c218435e81ff92455aa619db P f7d3855f4244492987f0d3cd83c4a348: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:08.176425 19785 raft_consensus.cc:2468] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 1.
I20260709 12:31:08.178866 20055 leader_election.cc:290] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:08.179137 19825 leader_election.cc:304] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:08.180877 20055 raft_consensus.cc:2804] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:08.183063 20055 raft_consensus.cc:697] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Becoming Leader. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Running, Role: LEADER
I20260709 12:31:08.182935 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7bc6b062e34c94a171a37dbec21045" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:08.183698 19933 raft_consensus.cc:3060] T 4f7bc6b062e34c94a171a37dbec21045 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:08.183995 20055 consensus_queue.cc:237] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.184645 20073 tablet_bootstrap.cc:492] T 6c15b658c218435e81ff92455aa619db P f7d3855f4244492987f0d3cd83c4a348: No bootstrap required, opened a new log
I20260709 12:31:08.185086 20073 ts_tablet_manager.cc:1403] T 6c15b658c218435e81ff92455aa619db P f7d3855f4244492987f0d3cd83c4a348: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.001s
I20260709 12:31:08.186203 20074 tablet_bootstrap.cc:492] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9: No bootstrap required, opened a new log
I20260709 12:31:08.186775 20074 ts_tablet_manager.cc:1403] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.010s
I20260709 12:31:08.187942 20073 raft_consensus.cc:359] T 6c15b658c218435e81ff92455aa619db P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.188673 20073 raft_consensus.cc:385] T 6c15b658c218435e81ff92455aa619db P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:08.188956 20073 raft_consensus.cc:740] T 6c15b658c218435e81ff92455aa619db P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Initialized, Role: FOLLOWER
I20260709 12:31:08.189771 20074 raft_consensus.cc:359] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.189685 20073 consensus_queue.cc:260] T 6c15b658c218435e81ff92455aa619db P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.190541 20074 raft_consensus.cc:385] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:08.190858 20074 raft_consensus.cc:740] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Initialized, Role: FOLLOWER
I20260709 12:31:08.191597 20089 raft_consensus.cc:493] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:08.192078 20089 raft_consensus.cc:515] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.192579 20073 ts_tablet_manager.cc:1434] T 6c15b658c218435e81ff92455aa619db P f7d3855f4244492987f0d3cd83c4a348: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:31:08.192744 19933 raft_consensus.cc:2468] T 4f7bc6b062e34c94a171a37dbec21045 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 1.
I20260709 12:31:08.193622 20073 tablet_bootstrap.cc:492] T 05311105c0bc48bab5cd036c37ccef25 P f7d3855f4244492987f0d3cd83c4a348: Bootstrap starting.
I20260709 12:31:08.194211 20089 leader_election.cc:290] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:08.194995 19785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c15b658c218435e81ff92455aa619db" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348" is_pre_election: true
I20260709 12:31:08.195632 19785 raft_consensus.cc:2468] T 6c15b658c218435e81ff92455aa619db P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 0.
I20260709 12:31:08.195894 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c15b658c218435e81ff92455aa619db" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" is_pre_election: true
I20260709 12:31:08.196498 19861 raft_consensus.cc:2468] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 0.
I20260709 12:31:08.197434 19899 leader_election.cc:304] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:08.198235 20089 raft_consensus.cc:2804] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:08.198927 20089 raft_consensus.cc:493] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:08.199335 20089 raft_consensus.cc:3060] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:08.200665 20073 tablet_bootstrap.cc:654] T 05311105c0bc48bab5cd036c37ccef25 P f7d3855f4244492987f0d3cd83c4a348: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:08.204385 20061 raft_consensus.cc:493] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:08.205168 20061 raft_consensus.cc:515] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.207476 20061 leader_election.cc:290] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:08.207765 20073 tablet_bootstrap.cc:492] T 05311105c0bc48bab5cd036c37ccef25 P f7d3855f4244492987f0d3cd83c4a348: No bootstrap required, opened a new log
I20260709 12:31:08.208249 20073 ts_tablet_manager.cc:1403] T 05311105c0bc48bab5cd036c37ccef25 P f7d3855f4244492987f0d3cd83c4a348: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:31:08.208230 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bbaeea725746cbbe1519c39ebeca50" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" is_pre_election: true
I20260709 12:31:08.208488 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bbaeea725746cbbe1519c39ebeca50" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" is_pre_election: true
I20260709 12:31:08.209003 19861 raft_consensus.cc:2393] T 24bbaeea725746cbbe1519c39ebeca50 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f7d3855f4244492987f0d3cd83c4a348 in current term 1: Already voted for candidate bc9e314a6d804f6a895a924cc11d3ec4 in this term.
I20260709 12:31:08.210377 19682 catalog_manager.cc:5697] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66). New cstate: current_term: 1 leader_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:08.213587 19749 leader_election.cc:304] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f7d3855f4244492987f0d3cd83c4a348; no voters: bc9e314a6d804f6a895a924cc11d3ec4, d44fdddd21fe44c09069dd1e3f98b8a9
I20260709 12:31:08.214615 20061 raft_consensus.cc:3060] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:08.217427 20073 raft_consensus.cc:359] T 05311105c0bc48bab5cd036c37ccef25 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.218154 20073 raft_consensus.cc:385] T 05311105c0bc48bab5cd036c37ccef25 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:08.218452 20073 raft_consensus.cc:740] T 05311105c0bc48bab5cd036c37ccef25 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Initialized, Role: FOLLOWER
I20260709 12:31:08.219223 20073 consensus_queue.cc:260] T 05311105c0bc48bab5cd036c37ccef25 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.221247 20073 ts_tablet_manager.cc:1434] T 05311105c0bc48bab5cd036c37ccef25 P f7d3855f4244492987f0d3cd83c4a348: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:31:08.221580 20074 consensus_queue.cc:260] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.224145 20075 tablet_bootstrap.cc:492] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4: No bootstrap required, opened a new log
I20260709 12:31:08.224658 20075 ts_tablet_manager.cc:1403] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent bootstrapping tablet: real 0.094s	user 0.007s	sys 0.030s
I20260709 12:31:08.226492 20074 ts_tablet_manager.cc:1434] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:31:08.227384 20075 raft_consensus.cc:359] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.228045 20075 raft_consensus.cc:385] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:08.228309 20075 raft_consensus.cc:740] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Initialized, Role: FOLLOWER
I20260709 12:31:08.228969 20075 consensus_queue.cc:260] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.231356 20075 ts_tablet_manager.cc:1434] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:31:08.231045 20089 raft_consensus.cc:515] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.232306 20075 tablet_bootstrap.cc:492] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4: Bootstrap starting.
I20260709 12:31:08.233738 20061 raft_consensus.cc:2749] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:08.222141 20073 tablet_bootstrap.cc:492] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348: Bootstrap starting.
I20260709 12:31:08.234021 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c15b658c218435e81ff92455aa619db" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:08.234331 19785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c15b658c218435e81ff92455aa619db" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:08.234670 19861 raft_consensus.cc:3060] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:08.234860 19785 raft_consensus.cc:3060] T 6c15b658c218435e81ff92455aa619db P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:08.234704 20089 leader_election.cc:290] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:08.240015 20073 tablet_bootstrap.cc:654] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:08.240105 20075 tablet_bootstrap.cc:654] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4: Neither blocks nor log segments found. Creating new log.
I20260709 12:31:08.241348 20055 raft_consensus.cc:493] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:08.241883 20055 raft_consensus.cc:515] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.243995 20055 leader_election.cc:290] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:08.245592 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8ef1253964c75aab3da58f7e9a417" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" is_pre_election: true
W20260709 12:31:08.247130 19827 leader_election.cc:343] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:08.250602 19861 raft_consensus.cc:2468] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 1.
I20260709 12:31:08.251873 19898 leader_election.cc:304] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, d44fdddd21fe44c09069dd1e3f98b8a9; no voters: 
I20260709 12:31:08.252616 20089 raft_consensus.cc:2804] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:08.253037 20089 raft_consensus.cc:697] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Becoming Leader. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Running, Role: LEADER
I20260709 12:31:08.253724 20089 consensus_queue.cc:237] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.256422 20090 raft_consensus.cc:493] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:08.257022 20090 raft_consensus.cc:515] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.259234 20090 leader_election.cc:290] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:08.260726 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f9b3b3645a4a8ca2406580f1775ed3" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348" is_pre_election: true
I20260709 12:31:08.261381 19786 raft_consensus.cc:2468] T 90f9b3b3645a4a8ca2406580f1775ed3 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 0.
I20260709 12:31:08.262622 19899 leader_election.cc:304] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:08.263540 20093 raft_consensus.cc:493] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:08.264570 20090 raft_consensus.cc:2804] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:08.264293 20093 raft_consensus.cc:515] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.265033 20090 raft_consensus.cc:493] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:08.265547 20090 raft_consensus.cc:3060] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:08.263590 19785 raft_consensus.cc:2468] T 6c15b658c218435e81ff92455aa619db P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 1.
I20260709 12:31:08.267122 20093 leader_election.cc:290] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:08.267583 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05311105c0bc48bab5cd036c37ccef25" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348" is_pre_election: true
I20260709 12:31:08.268220 19786 raft_consensus.cc:2468] T 05311105c0bc48bab5cd036c37ccef25 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 0.
W20260709 12:31:08.268460 19749 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.111.66:41479, user_credentials={real_user=slave}} blocked reactor thread for 55077.1us
I20260709 12:31:08.270089 19899 leader_election.cc:304] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:08.270908 20093 raft_consensus.cc:2804] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:08.271385 20093 raft_consensus.cc:493] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:08.271801 20093 raft_consensus.cc:3060] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:08.274452 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f9b3b3645a4a8ca2406580f1775ed3" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" is_pre_election: true
I20260709 12:31:08.275725 20061 raft_consensus.cc:493] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:08.275777 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05311105c0bc48bab5cd036c37ccef25" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" is_pre_election: true
I20260709 12:31:08.276546 19860 raft_consensus.cc:2468] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 0.
I20260709 12:31:08.276355 20061 raft_consensus.cc:515] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.278708 20061 leader_election.cc:290] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:08.281100 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29f26ef85584432b3f88fa1b72595b1" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" is_pre_election: true
I20260709 12:31:08.281741 19935 raft_consensus.cc:2468] T d29f26ef85584432b3f88fa1b72595b1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 0.
I20260709 12:31:08.282774 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29f26ef85584432b3f88fa1b72595b1" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" is_pre_election: true
I20260709 12:31:08.282353 19682 catalog_manager.cc:5697] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:08.283605 19860 raft_consensus.cc:2468] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 0.
I20260709 12:31:08.284103 19752 leader_election.cc:304] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:08.280320 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8ef1253964c75aab3da58f7e9a417" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348" is_pre_election: true
I20260709 12:31:08.284933 20061 raft_consensus.cc:2804] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:08.285310 20061 raft_consensus.cc:493] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:08.285640 20061 raft_consensus.cc:3060] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:08.275415 19861 raft_consensus.cc:2468] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 0.
W20260709 12:31:08.292398 19825 leader_election.cc:343] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:31:08.292889 19825 leader_election.cc:304] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9; no voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348
I20260709 12:31:08.292925 20061 raft_consensus.cc:515] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.293805 20055 raft_consensus.cc:2749] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:31:08.295527 20061 leader_election.cc:290] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 election: Requested vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:08.296620 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29f26ef85584432b3f88fa1b72595b1" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:08.297179 19935 raft_consensus.cc:3060] T d29f26ef85584432b3f88fa1b72595b1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:08.297363 20093 raft_consensus.cc:515] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.299504 20093 leader_election.cc:290] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:08.300211 20073 tablet_bootstrap.cc:492] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348: No bootstrap required, opened a new log
I20260709 12:31:08.300385 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05311105c0bc48bab5cd036c37ccef25" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:08.300794 20073 ts_tablet_manager.cc:1403] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348: Time spent bootstrapping tablet: real 0.079s	user 0.020s	sys 0.010s
I20260709 12:31:08.301007 19786 raft_consensus.cc:3060] T 05311105c0bc48bab5cd036c37ccef25 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:08.303340 19935 raft_consensus.cc:2468] T d29f26ef85584432b3f88fa1b72595b1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 1.
I20260709 12:31:08.303649 20073 raft_consensus.cc:359] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.304344 20073 raft_consensus.cc:385] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:08.304288 19752 leader_election.cc:304] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:08.304889 20073 raft_consensus.cc:740] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Initialized, Role: FOLLOWER
I20260709 12:31:08.305334 20061 raft_consensus.cc:2804] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:08.305754 20073 consensus_queue.cc:260] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.306825 20075 tablet_bootstrap.cc:492] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4: No bootstrap required, opened a new log
I20260709 12:31:08.306557 20061 raft_consensus.cc:697] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Becoming Leader. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Running, Role: LEADER
I20260709 12:31:08.307541 20075 ts_tablet_manager.cc:1403] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.026s
I20260709 12:31:08.308109 20073 ts_tablet_manager.cc:1434] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:31:08.307941 20061 consensus_queue.cc:237] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.310222 20075 raft_consensus.cc:359] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.310842 20075 raft_consensus.cc:385] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:31:08.311076 20075 raft_consensus.cc:740] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Initialized, Role: FOLLOWER
I20260709 12:31:08.311189 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05311105c0bc48bab5cd036c37ccef25" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:08.311900 19860 raft_consensus.cc:3060] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:08.311789 20075 consensus_queue.cc:260] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.313942 20075 ts_tablet_manager.cc:1434] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 12:31:08.317646 19682 catalog_manager.cc:5697] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "f7d3855f4244492987f0d3cd83c4a348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:08.319445 19860 raft_consensus.cc:2468] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 1.
I20260709 12:31:08.320672 19898 leader_election.cc:304] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, d44fdddd21fe44c09069dd1e3f98b8a9; no voters: 
I20260709 12:31:08.321696 20089 raft_consensus.cc:2804] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:08.322165 20089 raft_consensus.cc:697] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Becoming Leader. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Running, Role: LEADER
I20260709 12:31:08.322903 20089 consensus_queue.cc:237] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.297099 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29f26ef85584432b3f88fa1b72595b1" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:08.326859 19861 raft_consensus.cc:3060] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:08.328631 20055 consensus_queue.cc:1048] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:08.338500 19786 raft_consensus.cc:2468] T 05311105c0bc48bab5cd036c37ccef25 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 1.
I20260709 12:31:08.339541 20090 raft_consensus.cc:515] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.342382 20090 leader_election.cc:290] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:08.343291 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f9b3b3645a4a8ca2406580f1775ed3" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:08.350576 19786 raft_consensus.cc:3060] T 90f9b3b3645a4a8ca2406580f1775ed3 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:08.343642 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f9b3b3645a4a8ca2406580f1775ed3" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:08.351531 19859 raft_consensus.cc:3060] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:08.355238 20086 consensus_queue.cc:1048] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:08.359987 19682 catalog_manager.cc:5697] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:08.365484 19859 raft_consensus.cc:2468] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 1.
I20260709 12:31:08.366750 19898 leader_election.cc:304] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, d44fdddd21fe44c09069dd1e3f98b8a9; no voters: 
I20260709 12:31:08.368022 20089 raft_consensus.cc:2804] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:08.378325 19861 raft_consensus.cc:2468] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 1.
I20260709 12:31:08.366726 19786 raft_consensus.cc:2468] T 90f9b3b3645a4a8ca2406580f1775ed3 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 1.
I20260709 12:31:08.379107 20089 raft_consensus.cc:697] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Becoming Leader. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Running, Role: LEADER
I20260709 12:31:08.384964 20089 consensus_queue.cc:237] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.391790 20061 raft_consensus.cc:493] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:31:08.392516 20061 raft_consensus.cc:515] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.394819 20061 leader_election.cc:290] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:08.395828 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8ef1253964c75aab3da58f7e9a417" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" is_pre_election: true
I20260709 12:31:08.396207 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8ef1253964c75aab3da58f7e9a417" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" is_pre_election: true
I20260709 12:31:08.396504 19935 raft_consensus.cc:2468] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 0.
I20260709 12:31:08.396827 19861 raft_consensus.cc:2468] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 0.
I20260709 12:31:08.397769 19749 leader_election.cc:304] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:08.398496 20061 raft_consensus.cc:2804] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:31:08.398988 20061 raft_consensus.cc:493] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:31:08.399326 20061 raft_consensus.cc:3060] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:08.399773 19682 catalog_manager.cc:5697] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67). New cstate: current_term: 1 leader_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:08.405895 20061 raft_consensus.cc:515] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.408331 20061 leader_election.cc:290] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 election: Requested vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:08.408568 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8ef1253964c75aab3da58f7e9a417" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:08.408897 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8ef1253964c75aab3da58f7e9a417" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:08.409226 19861 raft_consensus.cc:3060] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:08.409540 19935 raft_consensus.cc:3060] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:31:08.414618 19861 raft_consensus.cc:2468] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 1.
I20260709 12:31:08.415460 19935 raft_consensus.cc:2468] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 1.
I20260709 12:31:08.415583 19749 leader_election.cc:304] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:08.416352 20061 raft_consensus.cc:2804] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:31:08.416762 20061 raft_consensus.cc:697] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Becoming Leader. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Running, Role: LEADER
I20260709 12:31:08.417434 20061 consensus_queue.cc:237] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.424276 19683 catalog_manager.cc:5697] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 reported cstate change: term changed from 0 to 1, leader changed from <none> to f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65). New cstate: current_term: 1 leader_uuid: "f7d3855f4244492987f0d3cd83c4a348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:08.466938 19935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d0b5a815b844529bc04dbfd6b4881a1"
dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
mode: GRACEFUL
new_leader_uuid: "f7d3855f4244492987f0d3cd83c4a348"
 from {username='slave'} at 127.0.0.1:52350
I20260709 12:31:08.467507 19935 raft_consensus.cc:606] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Received request to transfer leadership to TS f7d3855f4244492987f0d3cd83c4a348
I20260709 12:31:08.472389 19861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5df454fac23d4cf6a9c10ffa0ef263b4"
dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
mode: GRACEFUL
new_leader_uuid: "f7d3855f4244492987f0d3cd83c4a348"
 from {username='slave'} at 127.0.0.1:58784
I20260709 12:31:08.472817 19861 raft_consensus.cc:606] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Received request to transfer leadership to TS f7d3855f4244492987f0d3cd83c4a348
I20260709 12:31:08.477236 19935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24bbaeea725746cbbe1519c39ebeca50"
dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
mode: GRACEFUL
new_leader_uuid: "f7d3855f4244492987f0d3cd83c4a348"
 from {username='slave'} at 127.0.0.1:52350
I20260709 12:31:08.477658 19935 raft_consensus.cc:606] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Received request to transfer leadership to TS f7d3855f4244492987f0d3cd83c4a348
I20260709 12:31:08.481907 19861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f7bc6b062e34c94a171a37dbec21045"
dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
mode: GRACEFUL
new_leader_uuid: "f7d3855f4244492987f0d3cd83c4a348"
 from {username='slave'} at 127.0.0.1:58784
I20260709 12:31:08.482379 19861 raft_consensus.cc:606] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Received request to transfer leadership to TS f7d3855f4244492987f0d3cd83c4a348
I20260709 12:31:08.486683 19785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d29f26ef85584432b3f88fa1b72595b1"
dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
mode: GRACEFUL
new_leader_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
 from {username='slave'} at 127.0.0.1:35046
I20260709 12:31:08.487126 19785 raft_consensus.cc:606] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Received request to transfer leadership to TS d44fdddd21fe44c09069dd1e3f98b8a9
I20260709 12:31:08.491520 19935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90f9b3b3645a4a8ca2406580f1775ed3"
dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
mode: GRACEFUL
new_leader_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
 from {username='slave'} at 127.0.0.1:52350
I20260709 12:31:08.491978 19935 raft_consensus.cc:606] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Received request to transfer leadership to TS d44fdddd21fe44c09069dd1e3f98b8a9
I20260709 12:31:08.496594 19935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05311105c0bc48bab5cd036c37ccef25"
dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
mode: GRACEFUL
new_leader_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
 from {username='slave'} at 127.0.0.1:52350
I20260709 12:31:08.497074 19935 raft_consensus.cc:606] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Received request to transfer leadership to TS d44fdddd21fe44c09069dd1e3f98b8a9
I20260709 12:31:08.501626 19935 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c15b658c218435e81ff92455aa619db"
dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
mode: GRACEFUL
new_leader_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
 from {username='slave'} at 127.0.0.1:52350
I20260709 12:31:08.502125 19935 raft_consensus.cc:606] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Received request to transfer leadership to TS d44fdddd21fe44c09069dd1e3f98b8a9
I20260709 12:31:08.507251 19785 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ff8ef1253964c75aab3da58f7e9a417"
dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
mode: GRACEFUL
new_leader_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
 from {username='slave'} at 127.0.0.1:35046
I20260709 12:31:08.507855 19785 raft_consensus.cc:606] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Received request to transfer leadership to TS bc9e314a6d804f6a895a924cc11d3ec4
I20260709 12:31:08.530978 20089 consensus_queue.cc:1048] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:08.536926 20090 raft_consensus.cc:993] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4: : Instructing follower f7d3855f4244492987f0d3cd83c4a348 to start an election
I20260709 12:31:08.537433 20060 raft_consensus.cc:1081] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Signalling peer f7d3855f4244492987f0d3cd83c4a348 to start an election
I20260709 12:31:08.540419 19786 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24bbaeea725746cbbe1519c39ebeca50"
dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
 from {username='slave'} at 127.0.0.1:35040
I20260709 12:31:08.540982 19786 raft_consensus.cc:493] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:08.541357 19786 raft_consensus.cc:3060] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.543031 20090 consensus_queue.cc:1048] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:08.548625 19786 raft_consensus.cc:515] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.551927 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bbaeea725746cbbe1519c39ebeca50" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:08.551992 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24bbaeea725746cbbe1519c39ebeca50" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:08.552467 19786 leader_election.cc:290] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 2 election: Requested vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:08.553810 19861 raft_consensus.cc:3060] T 24bbaeea725746cbbe1519c39ebeca50 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.552604 19935 raft_consensus.cc:3055] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:08.554708 19935 raft_consensus.cc:740] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Running, Role: LEADER
I20260709 12:31:08.555516 19935 consensus_queue.cc:260] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.556793 19935 raft_consensus.cc:3060] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.562436 19861 raft_consensus.cc:2468] T 24bbaeea725746cbbe1519c39ebeca50 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 2.
I20260709 12:31:08.562714 19935 raft_consensus.cc:2468] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 2.
I20260709 12:31:08.563535 19749 leader_election.cc:304] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:08.564370 20061 raft_consensus.cc:2804] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:08.564805 20061 raft_consensus.cc:697] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [term 2 LEADER]: Becoming Leader. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Running, Role: LEADER
I20260709 12:31:08.565589 20061 consensus_queue.cc:237] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.572190 19683 catalog_manager.cc:5697] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 reported cstate change: term changed from 1 to 2, leader changed from bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67) to f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "f7d3855f4244492987f0d3cd83c4a348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:08.574024 20090 consensus_queue.cc:1048] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:08.580497 20060 raft_consensus.cc:993] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4: : Instructing follower f7d3855f4244492987f0d3cd83c4a348 to start an election
I20260709 12:31:08.581012 20089 raft_consensus.cc:1081] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Signalling peer f7d3855f4244492987f0d3cd83c4a348 to start an election
I20260709 12:31:08.583110 19785 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d0b5a815b844529bc04dbfd6b4881a1"
dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
 from {username='slave'} at 127.0.0.1:35040
I20260709 12:31:08.583822 19785 raft_consensus.cc:493] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:08.584172 19785 raft_consensus.cc:3060] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.586071 20090 consensus_queue.cc:1048] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:08.590791 19785 raft_consensus.cc:515] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.593499 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b5a815b844529bc04dbfd6b4881a1" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:08.593689 19785 leader_election.cc:290] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 2 election: Requested vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:08.594759 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d0b5a815b844529bc04dbfd6b4881a1" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:08.595317 19935 raft_consensus.cc:3055] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:08.595590 19935 raft_consensus.cc:740] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Running, Role: LEADER
I20260709 12:31:08.596391 19935 consensus_queue.cc:260] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.597118 20085 consensus_queue.cc:1048] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:08.597358 19935 raft_consensus.cc:3060] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.603689 19935 raft_consensus.cc:2468] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 2.
I20260709 12:31:08.604662 19752 leader_election.cc:304] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348; no voters: d44fdddd21fe44c09069dd1e3f98b8a9
I20260709 12:31:08.605863 20061 raft_consensus.cc:2804] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:08.606467 20061 raft_consensus.cc:697] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348 [term 2 LEADER]: Becoming Leader. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Running, Role: LEADER
I20260709 12:31:08.607203 20061 consensus_queue.cc:237] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.608228 20055 raft_consensus.cc:993] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9: : Instructing follower f7d3855f4244492987f0d3cd83c4a348 to start an election
I20260709 12:31:08.608752 20086 raft_consensus.cc:1081] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Signalling peer f7d3855f4244492987f0d3cd83c4a348 to start an election
I20260709 12:31:08.611409 19786 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f7bc6b062e34c94a171a37dbec21045"
dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
 from {username='slave'} at 127.0.0.1:35036
I20260709 12:31:08.611963 19786 raft_consensus.cc:493] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:08.612401 19786 raft_consensus.cc:3060] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.614711 20086 consensus_queue.cc:1048] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:08.619711 19786 raft_consensus.cc:515] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.622486 19861 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7bc6b062e34c94a171a37dbec21045" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:08.623137 19861 raft_consensus.cc:3055] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:08.623514 19861 raft_consensus.cc:740] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Running, Role: LEADER
I20260709 12:31:08.623292 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f7bc6b062e34c94a171a37dbec21045" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:08.622124 19786 leader_election.cc:290] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 2 election: Requested vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:08.624466 19861 consensus_queue.cc:260] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.625469 19861 raft_consensus.cc:3060] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.631799 19861 raft_consensus.cc:2468] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 2.
I20260709 12:31:08.632742 19749 leader_election.cc:304] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: bc9e314a6d804f6a895a924cc11d3ec4
I20260709 12:31:08.633005 19682 catalog_manager.cc:5697] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348 reported cstate change: term changed from 1 to 2, leader changed from bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67) to f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "f7d3855f4244492987f0d3cd83c4a348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:08.633895 20061 raft_consensus.cc:2804] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:08.634454 20061 raft_consensus.cc:697] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348 [term 2 LEADER]: Becoming Leader. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Running, Role: LEADER
I20260709 12:31:08.635226 20061 consensus_queue.cc:237] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.648625 19683 catalog_manager.cc:5697] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348 reported cstate change: term changed from 1 to 2, leader changed from d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66) to f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "f7d3855f4244492987f0d3cd83c4a348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:08.703249 20090 consensus_queue.cc:1048] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:08.704726 20089 consensus_queue.cc:1048] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:08.707201 20089 consensus_queue.cc:1048] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:08.711882 20060 raft_consensus.cc:993] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4: : Instructing follower d44fdddd21fe44c09069dd1e3f98b8a9 to start an election
I20260709 12:31:08.712345 20060 raft_consensus.cc:1081] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Signalling peer d44fdddd21fe44c09069dd1e3f98b8a9 to start an election
I20260709 12:31:08.715232 19860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c15b658c218435e81ff92455aa619db"
dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
 from {username='slave'} at 127.0.0.1:58768
I20260709 12:31:08.715972 19860 raft_consensus.cc:493] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:08.717137 19860 raft_consensus.cc:3060] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.718305 20089 raft_consensus.cc:993] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4: : Instructing follower d44fdddd21fe44c09069dd1e3f98b8a9 to start an election
I20260709 12:31:08.719084 20093 raft_consensus.cc:1081] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Signalling peer d44fdddd21fe44c09069dd1e3f98b8a9 to start an election
I20260709 12:31:08.723537 19858 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05311105c0bc48bab5cd036c37ccef25"
dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
 from {username='slave'} at 127.0.0.1:58768
I20260709 12:31:08.724114 19858 raft_consensus.cc:493] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:08.724466 19858 raft_consensus.cc:3060] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.724692 20060 consensus_queue.cc:1048] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:08.732373 19860 raft_consensus.cc:515] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.735587 19859 raft_consensus.cc:1240] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Rejecting Update request from peer bc9e314a6d804f6a895a924cc11d3ec4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:31:08.737453 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c15b658c218435e81ff92455aa619db" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:08.737834 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c15b658c218435e81ff92455aa619db" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:08.738133 19786 raft_consensus.cc:3060] T 6c15b658c218435e81ff92455aa619db P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.738507 19933 raft_consensus.cc:3055] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:08.738970 19933 raft_consensus.cc:740] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Running, Role: LEADER
I20260709 12:31:08.739776 19933 consensus_queue.cc:260] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.740876 19933 raft_consensus.cc:3060] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.736778 19860 leader_election.cc:290] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 2 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:08.746018 19786 raft_consensus.cc:2468] T 6c15b658c218435e81ff92455aa619db P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 2.
I20260709 12:31:08.746069 19858 raft_consensus.cc:515] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.748320 19861 raft_consensus.cc:1240] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Rejecting Update request from peer bc9e314a6d804f6a895a924cc11d3ec4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:31:08.748606 19825 leader_election.cc:304] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:08.749949 20086 raft_consensus.cc:2804] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:08.750414 20086 raft_consensus.cc:697] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 LEADER]: Becoming Leader. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Running, Role: LEADER
I20260709 12:31:08.751344 20086 consensus_queue.cc:237] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.754040 19933 raft_consensus.cc:2468] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 2.
I20260709 12:31:08.755118 20060 consensus_queue.cc:1059] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:08.755903 20089 raft_consensus.cc:3055] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:08.756264 20089 raft_consensus.cc:740] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Running, Role: LEADER
I20260709 12:31:08.757037 19858 leader_election.cc:290] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 2 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:08.757056 20089 consensus_queue.cc:260] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.758780 20089 raft_consensus.cc:3060] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.759182 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05311105c0bc48bab5cd036c37ccef25" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:08.759768 19786 raft_consensus.cc:3060] T 05311105c0bc48bab5cd036c37ccef25 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.767488 19786 raft_consensus.cc:2468] T 05311105c0bc48bab5cd036c37ccef25 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 2.
I20260709 12:31:08.766837 19683 catalog_manager.cc:5697] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 reported cstate change: term changed from 1 to 2, leader changed from bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67) to d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:08.768553 19825 leader_election.cc:304] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:08.768921 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05311105c0bc48bab5cd036c37ccef25" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:08.769459 20086 raft_consensus.cc:2804] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:08.770113 20086 raft_consensus.cc:697] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 LEADER]: Becoming Leader. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Running, Role: LEADER
I20260709 12:31:08.771050 20086 consensus_queue.cc:237] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.778641 19933 raft_consensus.cc:2468] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 2.
I20260709 12:31:08.779711 20110 consensus_queue.cc:1048] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:08.789645 19681 catalog_manager.cc:5697] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 reported cstate change: term changed from 1 to 2, leader changed from bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67) to d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:08.790498 20061 raft_consensus.cc:993] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348: : Instructing follower d44fdddd21fe44c09069dd1e3f98b8a9 to start an election
I20260709 12:31:08.791661 20110 raft_consensus.cc:1081] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Signalling peer d44fdddd21fe44c09069dd1e3f98b8a9 to start an election
I20260709 12:31:08.793018 20089 consensus_queue.cc:1048] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:31:08.796254 19860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d29f26ef85584432b3f88fa1b72595b1"
dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
 from {username='slave'} at 127.0.0.1:58758
I20260709 12:31:08.796917 19860 raft_consensus.cc:493] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:08.797307 19860 raft_consensus.cc:3060] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.805442 19860 raft_consensus.cc:515] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.810815 19785 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29f26ef85584432b3f88fa1b72595b1" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:08.811386 19785 raft_consensus.cc:3055] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:08.811679 19785 raft_consensus.cc:740] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Running, Role: LEADER
I20260709 12:31:08.812448 19785 consensus_queue.cc:260] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.813093 19785 raft_consensus.cc:3060] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.815526 19860 leader_election.cc:290] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 2 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:08.816730 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d29f26ef85584432b3f88fa1b72595b1" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:08.817364 19933 raft_consensus.cc:3060] T d29f26ef85584432b3f88fa1b72595b1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.826555 20060 consensus_queue.cc:1048] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:08.831565 19933 raft_consensus.cc:2468] T d29f26ef85584432b3f88fa1b72595b1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 2.
I20260709 12:31:08.832525 19785 raft_consensus.cc:2468] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 2.
I20260709 12:31:08.832921 19827 leader_election.cc:304] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, d44fdddd21fe44c09069dd1e3f98b8a9; no voters: 
I20260709 12:31:08.833925 20086 raft_consensus.cc:2804] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:08.834457 20086 raft_consensus.cc:697] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 LEADER]: Becoming Leader. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Running, Role: LEADER
I20260709 12:31:08.835356 20086 consensus_queue.cc:237] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.842967 20060 raft_consensus.cc:993] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4: : Instructing follower d44fdddd21fe44c09069dd1e3f98b8a9 to start an election
I20260709 12:31:08.843555 20089 raft_consensus.cc:1081] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Signalling peer d44fdddd21fe44c09069dd1e3f98b8a9 to start an election
I20260709 12:31:08.845288 19860 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90f9b3b3645a4a8ca2406580f1775ed3"
dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
 from {username='slave'} at 127.0.0.1:58768
I20260709 12:31:08.845871 19860 raft_consensus.cc:493] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:08.846239 19860 raft_consensus.cc:3060] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.852027 19860 raft_consensus.cc:515] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.853699 19860 leader_election.cc:290] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 2 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:08.854655 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f9b3b3645a4a8ca2406580f1775ed3" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:08.854818 19933 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90f9b3b3645a4a8ca2406580f1775ed3" candidate_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:08.855294 19786 raft_consensus.cc:3060] T 90f9b3b3645a4a8ca2406580f1775ed3 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.855433 19933 raft_consensus.cc:3055] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:08.855836 19933 raft_consensus.cc:740] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Running, Role: LEADER
I20260709 12:31:08.856535 19933 consensus_queue.cc:260] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.857649 19933 raft_consensus.cc:3060] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.858628 19683 catalog_manager.cc:5697] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9 reported cstate change: term changed from 1 to 2, leader changed from f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65) to d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:08.860633 19786 raft_consensus.cc:2468] T 90f9b3b3645a4a8ca2406580f1775ed3 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 2.
I20260709 12:31:08.861804 19825 leader_election.cc:304] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d44fdddd21fe44c09069dd1e3f98b8a9, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:08.862687 20086 raft_consensus.cc:2804] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:08.863137 20086 raft_consensus.cc:697] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 LEADER]: Becoming Leader. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Running, Role: LEADER
I20260709 12:31:08.863933 20086 consensus_queue.cc:237] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.864500 19933 raft_consensus.cc:2468] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d44fdddd21fe44c09069dd1e3f98b8a9 in term 2.
I20260709 12:31:08.866063 20061 consensus_queue.cc:1048] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:08.875304 19683 catalog_manager.cc:5697] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9 reported cstate change: term changed from 1 to 2, leader changed from bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67) to d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66). New cstate: current_term: 2 leader_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:08.875876 20134 consensus_queue.cc:1048] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:08.882721 20134 raft_consensus.cc:993] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348: : Instructing follower bc9e314a6d804f6a895a924cc11d3ec4 to start an election
I20260709 12:31:08.883117 20134 raft_consensus.cc:1081] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Signalling peer bc9e314a6d804f6a895a924cc11d3ec4 to start an election
I20260709 12:31:08.885823 19935 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ff8ef1253964c75aab3da58f7e9a417"
dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
 from {username='slave'} at 127.0.0.1:52324
I20260709 12:31:08.886343 19935 raft_consensus.cc:493] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:08.886720 19935 raft_consensus.cc:3060] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.892710 19935 raft_consensus.cc:515] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.894161 19935 leader_election.cc:290] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 2 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:08.894857 19786 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8ef1253964c75aab3da58f7e9a417" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:08.895560 19786 raft_consensus.cc:3055] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:08.895884 19786 raft_consensus.cc:740] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Running, Role: LEADER
I20260709 12:31:08.896660 19786 consensus_queue.cc:260] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.897212 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ff8ef1253964c75aab3da58f7e9a417" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:08.897679 19786 raft_consensus.cc:3060] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.897797 19860 raft_consensus.cc:3060] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.903246 19786 raft_consensus.cc:2468] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 2.
I20260709 12:31:08.904197 19899 leader_election.cc:304] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:08.904372 19860 raft_consensus.cc:2468] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 2.
I20260709 12:31:08.905042 20089 raft_consensus.cc:2804] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:08.905493 20089 raft_consensus.cc:697] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 LEADER]: Becoming Leader. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Running, Role: LEADER
I20260709 12:31:08.906180 20089 consensus_queue.cc:237] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.912444 19681 catalog_manager.cc:5697] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 reported cstate change: term changed from 1 to 2, leader changed from f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65) to bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67). New cstate: current_term: 2 leader_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:08.938218 20055 raft_consensus.cc:993] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9: : Instructing follower f7d3855f4244492987f0d3cd83c4a348 to start an election
I20260709 12:31:08.938745 20086 raft_consensus.cc:1081] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Signalling peer f7d3855f4244492987f0d3cd83c4a348 to start an election
I20260709 12:31:08.940075 19786 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5df454fac23d4cf6a9c10ffa0ef263b4"
dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
 from {username='slave'} at 127.0.0.1:35036
I20260709 12:31:08.940596 19786 raft_consensus.cc:493] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:08.940929 19786 raft_consensus.cc:3060] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.945344 19786 raft_consensus.cc:515] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.946697 19786 leader_election.cc:290] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 2 election: Requested vote from peers d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479), bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67:34465)
I20260709 12:31:08.947438 19860 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df454fac23d4cf6a9c10ffa0ef263b4" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:08.947700 19935 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5df454fac23d4cf6a9c10ffa0ef263b4" candidate_uuid: "f7d3855f4244492987f0d3cd83c4a348" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
I20260709 12:31:08.948061 19860 raft_consensus.cc:3055] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:31:08.948321 19935 raft_consensus.cc:3060] T 5df454fac23d4cf6a9c10ffa0ef263b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.948421 19860 raft_consensus.cc:740] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Running, Role: LEADER
I20260709 12:31:08.949218 19860 consensus_queue.cc:260] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.950114 19860 raft_consensus.cc:3060] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:08.953354 19935 raft_consensus.cc:2468] T 5df454fac23d4cf6a9c10ffa0ef263b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 2.
I20260709 12:31:08.954486 19752 leader_election.cc:304] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:08.955178 19860 raft_consensus.cc:2468] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f7d3855f4244492987f0d3cd83c4a348 in term 2.
I20260709 12:31:08.955264 20134 raft_consensus.cc:2804] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:31:08.955816 20134 raft_consensus.cc:697] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348 [term 2 LEADER]: Becoming Leader. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Running, Role: LEADER
I20260709 12:31:08.956595 20134 consensus_queue.cc:237] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:08.963801 19681 catalog_manager.cc:5697] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348 reported cstate change: term changed from 1 to 2, leader changed from d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66) to f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65). New cstate: current_term: 2 leader_uuid: "f7d3855f4244492987f0d3cd83c4a348" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:09.088496 19935 raft_consensus.cc:1275] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Refusing update from remote peer f7d3855f4244492987f0d3cd83c4a348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:09.089720 20134 consensus_queue.cc:1048] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:09.097394 19860 raft_consensus.cc:1275] T 24bbaeea725746cbbe1519c39ebeca50 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Refusing update from remote peer f7d3855f4244492987f0d3cd83c4a348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:09.098874 20110 consensus_queue.cc:1048] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:09.153327 19935 raft_consensus.cc:3060] T 4f7bc6b062e34c94a171a37dbec21045 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:09.158038 19935 raft_consensus.cc:1275] T 4f7bc6b062e34c94a171a37dbec21045 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Refusing update from remote peer f7d3855f4244492987f0d3cd83c4a348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:09.159242 20110 consensus_queue.cc:1048] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:09.162688 19860 raft_consensus.cc:1275] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Refusing update from remote peer f7d3855f4244492987f0d3cd83c4a348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:09.163944 20134 consensus_queue.cc:1048] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:09.179972 19860 raft_consensus.cc:3060] T 3d0b5a815b844529bc04dbfd6b4881a1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:31:09.181646 19935 raft_consensus.cc:1275] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Refusing update from remote peer f7d3855f4244492987f0d3cd83c4a348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:09.182780 20110 consensus_queue.cc:1048] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:09.185365 19786 raft_consensus.cc:1275] T 6c15b658c218435e81ff92455aa619db P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Refusing update from remote peer d44fdddd21fe44c09069dd1e3f98b8a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:09.186504 20086 consensus_queue.cc:1048] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:09.187755 19860 raft_consensus.cc:1275] T 3d0b5a815b844529bc04dbfd6b4881a1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Refusing update from remote peer f7d3855f4244492987f0d3cd83c4a348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:09.190598 20139 consensus_queue.cc:1048] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:09.199627 19935 raft_consensus.cc:1275] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Refusing update from remote peer d44fdddd21fe44c09069dd1e3f98b8a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:09.200834 20086 consensus_queue.cc:1048] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:09.253846 19935 raft_consensus.cc:1275] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Refusing update from remote peer d44fdddd21fe44c09069dd1e3f98b8a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:09.255074 20086 consensus_queue.cc:1048] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:09.262588 19786 raft_consensus.cc:1275] T 90f9b3b3645a4a8ca2406580f1775ed3 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Refusing update from remote peer d44fdddd21fe44c09069dd1e3f98b8a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:09.264169 20085 consensus_queue.cc:1048] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:09.281100 19786 raft_consensus.cc:1275] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Refusing update from remote peer d44fdddd21fe44c09069dd1e3f98b8a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:09.282356 20085 consensus_queue.cc:1048] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:09.289718 19935 raft_consensus.cc:1275] T d29f26ef85584432b3f88fa1b72595b1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Refusing update from remote peer d44fdddd21fe44c09069dd1e3f98b8a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:09.291541 20140 consensus_queue.cc:1048] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:31:09.305131 19786 raft_consensus.cc:1275] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Refusing update from remote peer bc9e314a6d804f6a895a924cc11d3ec4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:09.306216 20089 consensus_queue.cc:1048] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:09.313526 19860 raft_consensus.cc:1275] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Refusing update from remote peer bc9e314a6d804f6a895a924cc11d3ec4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:09.315335 20060 consensus_queue.cc:1048] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:09.318953 19786 raft_consensus.cc:1275] T 05311105c0bc48bab5cd036c37ccef25 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Refusing update from remote peer d44fdddd21fe44c09069dd1e3f98b8a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:09.323523 20085 consensus_queue.cc:1048] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:09.332696 19935 raft_consensus.cc:1275] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Refusing update from remote peer d44fdddd21fe44c09069dd1e3f98b8a9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:09.334041 20055 consensus_queue.cc:1048] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:09.394156 19860 raft_consensus.cc:1275] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Refusing update from remote peer f7d3855f4244492987f0d3cd83c4a348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:09.395453 20110 consensus_queue.cc:1048] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:09.403805 19935 raft_consensus.cc:1275] T 5df454fac23d4cf6a9c10ffa0ef263b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Refusing update from remote peer f7d3855f4244492987f0d3cd83c4a348: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:31:09.405221 20110 consensus_queue.cc:1048] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:31:11.510825 19682 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40800:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:31:11.529038 19682 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40800:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:31:11.622059  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:31:11.636953 20165 log.cc:927] Time spent T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:31:11.734244 20187 tablet.cc:1724] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:31:11.753388 19749 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:41479, user_credentials={real_user=slave}} blocked reactor thread for 101791us
W20260709 12:31:11.854678 19749 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.66:41479, user_credentials={real_user=slave}} blocked reactor thread for 59324.6us
I20260709 12:31:11.897765 20203 tablet.cc:1724] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:11.900490 20201 tablet.cc:1724] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:11.910620 20208 tablet.cc:1724] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:11.846101 20187 tablet.cc:1724] T 3d0b5a815b844529bc04dbfd6b4881a1 P d44fdddd21fe44c09069dd1e3f98b8a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:11.845014 20190 tablet.cc:1724] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:31:11.965380 20197 log.cc:927] Time spent T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:31:11.879980 20193 tablet.cc:1724] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:31:11.977488 19825 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.65:36403, user_credentials={real_user=slave}} blocked reactor thread for 44856.7us
I20260709 12:31:11.982532 20212 tablet.cc:1724] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:11.959035 20209 tablet.cc:1724] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:11.959131 20204 tablet.cc:1724] T 5df454fac23d4cf6a9c10ffa0ef263b4 P bc9e314a6d804f6a895a924cc11d3ec4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:11.976898 20211 tablet.cc:1724] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:31:12.032542 20192 log.cc:927] Time spent T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4: Append to log took a long time: real 0.143s	user 0.001s	sys 0.002s
W20260709 12:31:12.013872 19827 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.111.67:34465, user_credentials={real_user=slave}} blocked reactor thread for 60007.8us
I20260709 12:31:12.072878 20190 tablet.cc:1724] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:12.071317 20219 tablet.cc:1724] T 90f9b3b3645a4a8ca2406580f1775ed3 P f7d3855f4244492987f0d3cd83c4a348: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:12.082528 19861 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17775893872142bb88fbe22bedd96b11"
dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
mode: GRACEFUL
new_leader_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
 from {username='slave'} at 127.0.0.1:54096
I20260709 12:31:12.083205 19861 raft_consensus.cc:606] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 LEADER]: Received request to transfer leadership to TS bc9e314a6d804f6a895a924cc11d3ec4
I20260709 12:31:12.090240 20201 tablet.cc:1724] T 6c15b658c218435e81ff92455aa619db P f7d3855f4244492987f0d3cd83c4a348: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:12.066743 20208 tablet.cc:1724] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:12.097090 20213 tablet.cc:1724] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:12.100317 20219 tablet.cc:1724] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:12.103874 20193 tablet.cc:1724] T 05311105c0bc48bab5cd036c37ccef25 P f7d3855f4244492987f0d3cd83c4a348: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:12.109066 20187 tablet.cc:1724] T 24bbaeea725746cbbe1519c39ebeca50 P d44fdddd21fe44c09069dd1e3f98b8a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:12.116303 20201 tablet.cc:1724] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:12.117388 20188 raft_consensus.cc:993] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9: : Instructing follower bc9e314a6d804f6a895a924cc11d3ec4 to start an election
I20260709 12:31:12.117857 20188 raft_consensus.cc:1081] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 LEADER]: Signalling peer bc9e314a6d804f6a895a924cc11d3ec4 to start an election
I20260709 12:31:12.120855 20204 tablet.cc:1724] T 4f7bc6b062e34c94a171a37dbec21045 P bc9e314a6d804f6a895a924cc11d3ec4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:12.116076 20209 tablet.cc:1724] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:12.143496 20204 tablet.cc:1724] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:12.155520 20187 tablet.cc:1724] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:12.159868 19932 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17775893872142bb88fbe22bedd96b11"
dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
 from {username='slave'} at 127.0.0.1:52340
I20260709 12:31:12.160499 19932 raft_consensus.cc:493] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:12.160851 19932 raft_consensus.cc:3060] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:12.162787 20204 tablet.cc:1724] T d29f26ef85584432b3f88fa1b72595b1 P bc9e314a6d804f6a895a924cc11d3ec4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:12.169360 20203 tablet.cc:1724] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:31:12.171344 20221 log.cc:927] Time spent T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:31:12.177735 19932 raft_consensus.cc:515] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:12.180873 20187 tablet.cc:1724] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:31:12.185617 19783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17775893872142bb88fbe22bedd96b11" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:12.186367 19783 raft_consensus.cc:3060] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:12.193992 19783 raft_consensus.cc:2468] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 3.
I20260709 12:31:12.196179 19899 leader_election.cc:304] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, f7d3855f4244492987f0d3cd83c4a348; no voters: 
I20260709 12:31:12.197154 20089 raft_consensus.cc:2804] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:31:12.197628 20089 raft_consensus.cc:697] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 [term 3 LEADER]: Becoming Leader. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Running, Role: LEADER
I20260709 12:31:12.198532 20089 consensus_queue.cc:237] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:12.204833 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17775893872142bb88fbe22bedd96b11" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:12.205422 19859 raft_consensus.cc:3055] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:31:12.205745 19859 raft_consensus.cc:740] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d44fdddd21fe44c09069dd1e3f98b8a9, State: Running, Role: LEADER
I20260709 12:31:12.206578 19859 consensus_queue.cc:260] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } }
I20260709 12:31:12.207854 19859 raft_consensus.cc:3060] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:12.212993 19859 raft_consensus.cc:2468] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 3.
I20260709 12:31:12.213820 19783 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6cbdd9c7dcc14dfbb34eaa87c9c726c7"
dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
mode: GRACEFUL
new_leader_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
 from {username='slave'} at 127.0.0.1:35326
I20260709 12:31:12.214404 19932 leader_election.cc:290] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 3 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:12.214854 19783 raft_consensus.cc:606] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 2 LEADER]: Received request to transfer leadership to TS bc9e314a6d804f6a895a924cc11d3ec4
I20260709 12:31:12.216467  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:31:12.217074  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:12.224306 19681 catalog_manager.cc:6242] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734: soft_deleted_table [id=17fcf08c769a451090aca07efc81ce67] alter complete (version 1)
I20260709 12:31:12.235261 19683 catalog_manager.cc:5697] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 reported cstate change: term changed from 2 to 3, leader changed from d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66) to bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67). New cstate: current_term: 3 leader_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: HEALTHY } } }
I20260709 12:31:12.312700 20220 raft_consensus.cc:993] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348: : Instructing follower bc9e314a6d804f6a895a924cc11d3ec4 to start an election
I20260709 12:31:12.313289 20215 raft_consensus.cc:1081] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 2 LEADER]: Signalling peer bc9e314a6d804f6a895a924cc11d3ec4 to start an election
I20260709 12:31:12.314682 19932 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6cbdd9c7dcc14dfbb34eaa87c9c726c7"
dest_uuid: "bc9e314a6d804f6a895a924cc11d3ec4"
 from {username='slave'} at 127.0.0.1:52324
I20260709 12:31:12.315142 19932 raft_consensus.cc:493] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:31:12.315479 19932 raft_consensus.cc:3060] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:12.320519 19932 raft_consensus.cc:515] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } }
I20260709 12:31:12.322225 19932 leader_election.cc:290] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 3 election: Requested vote from peers f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403), d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479)
I20260709 12:31:12.322906 19783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cbdd9c7dcc14dfbb34eaa87c9c726c7" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f7d3855f4244492987f0d3cd83c4a348"
I20260709 12:31:12.323282 19859 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cbdd9c7dcc14dfbb34eaa87c9c726c7" candidate_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9"
I20260709 12:31:12.323589 19783 raft_consensus.cc:3055] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:31:12.323870 19859 raft_consensus.cc:3060] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:12.323961 19783 raft_consensus.cc:740] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f7d3855f4244492987f0d3cd83c4a348, State: Running, Role: LEADER
I20260709 12:31:12.324875 19783 consensus_queue.cc:260] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } }
I20260709 12:31:12.326202 19783 raft_consensus.cc:3060] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:31:12.331259 19859 raft_consensus.cc:2468] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 3.
I20260709 12:31:12.332346 19898 leader_election.cc:304] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bc9e314a6d804f6a895a924cc11d3ec4, d44fdddd21fe44c09069dd1e3f98b8a9; no voters: 
I20260709 12:31:12.333009 20089 raft_consensus.cc:2804] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:31:12.333173 19783 raft_consensus.cc:2468] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc9e314a6d804f6a895a924cc11d3ec4 in term 3.
I20260709 12:31:12.333459 20089 raft_consensus.cc:697] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [term 3 LEADER]: Becoming Leader. State: Replica: bc9e314a6d804f6a895a924cc11d3ec4, State: Running, Role: LEADER
I20260709 12:31:12.334630 20089 consensus_queue.cc:237] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } }
I20260709 12:31:12.341660 19683 catalog_manager.cc:5697] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 reported cstate change: term changed from 2 to 3, leader changed from f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65) to bc9e314a6d804f6a895a924cc11d3ec4 (127.8.111.67). New cstate: current_term: 3 leader_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc9e314a6d804f6a895a924cc11d3ec4" member_type: VOTER last_known_addr { host: "127.8.111.67" port: 34465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 } health_report { overall_health: UNKNOWN } } }
I20260709 12:31:12.641491 19783 raft_consensus.cc:1275] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 3 FOLLOWER]: Refusing update from remote peer bc9e314a6d804f6a895a924cc11d3ec4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:31:12.642731 20089 consensus_queue.cc:1048] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:31:12.651674 19859 raft_consensus.cc:1275] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 3 FOLLOWER]: Refusing update from remote peer bc9e314a6d804f6a895a924cc11d3ec4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:31:12.653270 20089 consensus_queue.cc:1048] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:31:12.763770 19783 raft_consensus.cc:1275] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 3 FOLLOWER]: Refusing update from remote peer bc9e314a6d804f6a895a924cc11d3ec4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:31:12.765060 20198 consensus_queue.cc:1048] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f7d3855f4244492987f0d3cd83c4a348" member_type: VOTER last_known_addr { host: "127.8.111.65" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:31:12.774977 19859 raft_consensus.cc:1275] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 3 FOLLOWER]: Refusing update from remote peer bc9e314a6d804f6a895a924cc11d3ec4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:31:12.776297 20234 consensus_queue.cc:1048] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d44fdddd21fe44c09069dd1e3f98b8a9" member_type: VOTER last_known_addr { host: "127.8.111.66" port: 41479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:31:13.218180  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:13.225065  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:13.225569  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:14.226579  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:14.232810  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:14.233341  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:15.234302  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:15.239938  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:15.240386  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:16.241299  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:16.246325  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:16.246753  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:17.248402  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:17.257015  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:17.257458  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:18.258585  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:18.263573  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:18.264014  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:19.264897  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:19.269749  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:19.270148  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:20.271155  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:20.276415  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:20.276851  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:21.277806  8637 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:31:21.283082  8637 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:31:21.283528  8637 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:31:22.339097  8637 tablet_server.cc:179] TabletServer@127.8.111.65:0 shutting down...
W20260709 12:31:22.356372 19825 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 12:31:22.365410 19825 consensus_peers.cc:597] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 -> Peer f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403): Couldn't send request to peer f7d3855f4244492987f0d3cd83c4a348. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:31:22.371634 19825 consensus_peers.cc:597] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 -> Peer f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403): Couldn't send request to peer f7d3855f4244492987f0d3cd83c4a348. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:31:22.386605 19899 consensus_peers.cc:597] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 -> Peer f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403): Couldn't send request to peer f7d3855f4244492987f0d3cd83c4a348. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:31:22.387367 19899 consensus_peers.cc:597] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 -> Peer f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403): Couldn't send request to peer f7d3855f4244492987f0d3cd83c4a348. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:22.394761  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:31:22.396024  8637 tablet_replica.cc:333] T 05311105c0bc48bab5cd036c37ccef25 P f7d3855f4244492987f0d3cd83c4a348: stopping tablet replica
I20260709 12:31:22.397125  8637 raft_consensus.cc:2243] T 05311105c0bc48bab5cd036c37ccef25 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.397846  8637 raft_consensus.cc:2272] T 05311105c0bc48bab5cd036c37ccef25 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.400632  8637 tablet_replica.cc:333] T 6c15b658c218435e81ff92455aa619db P f7d3855f4244492987f0d3cd83c4a348: stopping tablet replica
I20260709 12:31:22.401326  8637 raft_consensus.cc:2243] T 6c15b658c218435e81ff92455aa619db P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.401923  8637 raft_consensus.cc:2272] T 6c15b658c218435e81ff92455aa619db P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.404503  8637 tablet_replica.cc:333] T 90f9b3b3645a4a8ca2406580f1775ed3 P f7d3855f4244492987f0d3cd83c4a348: stopping tablet replica
I20260709 12:31:22.405123  8637 raft_consensus.cc:2243] T 90f9b3b3645a4a8ca2406580f1775ed3 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.405670  8637 raft_consensus.cc:2272] T 90f9b3b3645a4a8ca2406580f1775ed3 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.408643  8637 tablet_replica.cc:333] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348: stopping tablet replica
I20260709 12:31:22.409500  8637 raft_consensus.cc:2243] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:22.410758  8637 raft_consensus.cc:2272] T 24bbaeea725746cbbe1519c39ebeca50 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:22.411031 19825 consensus_peers.cc:597] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 -> Peer f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403): Couldn't send request to peer f7d3855f4244492987f0d3cd83c4a348. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:22.413220  8637 tablet_replica.cc:333] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348: stopping tablet replica
I20260709 12:31:22.414070  8637 raft_consensus.cc:2243] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:22.415393  8637 raft_consensus.cc:2272] T 4f7bc6b062e34c94a171a37dbec21045 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.418243  8637 tablet_replica.cc:333] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348: stopping tablet replica
I20260709 12:31:22.418931  8637 raft_consensus.cc:2243] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.419420  8637 raft_consensus.cc:2272] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.421913  8637 tablet_replica.cc:333] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348: stopping tablet replica
I20260709 12:31:22.422536  8637 raft_consensus.cc:2243] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.423024  8637 raft_consensus.cc:2272] T 17775893872142bb88fbe22bedd96b11 P f7d3855f4244492987f0d3cd83c4a348 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.426486  8637 tablet_replica.cc:333] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348: stopping tablet replica
I20260709 12:31:22.427335  8637 raft_consensus.cc:2243] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.428148  8637 raft_consensus.cc:2272] T 0ff8ef1253964c75aab3da58f7e9a417 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.430590  8637 tablet_replica.cc:333] T cd117ec76ec24b74988cfdccf3bcb28c P f7d3855f4244492987f0d3cd83c4a348: stopping tablet replica
I20260709 12:31:22.431205  8637 raft_consensus.cc:2243] T cd117ec76ec24b74988cfdccf3bcb28c P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.431669  8637 raft_consensus.cc:2272] T cd117ec76ec24b74988cfdccf3bcb28c P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.434348  8637 tablet_replica.cc:333] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348: stopping tablet replica
I20260709 12:31:22.434893  8637 raft_consensus.cc:2243] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.435388  8637 raft_consensus.cc:2272] T 6de140a555174689bc2a03d802a477e5 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.438047  8637 tablet_replica.cc:333] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348: stopping tablet replica
I20260709 12:31:22.438829  8637 raft_consensus.cc:2243] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.439438  8637 raft_consensus.cc:2272] T d29f26ef85584432b3f88fa1b72595b1 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.441967  8637 tablet_replica.cc:333] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348: stopping tablet replica
I20260709 12:31:22.442550  8637 raft_consensus.cc:2243] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:22.443362  8637 raft_consensus.cc:2272] T 57bb268f539c448cabdf9058d7567b80 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.445623  8637 tablet_replica.cc:333] T ecbfa438576e4052957cc88dc495f4d2 P f7d3855f4244492987f0d3cd83c4a348: stopping tablet replica
I20260709 12:31:22.446156  8637 raft_consensus.cc:2243] T ecbfa438576e4052957cc88dc495f4d2 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.446669  8637 raft_consensus.cc:2272] T ecbfa438576e4052957cc88dc495f4d2 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.448982  8637 tablet_replica.cc:333] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348: stopping tablet replica
I20260709 12:31:22.449465  8637 raft_consensus.cc:2243] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:22.450326  8637 raft_consensus.cc:2272] T ce4bc28a0a8d473698323f80cd969094 P f7d3855f4244492987f0d3cd83c4a348 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.452569  8637 tablet_replica.cc:333] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348: stopping tablet replica
I20260709 12:31:22.453132  8637 raft_consensus.cc:2243] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:22.453982  8637 raft_consensus.cc:2272] T 3d0b5a815b844529bc04dbfd6b4881a1 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.456275  8637 tablet_replica.cc:333] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348: stopping tablet replica
I20260709 12:31:22.456790  8637 raft_consensus.cc:2243] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.457227  8637 raft_consensus.cc:2272] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P f7d3855f4244492987f0d3cd83c4a348 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.459372  8637 tablet_replica.cc:333] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348: stopping tablet replica
I20260709 12:31:22.459887  8637 raft_consensus.cc:2243] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:22.460779  8637 raft_consensus.cc:2272] T 5df454fac23d4cf6a9c10ffa0ef263b4 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.463340  8637 tablet_replica.cc:333] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348: stopping tablet replica
I20260709 12:31:22.463830  8637 raft_consensus.cc:2243] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:22.464655  8637 raft_consensus.cc:2272] T 71185e64eb2744ffaf2f069c035505a4 P f7d3855f4244492987f0d3cd83c4a348 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:22.495311 19899 consensus_peers.cc:597] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 -> Peer f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403): Couldn't send request to peer f7d3855f4244492987f0d3cd83c4a348. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:31:22.504228 19899 consensus_peers.cc:597] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 -> Peer f7d3855f4244492987f0d3cd83c4a348 (127.8.111.65:36403): Couldn't send request to peer f7d3855f4244492987f0d3cd83c4a348. Status: Network error: Client connection negotiation failed: client connection to 127.8.111.65:36403: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:22.512339  8637 tablet_server.cc:196] TabletServer@127.8.111.65:0 shutdown complete.
I20260709 12:31:22.556504  8637 tablet_server.cc:179] TabletServer@127.8.111.66:0 shutting down...
W20260709 12:31:22.565037 19898 consensus_peers.cc:597] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 -> Peer d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479): Couldn't send request to peer d44fdddd21fe44c09069dd1e3f98b8a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:22.588421  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:31:22.589409  8637 tablet_replica.cc:333] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9: stopping tablet replica
I20260709 12:31:22.590699  8637 raft_consensus.cc:2243] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:22.591873  8637 raft_consensus.cc:2272] T 6c15b658c218435e81ff92455aa619db P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.594477  8637 tablet_replica.cc:333] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9: stopping tablet replica
I20260709 12:31:22.595088  8637 raft_consensus.cc:2243] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:22.596012  8637 raft_consensus.cc:2272] T 05311105c0bc48bab5cd036c37ccef25 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.598434  8637 tablet_replica.cc:333] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9: stopping tablet replica
I20260709 12:31:22.599017  8637 raft_consensus.cc:2243] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:22.599843  8637 raft_consensus.cc:2272] T 90f9b3b3645a4a8ca2406580f1775ed3 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.602182  8637 tablet_replica.cc:333] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9: stopping tablet replica
I20260709 12:31:22.602820  8637 raft_consensus.cc:2243] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.603338  8637 raft_consensus.cc:2272] T 4f7bc6b062e34c94a171a37dbec21045 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.605409  8637 tablet_replica.cc:333] T 3d0b5a815b844529bc04dbfd6b4881a1 P d44fdddd21fe44c09069dd1e3f98b8a9: stopping tablet replica
I20260709 12:31:22.605932  8637 raft_consensus.cc:2243] T 3d0b5a815b844529bc04dbfd6b4881a1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.606566  8637 raft_consensus.cc:2272] T 3d0b5a815b844529bc04dbfd6b4881a1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.609370  8637 tablet_replica.cc:333] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9: stopping tablet replica
I20260709 12:31:22.610255  8637 raft_consensus.cc:2243] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.610903  8637 raft_consensus.cc:2272] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:31:22.612802 19898 consensus_peers.cc:597] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 -> Peer d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479): Couldn't send request to peer d44fdddd21fe44c09069dd1e3f98b8a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:22.613843  8637 tablet_replica.cc:333] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9: stopping tablet replica
I20260709 12:31:22.614427  8637 raft_consensus.cc:2243] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.614858  8637 raft_consensus.cc:2272] T 17775893872142bb88fbe22bedd96b11 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.617115  8637 tablet_replica.cc:333] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9: stopping tablet replica
I20260709 12:31:22.617597  8637 raft_consensus.cc:2243] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.618093  8637 raft_consensus.cc:2272] T 5df454fac23d4cf6a9c10ffa0ef263b4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.620128  8637 tablet_replica.cc:333] T 24bbaeea725746cbbe1519c39ebeca50 P d44fdddd21fe44c09069dd1e3f98b8a9: stopping tablet replica
I20260709 12:31:22.620608  8637 raft_consensus.cc:2243] T 24bbaeea725746cbbe1519c39ebeca50 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.621061  8637 raft_consensus.cc:2272] T 24bbaeea725746cbbe1519c39ebeca50 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.623097  8637 tablet_replica.cc:333] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9: stopping tablet replica
I20260709 12:31:22.623605  8637 raft_consensus.cc:2243] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.624020  8637 raft_consensus.cc:2272] T 71185e64eb2744ffaf2f069c035505a4 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.626340  8637 tablet_replica.cc:333] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9: stopping tablet replica
I20260709 12:31:22.626813  8637 raft_consensus.cc:2243] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:22.627621  8637 raft_consensus.cc:2272] T d29f26ef85584432b3f88fa1b72595b1 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.629797  8637 tablet_replica.cc:333] T 57bb268f539c448cabdf9058d7567b80 P d44fdddd21fe44c09069dd1e3f98b8a9: stopping tablet replica
I20260709 12:31:22.630383  8637 raft_consensus.cc:2243] T 57bb268f539c448cabdf9058d7567b80 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.630820  8637 raft_consensus.cc:2272] T 57bb268f539c448cabdf9058d7567b80 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.632782  8637 tablet_replica.cc:333] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9: stopping tablet replica
I20260709 12:31:22.633301  8637 raft_consensus.cc:2243] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:22.634042  8637 raft_consensus.cc:2272] T ecbfa438576e4052957cc88dc495f4d2 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.635921  8637 tablet_replica.cc:333] T ce4bc28a0a8d473698323f80cd969094 P d44fdddd21fe44c09069dd1e3f98b8a9: stopping tablet replica
I20260709 12:31:22.636412  8637 raft_consensus.cc:2243] T ce4bc28a0a8d473698323f80cd969094 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.636798  8637 raft_consensus.cc:2272] T ce4bc28a0a8d473698323f80cd969094 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.638991  8637 tablet_replica.cc:333] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9: stopping tablet replica
I20260709 12:31:22.639568  8637 raft_consensus.cc:2243] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.640132  8637 raft_consensus.cc:2272] T 0ff8ef1253964c75aab3da58f7e9a417 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.642323  8637 tablet_replica.cc:333] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9: stopping tablet replica
I20260709 12:31:22.642947  8637 raft_consensus.cc:2243] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:22.643796  8637 raft_consensus.cc:2272] T cd117ec76ec24b74988cfdccf3bcb28c P d44fdddd21fe44c09069dd1e3f98b8a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.645843  8637 tablet_replica.cc:333] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9: stopping tablet replica
I20260709 12:31:22.646337  8637 raft_consensus.cc:2243] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:22.647405  8637 raft_consensus.cc:2272] T 6de140a555174689bc2a03d802a477e5 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.650367  8637 tablet_replica.cc:333] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9: stopping tablet replica
W20260709 12:31:22.650442 19898 consensus_peers.cc:597] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 -> Peer d44fdddd21fe44c09069dd1e3f98b8a9 (127.8.111.66:41479): Couldn't send request to peer d44fdddd21fe44c09069dd1e3f98b8a9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:31:22.651044  8637 raft_consensus.cc:2243] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.651539  8637 raft_consensus.cc:2272] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P d44fdddd21fe44c09069dd1e3f98b8a9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.695611  8637 tablet_server.cc:196] TabletServer@127.8.111.66:0 shutdown complete.
I20260709 12:31:22.736841  8637 tablet_server.cc:179] TabletServer@127.8.111.67:0 shutting down...
I20260709 12:31:22.769330  8637 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:31:22.770223  8637 tablet_replica.cc:333] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4: stopping tablet replica
I20260709 12:31:22.771065  8637 raft_consensus.cc:2243] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.771693  8637 raft_consensus.cc:2272] T 05311105c0bc48bab5cd036c37ccef25 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.773988  8637 tablet_replica.cc:333] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4: stopping tablet replica
I20260709 12:31:22.774664  8637 raft_consensus.cc:2243] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.775166  8637 raft_consensus.cc:2272] T 6c15b658c218435e81ff92455aa619db P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.777186  8637 tablet_replica.cc:333] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4: stopping tablet replica
I20260709 12:31:22.777734  8637 raft_consensus.cc:2243] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.778309  8637 raft_consensus.cc:2272] T 90f9b3b3645a4a8ca2406580f1775ed3 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.780365  8637 tablet_replica.cc:333] T 4f7bc6b062e34c94a171a37dbec21045 P bc9e314a6d804f6a895a924cc11d3ec4: stopping tablet replica
I20260709 12:31:22.780920  8637 raft_consensus.cc:2243] T 4f7bc6b062e34c94a171a37dbec21045 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.781379  8637 raft_consensus.cc:2272] T 4f7bc6b062e34c94a171a37dbec21045 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.783609  8637 tablet_replica.cc:333] T 5df454fac23d4cf6a9c10ffa0ef263b4 P bc9e314a6d804f6a895a924cc11d3ec4: stopping tablet replica
I20260709 12:31:22.784137  8637 raft_consensus.cc:2243] T 5df454fac23d4cf6a9c10ffa0ef263b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.784610  8637 raft_consensus.cc:2272] T 5df454fac23d4cf6a9c10ffa0ef263b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.786645  8637 tablet_replica.cc:333] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4: stopping tablet replica
I20260709 12:31:22.787168  8637 raft_consensus.cc:2243] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:22.787954  8637 raft_consensus.cc:2272] T f9874751d7e14ddaa2cf2f9e29c3e5b4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.790001  8637 tablet_replica.cc:333] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4: stopping tablet replica
I20260709 12:31:22.790601  8637 raft_consensus.cc:2243] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:31:22.791412  8637 raft_consensus.cc:2272] T 17775893872142bb88fbe22bedd96b11 P bc9e314a6d804f6a895a924cc11d3ec4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.793411  8637 tablet_replica.cc:333] T 6de140a555174689bc2a03d802a477e5 P bc9e314a6d804f6a895a924cc11d3ec4: stopping tablet replica
I20260709 12:31:22.793947  8637 raft_consensus.cc:2243] T 6de140a555174689bc2a03d802a477e5 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.794440  8637 raft_consensus.cc:2272] T 6de140a555174689bc2a03d802a477e5 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.796343  8637 tablet_replica.cc:333] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4: stopping tablet replica
I20260709 12:31:22.796842  8637 raft_consensus.cc:2243] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:31:22.797649  8637 raft_consensus.cc:2272] T 0ff8ef1253964c75aab3da58f7e9a417 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.799777  8637 tablet_replica.cc:333] T cd117ec76ec24b74988cfdccf3bcb28c P bc9e314a6d804f6a895a924cc11d3ec4: stopping tablet replica
I20260709 12:31:22.800292  8637 raft_consensus.cc:2243] T cd117ec76ec24b74988cfdccf3bcb28c P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.800747  8637 raft_consensus.cc:2272] T cd117ec76ec24b74988cfdccf3bcb28c P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.802767  8637 tablet_replica.cc:333] T d29f26ef85584432b3f88fa1b72595b1 P bc9e314a6d804f6a895a924cc11d3ec4: stopping tablet replica
I20260709 12:31:22.803273  8637 raft_consensus.cc:2243] T d29f26ef85584432b3f88fa1b72595b1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.803764  8637 raft_consensus.cc:2272] T d29f26ef85584432b3f88fa1b72595b1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.805790  8637 tablet_replica.cc:333] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4: stopping tablet replica
I20260709 12:31:22.806329  8637 raft_consensus.cc:2243] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.806772  8637 raft_consensus.cc:2272] T ecbfa438576e4052957cc88dc495f4d2 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.808822  8637 tablet_replica.cc:333] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4: stopping tablet replica
I20260709 12:31:22.809341  8637 raft_consensus.cc:2243] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.809780  8637 raft_consensus.cc:2272] T 57bb268f539c448cabdf9058d7567b80 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.811879  8637 tablet_replica.cc:333] T ce4bc28a0a8d473698323f80cd969094 P bc9e314a6d804f6a895a924cc11d3ec4: stopping tablet replica
I20260709 12:31:22.812373  8637 raft_consensus.cc:2243] T ce4bc28a0a8d473698323f80cd969094 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.812789  8637 raft_consensus.cc:2272] T ce4bc28a0a8d473698323f80cd969094 P bc9e314a6d804f6a895a924cc11d3ec4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.814819  8637 tablet_replica.cc:333] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4: stopping tablet replica
I20260709 12:31:22.815431  8637 raft_consensus.cc:2243] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.815948  8637 raft_consensus.cc:2272] T 24bbaeea725746cbbe1519c39ebeca50 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.818005  8637 tablet_replica.cc:333] T 71185e64eb2744ffaf2f069c035505a4 P bc9e314a6d804f6a895a924cc11d3ec4: stopping tablet replica
I20260709 12:31:22.818544  8637 raft_consensus.cc:2243] T 71185e64eb2744ffaf2f069c035505a4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.818979  8637 raft_consensus.cc:2272] T 71185e64eb2744ffaf2f069c035505a4 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.820819  8637 tablet_replica.cc:333] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4: stopping tablet replica
I20260709 12:31:22.821339  8637 raft_consensus.cc:2243] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:31:22.821828  8637 raft_consensus.cc:2272] T 3d0b5a815b844529bc04dbfd6b4881a1 P bc9e314a6d804f6a895a924cc11d3ec4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.823757  8637 tablet_replica.cc:333] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4: stopping tablet replica
I20260709 12:31:22.824213  8637 raft_consensus.cc:2243] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:31:22.824987  8637 raft_consensus.cc:2272] T 6cbdd9c7dcc14dfbb34eaa87c9c726c7 P bc9e314a6d804f6a895a924cc11d3ec4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.864009  8637 tablet_server.cc:196] TabletServer@127.8.111.67:0 shutdown complete.
I20260709 12:31:22.899072  8637 master.cc:562] Master@127.8.111.126:38517 shutting down...
I20260709 12:31:22.922528  8637 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:31:22.923131  8637 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:31:22.923471  8637 tablet_replica.cc:333] T 00000000000000000000000000000000 P c8b1a28a177141e6bef39772ff663734: stopping tablet replica
I20260709 12:31:22.944599  8637 master.cc:584] Master@127.8.111.126:38517 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (20407 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (41346 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (406543 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:31:23.000376  8637 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2256 messages since previous log ~31 seconds ago
I20260709 12:31:23.000623  8637 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2256 messages since previous log ~31 seconds ago
I20260709 12:31:23.000839  8637 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2249 messages since previous log ~31 seconds ago
I20260709 12:31:23.001058  8637 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~49 seconds ago
I20260709 12:31:23.001257  8637 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~50 seconds ago
I20260709 12:31:23.001464  8637 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~196 seconds ago
I20260709 12:31:23.001739  8637 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 9 messages since previous log ~0 seconds ago
I20260709 12:31:23.002038  8637 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~19 seconds ago
